Principal Data Engineer
Tasks
- Architect streaming and batch data systems
- Build and evolve data infrastructure
- Coach engineers and improve hiring process
- Define event sourced streaming standards
- Design data services for scale and reliability
- Develop and review production Python code
- Integrate data platform with services using APIs and event streams
- Lead data platform design
- Manage lineage quality freshness observability
- Own real time knowledge graph pipelines
- Partner with ML and data science for feature engineering and inference
- Provide data architecture governance and tooling strategy
- Represent company at engineering events
- Set data domain technical direction
- Set data quality schema evolution and contract testing standards
Perks/Benefits
Skills/Tech-stack
API Development | AWS | Airflow | Alerting | Argo Workflows | ArgoCD | Batch Processing | DBT | Data Contracts | Data Observability | Data Quality | Data Warehousing | Docker | ELT | ETL | Entity Resolution | Event Sourcing | Flink | GCP | GRPC | Grafana | Incident Management | Kafka | Knowledge graph | Kotlin | Kubernetes | Lakehouse | Logging | Microbatch | Monitoring | Postgres | Python | React | Schema evolution | Spark | Streaming | TypeScript | Yugabyte
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Related jobs
-
Senior Machine Learning Engineer USD 171K-270KAWS | Agentic Systems | Amazon EKS | Azure | CI/CD25 annual days of vacations | Coffee and fruit | Flexible working hours | Gym allowance | Health insuranceSenior-level Full TimeLisbon IT Campus - Swiss Post14h ago
-
Mid-level Full TimeErmesinde, Porto District, Portugal1d ago
-
Data Engineer (Digital Solutions) EUR 35K-46KAgile | Apache Flink | Apache Hive | Apache Iceberg | Apache SparkCollaborative work environment | Flexible working model | International work environment | Training opportunitiesMid-level Full TimeLousado, Braga, Portugal1d ago
-
AI Engineer (m/f/d) EUR 56K-75KAWS Bedrock | Amazon Web Services | Continuous Deployment | Continuous integration | GoBirthday day off | Flexible work setup | Learning and knowledge exchange | Meal allowance | Private health insuranceSenior-level Full TimeLisbon, Portugal1d ago
-
Senior AI Engineer ID80138 EUR 54K-75KAnthropic | Automated testing | CI/CD | DNS | FirewallsAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeAveiro, Portugal1d ago
-
Senior AI Engineer ID80138 EUR 54K-75KAnthropic | Automated testing | CI/CD | DNS | GitFlexible hours | Learning budget | Mentorship | Remote work | Well-being programsSenior-level Full TimePorto, Portugal1d ago
-
AI Agents | API Integration | AWS | CI/CD | DataikuBenefits plan | Provision of work equipment | Remote workSenior-level Full TimePorto, Portugal R2d ago
-
Data Engineer / Data Analyst (m/f) EUR 38K-45KAzure Data | Azure Data Factory | Data Factory | Data Modeling | ELTMid-level Full TimeLisboa, Lisboa, Portugal4d ago
-
AI Foundry | AWS GovCloud | AWS SageMaker | Agentic AI | Amazon Bedrock401k matching | Career development resources | Company paid medical plans | Flexible work arrangements | Health savings account optionsSenior-level Full TimePortugal4d ago
-
AI Engineer (m/f/d) EUR 56K-79KAWS | AWS Bedrock | Continuous Deployment | Continuous integration | GoCoverflex allowance | Employee travel discounts | Flexible work setup | Learning and knowledge exchange | Meal allowanceSenior-level Full TimeLisbon, Portugal4d ago
-
Software Engineer - Developer Experience EUR 86K-129KAWS | Amazon Web Services | Azure | Bash | CI/CDSenior-level Full TimePortugal - Remote R4d ago
-
Senior Data Engineer - Portugal Full Remote EUR 30K-38KAWS | Access Management | Amazon Kinesis | Apache Airflow | Apache Iceberg15th month salary | Birthday off | Health insurance | Mobility program | Remote within PortugalSenior-level Full TimePortugal, Portugal R4d ago
-
Automation | Azure | Azure Data | Azure Data Explorer | CSVCollaborative global working environment | Cross-functional collaboration | Exposure to large scale security telemetry | Hands on development of automation and data quality solutions | Professional growthMid-level Full TimePortugal R4d ago
-
AI Engineer - Agentic Backend EUR 45K-65KAI | API Security | APIs | Agent Orchestration | Asynchronous processingSenior-level Full TimeLisbon, PT4d ago
-
Senior Data Engineer - Knowledge Graph EUR 75K-87KData Lineage | Data Modeling | Entity Resolution | Graph Data | Graph Data ModelingGreat Place to Work certificationSenior-level Full TimeLisbon, PT4d ago
-
Senior-level Full TimeLisbon, PT4d ago
-
Amazon Redshift | Apache Airflow | CI/CD | Dagster | DatabricksCareer progression | Discounts | Health insurance | Meal card | Welcome kitSenior-level ContractPortugal R4d ago
-
Agile | CI/CD | Cloud Data | Cloud Data Integration | Data QualityCareer progression | Discounts | Health insurance | Meal card | Welcome kitSenior-level ContractLisbon, Portugal R4d ago
-
Airflow | Apache Beam | BigQuery | CCPA | CI/CDHealth insurance | Meal cardSenior-level ContractLisbon, Portugal R4d ago
-
Senior-level Full TimeLisbon, PT4d ago
-
Senior Data Engineer Consultant EUR 63K-79KAI | Azure Data | Azure Data Factory | Data Factory | DatabricksAnnual leave | Employee assistance programme | Flexible work environment | Health insurance | Hybrid work modelSenior-level Full TimePorto, Porto District, Portugal R5d ago
-
Data Engineer EUR 39K-46KApache Spark | Data Modeling | Data Processing | Data Transformation | Data WarehousingSenior-level Full TimeLisbon, Portugal5d ago
-
Data Engineer EUR 35K-51KAWS | Azure | Business glossary | Cloud Architecture | Cloud platformDiscounts and flex options | Health insurance | Hybrid work | Meal allowance | Paid vacationSenior-level Full TimeLisbon, Portugal R5d ago
-
Ansible | CI/CD | Docker | ELK Stack | GitLabHealth insurance | Meal card | Remote workSenior-level Full TimePortugal - Remote R5d ago
-
AI Engineer EUR 36K-65KAPI Development | Agent systems | CI/CD | Docker | FastAPIHealth insurance | Hybrid work | Life insurance | Referral program | Training programsMid-level Full TimeLisboa, PT R5d ago