Data Engineer
Tasks
- Build batch and streaming data pipelines
- Collaborate on data governance and data contracts
- Design and implement data models for analytics and machine learning
- Develop core data platform components
- Establish data quality monitoring and lineage
- Implement logging, tracing, and monitoring
- Manage and optimize data infrastructure
- Troubleshoot production pipeline failures and bottlenecks
Perks/Benefits
Skills/Tech-stack
AWS | Access Control | Active Directory | Alerting | Automated testing | Azure | Azure Active Directory | Azure Cosmos | Azure Cosmos DB | CI/CD | Cloud infrastructure | Cosmos DB | Data Catalog | Data Contracts | Data Governance | Data Lakes | Data Lineage | Data Quality | Delta Lake | Distributed tracing | GCP | Lakehouse | Logging | Metrics | Monitoring | NoSQL | Observability | Parquet | Python | Regulatory Compliance | Relational databases | SQL
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
AI Engineer GBP 100K-125KAPI Development | AWS | Apache Spark | CI/CD | DatabricksCustom designed offices | Enhanced parental leave | Enhanced pension | Free breakfasts and snacks | Life insuranceMid-level Full TimeLondon, England, United Kingdom12h ago
-
AI Engineer - FDE (Forward Deployed Engineer) GBP 80K-110KAWS | Apache Spark | Azure | Cloud platform | Data EngineeringConference presentations | Remote work | Travel opportunitiesSenior-level Full TimeRemote - United Kingdom R21h ago
-
Automation | Data Modeling | Data Quality | Kdb Plus | LinuxClose mentorship | Flexible assignments | Long-term career supportSenior-level Contract Full TimeLondon1d ago
-
Lead Data Engineer GBP 75K-80KAWS | Agile | Apache Spark | Azure | CI/CDAnnual leave | Cycle to work scheme | Discounted gym membership | Employee events and clubs | Employer pension schemeSenior-level Full TimeLeeds1d ago
-
Machine Learning and Quant Engineer - London GBP 110K-200KData Engineering | Financial Modeling | Machine Learning | Python | Scenario AnalysisDirect influence on investment decisions | Equity | In-office work | Technical autonomyMid-level Full TimeLondon1d ago
-
Senior Data Engineer EUR 60K-84KCI/CD | ClickHouse | Docker | Kafka | KubernetesCareer development | Flexible working hours | Learning time | Remote-first | Social benefitsSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
Lead Data Engineer GBP 86K-102KAWS | Apache Airflow | Apache Hive | Apache Spark | AutomationAnnual leave | Flexible benefits | Pension contributions | Private medical insurance | Staff travel benefitsSenior-level Full TimeUnited Kingdom-London-London Luton Airport1d ago
-
Research Engineer, Tool Use, DeepMind GBP 155K-163KAgents | Data Analysis | Data Pipelines | Data Visualization | JAXSenior-level Full TimeLondon, UK2d ago
-
Senior-level Full TimeGothenburg, SE, 405312d ago
-
Azure Data Platform Engineer (m/w/d) EUR 48K-66KAutomation | Azure Data | Azure Data Factory | Azure SQL | Backup and Recovery30 days vacation | Childcare allowance | Company car | Discounts and tickets | Fitness training subsidyMid-level Full TimeGermany; Borken, Nordrhein-Westfalen, Germany; Mannheim, Baden-Württemberg, … R2d ago
-
Senior Data Engineer (w/m/d) EUR 60K-82KAWS | AWS Glue | Airbyte | Amazon Athena | Amazon EC2Hybrid work | Jobrad | Public transport subsidy | Team events | Training and conferencesSenior-level Full TimeKarlsruhe, BW, Germany2d ago
-
Frontend Engineer, Robotics HMI USD 115K-160KAWS | CI/CD | Datadog | Django | Docker401k match | Cell phone reimbursement | Dental insurance | Employee assistance program | EquityMid-level Full TimeChicago || Bolingbrook, IL R2d ago
-
Automated testing | C++ | Cloud Computing | Code review | Continuous integrationCareer growth | Flexible schedule | Inclusive workplace culture | Mentorship | Remote workSenior-level Full TimeGermany2d ago
-
Senior Specialist Solutions Architect (AI/ML) GBP 74K-110KAWS | Apache Spark | Artificial Intelligence | Azure | Data ScienceSenior-level Full TimeLondon, United Kingdom2d ago
-
AWS Glue | Airflow | Automation | By Design | CI/CDBlended working arrangements | Defined contribution pension | Employee assistance programme | Enhanced maternity leave | Enhanced paternity leaveSenior-level Full TimeLondon, England, United Kingdom2d ago
-
Lead Analytics Engineer GBP 75K-90KAWS | Amazon Web Services | DBT | Omni | SQL3 office days per week in London | Hybrid remote workSenior-level Full TimeLondon2d ago
-
Senior AI Engineer GBP 70K-98KAgentic Workflows | C++ | Evals | Fine Tuning | LLM orchestrationEnhanced parental leave | Enhanced pension scheme | Hybrid working | L and D budget | Private health insuranceSenior-level Full TimeLondon, United Kingdom2d ago
-
Senior Data Engineer GBP 55K-62KAgile | Azure | Azure Data | Azure Data Factory | Azure DatabricksAnnual leave | Flexible benefits | Income protection | Pension | Private medical insuranceSenior-level Full TimeLeeds, United Kingdom R2d ago
-
Amazon Web Services | Apache Flink | Apache Spark | Avro | AzureCareer progression | Hybrid work | Inclusive team culture | Training and developmentMid-level Full TimeLondon; South East (England)2d ago
-
Machine Learning Engineer GBP 80K-110KAWS | Azure | Best practices | Cloud infrastructure | Cloud platformCoaching | Enhanced parental leave | Flexible working | Hybrid working | Private dentalMid-level Full TimeUK - London2d ago
-
Apache Airflow | Azure Data | Azure Data Factory | Azure Databricks | Azure SynapseBenefits | Collective agreement | Professional development | Work-life balanceMid-level Full TimeGothenburg, Västra Götaland County, Sweden2d ago
-
Assertions | BigQuery | CI/CD | DBT | DagsterAfter work drinks | Flexible work culture | Inclusive workplace | Team events | Team lunchesSenior-level Full TimeHamburg, HH, Germany2d ago
-
CI/CD | DBT | Dagster | Data Modeling | Data QualityAfterwork drinks | Company events | Inclusive culture | Team lunchesSenior-level Full TimeHamburg, HH, Germany2d ago
-
3D Reconstruction | ADAS | C++ | Camera Calibration | Coordinate TransformationSenior-level Full TimeFrankfurt am Main, Germany2d ago
-
Bachelorarbeit LLM-gestützte Automatisierung der Daten-aufbereitung - Machine Learning Pipelines EUR 38K-38KCloud Architecture | Databricks | Language Processing | Machine Learning | Machine Learning PipelinesOffice based work requirement | Part time schedule 10 hours per weekEntry-level Full TimeUlm, BW, Germany3d ago