Senior Data Engineer – Data Quality & Observability
Tasks
- Build automated data validation checks
- Create validation processes for completeness accuracy integrity consistency reconciliation freshness anomaly detection
- Define and maintain data lineage
- Design and implement data quality frameworks
- Develop data quality rules with Rule as Code
- Develop reporting for data quality trends and operational metrics
- Establish governance ownership and remediation workflows
- Implement data observability monitoring alerting reporting dashboards
- Implement data validation with Great Expectations or Soda
- Implement preventive data quality improvements
- Integrate data quality checks into CI/CD pipelines
- Investigate recurring data issues
- Perform root cause analysis
Perks/Benefits
Skills/Tech-stack
Alerting | Amazon Redshift | CI/CD | Dashboards | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Validation | ETL | Git | Great Expectations | Monitoring | PostgreSQL | SQL | Soda
Education
N/A
Roles
Related jobs
-
AWS | Autoscaling | Azure | Bash | CI/CDFully remote work Europe | Healthcare coverage | Paid parental leave | Relocation assistanceMid-level Full TimeGermany R16h ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R1d ago
-
Apache Airflow | Azure | Azure Synapse | Azure Synapse Analytics | DBTFlexible working hours | Remote workSenior-level Full TimeGermany, Germany R1d ago
-
Apache Airflow | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsAttractive total compensation package | Flexible working hours | Remote workSenior-level Full TimeGermany, Germany R1d ago
-
Agents | Data Architecture | Data Ingestion | Data Modeling | Data PipelinesAnnual performance bonus | Equipment support | Flexible working hours | Gifts and rewards | In-person team eventsSenior-level Full TimeGermany R1d ago
-
Senior AI Engineer (m/w/d) EUR 60K-68KAI Agents | AWS | Cloud Native | Code review | EvalsCompany events | Development budget | Ergonomic workstation | Family-friendly working hours | Fitness membership discountMid-level Full TimeRemote / Düsseldorf R1d ago
-
Senior AI Engineer (m/w/d) EUR 60K-68KAI Safety | AWS | Agentic Workflows | Artificial Intelligence | CI/CDAssistance with transportation | Development budget | Employer pension contributions | Ergonomic workplace | Events and partiesMid-level Full TimeRemote / Düsseldorf R1d ago
-
Senior Data Engineer EUR 70K-90KCI/CD | ClickHouse | Docker | Elasticsearch | KafkaFlexible working hours | Learning time | Location Based Social Benefits | Remote-first | Team eventsSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
Lead Software Engineer (AI/ML) EUR 56K-79KAPIs | AWS | Agent Orchestration | Autogen | AzureCompany hackathons | Company ticket | Flexible working hours | German language course | Hybrid work modelSenior-level Full TimeBerlin, Germany R1d ago
-
Azure | Data Lakehouse | Data Modeling | Data Pipelines | Data WarehousingCompany health management | Flexible working hours | Home office options | Hybrid work model | Jobrad eBike leasingSenior-level Full Time Part TimeRatingen, Germany; Ratingen, NRW, Germany; Ratingen R1d ago
-
Bachelorarbeit (m/w/d) – KI-gestützte Automatisierung des Datenimports im Data Warehouse EUR 54K-54KData Modeling | Data Types | Data Warehousing | Data integration | Database fundamentalsRemote work options | Work on innovative projectsEntry-level Full Time InternshipHeidelberg, Remote R4d ago
-
Engineering - Internal AI Transformation USD 74K-110KAPIs | Agentic Workflows | Auditability | Authentication | DockerAnnual company offsite | Co-working stipend | Learning and development stipend | Social travel stipendEntry-level Full TimeUnited States R4d ago
-
Blue-Green Deployment | Blue/green | CI/CD | CUDA | CUDA optimizationFully remote work | Growth opportunities | High ownership and influence | Remote-first flexibility | Technical impactSenior-level Full TimeGermany R5d ago
-
AI-First Data Engineer (m/f/d) EUR 72K-82KAWS | Amazon Aurora | Amazon DynamoDB | Amazon EMR | Amazon RedshiftAnnual leave | Company pension scheme | Deutschland-Ticket subsidy | Employee discounts | Fitness and well being programMid-level Full TimeRemote (Germany) R5d ago
-
Working Student (f/m/d) AI/ML Solutions EUR 36K-36KKeras | Langchain | Language Models | Large Language Models | MCP30 vacation days | Employee resource groups | Flexible working hours | Hybrid work | Networking initiativesEntry-level Part TimeHamburg, Germany R5d ago
-
Agent Orchestration | Alerting | Best practices | Continuous Monitoring | CopilotAttractive office in Berlin | E-learning | Flexible working hours | Online language training | Remote work flexibilitySenior-level Full TimeDEU - Berlin, Germany R5d ago
-
APIs | Apache Airflow | Apache Hive | Apache Impala | Apache SparkFlexible paid time off | Internal Professional Development Resources | Internet reimbursement | Mobile reimbursement | Paid public holidaysSenior-level Full TimeBerlin, Germany R6d ago
-
APIs | Apache Airflow | Batch Data Processing | Batch data | Cloud StorageAdditional pension scheme | Annual bonus | ESPP | Equipment reimbursement | Flexible paid time offSenior-level Full TimeBerlin, Germany R6d ago
-
Automated testing | CI/CD | Cirq | Code linting | Code reviewFlexible hours | Hybrid setup | Learning opportunitiesMid-level Full TimeMünchen, Germany R6d ago
-
(Senior) Data Engineer (all genders) EUR 60K-75KAWS | Apache Airflow | Apache Spark | Azure | Cloud platformCoffee and snacks | Company bike | Company events | Fitness membership subsidy | Flexible working hoursMid-level Full TimeHamburg, München, Düsseldorf, remote R6d ago
-
Carbon Accounting | Data Modeling | Data Pipelines | ETL | EmbeddingsAltersvorsorge | Bicycle leasing | Corporate benefits | Flexible working hours | MacBook equipment allowanceEntry-level Internship Part TimeRemote (Deutschland), Münster R6d ago
-
API Design | Agent systems | Automated testing | Bash | CI/CDContinuous learning exposure | Flexible contractor schedule | Networking opportunities | Recognition | Remote work flexibilitySenior-level Contract FreelanceGermany R6d ago
-
Data Engineer (f/m/d) EUR 45K-45KApache Spark | Azure | Azure Synapse | Azure Synapse Analytics | CI/CDFitness and sports programs | Flexible working hours | Remote work optionEntry-level Full TimeDitzingen, Germany R6d ago
-
Senior/Lead Software Data Engineer (Roads Team) EUR 56K-80KAmazon Athena | Amazon EC2 | Amazon EMR | Amazon Glue | Amazon IAMFlexible work schedule | Parental leave | Remote work | Supportive health careSenior-level Full TimeMapbox Germany R7d ago
-
Senior Snowflake Data Engineer (m/w/d) EUR 60K-84KApache Airflow | Azure | DBT | Dagster | Data ArchitectureCompany events | Deutschlandticket support | Flexible working hours | Food and beverages | Health promotionMid-level Full TimeMünchen, Full Remote, Kabelsketal OT Großkugel R7d ago