(Senior) Data Engineer - Integration (m/w/d)
Tasks
- Build RAG workflows
- Build data pipelines
- Decide batch or real time processing
- Design integration architecture
- Develop ETL workflows
- Develop data modeling and performance optimization
- Implement error handling retry logic and monitoring
- Implement event-driven data flows
- Integrate CRM APIs
- Integrate ERP APIs
- Integrate LLM APIs into data pipelines
- Load vectors into vector databases
- Manage CI CD pipelines with GitHub Actions or Cloud Build
- Manage infrastructure as code with Terraform
- Orchestrate workflows with n8n or Airflow
- Prepare chunk and vectorize data
Perks/Benefits
Skills/Tech-stack
Airflow | Anthropic API | BigQuery | CI/CD | Cloud Build | Cloud Functions | DBT | Firestore | GCP Cloud | GCP Cloud Functions | GCP Pub/Sub | Git | GitHub Actions | Infrastructure as Code | N8n | OpenAI API | PostgreSQL | Pub/Sub | Python | RAG | REST APIs | SQL | Serverless | Terraform | Vector Databases | “as-code”
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
AWS CloudFormation | Amazon ECS | CI/CD | DBT | DagsterAfter work drinks | Company events | Team lunchesSenior-level Full TimeHamburg oder Berlin, Germany2h ago
-
AWS | Amazon ECS | CI/CD | Cloud platform | CloudFormationSenior-level Full TimeHamburg or Berlin, Germany2h ago
-
3D Deep Learning | AWS | Amazon EC2 | Amazon IAM | Amazon S3Onsite work optionEntry-level Full TimeHerzo/remote, Herzo/remote R13h ago
-
Staff Engineer - Data Platform (m|w|d) EUR 70K-90KAWS | AWS CDK | AWS Glue | Amazon Bedrock | Apache AirflowCoaching and mediation | Deutschlandticket | Elearning programs | Free counseling | Free lunchSenior-level Full TimeBerlin, Berlin, Deutschland13h ago
-
AI Security | AWS | Azure | CI/CD | Cloud NativeHybrid work | Paid time off | Travel opportunities | Unrestricted contractSenior-level Full TimeDeutschlandweit & Hybrid Work R16h ago
-
AI Infrastructure Engineer EUR 40K-65KArtificial Intelligence | Cloud Native | Containerization | GPU | Infrastructure as CodeDiverse projects | Long term opportunities | Multicultural environment | Skill developmentMid-level Full TimeDarmstadt, Germany17h ago
-
Agent systems | Agentic Systems | CI/CD | Compliance | DevOpsCTO mentoring | Greenfield projects | Remote work 2 days per weekSenior-level Full TimeFrankfurt am Main, Germany21h ago
-
Master Thesis Physically Informed Machine Learning Based System Identification in MEMS Gyroscopes EUR 38K-38KData Analysis | Data pipeline | Machine Learning | Pandas | Probabilistic ModelingOn-site workEntry-level Full TimeReutlingen, BW, Germany23h ago
-
Consultant Robotics & Embodied AI (m/f/d) EUR 66K-80KC++ | Cloud Platforms | Computer Vision | Data analytics | DevOpsCompany pension scheme | Employee discounts | Fitness offerings | Flexible working hours | Freely choose place of residence anywhere in GermanyEntry-level Full TimeBerlin, Deutschlandweit, Düsseldorf, Frankfurt, Hamburg, München, … R23h ago
-
Experte Data Science (m/w/d) EUR 70K-134KCloud Computing | Copilot | Data Mining | Data Modeling | Data QualitySenior-level Full TimeLudwigshafen am Rhein23h ago
-
Senior Analytics Engineer EUR 54K-79KAnomaly Detection | CI/CD | DBT | Data Contracts | Data GovernanceAdditional day of annual leave for each year of service | Autonomy | Discounts | Fitness and wellness memberships | Language appsSenior-level Full TimeBerlin1d ago
-
APIs | Airflow | BigQuery | DBT | DLTCustomizable benefits package | Paid vacation | Remote calendar weeks | Remote flexible hybrid | Tech and work setupSenior-level Full TimeBerlin1d ago
-
AWS | AWS ECS | CI/CD | CloudFormation | DBTAfterwork drinks | Company events | Flexible working hours | Inclusion culture | Team lunchesSenior-level Full TimeHamburg, HH, Germany1d ago
-
API Integration | Access Control | Audit Logging | Automated testing | CI/CDAnnual company offsite | Annual professional development budget | Coworking allowance | Dependent coverage support | Employee equity ownershipMid-level Full TimeGermany R1d ago
-
C++ | Camera simulation | Computer Graphics | Data Augmentation | Domain RandomizationDog-friendly office | Employee discounts | Flexible benefits budget | Hybrid working | Learning and development supportSenior-level Full TimeMunich1d ago
-
Senior Data Engineer EUR 70K-90KAWS | Airflow | Alerting | Anomaly Detection | Apache FlinkCorporate discounts | Corporate pension plan | Digital meal vouchers | Educational budget | Employee share purchase planSenior-level Full TimeBerlin, Germany1d ago
-
AWS | Azure | CI/CD | Code review | DockerAfter-work events | Family and childcare support | Flexible work environment | Inclusive workplace | Lifelong learning opportunitiesSenior-level Full TimeAZ Computational Pathology GmbH - Munich, …1d ago
-
AWS | Azure | CI/CD | Docker | GCPSenior-level Full TimeAZ Computational Pathology GmbH - Munich, …1d ago
-
BI tools | Cause analysis | Data Analysis | Data Architecture | Data Governance30 days vacation | Family service for childcare support | Flexible working hours | Health offers | Home officeMid-level Full TimeHamburg, DE1d ago
-
Fullstack Machine Learning Developer (Junie) GBP 100K-131KAgent workflows | Command Line | Command-line Interface | Cost Optimization | Language ModelsExtra time off | Gym or Sports Stipend | Language classes | Learning and development | Lunch allowanceMid-level Full TimeAmsterdam, Netherlands; Belgrade, Serbia; Berlin, Germany; … R1d ago
-
Data Lake | Data Modeling | Data Quality | Data Warehouse | Data integrationCorporate benefits | Flexible working hours | Free beverages | Paid time off | Training and developmentMid-level Full TimeLandsberg am Lech, Germany1d ago
-
AI Engineer (m/f/d) EUR 47K-51KAPI | AWS | Access Control | Distributed Systems | Inference latencyCompany pension scheme | Flexible working hours | Home office | Relocation support | Snacks and drinks providedSenior-level Full TimeBerlin, Berlin, Germany1d ago
-
Working student Data Engineer EUR 38K-38KAI | Analytics | Data Analysis | Data Pipelines | Data QualityFlexible work style | Flexible working hours | Home office option | Start-up culture | Work from homeEntry-level Full Time Part TimeMunich, Germany1d ago
-
3D Deep Learning | C# | C++ | Debugging | Deep learning30 days vacation | Cafeteria | Capital formation benefits | Corporate benefits | Employer pension contributionSenior-level Full TimeWiesbaden, HE, Germany1d ago
-
API Authentication | Data Modeling | Data Pipeline Monitoring | Data pipeline | DatabricksBike leasing | Birthday gift | Christmas bonus | Employee discounts | Extra vacationEntry-level Full TimeMünchen, Germany1d ago