Data Engineer / Software Developer MDOCore Datalake (w/m/d)
Tasks
- Automate data processing testing deployments
- Build interfaces APIs and services
- Build tool APIs for AI
- Deploy in Kubernetes environments
- Design data models schemata transformation logic data products
- Develop data ingestion validation transformation storage components
- Develop data pipelines
- Develop retrieval interfaces for AI
- Implement access control
- Implement data quality metadata versioning traceability data cataloging
- Integrate datalake components into CICD pipelines
- Integrate heterogeneous data sources
- Integrate vector databases
- Monitor debug and resolve data pipeline errors
- Operate data pipelines
- Operationalize analytic models
- Optimize data pipelines
- Optimize performance
- Provide context for retrieval
- Support data governance
- Support data scientists data access preparation feature engineering
Perks/Benefits
- N/A
Skills/Tech-stack
API | C++ | CI/CD | Data Catalog | Data Modeling | Data Quality | Data fabric | Data mesh | Datalake | Docker | ELT | ETL | Go | Java | Kotlin | Kubernetes | Linux | Metadata Management | NoSQL | Object storage | Python | Rust | S3 | SQL | Scala | Semantic integration | TypeScript | Vector Databases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level Full TimeKaiserslautern, DE1d ago
-
AI Agents | AI Foundry | Azure | Azure AI | Azure AI FoundryDevelopment opportunities | Flexible work hours | Homeoffice | Mitarbeiterrabatte | Sport Mitgliedschaft ZuschussEntry-level Part TimeHamburg, HH, Germany1d ago
-
AI Agents | AI Foundry | Azure | Azure AI | Azure AI FoundryCareer development | Employee discounts | Homeoffice | Modern equipment | Sports membership subsidyEntry-level Part TimeGermering, BY, Germany1d ago
-
Computer Vision | Data Preprocessing | Deep learning | Fine Tuning | GeometryBike leasing | Employee referral bonus | Fitness and Wellness Subsidy | Flexible working hours | Hybrid work setupSenior-level Full TimeMunich Hybrid (NavVis GmbH) R1d ago
-
Algorithm Design | C++ | Client collaboration | Computational optimization | Data analyticsCoaching & mentoring | Professional development | Training workshopsEntry-level Full TimeMünchen, Germany1d ago
-
C++ | Data analytics | Development Lifecycle | Java | JavaScriptInternshipEntry-level InternshipMünchen, Germany1d ago
-
Senior-level Full TimeBerlin, Germany; Frankfurt, Germany; Munich, Germany1d ago
-
Cloud technologies | Data Engineering | Data Visualization | Data analytics | Generative AIInternational team collaboration | Work-life balanceEntry-level InternshipBerlin, Frankfurt am Main, Hamburg, Köln, …2d ago
-
(Senior) Analytics Engineer (m/f/d) EUR 67K-75KAnalytics engineering | BigQuery | DBT | Data Documentation | Data ModelingDiscounts and benefits | Health benefits | Job bike leasing | Remote workSenior-level Full TimeRemote, Hamburg, Berlin, München R2d ago
-
Werkstudent Data Engineer / Analyst (m/w/d) EUR 32K-36KDashboarding | Data Analysis | Data Pipelines | Deep learning | JavaScriptCompany car | Company equipment support | Company fitness | Family service | Flexible vacationEntry-level Contract Part TimeHamburg , Germany2d ago
-
AI / ML Lead Consultant (m/w/d) EUR 75K-85KAPIs | Advanced Analytics | CI/CD | Cloud platform | Computer VisionCareer development opportunities | Continuous learning | International team collaboration | Mentoring and coaching | Support for certificationsSenior-level Full TimeFrankfurt am Main, HE, Germany2d ago
-
Analytics Engineer, Marketing DSA EUR 61K-82KAirflow | Anomaly Detection | BigQuery | Cloud platform | DBTDiscounted gym membership | Employee assistance program | Home office support | Life and disability insurance | Lunch benefitSenior-level Full TimeBerlin, Germany2d ago
-
DBT | Data Analysis | Data Modeling | ELT | ETLCompany pension plan | Employee discounts | Fitness membership discount | Home office | Job ticket subsidyEntry-level Full TimeDüsseldorf, Nordrhein-Westfalen, Deutschland2d ago
-
C++ | EtherCAT | Ethernet | Ethernet/IP | FieldbusChildcare support | Company pension subsidy | Employee benefits | Flexible working hours | Health and sports activitiesEntry-level Full TimeFürth2d ago
-
Software Engineer (f/m/d) – Data Platforms EUR 32K-38KAWS | Apache Hadoop | Apache Spark | Big Data | CI/CDConference attendance | Corporate benefits | Germany ticket | Hackathons | JobradEntry-level Full TimeBerlin, State of Berlin, Germany2d ago
-
AWS | Agile | Business Intelligence | Data Modeling | Data VisualizationContract-based role | Flexible and dynamic working environment | Flexible work location | Fully remote workMid-level Contract Full TimeGermany R2d ago
-
AI Infrastructure Engineer EUR 100K-102KApache Beam | Apache Hadoop | Apache Hive | Apache Spark | C plus plusMid-level Full TimeLondon, UK; Berlin, Germany2d ago
-
AWS | Azure | Backend Development | C++ | Cloud ComputingConference and training access | Flexible working hours | Fully remote work | Health, dental, vision benefits | Home office supportSenior-level Full TimeGermany R2d ago
-
Senior Analytics Engineer EUR 75K-89KAWS | BigQuery | CI/CD | DBT | FinOpsAnnual team gatherings | Company stock options program | Comprehensive healthcare coverage | Flexible PTO | Inclusive parental leaveSenior-level Full TimeRemote • France, Germany, Spain or … R2d ago
-
Senior Analytics Engineer EUR 75K-89KAWS S3 | BigQuery | CI/CD | DBT | Data ArchitectureAnnual team gatherings | Company stock options | Comprehensive healthcare | Flexible PTO | Inclusive parental leaveSenior-level Full TimeRemote • France, Germany, Spain or … R2d ago
-
(Senior) AI Engineer (all genders) EUR 65K-80KCloud Computing | Containerization | DevOps | Docker | Language ModelsE-learning support | Family-friendly policies | Fitness benefits | Flexible work options | Internal and public eventsMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R2d ago
-
Trainee Aktuariat & Data Sciene (m/w/d) EUR 14K-16KCloud Computing | Data analytics | Generalized Linear Models | Git | Gradient boostingEmployee discounts | Extra vacation days | Fitness subsidies | Flexible working hours | Health and wellness programsEntry-level Full TimeKÖLN, Germany2d ago
-
Agile | C# | DO-178C | DO-330 | Java30 days vacation | Career development opportunities | Flexible work hours | Health management | Job securitySenior-level Full TimeUlm, DE2d ago
-
Senior Applied AI Engineer EUR 60K-85KCloud Computing | Data Science | Docker | Foundation Models | Generative AICompany pension | External employee consulting | Flexible work | Health benefits | Individual qualification opportunitiesSenior-level Full TimeBerlin, BE, DE, 101172d ago
-
AWS | Access Management | Airflow | CI/CD | DagsterCareer growth opportunities | Equity participation | Flexible work arrangements | Fully remote work | International collaborationMid-level Full TimeGermany R2d ago