Data Engineer / Software Developer MDOCore Datalake (w/m/d)
Tasks
- Automate data processing
- Automate data testing
- Automate deployments
- Build data ingestion components
- Build data storage solutions
- Contribute to data governance
- Create reusable data products
- Debug data pipeline issues
- Deploy to Kubernetes environments
- Design data models and schemas
- Develop APIs
- Develop data pipelines
- Implement access control
- Implement data cataloging
- Implement data quality requirements
- Implement data transformation
- Implement data validation
- Implement transformation logic
- Integrate data lake components into CICD pipelines
- Integrate heterogeneous data sources
- Manage metadata versioning and traceability
- Operate data pipelines
- Operationalize analytical models
- Optimize data pipelines
- Optimize performance
- Perform technical documentation
- Provide data via APIs and services
- Support data scientists with data access
- Support feature engineering
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Access Control | C++ | CI/CD | Cloud Native | Containers | Data Catalog | Data Governance | Data Modeling | Data Products | Data Quality | Data Versioning | Data fabric | Data integration | Data mesh | Data traceability | ELT | ETL | Go | Java | Kotlin | Kubernetes | Linux | Metadata Management | NoSQL | Object storage | Python | Retrieval | Rust | S3 | SQL | Scala | Semantic integration | TypeScript | Vector Databases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI Infrastructure Engineer EUR 100K-102KApache Beam | Apache Hadoop | Apache Hive | Apache Spark | C plus plusMid-level Full TimeLondon, UK; Berlin, Germany10h ago
-
Agile | C# | DO-178C | DO-330 | Java30 days vacation | Career development opportunities | Flexible work hours | Health management | Job securitySenior-level Full TimeUlm, DE13h ago
-
Senior Applied AI Engineer EUR 60K-85KCloud Computing | Data Science | Docker | Foundation Models | Generative AICompany pension | External employee consulting | Flexible work | Health benefits | Individual qualification opportunitiesSenior-level Full TimeBerlin, BE, DE, 1011715h ago
-
AWS | Access Management | Airflow | CI/CD | DagsterCareer growth opportunities | Equity participation | Flexible work arrangements | Fully remote work | International collaborationMid-level Full TimeGermany R18h ago
-
C# | C++ | Data Persistence | Embedded Systems | FirmwareFlexible working hours | Part-time workEntry-level Part TimeDresden, DE, 0110919h ago
-
C# | C++ | Data Persistence | Firmware Development | Graphical User InterfacesFlexible schedule | Long-term collaboration | Thesis topic supportEntry-level Full TimeDresden, DE, 0110919h ago
-
AI Developer (m/f/d) EUR 50K-70KAutomation | Bash | CI/CD | Code review | DockerFlexible working arrangements | Professional development and training | Training and certificationsSenior-level Full TimeHerzogenrath,North Rhine Westphalia,Germany1d ago
-
Apache Kafka | Apache Spark | Batch Processing | BigQuery | Cloud DataFully remote work | Training and professional developmentSenior-level Full TimeGermany R1d ago
-
API Integration | ComfyUI | ControlNet | Diffusers | GPUConferences and workshops | Fitness and wellness allowance | Fully remote | Home office equipment allowance | Learning SupportSenior-level Full TimeGermany R1d ago
-
Data Engineering Lead - Data & AI Tools (m/f/d) EUR 70K-90KAPI Development | Amazon Web Services | Apache Airflow | Docker | EC2Career & training opportunities | Fitness wellness options | Flex Time | Free access to Langdock | Hybrid workSenior-level Full TimeHamburg or Berlin1d ago
-
Werkstudent (w/m/d) Perception Software Engineer EUR 30K-38K3D Point Cloud Processing | 3D point cloud | Background Segmentation | C++ | CPU performanceHybrid work | Inclusion and diversity | Remote WorkingEntry-level Part TimeBraunschweig - Niedersachsen - Germany1d ago
-
Agentic AI Software Engineer EUR 38K-51KAWS | Azure | CI/CD | Docker | FastAPICommunity knowledge sharing | Downtown office location | Flexible working model | Hackathons and conferences | Public transport ticketEntry-level Full TimeMunich, Bayern, Germany1d ago
-
Expert Robotics & Automation (m/w/d) EUR 55K-55KAPI Integration | Automation | Azure | Data Architecture | Data Lake30 days vacation | Bike leasing | Company pension | Employee discounts | Flexible working hoursSenior-level Full TimeKirchdorf/Oberopfingen, DE1d ago
-
Database Platform Engineer (m/f/d) EUR 35K-48KAI | AWS RDS | Access Management | Amazon Aurora | AuditingEntry-level Full TimeHerzogenaurach, BY, DE1d ago
-
AWS | Azure | Data Lakes | Databricks | DockerFlexible working models | Learning opportunities | Professional developmentEntry-level Part TimeWalldorf, DE, 691901d ago
-
Senior AI Solutions Engineer (m/f/d) EUR 54K-75KAPI Integration | Agile | BigQuery | Cloud Run | Cloud platformCareer growth | Informal working atmosphere | International working environment | Professional development opportunities | Room for initiative and ownershipSenior-level Full TimeDormagen, DE, 415411d ago
-
Anomaly Detection | Biometric verification | CNN | Computer Vision | Convolutional Neural NetworksCollaborative work environment | Flexible working hours | Mentorship | Onsite dining | Sports club accessEntry-level Part TimeMunich, DE1d ago
-
AI Engineer (f/m/d) EUR 40K-60KAI Search | Autogen | Azure AI | Azure AI Search | Azure CosmosCareer development | Company pension | Hybrid work | Learning and development programs | Mental health and wellbeing programsMid-level Full TimeMünchen, DE, 80335 R1d ago
-
Teamleiter Embedded Software (m/w/d) EUR 76K-90KC# | Project Management | Python | Software Architecture | Stakeholder managementBusiness travel | Travel for customer visitsMid-level Full TimeUlm, BW, DE, 890731d ago
-
Algorithm Development | Autonomous Navigation | C++ | Coverage Path Planning | Path PlanningHands-on robotics experience | Responsibility and autonomy | Work with test environmentsSenior-level Full TimeStuttgart, DE, 705691d ago
-
Algorithm Development | C++ | Coverage Path Planning | Path Planning | PythonAutonomy | Own test environments | Practical work with robots | Team collaboration with studentsEntry-level Full TimeStuttgart, DE, 705691d ago
-
AI Engineer (m/w/d) EUR 54K-54KAzure | CI/CD | Code review | Computer Vision | Data GovernanceCareer development | Collaborative work environment | Healthy Meals | International team experience | Training opportunitiesEntry-level Full TimeDitzingen, Germany1d ago
-
Operational Data Engineer (m/w/d) EUR 67K-72KAutomation engineering | Data Pipelines | Data integration | Industrial networking | Information TechnologyEntry-level Full TimeLaufenburg, Germany1d ago
-
Senior AI Software Engineer (f/m/d) EUR 55K-90KAWS | AWS CDK | Angular | Data Pipelines | DockerConference opportunities | Health benefits | Hybrid work | Mobility benefits | Team eventsSenior-level Full TimeKarlsruhe, BW, Germany2d ago
-
Algorithm Optimization | C++ | Computational Efficiency | Data analytics | JavaCoaching | Mentoring | Training programs | WorkshopsEntry-level Full TimeMünchen, Germany2d ago