Software Engineer, Data Infrastructure & Acquisition - Berlin, Germany
Tasks
- Build dataset roadmap for AI team
- Collaborate with scientists on dataset quality and cost
- Develop web crawlers
- Extend cloud infrastructure for ingestion pipeline
- Find new audio data sources
- Ingest data into ingestion pipeline
- Operate ingestion pipeline infrastructure
- Process large scale data workflows
Perks/Benefits
Skills/Tech-stack
Bash | Data Processing | Docker | GCP | Infrastructure as Code | Linux | Python | Terraform | Web Crawling | “as-code”
Education
Related jobs
-
Chunking | Data Management | Embeddings | Generative AI | Information ExtractionCoaching and mindfulness access | Deutschlandticket | Digital work tools | Ergonomic workspace | Flexible working hoursMid-level Full TimeBerlin, Köln, Hamburg, München3h ago
-
MLOps Engineer EUR 54K-54KAWS | CI/CD | Docker | Flux | GitLab CIExternal consulting | Flexible work | Health benefits | Job bike | Job ticketMid-level Full TimeBerlin, BE, DE, 101176h ago
-
Data Engineer (m/w/d) Software EUR 30K-38KApache Spark | CI/CD | Containerization | ELT | ETLE-learning | Flexible working hours | Health management | Homeoffice | Seminar TrainingMid-level Full TimeKöln, NW, DE, 510636h ago
-
AWS | Autoscaling | Azure | Bash | CI/CDFully remote work Europe | Healthcare coverage | Paid parental leave | Relocation assistanceMid-level Full TimeGermany R9h ago
-
AI Software Engineer (d/w/m) EUR 47K-47KAPIs | C Sharp | C plus plus | Computer Vision | Data PreprocessingSenior-level Full TimeDEU - Mannheim - Leica Microsystems, …12h ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R20h ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami20h ago
-
Senior Python Engineer, DataFeed Team EUR 75K-99KAlerting | Apache Kafka | Asyncio | Code review | Data PipelinesOn-call rotationSenior-level Contract Full TimeBerlin20h ago
-
API Design | Agentic AI | Analytics | Cloud Architecture | Data fabricSenior-level Full TimeGermany22h ago
-
APIs | Agentic AI | Analytics | Artificial Intelligence | C#Entry-level Full TimeDarmstadt22h ago
-
Agents | Data Architecture | Data Ingestion | Data Modeling | Data PipelinesAnnual performance bonus | Equipment support | Flexible working hours | Gifts and rewards | In-person team eventsSenior-level Full TimeGermany R23h ago
-
AI Software Engineer – Python (m/f/x) EUR 54K-75KAPI Development | AWS | Anthropic API | CI/CD | Cloud APICompany pension scheme | Flexible sports activities | Jobticket subsidy | Prime Plus Broker SubscriptionSenior-level Full TimeMünchen, BY, Germany23h ago
-
(Senior) Data Engineer (m/f/x) EUR 64K-75KAWS | AWS DMS | AWS Glue | AWS IAM | Amazon AthenaCompany pension scheme | Discounted sports activities | Education budget | German language classes | International relocation supportSenior-level Full TimeBerlin, BE, Germany1d ago
-
Senior AI Engineer (m/w/d) EUR 60K-68KAI Safety | AWS | Agentic Workflows | Artificial Intelligence | CI/CDAssistance with transportation | Development budget | Employer pension contributions | Ergonomic workplace | Events and partiesMid-level Full TimeRemote / Düsseldorf R1d ago
-
AWS | Aurora PostgreSQL | CloudFormation | Event Driven | Event-driven architectureCoaching | Company events | Deutschlandticket | E-learning | Family Support ServiceSenior-level Full TimeBerlin, Berlin, Deutschland1d ago
-
Algorithm Optimization | C++ | CNC | Data Analysis | IIoTFlexible working hours | Team collaboration | Unrestricted contractSenior-level Full TimeAachen1d ago
-
AI Engineer (Content Management Systeme) (m/w/d) EUR 66K-75KArtificial Intelligence | Content Management | Content Management Systems | GitHub | Information RetrievalCoaching | Company pension | E-learning | Fitness benefits | Flexible work hoursSenior-level Full TimeKÖLN, Germany1d ago
-
Senior Data Engineer EUR 70K-90KCI/CD | ClickHouse | Docker | Elasticsearch | KafkaFlexible working hours | Learning time | Location Based Social Benefits | Remote-first | Team eventsSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
Lead Software Engineer (AI/ML) EUR 56K-79KAPIs | AWS | Agent Orchestration | Autogen | AzureCompany hackathons | Company ticket | Flexible working hours | German language course | Hybrid work modelSenior-level Full TimeBerlin, Germany R1d ago
-
AWS | Apache Iceberg | Apache NiFi | Avro | AzureFlexible work environment | Inclusive workplace | Training and developmentMid-level Full TimeDüsseldorf, DE, 402191d ago
-
AWS | AWS Glue | AWS Lambda | Amazon S3 | Amazon SNSFlexible work environment | Training and developmentSenior-level Full TimeDüsseldorf, DE, 402191d ago
-
ADLS Gen2 | AI Services | Azure AI | Azure AI Services | Azure DataFlexible working environment | Training and developmentSenior-level Full TimeDüsseldorf, DE, 402191d ago
-
Master Thesis - Performance Simulation and Optimization of an Air Conditioning Pack (d/f/m) EUR 36K-36KDymola | Genetic Algorithms | MATLAB | Modelica | PythonFlexible working hours | International environment | Mobile working | Modern technologies | Networking opportunitiesNone Full TimeHamburg - Finkenwerder, Germany1d ago
-
System Engineer Server & Storage (m/w/d) EUR 42K-51KBackup and Recovery | Disaster Recovery | Linux | Monitoring | NetworkingAnnual training budget | Bike leasing | Buddy program | Discounts and Partner Benefits | Employee referral bonusEntry-level Full TimeNürnberg, Bayern, DE1d ago
-
Senior AI Engineer (m/w/d) Applied Agentic AI EUR 47K-47KAI Agents | Agentic Memory | Anthropic | Azure OpenAI | BenchmarkingSenior-level Full TimeMunich - FS 22, Germany1d ago