AI Software Engineer - Model Evaluation (f/m/d)
Tasks
- Build evaluation infrastructure
- Close capability gaps
- Correlate signals
- Design aggregation and reporting
- Own German evaluation
- Own benchmarks end to end
Perks/Benefits
- Bike lease
- Company pension subsidy
- Fitness wellness benefits
- Flexible working hours
- Hybrid work model
- Mental health support
- Paid vacation
- Technical equipment budget
- Transportation ticket subsidy
- Virtual stock option plan
Skills/Tech-stack
Benchmarking | Dashboarding | Data Pipelines | Dataset curation | Distributed Systems | Evaluation dataset curation | Experimental Design | LLM Evaluation | ML Infrastructure | PyTorch | Python | Statistical Methods
Education
Roles
Regions
Countries
States
Related jobs
-
Apache Beam | Apache Spark | BigQuery | C plus plus | C#Client stakeholder engagement | Travel up to 30 percentMid-level Full TimeMunich, Germany; Frankfurt, Germany7h ago
-
AI Software Engineer – Python (m/f/x) EUR 47K-85KAPI Development | AWS | Anthropic | CI/CD | DockerCompany pension scheme | Complimentary PRIME Broker subscription | Education budget | Flexible vacation policy | German language classesSenior-level Full TimeMünchen, BY, Germany10h ago
-
Cloud Computing | Elasticsearch | Generative AI | MLOps | Machine LearningAdditional vacation days | Company events and team activities | EGYM Wellpass subsidy | Fitness and wellness access | Home office on FridaysMid-level Full TimeErfurt, Thüringen, Germany10h ago
-
Lead Software Engineer (m/w/d) – Search & GenAI EUR 53K-53KAWS | Agentic search | Cloud infrastructure | Golang | High PerformanceCompany events | External training budget | Flexible work model | Free Germany ticket | Free lunchSenior-level Full TimeMünchen, Bayern, Germany12h ago
-
Anomaly Detection | C++ | Computer Vision | Data Preprocessing | Machine LearningCareer development support | Flexible working hours | Mentoring | Onboarding | Remote workEntry-level InternshipMünchen, BY, DE, 8080918h ago
-
Cloud Data Engineer (m/w/d) – AWS und Databricks EUR 65K-85KAWS | CI/CD | DBT | Data Governance | Data QualityAdditional Vacation Time Options | Bicycle leasing | Company pension | Flexible working hours | Germany Ticket subsidySenior-level Full TimeHannover, Niedersachsen, DE18h ago
-
Werkstudent Automation / Data Analytics (m/w/d) EUR 32K-36KAutomation | Data Analysis | Data Quality | NumPy | PandasCafeteria meals | Flexible working hours | Home office | Internal communities | Mobile work equipmentEntry-level Part TimeNürnberg Fürther Str. 111, Germany18h ago
-
API Integration | API Management | Agile Kanban | Agile Scrum | AlertingCareer development opportunities | Fitness area | International work environment | Meal stipend | Remote Work N/AMid-level Full TimeHamburg1d ago
-
Agent Orchestration | Data Processing | Docker | Embeddings | EvaluationBicycle subsidy | Corporate discounts | Corporate pension plan | Digital meal vouchers | Educational budgetSenior-level Full TimeBerlin, Germany1d ago
-
AI Software Engineer – Python (m/f/x) EUR 47K-85KAPI | AWS | Anthropic API | CI/CD | DockerCompany pension scheme | Complimentary broker subscription | Discounted sports activities | Education budget | Flexible vacation policySenior-level Full TimeMünchen, BY, Germany1d ago
-
Agile | Apache Airflow | Apache Spark | Compliance | Data GovernanceCentral office location | Coffee and tea stations | Employee discounts | Networking opportunitiesSenior-level Full TimeMunich, Germany1d ago
-
Staff Data Engineer - Finance Tech (all genders) EUR 33K-33KAttribution Modeling | Clustering | Dagster | Data orchestration | Machine LearningSenior-level Full TimeHamburg, HH, Germany1d ago
-
Staff Data Engineer - Finance Tech (all genders) EUR 50K-50KAttribution Modeling | Clustering | Dagster | Data orchestration | Machine LearningSenior-level Full TimeHamburg, HH, Germany1d ago
-
Attribution Modeling | Clustering | Dagster | Data Analysis | Data orchestrationSenior-level Full TimeHamburg, HH, Germany1d ago
-
Clustering | Dagster | Data orchestration | Machine Learning | Marketing attributionAcceptance and inclusion | Afterwork drinks | Company events | Inclusive culture | Team lunchesSenior-level Full TimeHamburg, HH, Germany1d ago
-
AWS Fargate | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQSAfterwork drinks | Company events | Quick coffee | Team lunchesSenior-level Full TimeHamburg, Germany1d ago
-
ArgoCD | Command Line | Command-line Interface | Continuous Delivery | Continuous integrationRemote workEntry-level Internship Part TimeBamberg, BY, Germany1d ago
-
Staff Data Engineer - Finance Tech (all genders) EUR 45K-50KClustering | Dagster | Data orchestration | Machine Learning | PythonSenior-level Full TimeHamburg, HH, Germany1d ago
-
Clustering | Dagster | Data orchestration | Machine Learning | PythonSenior-level Full TimeHamburg, HH, Germany1d ago
-
Amazon SageMaker | Apache Arrow | Big Data | CI/CD | Cloud ComputingSenior-level Full TimeHamburg, HH, Germany1d ago
-
(Senior) AI Engineer (all genders) EUR 65K-85KCloud Platforms | Containerization | DevOps | Docker | LLM InferenceE-learning support | Family-friendly | Fitness benefits | Flexible work options | Paid time offMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R1d ago
-
Chatbot LLM Engineer (all genders) EUR 43K-66KAgile methods | Chatbot Development | Language Models | Large Language Models | Prompt engineering30 days vacation | Bio Fruit And Vegetables | Company bike | Company boat | E-Learning Course ReimbursementMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R1d ago
-
Senior Analytics Engineer EUR 67K-88KApache Airflow | Bayesian statistics | DAG | DBT | DashboardsAnnual bonus | Equity | Fun employee events | Hybrid working | MacBook providedSenior-level Full TimeBerlin, Germany1d ago
-
AI Services | APIs | Anthropic Claude | Anthropic Claude API | AzureEntry-level Full TimeFrankfurt am Main, München, Hamburg, Stuttgart, …1d ago
-
Junior Consultant Data Science & AI (m/w/d) EUR 36K-36KAdvanced Document Processing | Agentic Workflows | Artificial Intelligence | Cloud services | Data AnalysisAdditional equipment support | Company bike | Company car | Company fitness | Family serviceEntry-level Full Timebundesweit, Germany R1d ago