Praktikant*in für KI-Evaluation für LLM-basierte Systeme im Bereich Daten und KI Research & Development
Tasks
- Analyze agent decision processes
- Apply statistical reliability analysis
- Build scalable Python analysis pipelines
- Calibrate automated evaluation methods
- Create evaluation dashboards
- Define evaluation quality criteria
- Design and run experiments
- Detect evaluation system bias
- Develop LLM evaluation approaches
- Integrate evaluation automation frameworks
- Process and analyze evaluation datasets
- Write decision reports for model comparisons
Perks/Benefits
- Barrier free access
- Canteen cafe
- Child care
- Coaching
- Company doctor
- Company pension
- Company phone
- Employee discounts
- Employee events
- Employee participation
- Flexible working hours
- Good public transport access
- Health programs
- Hybrid work
- Meal allowance
- Mobility options
- Parking
Skills/Tech-stack
Bias detection | Calibration | Dashboards | Data Pipelines | Data Visualization | Experiment design | Experiment tracking | LLM Evaluation | Language Models | Large Language Models | MLflow | Machine Learning | Machine learning experiment tracking | Python | Reliability | Statistical Analysis | Weights and Biases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
AI | AI Research Intern | Data Science | Data Science Intern | Intern | Research Intern | Science Intern
Regions
Countries
States
Related jobs
-
Werkstudent (w/m/d) Gen AI Explorer im Finanzbereich – Test und Evaluierung unstrukturierter Daten EUR 30K-38KChatGPT | Copilot Studio | Data Analysis | Gemini | Generative AICommunity support | Inclusive work environment | Professional networkingEntry-level Part TimeMunich - - Germany7h ago
-
Computer Vision | Deep learning | Efficient Fine Tuning | Experience Replay | Fine TuningHybrid workEntry-level Full Time InternshipHildesheim, NDS, Germany10h ago
-
Chunking | Data Management | Embeddings | Generative AI | Information ExtractionCoaching and mindfulness access | Deutschlandticket | Digital work tools | Ergonomic workspace | Flexible working hoursMid-level Full TimeBerlin, Köln, Hamburg, München11h ago
-
AI Software Engineer (d/w/m) EUR 47K-47KAPIs | C Sharp | C plus plus | Computer Vision | Data PreprocessingSenior-level Full TimeDEU - Mannheim - Leica Microsystems, …20h ago
-
Wissenschaftliche*r Mitarbeiter*in (w/m/d) Künstliche Intelligenz / Machine Learning – Projekt iTAS-PLMS EUR 30K-30KArtificial Intelligence | Electronics Development | Machine Learning | PythonFlexible work options | Germany Ticket subsidy | Mobile work options | Promotion opportunity | Sports and health benefitsEntry-level Full TimeUlm (Oberer Eselsberg)20h ago
-
Artificial Intelligence | Cloud Computing | Generative AI | Machine Learning | Software developmentBarrier-free accessibility | Cafeteria | Coaching | Company pension | Continuous learningEntry-level Full TimeUlm, DE20h ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami1d ago
-
Algorithmic trading | Backtesting | Data Visualization | Google Sheets | Market-MakingFree Prime Broker Subscription | Inclusive workplace | International team collaboration | Knowledge sharing sessions | Modern hardware and toolsEntry-level InternshipMünchen, BY, Germany1d ago
-
API Design | AWS | Agentic Workflows | Anthropic | Backend EngineeringCompany pension scheme | Complimentary broker subscription | Deutschland Jobticket subsidy | Education budget | Flexible sports activitiesMid-level Full TimeBerlin, BE, Germany1d ago
-
AI Software Engineer – Python (m/f/x) EUR 54K-75KAPI Development | AWS | Anthropic API | CI/CD | Cloud APICompany pension scheme | Flexible sports activities | Jobticket subsidy | Prime Plus Broker SubscriptionSenior-level Full TimeMünchen, BY, Germany1d ago
-
Senior AI Engineer (m/w/d) EUR 60K-68KAI Agents | AWS | Cloud Native | Code review | EvalsCompany events | Development budget | Ergonomic workstation | Family-friendly working hours | Fitness membership discountMid-level Full TimeRemote / Düsseldorf R1d ago
-
AI Engineer (Content Management Systeme) (m/w/d) EUR 66K-75KArtificial Intelligence | Content Management | Content Management Systems | GitHub | Information RetrievalCoaching | Company pension | E-learning | Fitness benefits | Flexible work hoursSenior-level Full TimeKÖLN, Germany1d ago
-
A/B | A/B Testing | B testing | Causal Inference | ForecastingCorporate pension plan | Digital meal vouchers | Educational budget | Employee share purchase plan | Food vouchersMid-level Full TimeBerlin, Germany1d ago
-
Working Student (Werkstudent) – Product Management for Analytical Instruments (HPLC/UHPLC) (M/F/D) EUR 34K-36KArtificial Intelligence | Chromatography | Data Analysis | HPLC | Instrumental analysisFlexible schedule | Mentorship | Part-time schedule | Remote work optionEntry-level Part TimeGermany-Waldbronn R1d ago
-
Senior AI Engineer (m/w/d) Applied Agentic AI EUR 47K-47KAI Agents | Agentic Memory | Anthropic | Azure OpenAI | BenchmarkingSenior-level Full TimeMunich - FS 22, Germany1d ago
-
AI Engineer (w/m/x) Germany EUR 47K-47KAzure | Azure OpenAI | CI/CD | Cloud Computing | DockerHybrid workSenior-level Full TimeMunich, Balan Campus Building 17, Germany1d ago
-
AI & Data Engineer d/f/m EUR 15K-19KAWS | Agent evaluation | AgentOps | Apache Spark | AzureE-charging stations | Flexible working time models | Free Access to Health Center | Free parking | Hybrid workingMid-level Full TimeEssen, NW, DE, 451411d ago
-
AI & Data Engineer d/w/m EUR 15K-19KAWS | AgentOps | Apache Spark | Azure | CI/CDDigital onboarding process | EV charging stations | Flexible working arrangements | Free parking | Health Center AccessMid-level Full TimeEssen, NW, DE, 451411d ago
-
Client Communication | Data Science | Data Visualization | Machine Learning | Operations ResearchCoaching | Mentoring | Training programs | WorkshopsMid-level Full TimeMünchen, Germany2d ago
-
Algorithm Design | C++ | Computational Efficiency | Data analytics | JavaCoaching | Mentoring | Professional development | Training programs | WorkshopsEntry-level Full TimeMünchen, Germany2d ago
-
C++ | Data Science | Java | JavaScript | Machine LearningClient collaboration | Conference opportunities | Internship experience | Thought leadership opportunitiesEntry-level InternshipMünchen, Germany2d ago
-
Backend Engineer, AI (Agent Systems) EUR 54K-75KAPI Development | Alerting | Anthropic | Batching | CachingMid-level Full TimeGermany2d ago
-
AI Agents | AWS | Anomaly Detection | CI/CD | ClusteringCorporate benefits discounts | Health and fitness | Mobile Talent Programs | Networking community | Professional developmentEntry-level Part Time TemporaryKöln2d ago
-
(Senior) AI Engineer (all genders) EUR 65K-80KCloud Computing | Containerization | DevOps | Docker | Language ModelsBike benefit | E-learning support | Family-friendly benefits | Fitness program | Flexible working hoursMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R2d ago
-
Artificial Intelligence | Business Process | Business Process Analysis | Data Visualization | Data analyticsEmployee discounts | Homeoffice | Modern work equipment | Sport membership subsidy | Team eventsEntry-level Full Time Part TimeGermering, BY, Germany2d ago