Praktikant*in für KI-Evaluation für LLM-basierte Systeme im Bereich Daten und KI Research & Development
Tasks
- Analyze agent decision processes
- Apply statistical reliability analysis
- Build scalable Python analysis pipelines
- Calibrate automated evaluation methods
- Create evaluation dashboards
- Define evaluation quality criteria
- Design and run experiments
- Detect evaluation system bias
- Develop LLM evaluation approaches
- Integrate evaluation automation frameworks
- Process and analyze evaluation datasets
- Write decision reports for model comparisons
Perks/Benefits
- Barrier free access
- Canteen cafe
- Child care
- Coaching
- Company doctor
- Company pension
- Company phone
- Employee discounts
- Employee events
- Employee participation
- Flexible working hours
- Good public transport access
- Health programs
- Hybrid work
- Meal allowance
- Mobility options
- Parking
Skills/Tech-stack
Bias detection | Calibration | Dashboards | Data Pipelines | Data Visualization | Experiment design | Experiment tracking | LLM Evaluation | Language Models | Large Language Models | MLflow | Machine Learning | Machine learning experiment tracking | Python | Reliability | Statistical Analysis | Weights and Biases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
AI | AI Research Intern | Data Science | Data Science Intern | Intern | Research Intern | Science Intern
Regions
Countries
States
Related jobs
-
AWS | Experimentation | Generative AI | Language Models | Language ProcessingBicycle leasing | Development programs | Employee smartphone plan | Good team culture | Interesting ProductsEntry-level Full TimeHamburg7h ago
-
Architecture Optimization | Data Analysis | Data Preparation | Machine Learning | Model ArchitectureCareer development | Hybrid work | Working student communityEntry-level Part TimeBerlin - Berlin - Germany8h ago
-
AI / ML Lead Consultant (m/w/d) EUR 67K-85KAPIs | CI/CD | Cloud platform | Computer Vision | DBTCareer development opportunities | Continuous learning | Support for certifications | Supportive international teamSenior-level Full TimeMünchen, BY, Germany8h ago
-
AI Engineer EUR 44K-70KA/B | A/B Testing | API Design | AWS | B testingAdditional annual leave | Discounts | Fitness and wellness memberships | Language apps | Personal development budgetMid-level Full TimeBerlin1d ago
-
Agentic AI Software Engineer EUR 38K-51KAWS | Azure | CI/CD | Docker | FastAPIAccess to certifications | Conferences and Knowledge Sharing | Flexible working model | Hackathons | Remote work optionEntry-level Full TimeMunich, Bayern, Germany1d ago
-
Werkstudent (w/m/d) Gen AI Explorer im Finanzbereich – Test und Evaluierung unstrukturierter Daten EUR 30K-38KChatGPT | Copilot Studio | Data Analysis | Gemini | Generative AICommunity support | Inclusive work environment | Professional networkingEntry-level Part TimeMunich - - Germany1d ago
-
Gazebo | Isaac Sim | Linux | MS Office | NVIDIA IsaacCanteen discount | Corporate discounts | Flexible working hours | Health and wellness programs | Hybrid workEntry-level Full Time InternshipHannover, NDS, Germany1d ago
-
Computer Vision | Deep learning | Efficient Fine Tuning | Experience Replay | Fine TuningHybrid workEntry-level Full Time InternshipHildesheim, NDS, Germany1d ago
-
Chunking | Data Management | Embeddings | Generative AI | Information ExtractionCoaching and mindfulness access | Deutschlandticket | Digital work tools | Ergonomic workspace | Flexible working hoursMid-level Full TimeBerlin, Köln, Hamburg, München1d ago
-
Machine Learning Consultant (m/w/d) EUR 38K-51KAgile project management | Apache Spark | Artificial Intelligence | Cloud Architecture | Cloud infrastructureConferences | Gym membership subsidy | Hackathons | Public transport ticket | Remote workEntry-level Full TimeMunich, Bayern, Germany1d ago
-
AI Engineer (Enablement) EUR 54K-79KAPIs | Backend Development | Cloud infrastructure | Databricks | EvaluationEmployee assistance program | Flexible working arrangements | Health insurance | LinkedIn Learning | Mobility CreditSenior-level Full TimeBerlin, Germany; Hamburg, Germany1d ago
-
AI Software Engineer (d/w/m) EUR 47K-47KAPIs | C Sharp | C plus plus | Computer Vision | Data PreprocessingSenior-level Full TimeDEU - Mannheim - Leica Microsystems, …1d ago
-
Wissenschaftliche*r Mitarbeiter*in (w/m/d) Künstliche Intelligenz / Machine Learning – Projekt iTAS-PLMS EUR 30K-30KArtificial Intelligence | Electronics Development | Machine Learning | PythonFlexible work options | Germany Ticket subsidy | Mobile work options | Promotion opportunity | Sports and health benefitsEntry-level Full TimeUlm (Oberer Eselsberg)1d ago
-
Artificial Intelligence | Cloud Computing | Generative AI | Machine Learning | Software developmentBarrier-free accessibility | Cafeteria | Coaching | Company pension | Continuous learningEntry-level Full TimeUlm, DE1d ago
-
Werkstudent (m/w/d) Web Analytics & Testing USD 36K-36KA/B | A/B Testing | B testing | BigQuery | Conversion RateCorporate benefits | Ergonomic workplace | Fitness courses | Flexible working hours | Home office optionEntry-level Part TimeMünchen, BY, DE, 809921d ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami2d ago
-
Algorithmic trading | Backtesting | Data Visualization | Google Sheets | Market-MakingFree Prime Broker Subscription | Inclusive workplace | International team collaboration | Knowledge sharing sessions | Modern hardware and toolsEntry-level InternshipMünchen, BY, Germany2d ago
-
API Design | AWS | Agentic Workflows | Anthropic | Backend EngineeringCompany pension scheme | Complimentary broker subscription | Deutschland Jobticket subsidy | Education budget | Flexible sports activitiesMid-level Full TimeBerlin, BE, Germany2d ago
-
AI Software Engineer – Python (m/f/x) EUR 54K-75KAPI Development | AWS | Anthropic API | CI/CD | Cloud APICompany pension scheme | Flexible sports activities | Jobticket subsidy | Prime Plus Broker SubscriptionSenior-level Full TimeMünchen, BY, Germany2d ago
-
Senior AI Engineer (m/w/d) EUR 60K-68KAI Agents | AWS | Cloud Native | Code review | EvalsCompany events | Development budget | Ergonomic workstation | Family-friendly working hours | Fitness membership discountMid-level Full TimeRemote / Düsseldorf R2d ago
-
AI Engineer (Content Management Systeme) (m/w/d) EUR 66K-75KArtificial Intelligence | Content Management | Content Management Systems | GitHub | Information RetrievalCoaching | Company pension | E-learning | Fitness benefits | Flexible work hoursSenior-level Full TimeKÖLN, Germany2d ago
-
A/B | A/B Testing | B testing | Causal Inference | ForecastingCorporate pension plan | Digital meal vouchers | Educational budget | Employee share purchase plan | Food vouchersMid-level Full TimeBerlin, Germany2d ago
-
Working Student (Werkstudent) – Product Management for Analytical Instruments (HPLC/UHPLC) (M/F/D) EUR 34K-36KArtificial Intelligence | Chromatography | Data Analysis | HPLC | Instrumental analysisFlexible schedule | Mentorship | Part-time schedule | Remote work optionEntry-level Part TimeGermany-Waldbronn R2d ago
-
Senior AI Engineer (m/w/d) Applied Agentic AI EUR 47K-47KAI Agents | Agentic Memory | Anthropic | Azure OpenAI | BenchmarkingSenior-level Full TimeMunich - FS 22, Germany2d ago
-
AI Engineer (w/m/x) Germany EUR 47K-47KAzure | Azure OpenAI | CI/CD | Cloud Computing | DockerHybrid workSenior-level Full TimeMunich, Balan Campus Building 17, Germany2d ago