Lead LLM
Tasks
- Build evaluation systems datasets and metrics
- Debug complex failures across retrieval prompts and model behavior
- Define quality metrics and eval frameworks
- Design and evolve LLM and agent architecture
- Develop real world LLM pipelines
- Drive iteration loops from production data
- Ensure output quality across use cases
- Ensure production reliability latency failure modes and fallbacks
- Improve retrieval reasoning and tool usage
- Run continuous evaluations to prevent regressions
Perks/Benefits
- N/A
Skills/Tech-stack
Azure OpenAI | Datasets | Evaluation | FastAPI | Google Cloud | LLM APIs | Langchain | Langfuse | Langgraph | Metrics | PostHog | PostgreSQL | Python | Regression testing | Retrieval-Augmented Generation
Education
N/A
Roles
Related jobs
-
C++ | Cloud platform | Data Pipelines | ETL | Google CloudCDI | Career growth opportunities | Flexible work environment | Telework 1 day per weekSenior-level Full TimeCastelnaudary, France R12h ago
-
Maitrise Ouvrage/Support Booking & Risk H/F EUR 21K-21KOffice 365 | Python | SQLAgile team environment | Career coaching | HR support | Modern campus services | Remote work opportunityEntry-level Full TimeEurope, France, Ile-de-France, 92 - Hauts-De-Seine R14h ago
-
Data Engineer (H/F/NB) EUR 42K-48KAWS | Airflow | Amazon Redshift | Azure | BigQueryInclusive workplace | International mobility | Professional developmentEntry-level Full TimeToulouse, France14h ago
-
AWS | Agile | Cloud Computing | Data Mining | Data VisualizationAgile team environment | Full-time internshipEntry-level Full TimeToulouse, FR, 3110015h ago
-
Data Engineer Databricks (H/F) EUR 47K-55KAmazon Web Services | Apache Spark | Azure | Azure DevOps | CI/CDCareer development | Flexible remote work | Meal tickets | Paid time off | RTT daysSenior-level Full TimeSAINT OUEN, France R16h ago
-
Senior Data engineer H/F EUR 47K-59KAWS | Apache Kafka | Cloudera | Databricks | DockerLearning opportunitiesSenior-level Full TimeLille, Hauts-de-France, France16h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly laid-back atmosphere | Hands-off management | Remote-friendly, distributed teamMid-level Full TimeToulouse, France19h ago
-
API | Anomaly Detection | Data Modeling | Data Pipelines | DockerCareer growth | Flexible work environment | Remote workMid-level Full TimeFrance R20h ago
-
Accelerator Lead Data & AI Engineering (Paris) EUR 76K-101KAWS | Amazon Bedrock | Ansible | Apache Airflow | AutomationEmployee benefit programs | Hybrid work scheduleSenior-level Full TimeParis, France1d ago
-
Mid-level Full TimeAL Paris HO - Digital & …1d ago
-
AWS | Alerting | Amazon SageMaker | CI/CD | Cost OptimizationCareer growth opportunities | Flexible employment options | Remote-first work environmentSenior-level Full TimeFrance R1d ago
-
3D Modeling | Agile | Automation | Blender | FreeCADTicket restaurant | Transport reimbursementEntry-level Full Time InternshipToulouse, Occitanie, France1d ago
-
Deep learning | Generative AI | Hugging Face | Image Processing | LLMMeal tickets | Transportation coverage | Transportation reimbursementEntry-level Full Time InternshipToulouse, Occitanie, France1d ago
-
3D Modeling | 3D Rotation | Agile | Blender | C++Meal tickets | Paid internship | Transportation coverageEntry-level Full Time InternshipToulouse, Occitanie, France1d ago
-
Agile | C++ | Computer Vision | Convolutional Neural Networks | Deep learningMeal tickets | Transport passEntry-level Full Time InternshipSèvres, IDF, France1d ago
-
5G | Artificial Intelligence | C++ | Computer Vision | Machine LearningPaid internship experience | Ticket Restaurants | Transport allowanceEntry-level Full Time InternshipRennes, Brittany, France1d ago
-
Data Engineer (M/F) - Internship - Paris EUR 19K-19KApache Druid | FastAPI | GitLab | Grafana | KibanaCompany culture | Learning opportunities | Remote work | Team-building activities | Wellness benefitsEntry-level InternshipParis, France1d ago
-
Data engineer / OPS H/F EUR 47K-55KAWS | Apache Airflow | DBT | DMS | Data QualityCompany social activities | Employee benefits | Employee savings plan | Extra days off | Meal vouchersSenior-level Full TimeSaint-Herblain, Pays de la Loire, France1d ago
-
Accelerate | Deep learning | Diffusers | Generative AI | Generative ModelsAutonomy and ownership | Career growth opportunities | Continuous learning | Flexible work environment | Fully remote workMid-level Full TimeFrance R1d ago
-
Data Scientist EUR 80K-96KAWS | Airflow | Azure | CI/CD | Computer VisionFlexible hours | Learning and conference budget | Pension contribution | Private healthcare | Remote-first workMid-level Full TimeFrance1d ago
-
Agile | CI/CD | Cloud | Data Governance | Data LakeCareer development opportunities | Cooptation bonus | Employee representative council | Health insurance | Meal vouchersSenior-level Full TimeParis, IDF, France R1d ago
-
Data Engineer junior H/F EUR 35K-45KAWS | Apache Airflow | Apache Kafka | DBT | DMSEmployee savings plan | Extra leave for personal events | Gift vouchers | Meal vouchers | Paid time offEntry-level Full TimeSaint-Herblain, Pays de la Loire, France1d ago
-
Data Engineer (F/H/NB) EUR 45K-55KAgile | Apache Airflow | Azure | Data Observability | DatabricksHealth insurance | Meal vouchers | On-site gym | Paid time off | Parental leaveMid-level Full TimeSaint-Mandé, IDF, France1d ago
-
C++ | Computer Vision | Contour detection | Convolutional Neural Networks | Image ProcessingInternship allowance | Tickets restaurant | Transportation coverageEntry-level Full Time InternshipSèvres, IDF, France1d ago
-
Audio Processing | Data Pipelines | Deep learning | Generative AI | Language ProcessingRestaurant tickets | Transport reimbursementEntry-level Full Time InternshipSèvres, IDF, France1d ago