Lead LLM Engineer
Tasks
- Build evaluation systems
- Build fast iteration loops from production data
- Create datasets and quality metrics
- Debug complex LLM failures across retrieval prompts model behavior
- Design and evolve LLM agent architecture
- Ensure output quality across use cases
- Ensure production reliability latency failure handling
- Improve retrieval and reasoning
- Optimize tool usage in workflows
- Run continuous regression evaluations
Perks/Benefits
- N/A
Skills/Tech-stack
Azure OpenAI | Dataset creation | Evaluation metrics | FastAPI | Google Cloud | LLM API | Langchain | Langfuse | Langgraph | PostHog | PostgreSQL | Python | Regression Detection | Retrieval-Augmented Generation | Structured Output | Tool use
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeEurope, France, Ile-de-France, 92 - Hauts-De-Seine9h ago
-
Airbyte | Apache Airflow | Apache Kafka | Apache Spark | Batch ProcessingSenior-level Full TimeParis21h ago
-
AWS | Airflow | Debezium | GCP | KafkaCSE | Occasional travel | Performance bonus | Profit-sharing bonus | Public transportMid-level Full TimeParis R21h ago
-
AWS | Azure | Cloud Computing | Dash | Data LakeMid-level Full TimeParis21h ago
-
AI Agents | Azure | Cloud infrastructure | Docker | ElasticsearchSenior-level Full TimeParis21h ago
-
AWS Lambda | AWS Parallel Computing | Amazon EC2 | Amazon ECS | Amazon S3Early-stage startup | Flexible work environment | Stimulating projects | Supportive teamMid-level Full TimeParis21h ago
-
Research Engineer - Robotics EUR 48K-70K3D Printing | Actuator control | CAD | Computer Vision | Control TheoryFood vouchers | Gympass subscription | Health insurance | Mobility pass | Parental leaveMid-level Full TimeParis1d ago
-
Angular | Debugging | GenAI | Java | JavaScriptAnnual company weekend | Budget equipment | Childcare assistance | Coaching | Employee participation plansSenior-level Full TimeParis1d ago
-
Experienced Data Engineer - Streaming Platform EUR 60K-80KAlerting | Amazon Kinesis | Apache Beam | Apache Flink | Apache PulsarChild day care | Gym membership | Healthcare coverage | Lunch vouchers | Relocation packageMid-level Full TimeParis R1d ago
-
Data Engineer expérimenté(e) EUR 48K-48KAirflow | Cloud Architecture | DBT | Data Governance | Data QualityContinuous learning | Technical community events | Telework/Hybrid | Training budgetMid-level Full TimeLille R1d ago
-
Data Engineer expérimenté.e EUR 48K-52KAmazon Web Services | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkEmployee savings plan | Learning budget | MacBook Pro or Dell laptop | Mobility allowance | Paid trainingMid-level Full TimeBordeaux R1d ago
-
Data Engineer confirmé (H/F) EUR 40K-48KAWS | Amazon Kinesis | Azure | CloudFormation | FlinkAgile team culture | Blog writing opportunities | Community events | Foundation support | Internal trainingEntry-level Full TimeTours1d ago
-
Alternance - Data Engineer (F/H) EUR 38K-38KAWS | Amazon S3 | Apache Airflow | Apache Flink | Apache KafkaFlexible hours | Health insurance | Paid time off | Public transport coverage | Severance planningEntry-level ApprenticeshipPuteaux, J, FR R2d ago
-
Alternance - Data Engineer (F/H) EUR 38K-38KAmazon S3 | Apache Airflow | Apache Flink | Apache Iceberg | Apache KafkaAnnual bonus | Flexible hours | Health insurance | Paid time off | Public transport reimbursementEntry-level ApprenticeshipPuteaux, J, FR R2d ago
-
Apache Kafka | Apache Spark | Azure HDInsight | Cloudera | DatabricksCareer Development Programs | Employee benefits council | Health insurance | Hybrid remote work | Meal vouchersSenior-level Full TimeNantes, Pays de la Loire, France R3d ago
-
Senior-level Full TimeFrance, Remote R3d ago
-
Senior - Computer Vision Consultant EUR 50K-60KAmazon Web Services | Bash | Big Data | C++ | CI/CDProfessional development | Training opportunitiesSenior-level Full TimeParis, France3d ago
-
2026 - Internship, Machine Learning Engineer EUR 27K-32KAPIs | Benchmarking | Data Pipelines | Distributed Systems | Experiment trackingFull-time opportunity | Internship | MentorshipEntry-level InternshipParis3d ago
-
AI Engineer EUR 0K-0KAgentic Systems | Deep learning | Fine Tuning | Language Models | Language ProcessingHybrid work | Paid internship | Paid trial project | Remote work within FranceEntry-level Full TimeParis, IDF, FR / Paris, Île-de-France, … R3d ago
-
Mid-level Full TimeLevallois-Perret, IDF, France3d ago
-
Machine Learning Engineer - H/F/NB EUR 45K-48KClassification | Docker | Fine Tuning | Information Retrieval | LLMCareer development plan with manager objectives | E-learning platform | Employee sports and fitness benefits | Employee works council benefits | Internal e learning trainingEntry-level Full TimeParis, IDF, France3d ago
-
Software Engineer (MLOps) - H/F/NB EUR 35K-36KAWS | Airflow | Azure | CI/CD | DVCEmployee benefits through CSE | Internal e-learning platformEntry-level Full TimeParis, IDF, France3d ago
-
Apprentice - Data governance Engineer (x/f/m) EUR 21K-26KAI Automation | Access Control | CI/CD | Cloud Computing | Cloud platformHybrid work modelEntry-level ApprenticeshipParis, Paris, France3d ago
-
Entry-level Full TimeNantes, France3d ago
-
Consultant·e AI Engineer – Senior / Confirmé·e EUR 53K-60KAzure | Bash | Cloud platform | Data Pipelines | Generative AIAnnual seminar | Career development | Health insurance coverage | Holiday bonus | Interest bonusSenior-level Full TimeParis, France3d ago