Lead LLM Engineer
Tasks
- Build evaluation systems datasets and metrics
- Build fast iteration loops from production data
- Collaborate with product and founders on what to build and why
- Design and evolve LLM agent architecture
- Detect regressions using regression monitoring
- Ensure output quality across use cases
- Ensure production reliability latency and failure handling
- Improve retrieval reasoning and tool usage
Perks/Benefits
- N/A
Skills/Tech-stack
Azure OpenAI | Evaluation datasets | FastAPI | Google Cloud | LLM tool-use | Langchain | Langfuse | Langgraph | Latency optimization | PostHog | PostgreSQL | Python | Quality metrics | Regression testing | Retrieval-Augmented Generation | Tool use
Education
N/A
Roles
Related jobs
-
Data Engineer – Plateforme Data Engineering EUR 48K-52KApache Airflow | Apache Flink | Apache Kafka | DBT | DebeziumAgile scrum teamworkSenior-level Full TimeVitrolles, Provence-Alpes-Côte d'Azur, France9h ago
-
Manager - Lead Data Scientist (H/F) EUR 50K-60KAmazon SageMaker | Apache Spark | Data Pipelines | Databricks | Deep learningCareer development support | Flexible work | Great Place to Work recognition | Mobile work | Training opportunitiesSenior-level Full TimePuteaux, IDF, France10h ago
-
API | AWS | Apache Kafka | Azure | Data GovernanceFlexible work | Further training | Mentorship | Mobile work | SmartworkingEntry-level Full TimePuteaux, IDF, France10h ago
-
3D simulation | Artificial Intelligence | C++ | CE | Computer VisionContinuous training | Innovative projects | Stimulation environmentSenior-level Full TimeToulouse, Occitanie, France10h ago
-
AI | APIs | AWS | CircleCI | DynamoDBHealth insurance | Hybrid working | International team events | Meal card | Paid leaveSenior-level Full TimeParis, France11h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Friendly atmosphere | Handsoff management | Portfolio feedback | Remote-friendly environmentMid-level Full TimeLyon, France13h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Career growth opportunities | Impactful product mission | Remote-friendly environment | Supportive teamMid-level Full TimeLille, France13h ago
-
Senior Data Engineer - F/H EUR 45K-55KAirflow | Batch Processing | Cloud | DBT | Data ModelingAfterworks | Conferences | Flexible hours | Health insurance | Holiday bonusSenior-level Full TimeWasquehal, France1d ago
-
Senior-level Full TimeBORDEAUX, FRA1d ago
-
Azure OpenAI | Cloud platform | Evaluation metrics | FastAPI | Google CloudMid-level Full TimeParis, France1d ago
-
Agentic AI | Amazon Web Services | Cloud platform | Dash | Data LakeMid-level Full TimeParis, France1d ago
-
Airbyte | Apache Airflow | Apache Spark | Batch Processing | CI/CDSenior-level Full TimeParis, France1d ago
-
AI Foundry | AWS | AWS Bedrock | Agentic AI | Amazon SageMaker401k match | Career development | Dental insurance | Flexible work arrangements | Health insuranceSenior-level Full TimeFrance3d ago
-
Lead Data Scientist (H/F) EUR 46K-60KAgentic Workflows | Azure | Benchmarks | Docker | GitCSE access | Commuting support | Health insurance | Meal tickets | TeleworkSenior-level Full TimeCourbevoie, La Défense, Île-de-France, France3d ago
-
AI Research Engineer - GPU Simulation GBP 80K-105KC++ | CUDA | Domain Randomization | Flight Dynamics | GPU ProgrammingEnhanced parental leave | Health and wellness gym membership | Learning allowance | Mental health support | Paid Family Emergency LeaveSenior-level Full TimeMunich - Berlin - London - … R3d ago
-
Apache Spark | Big Data | Cluster management | Data Engineering | Data GovernanceEmployee share ownership | Great Place to Work certification | Health insurance | Meal vouchers | Mentoring programMid-level Full TimeLyon, Auvergne-Rhône-Alpes, France3d ago
-
Data Scientist Senior H/F EUR 45K-55KAWS | Bash | CI/CD | Data Engineering | Data TableCommunity groups | Company phone | Meetups | Mobility allowance | Sports and eventsSenior-level Contract Full TimeParis, IDF, France3d ago
-
API Development | Backup and Restore | Cause analysis | Disaster Recovery | ElasticsearchRemote-firstMid-level Full TimeParis R3d ago
-
Automation | Azure | Azure Data | Azure Data Explorer | Azure Log AnalyticsCross-functional collaboration | Exposure to large scale security telemetry | Professional growth | Remote work opportunityMid-level Full TimeFrance R3d ago
-
API Integration | Computer Vision | Hugging Face | Langchain | Language ModelsEmployee Committee | Health insurance | Meal vouchers | Referral bonusEntry-level Full TimeNantes, Pays de la Loire, France4d ago
-
AI Agents | Data Science | Generative AI | Language Models | Large Language ModelsCoaching and mentoring | Employee committee benefits | Health insurance | Paid vacation bonus | Referral bonusSenior-level Full TimeStrasbourg, Grand Est, France4d ago
-
AI Agents | Deep learning | GenAI | LLM-Ops | Language ModelsEmployee Committee | Health insurance | Meal vouchers | Mentoring | Profit sharingSenior-level Full TimeSaint-Herblain, Pays de la Loire, France4d ago
-
AI Agents | Artificial Intelligence | Generative AI | Language Models | Large Language ModelsCareer growth | Community volunteering platform | Coopting bonus | Diversity and inclusion programs | Employee benefits programSenior-level Full TimeCourbevoie, IDF, France4d ago
-
Senior Data Engineer Python/GCP (x/f/m) EUR 60K-74KBigQuery | CI/CD | Cloud Storage | Cloud platform | Data GovernanceCoaching services | Health insurance | Long term employee value sharing plan | Lunch vouchers | Mental health supportSenior-level Full TimeParis, Paris, France R4d ago
-
Staff AI Data Engineer (x/f/m) EUR 56K-79KAmplitude | Anonymization | BigQuery | Cloud platform | DBTCoaching | Extra leave | Health insurance | Lunch voucher | Mental health servicesSenior-level Full TimeParis, Paris, France R4d ago