Lead LLM
Tasks
- Build evaluation systems
- Collaborate with product and founders on system requirements
- Create datasets and quality metrics
- Design LLM agent architecture
- Drive iteration loops from production data
- Ensure production reliability
- Improve retrieval reasoning and tool usage
- Own output quality
- Run continuous regression detection
Perks/Benefits
- N/A
Skills/Tech-stack
Agents | Azure OpenAI | Evaluation | FastAPI | Google Cloud | Langchain | Langfuse | Langgraph | Latency optimization | PostHog | PostgreSQL | Python | Regression testing | Retrieval-Augmented Generation | Structured Output
Education
N/A
Roles
Related jobs
-
AWS Glue | AWS Lambda | Airflow | Amazon Athena | Amazon ECSAsync-friendly culture | Company offsites | Conference support | Flexible working hours | Fully remoteSenior-level Full TimeFrance R5h ago
-
Data Engineer confirmé(e) - Assurance - Lille EUR 45K-48KAmazon Web Services | Apache Kafka | CI/CD | Data Governance | Data ProcessingEmployee engagement bonus | Employee representative council | Health insurance | Meal vouchers | Referral bonusMid-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R8h ago
-
Senior-level Full TimeVitrolles, Provence-Alpes-Côte d'Azur, France R8h ago
-
AWS | Airflow | Apache Flink | Apache Kafka | Apache SparkFully paid parental leave | Fully remote-first | Home office stipend | Inclusive diverse workplace culture | Internal knowledge sharing programsSenior-level Full TimeFrance R19h ago
-
Senior-level Full TimeLevallois-Perret, France1d ago
-
Data Engineer Snowflake Senior (H/F/NB) EUR 47K-55KAWS | Azure | CI/CD | DBT | Data IngestionInternational mobility | Proximity management | Telework | Training platform accessSenior-level Full TimeLevallois-Perret, France R1d ago
-
Data Engineer GCP (F/H) EUR 50K-55KAPI Development | Agile | BigQuery | CI/CD | Cloud BuildCareer growth | Learning platform | Supportive management | TeleworkMid-level Full TimeParis, Île-de-France, France R1d ago
-
Data Engineer AWS (F/H) EUR 30K-42KAWS Glue | AWS Lambda | Amazon Athena | Amazon S3 | Apache AirflowCooptation bonus | E-learning access | English training | Health insurance | Meal vouchersSenior-level Full TimeLa Garenne-Colombes, Île-de-France, France R1d ago
-
Data Engineer EUR 50K-55KAPI | Agile | Hadoop | Kafka | MongoDBEmployee referral bonus | English courses | Health insurance | Mobility bonus | RTTMid-level Full TimeSophia-Antipolis, Provence-Alpes-Côte d'Azur, France R1d ago
-
Data Engineer AWS Senior (F/H) EUR 30K-42KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon CognitoCooptation bonus | Employee benefits | English Training Access | Health insurance | Meal ticketsSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Data Engineer GCP Senior (F/H) EUR 30K-42KBash | Cloud platform | Docker | GCP | GitCE benefits | Cooptation bonus | E-learning access | Employee benefits | English classesSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Data Engineer Cloud (F/H) EUR 30K-42KAWS | AWS Lambda | AWS Step Functions | Agile | Amazon RDSContinuing education budget | Cooptation bonus | Employee benefits | English courses | Health insuranceSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Mid-level Full TimeParis1d ago
-
AWS | Agentic AI | Azure | Cloud infrastructure | Cloud platformMid-level Full TimeParis1d ago
-
API Design | AWS | Agent Orchestration | Anthropic SDK | AutogenContinuous learning | International collaboration | Technical excellence cultureSenior-level Full TimeParis1d ago
-
AWS | Agent Orchestration | Amazon Web Services | Apache Airflow | AzureFast career progression | Innovation freedom to test new technologies | Training opportunitiesEntry-level Full TimeParis1d ago
-
Senior-level Full TimeParis1d ago
-
(Senior) Data Platform Engineer (m/f/d) EUR 45K-67KABAC | Airflow | Audit Logging | Automated testing | CI/CD30 days vacation | Bike leasing | Discounts | Flex budget for expenses | Flexible working hoursMid-level Full TimeGermany, Munich, Germany, Berlin, France, Paris3d ago
-
Apache Spark | CI/CD | Cloud | Data Lake | HadoopCooptation bonus | Employee representative council | Health insurance | Meal vouchers | Profit sharingSenior-level Full TimeParis, IDF, France R3d ago
-
APIs | Cloud platform | Google Cloud | Google Cloud Platform | LLM EvaluationSenior-level Full TimeParis, France3d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Flexible management approach | Friendly laid-back atmosphere | Remote-friendly environmentMid-level Full TimeParis, France3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote work or distributed setting | Supportive entrepreneurial teamMid-level Full TimeNantes, France3d ago
-
Machine Learning Developer (Freelance) USD 116K-116KLangchain | MLOps | Machine Learning | NumPy | PandasFreelance opportunities | Part-time availability | Project based workMid-level FreelanceFrance - Remote R3d ago
-
Freelance Machine Learning Engineer USD 116K-116KGenAI | Langchain | Language Models | Large Language Models | MLOpsFreelance opportunity | Part-time hours | Project based workMid-level FreelanceFrance - Remote R3d ago
-
Deep learning | MATLAB | Machine Learning | Model Distillation | Powertrain modelingEntry-level Full TimeFR REN AMPERE S.A.S. - Guyancourt, …3d ago