Lead LLM Engineer
Tasks
- Build evaluation systems and metrics
- Collaborate with product and founders on system decisions
- Design and evolve LLM agent architecture
- Detect regressions with regression detection
- Drive fast iteration loops from production data
- Ensure output quality across use cases
- Ensure production reliability including latency and failure modes
- Implement fallback strategies
- Improve retrieval reasoning and tool usage
Perks/Benefits
- N/A
Skills/Tech-stack
Azure OpenAI | Debugging | Failure mode analysis | FastAPI | Google Cloud | LLM Evaluation | Langchain | Langfuse | Langgraph | Latency optimization | Logging | PostHog | PostgreSQL | Python | Regression Detection | Retrieval-Augmented Generation | Structured Output | Tool use
Education
N/A
Roles
Related jobs
-
Apache Kafka | Apache Spark | Azure HDInsight | Cloud | ClouderaCareer development training | Employee representative council | Health insurance | Meal vouchers | Profit sharingSenior-level Full TimeNantes, Pays de la Loire, France R7h ago
-
AI Engineer H/F EUR 60K-70KAI Search | AIOps | Agent Framework | Alerting | AzureCompany phone | Meetups | Mobility allowance | Sports and events | TrainingSenior-level Full TimeBordeaux, Nouvelle-Aquitaine, France8h ago
-
Lead Data Engineer / ML H/F EUR 45K-55KA/B | A/B Testing | AWS SageMaker | Apache Airflow | B testingCommunity events | Meetups | Phone allowance | Sport-Events | Sustainable Mobility PassSenior-level Full TimeParis, IDF, France9h ago
-
Data Engineer Azure – Digital Factory (H/F) EUR 65K-65KAgile | Alerting | Azure Container | Azure Container Instances | Azure DataGreat Place to Work certification | Paid vacation bonus | Referral bonus | Telework 2 days per weekEntry-level Full TimeNeuilly-sur-Seine, IDF, France R10h ago
-
Apache Airflow | CI/CD | DBT | Data Documentation | Data ModelingCultural and sports activities fund | Flexible work options | Hackathons | Health insurance | Meal ticketsSenior-level Full TimeIssy-les-Moulineaux, IDF, France R10h ago
-
Machine Learning Engineer - H/F/NB EUR 42K-48KClassification | Docker | Fine Tuning | Generative AI | Inference OptimizationCSE benefits | ELearning platform | Flexible career development | LudothequeEntry-level Full TimeParis, IDF, France10h ago
-
Team Lead Machine Learning Engineer - H/F/NB EUR 42K-45KAWS | Agents | C# | C++ | CI/CDCareer plan | E-learning platform | Employee benefits through CSE | Inclusive work environment | LudothequeSenior-level Full TimeParis, IDF, France10h ago
-
Android | Appium | GenAI | IOS | LLMAgile environment | Beta Testing | English communication | International teamEntry-level Full TimeIssy-les-Moulineaux, Île-de-France, France19h ago
-
CDD Ingénieur Etudes Algorithmes quantiques H/F EUR 21K-25KAlgorithm Design | Applied statistics | Complexity analysis | Computer Vision | CryptographyContinuous learning | Inclusive work environment | Internal communities | Mentoring programs | Training programsEntry-level Full TimeVélizy, France19h ago
-
Data Engineer EUR 46K-65KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon RedshiftHealth benefits | Hybrid work schedule | Paid time off | Permanent contractSenior-level Full TimeParis23h ago
-
Experienced Data Engineer - Streaming Platform EUR 60K-80KAmazon Kinesis | Apache Beam | Apache Flink | Apache Kafka | Apache PulsarChild care support | Gym membership | Healthcare coverage | Lunch vouchers | Relocation packageMid-level Full TimeParis R1d ago
-
AWS | Azure | Cloud infrastructure | Dash | Data LakeMid-level Full TimeParis1d ago
-
AI Agents | Azure | CI/CD | Docker | ElasticsearchSenior-level Full TimeParis1d ago
-
Airbyte | Apache Airflow | Apache Hadoop | Apache Spark | CI/CDSenior-level Full TimeParis1d ago
-
API | AWS | AWS Lambda | Airflow | Amazon EC2Early-stage startup culture | Flexible work schedule | Stimulating projects | Supportive work environmentMid-level Full TimeParis1d ago
-
AI Act | AWS | Apache Airflow | Apache Spark | AzureCareer acceleration program | Innovation freedom | Training catalogEntry-level Full TimeParis1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Entrepreneurial team environment | Flexible remote workMid-level Full TimeLyon, France2d ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Collaborative team | Remote-friendly environment | Supportive managementMid-level Full TimeLille, France2d ago
-
Freelance Data Science Engineer (Python & SQL) USD 116K-116KLLMs | Langchain | MLOps | Matplotlib | NumPyPart-time availability | Project based workMid-level FreelanceFrance - Remote R2d ago
-
Senior AI/ MLOps Engineer H/F EUR 52K-59KAWS | Docker | GCP | Git | GitLab CICareer development | Continuous training | Learning opportunitiesSenior-level Full TimeNantes, Pays de la Loire, France3d ago
-
Data Engineer Spark / Databricks H/F EUR 42K-49KAirflow | Apache Spark | Databricks | Docker | GitCareer development | Continuous learning | Team collaborationEntry-level Full TimeNantes, Pays de la Loire, France3d ago
-
Analytics Engineer H/F EUR 16K-20KAdobe Analytics | Apache Airflow | DBT | Git | Google AnalyticsCommunity events | Meetups | Mobile mobility allowance | Modern phone provided | Sports and social eventsEntry-level Full TimeParis, IDF, France3d ago
-
AWS | Azure | CI/CD | Django | DockerCareer model | Further training | SmartworkingSenior-level Full TimePuteaux, IDF, France3d ago
-
AWS | Azure | Azure Fabric | Bicep | CloudFormationFlexible and mobile work | Further training | Smart workingSenior-level Full TimePuteaux, IDF, France3d ago
-
Ingénieur de recherche en Bioinformatique (H/F) EUR 48K-55KBulk RNA sequencing | Cell Annotation | Clustering | DESeq2 | Data VisualizationSenior-level Full TimeParis, France3d ago