Lead LLM
Tasks
- Build evaluation systems
- Collaborate with product and founders
- Create datasets and metrics
- Define output quality for use cases
- Design LLM and agent architecture
- Drive iteration from production data
- Ensure production reliability latency and failure modes
- Implement fallback strategies
- Improve retrieval reasoning and tool usage
- Run regression detection
Perks/Benefits
- N/A
Skills/Tech-stack
Azure OpenAI | Evaluation | FastAPI | Google Cloud | LLM tracing | Langchain | Langfuse | Langgraph | PostHog | Postgres | Python | Regression testing | Retrieval-Augmented Generation
Education
N/A
Roles
Related jobs
-
Apache Spark | Azure | CI/CD | Data Quality | DatabricksCitizenship engagement platform | Employee representative council | Health insurance | Meal vouchers | Profit sharingSenior-level Full TimeNantes, Pays de la Loire, France R13h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Life changing product mission | Opportunity to impact product | Remote-friendlyMid-level Full TimeLyon, France16h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Friendly work environment | Impactful product | Professional growth opportunitiesMid-level Full TimeLille, France16h ago
-
AWS | Apache Airflow | Apache Spark | Azure | CI/CDInnovation freedom | Training and certificationsEntry-level Full TimeParis20h ago
-
API Design | AWS | Agent systems | Anthropic API | AutogenCareer growth mentoring | Continuous learning | International exposureSenior-level Full TimeParis20h ago
-
Mid-level Full TimeParis20h ago
-
Algorithms | Data Structures | Design Patterns | GenAI | LLMFood vouchers | Gym membership contribution | Health insurance | Mobility pass | Parental leaveMid-level Full TimeParis1d ago
-
Experienced Data Engineer - Streaming Platform EUR 55K-80KAWS Kinesis | Amazon Kinesis | Apache Flink | Apache Kafka | Apache PulsarChild day care | Gym membership | Lunch vouchers | Premium healthcare | Relocation assistanceMid-level Full TimeParis R1d ago
-
Data Engineer GCP (F/H) EUR 50K-55KAPI Development | Agile | BigQuery | CI/CD | Cloud BuildCareer development | Learning platform access | Remote work | Supportive managementMid-level Full TimeParis, Île-de-France, France R1d ago
-
Data Engineer AWS (F/H) EUR 30K-42KAWS Glue | AWS Lambda | Amazon Athena | Amazon S3 | Amazon Web ServicesELearning access | English courses | Health insurance | Mobility allowance | RTTSenior-level Full TimeLa Garenne-Colombes, Île-de-France, France R1d ago
-
Data Engineer AWS Senior (F/H) EUR 30K-42KAPI Gateway | AWS | Agile | Amazon Cognito | CI/CD100 percent health insurance coverage | Cooptation bonus | ELearning access | English courses | Health insuranceSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Data Engineer Cloud (F/H) EUR 30K-42KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileAccord télétravail | Accès plateforme e-learning | Avantages CE | Cours anglais interne | Formation certifications techniquesSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Data Engineer GCP Senior (F/H) EUR 30K-42KBash | Cloud platform | Docker | GCP | GitCE benefits | Cooptation bonus | Employee benefits | English classes | Health insuranceSenior-level Full TimeLa Défense, Île-de-France, France R1d ago
-
Freelance Machine Learning Engineer USD 116KLangchain | MLOps | Machine Learning | NumPy | PandasPart time freelance projects | Project based workMid-level FreelanceFrance - Remote R1d ago
-
Deep learning | Generative AI | LLMs | Langchain | MLOpsProject based workMid-level FreelanceFrance - Remote R1d ago
-
Data Engineer Azure – Digital Factory (H/F) EUR 42K-47KAgile | Alerting | Azure | Azure Container | Azure Container InstancesGreat Place to Work certifications | Health and wellbeing support N/A | Long-term mission | Telework 2 days per weekEntry-level Full TimeNeuilly-sur-Seine, IDF, France R3d ago
-
Entry-level Full TimeParis, IDF, France3d ago
-
Angular | Authentication | Database | FastAPI | Hugging FaceEntry-level Full Time InternshipSèvres, IDF, France3d ago
-
AWS | Amazon S3 | Apache Airflow | CI/CD | DBTCareer international opportunities | Equipment provided | Remote work 2 days per week | Training and certificationsMid-level Full TimeLille - Btwin Village, Nord, France R3d ago
-
BI & Data Engineer - data visualization skills EUR 43K-67K.Netcore | Agile | Apache Spark | Azure Data | Azure Data FactoryFlexible remote working | Focus Fridays | Hybrid working | Learning and development | Mental health benefitsMid-level Full TimeFrance - Paris3d ago
-
Computer Vision | Convolutional Neural Network | Data Fusion | Graph Neural Network | Graph ProcessingEntry-level Full Time InternshipSèvres, IDF, France3d ago
-
BERT | Deep learning | Entity recognition | Hugging Face | Hugging Face TransformersMeal vouchers | Tickets restaurant | Transportation reimbursementEntry-level Full Time InternshipSèvres, IDF, France3d ago
-
Audio Processing | Data Pipelines | Deep learning | Generative AI | Language ProcessingTickets restaurant | Transport reimbursementEntry-level Full Time InternshipSèvres, IDF, France3d ago
-
C++ | Computer Vision | Contour detection | Convolutional Neural Network | Image SegmentationMeal tickets | Transport reimbursementEntry-level Full Time InternshipSèvres, IDF, France3d ago
-
Angular | Authentication | Embeddings | FastAPI | GraphRAGEntry-level Full Time InternshipToulouse, Occitanie, France3d ago