AI Researcher / Data Scientist
Remote (United States)
Log10
Improve LLM accuracy by 50% or more with Log10's AutoFeedback. Scale human perspective by 1000x using fine-tuned models and synthetic data. Optimize generative AI applications with advanced features, custom models, and dedicated support.About Log10 Inc
Log10 is addressing the challenges around reliability and consistency of LLM-powered applications via a platform that provides AI-powered evaluations, fine-tuning and debugging tools. We are currently a team of 8 having previously worked in AI and infra roles at companies such as Intel, MosaicML, Adobe, Docker, PostEra, Starburst and Second Measure.Responsibilities
- Develop and implement novel AI algorithms to automate improvements of LLM applications
- Train fine-tuned and reward models based on large datasets to reflect human preferences of domain experts
- Invent synthetic data generation algorithms to train custom evaluation models and augment human review
- Collaborate with cross-functional teams to integrate AI solutions into our LLMOps product offerings
- Stay updated with the latest trends and developments in LLMs, especially evaluations, prompt engineering, fine-tuning and open source models (DBRX, Mistral, Mixtral, Llama-3 etc.)
- Document and present research findings and methodologies to both internal and external stakeholders
Requirements
- Master’s or PhD in Computer Science, Machine Learning, Artificial Intelligence, or a related field
- Proven experience with machine learning algorithms and statistical models. Solid understanding of NLP and experience working with LLMs.
- Strong programming skills in Python and experience with AI/ML frameworks like TensorFlow, PyTorch, etc.
- Excellent problem-solving and analytical skills
- Ability to work independently in an organized manner. Strong communication and collaboration skills
- Comfortable working with version control (git)
- Significant post-academic experience
Nice to have
- Experience in a startup environment
- Experience with evaluating LLMs, familiarity with research in LLM evaluation, e.g. Prometheus
- Experience in logging, debugging and fine-tuning large language models
- Experience developing end-to-end machine learning systems
- Publications in relevant AI/ML conferences and journals
- Experience with cloud computing platforms like AWS, GCP, or Azure
- Knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes)
We provide a competitive salary, equity, and the chance to develop foundational systems that will redefine how companies build AI. This is a high-impact, high-autonomy role for someone eager to take on technical ownership and leadership. If this matches your background and ambitions, we'd love to hear from you!
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Azure Computer Science Docker Engineering GCP Git Kubernetes LLaMA LLMOps LLMs Machine Learning MosaicML NLP Open Source PhD Prompt engineering Python PyTorch Research Statistics TensorFlow
Perks/benefits: Competitive pay Conferences Equity / stock options Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.