Machine Learning Lead Engineer
Atlanta, GA - 6305 Peachtree Dunwoody Rd Bldg B, United States
R
USD 134K-224K Senior-level Full Time
Tasks
- Benchmark open source and hosted models for quality cost and latency
- Build ML infrastructure monitoring and documentation
- Build evaluation systems using GenAI Eval Framework
- Build synthetic conversations for agent testing
- Calibrate LLM as judge using human baselines
- Coach teams on AI adoption and lead AI transformation
- Curate golden datasets with human labels
- Deploy models for training inference and production
- Design agent based workflows for training data pipelines and analysis
- Design build and maintain ML models algorithms and pipelines
- Fine tune and quantize models for task and hardware constraints
- Own model selection strategy for agentic AI
- Partner with legal and compliance for AI regulations
- Run evaluation comparisons before and after prompt or model change
- Select open source models for deployment
- Set AI governance policy including bias checks compliance tracking and audit trails
- Set standards for model testing and rollout
- Trace drift root cause for agent quality changes
- Track model cost across projects and report spend to leadership
Perks/Benefits
- Additional paid time off options
- Hybrid remote work
- Paid Holidays
- Paid vacation
- Paid wellness time
- Pre employment drug test required
Skills/Tech-stack
AI ethics | AWS AgentSquad | AWS Strands | Agent Frameworks | Audit trails | Benchmarking | Bias detection | Compliance tracking | Computer Vision | Deep learning | Fine Tuning | Generative AI | Inference | LLM | LLM-as-judge | Langchain | Machine Learning | Model Evaluation | Model Governance | Model Monitoring | Model Serving | Open Source | Open-source Models | Prompt engineering | Quantization | Responsible AI | Synthetic data
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R23d ago
-
AI & Machine Learning Vice President USD 120K-220KAWS | Alteryx | Anomaly Detection | Azure | C#401k | Dental insurance | Disability insurance | Health insurance | Hybrid work modelExecutive-level Full TimeUnited States R1d ago
-
Staff Machine Learning Engineer, Applied Research USD 189K-389KC++ | Graph Neural Networks | Information Retrieval | Java | Language ProcessingSenior-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Principal AI Engineer USD 185K-265KAPI Integration | Agent systems | Artificial Intelligence | Cloud Native | Cloud-native ArchitecturesEducation reimbursement | Health plans | Paid time off | Parental leave | Remote workSenior-level Full TimeRemote - USA R1d ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Cloud Computing | Data Association401k match | Dental insurance | Emotional & mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
A/B | A/B Testing | API Development | AWS Bedrock | Access Control401k plan | Healthcare premium coverage | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CodeBuild401k | PTO | Paid Company Holidays | Phone stipend | Wellness stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
AI Engineer II USD 125K-145KAPI Gateway | AWS | AWS Bedrock | AWS Lambda | Amazon APICareer advancement | Employee recognition | LinkedIn Learning Platform | Open PTO | Paid HolidaysMid-level Full TimeRemote US R1d ago
-
Principal AI Engineer (Remote) USD 128K-200KAPI Gateways | Agent Orchestration | Artificial Intelligence | BigQuery | By DesignAfter hours incident support | Occasional overtime | Occasional travel | Remote workSenior-level Full TimeOak Brook, IL, United States R1d ago
-
AI & Machine Learning Teaching Expert (Part-time) USD 100K-200KA/B | A/B Testing | Agentic Systems | Artificial Intelligence | B testingFlexible schedule | Fully remote | Professional autonomy | Use of collaboration tools Notion Slack ZoomSenior-level Part TimeBoston, US R1d ago
-
APIs | AWS | Agentic AI | Azure | Claude401k | Dental insurance | Fully remote US based | Generous PTO | HolidaysSenior-level Full TimeRemote USA, United States R2d ago
-
Senior AI Engineer USD 155K-175KAWS | Agile | Azure | Computer Vision | GitCareer development | High responsibility | Remote workSenior-level Full TimeJersey City, New Jersey, United States R2d ago
-
Senior Applied AI Engineer USD 205K-238KAgentic Methodologies | Agentic Workflows | Deep learning | Fine Tuning | Generative AIFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R2d ago
-
Architect MLE USD 160K-201KAKS | AWS | Arize AI | Asynchronous programming | AzureCareer development | Flexible work environment | Learning and growthSenior-level Full TimeUSA - Remote, United States R2d ago
-
Software Engineer, AI/ML USD 102K-160KAWS | AWS Bedrock | Azure | Azure OpenAI | C#401k matching | Disability insurance | Employee ownership | Growth opportunities | Health insuranceSenior-level Full TimeUSA-GA-Office-Atlanta, United States R2d ago
-
Senior MLOps & Generative AI Engineer - Remote USD 91K-152KAI Evaluation | APIs | AWS | Alerting | AzureAdoption reimbursement | Emergency backup care | Family caregiver leave | Fertility reimbursement | Medical, dental, vision plansSenior-level Full TimeCorp Facilities MPB - 350 Centre … R2d ago
-
Sr. AI/ML Engineer- Life Sciences USD 78K-156KAgile | Artificial neural networks | Computer Vision | Data Mining | Deep learningSenior-level Full TimeUnited States - California : Remote, … R2d ago
-
Sr. AI/ML Engineer - Life Science USD 99K-198KAgile | Artificial neural networks | Computer Vision | Data Mining | Deep learningSenior-level Full TimeUnited States - California : Remote, … R2d ago
-
Lead AI Engineer - Remote USD 145K-249KAWS Bedrock | Agent Orchestration | Agentic AI | Docker | FastAPI401k contribution | Comprehensive benefits package | Remote work within the United StatesSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R2d ago
-
Embedded Robotics Engineer USD 125K-145KC++ | Concurrent programming | Control | Debugging | GazeboSenior-level Full TimeUnited States - Remote R2d ago
-
Sr. AI/ML Engineer - Life Science USD 99K-198KAgile | Artificial Intelligence | Artificial neural networks | Computer Vision | Data MiningSenior-level Full TimeUnited States - California : Remote, … R2d ago
-
Sr. AI/ML Engineer- Life Sciences USD 78K-156KArtificial neural networks | Computer Vision | Deep learning | Image Processing | Language ModelsAgile environment | Knowledge Base Development | Mentorship | Training resourcesSenior-level Full TimeUnited States - California : Remote, … R2d ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R2d ago
-
Staff Software Engineer (Tech Lead) USD 180K-230KBigQuery | Cloud Run | Cloud platform | Distributed Systems | Docker401k company match | Flexible PTO | GitHub | Health savings account | Hybrid workSenior-level Full TimeUnited States - Remote R2d ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agile | Algorithms | C++ | CI/CDHybrid remote workSenior-level Full TimeWoburn, MA R2d ago