Machine Learning Lead Engineer
Atlanta, GA - 6305 Peachtree Dunwoody Rd Bldg B, United States
R
USD 134K-224K Senior-level Full Time
Tasks
- Benchmark open source and hosted models for quality cost and latency
- Build ML infrastructure monitoring and documentation
- Build evaluation systems using GenAI Eval Framework
- Build synthetic conversations for agent testing
- Calibrate LLM as judge using human baselines
- Coach teams on AI adoption and lead AI transformation
- Curate golden datasets with human labels
- Deploy models for training inference and production
- Design agent based workflows for training data pipelines and analysis
- Design build and maintain ML models algorithms and pipelines
- Fine tune and quantize models for task and hardware constraints
- Own model selection strategy for agentic AI
- Partner with legal and compliance for AI regulations
- Run evaluation comparisons before and after prompt or model change
- Select open source models for deployment
- Set AI governance policy including bias checks compliance tracking and audit trails
- Set standards for model testing and rollout
- Trace drift root cause for agent quality changes
- Track model cost across projects and report spend to leadership
Perks/Benefits
- Additional paid time off options
- Hybrid remote work
- Paid Holidays
- Paid vacation
- Paid wellness time
- Pre employment drug test required
Skills/Tech-stack
AI ethics | AWS AgentSquad | AWS Strands | Agent Frameworks | Audit trails | Benchmarking | Bias detection | Compliance tracking | Computer Vision | Deep learning | Fine Tuning | Generative AI | Inference | LLM | LLM-as-judge | Langchain | Machine Learning | Model Evaluation | Model Governance | Model Monitoring | Model Serving | Open Source | Open-source Models | Prompt engineering | Quantization | Responsible AI | Synthetic data
Education
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R3d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R16d ago
-
Principal Data Engineer USD 180K-220KAWS | Apache Airflow | Artificial Intelligence | CI/CD | Confluence401k | Autonomy | Company paid life insurance | Disability coverage | FSASenior-level Full TimeRemote - US, Canada and Poland R1d ago
-
API Design | Agent Optimization | Agent systems | Atomic operations | Caching401k plan | Calm app access | Disability insurance | In Home Office Setup Support | Internet stipendSenior-level Full TimeUnited States and Canada - Remote … R2d ago
-
Data Analytics USD 130K-170KA/B | A/B Testing | AI | B testing | Credit Risk401k match | Flexible time off | Growth opportunities | Health benefits | Remote-friendlyMid-level Full TimeUnited States (Remote) R2d ago
-
Forward Deployed ML/AI Engineer USD 167K-200KAWS | Azure | CI/CD | Databricks | DockerAnnual company retreat | Company winter break | Education bonus | High-performance culture | Optional in person events and meetupsSenior-level Full TimeUnited States R2d ago
-
AI Solutions Engineer USD 127K-204KAPI Integrations | Anthropic Claude | Benefit Analysis | Change Management | Cost BenefitCareer development | Distributed team collaboration | Learning opportunities | Work from anywhereMid-level Full TimeCanada R2d ago
-
AI Specialist USD 182K-295KAgent systems | AgentCore) | Agentbuilder | Architecture Diagrams | Automated EvaluationDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R2d ago
-
Principal AI Engineer USD 167K-250KAzure | CI/CD | Context Management | Docker | Embedding401k employer matching | Charitable matching program | Community outreach groups | Dental insurance | Flexible paid time offSenior-level Full TimeGilbert, AZ, US R2d ago
-
AI Engineer USD 125K-171KAngular | Apache Kafka | Azure | CI/CD | Context Management401k matching | Charitable matching program | Dental insurance | Life insurance | Medical insuranceMid-level Full TimeLeawood, KS, US R2d ago
-
AWS | Artificial Intelligence | BigQuery | Cloud platform | Computer VisionEquity incentives | Flexible time off | Fully remote | Healthcare coverage | Professional developmentSenior-level Full TimeCanada R3d ago
-
Machine Learning Engineer USD 120K-150KBERT | CI/CD | Document parsing | Embeddings | Fine Tuning401k matching | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountMid-level Full TimeRemote (United States) R3d ago
-
AI Engineer - AI/ML USD 98K-176KAWS | Access Control | Agentic Workflows | Agile | AuditabilityCareer development | Comprehensive benefits | Inclusion culture | TelecommuteMid-level Full TimeMinnetonka, Minnesota, UNITED STATES; REMOTE R3d ago
-
Senior-level Full TimeUnited States - Remote R3d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labelingMid-level Full TimeUnited States - Remote R3d ago
-
Mid-level Full TimeUnited States - Remote R3d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Attention Optimization | Dataset curation | Direct Preference Optimization | Evaluation methodology100% remote | Benefits package | Full-time W2 employment | Long term multi year engagementMid-level Full TimeUnited States - Remote R3d ago
-
Prompt Engineer USD 100K-150KAgentic Workflows | Chunking | Embeddings | Evaluation | IndexingBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R3d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Computer Vision | Concurrent programming | Critical softwareMid-level Full TimeUnited States - Remote R3d ago
-
ML Platform Engineer USD 100K-150KAPI Gateway | Automated rollback | Autoscaling | C++ | CachingCareer growth | Direct W2 employment | H1B transfer support | Long-term employment | Remote workSenior-level Full TimeJersey City, NJ R3d ago
-
Senior Machine Learning Operations Engineer USD 135K-170KAWS SageMaker | Amazon Bedrock | Anthropic API | Batch Transform | CI/CD401k match | Commuter savings | Dental insurance | Disability insurance | Employee resource groupsSenior-level Full TimeNew Jersey, United States R3d ago
-
Agentic AI | Data Analysis | Feature Engineering | Generative AI | Machine LearningSenior-level Full TimeVirtual, United States R3d ago
-
AI/ML Engineer USD 97K-185KAWS | Amazon SageMaker | CI/CD | Docker | Drift DetectionCharitable giving employee match | Educational assistance | Emotional well-being support | Health care coverage | Learning resourcesSenior-level Full Time499 Washington Blvd., Jersey City NJ, … R3d ago
-
Applied AI Engineer - Federal (TS Required) USD 170K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25 percent | Federal clearance supportMid-level Full TimeUnited States (Remote); Washington, D.C. (Remote) R3d ago
-
Staff Software Engineer - Data Platform USD 166K-232KAirflow | Automated testing | BigQuery | CI/CD | Cloud platformDental insurance | Flexible time off | In-office workspace | LinkedIn Learning access | Medical insuranceSenior-level Full TimeUnited States (Remote) R3d ago