ML Performance Engineer
Tasks
- Build benchmark suites and regression frameworks
- Document performance tuning playbooks and share findings
- Drive compiler level optimizations for measurable end to end performance gains
- Embed best practices in standard ML pipelines
- Evaluate new hardware and software offerings
- Identify and eliminate bottlenecks in data loading model compute communication and memory
- Implement and tune quantization sparsity and pruning for faster inference
- Improve cost efficiency through model architecture hardware selection and scheduling
- Optimize AI training and inference pipelines for throughput latency and cost
- Optimize KV cache continuous batching and speculative decoding for LLM serving
- Optimize data pipelines sharding strategies and storage access patterns
- Optimize distributed training using tensor parallelism pipeline parallelism and sharding
- Tune attention implementations for efficiency
Perks/Benefits
Skills/Tech-stack
Benchmarking | C++ | Compiler optimization | Continuous batching | Deep learning | Distributed Training | FSDP | FlashAttention | GPU Architecture | KV cache | Memory Management | Model Parallelism | Paged Attention | Pipeline parallelism | Profiling | Pruning | Python | Quantization | Quantization aware training | Regression testing | Sparsity | Speculative decoding | TVM | Tensor Parallelism | TorchInductor | Triton | XLA | Zero
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
ABAC | AWS CloudFormation | AWS Lambda | AWS Step Functions | AWS-APIsOnsite/hybrid workSenior-level Full TimeChantilly, Virginia R2h ago
-
AI Developer Builder USD 140K-180KAWS | Agentic Systems | Anthropic Bedrock | Context pipelines | DatadogDirect input on roadmap | High ownershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R5h ago
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R14h ago
-
Senior Software Engineer - Storage Control Plane USD 266K-395KBlock Storage | C# | C++ | CI/CD | CephSenior-level Full TimeSan Francisco Office (Fremont St) R19h ago
-
A/B | A/B Testing | B testing | Data parallelism | Deep learning401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefit programsSenior-level Full TimeRemote - United States R19h ago
-
A/B | A/B Testing | B testing | C++ | Cloud Computing401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefitsSenior-level Full TimeRemote - United States R19h ago
-
Applied AI/ML Engineer USD 150K-200KAPI Integration | Anomaly Detection | Apache Spark | CI/CD | Cloud Platforms401k match | Comprehensive benefits package | Flexible PTO | Paid Holidays | Remote workMid-level Full TimeWashington DC area R20h ago
-
Finance & Strategy AI Engineer USD 146K-246KAPI Integration | Adaptive Planning | Agentic Workflows | BigQuery | Data GovernanceFlexible remote work | Health benefits | Parental leave | Professional development stipendSenior-level Full TimeSan Francisco - SF9 R20h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-170KArgoCD | CSI | Cluster API | Flux | GitOpsCompany outings and happy hours | Conferences and working groups | Hackathons and tech talks | Professional development and trainingSenior-level Full TimeRemote, USA, United States R21h ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid work environment | Remote work optionMid-level Full TimeArlington, VA R21h ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDFlexible work schedule | Hybrid work environment | Remote work availableMid-level Full TimeWoburn, MA R21h ago
-
Forward Deployed Engineer USD 280K-320KAgent Development | Deployment | Evaluation | JavaScript | Language ModelsFlexible working hours | Generous vacation | Parental leave | Visa sponsorshipMid-level Full TimeNew York City, NY; San Francisco, … R22h ago
-
Software Engineer, Embedded Agentic AI USD 170K-210KC# | C++ | Cloud Platforms | Containerization | DockerDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offEntry-level Full TimeSan Jose, California R22h ago
-
Senior Software Engineer, Data Platform USD 196K-245KAirflow | BigQuery | Cost Optimization | Dagster | Data GovernanceBenefits | Equity | Relocation assistanceSenior-level Full TimeSan Francisco Bay Area or Remote … R22h ago
-
Senior Research Engineer, LLM Training & Post-Training USD 165K-310KCUDA | DPO | DeepSpeed | Distributed Training | Experiment design401k matching | Company holidays | Comprehensive health coverage | Dental coverage | Flexible time offSenior-level Full TimeNew York, New York, United States; … R22h ago
-
AWS | Agile | Application Security | Azure | Azure DevOps401k match | Educational assistance | Employee assistance program | Employer subsidized medical dental vision and life insurance | Flexible spending accountsMid-level Full TimePhoenix, AZ, United States R23h ago
-
Robotics Test Engineer USD 140K-170KAQL | Accelerated life testing | Build Management | CAD | Cause analysis100 percent employer paid healthcare | 401k employer matching | Annual professional development stipend | Complimentary dinner while working late | Complimentary recovery sessions for self friends and familySenior-level Full TimeNYC/Metro Area R1d ago
-
Senior Software Development Engineer - Iris AI USD 130K-162K.NET | API Design | Amazon Bedrock | Anthropic API | Asynchronous ArchitectureEmployee assistance program | Health insurance | Life insurance | Paid Company Holidays | Paid time offSenior-level Full TimeU.S. Remote R1d ago
-
Specialist Solutions Architect - Data Engineering & Warehousing (Digital Native Business) USD 180K-247KAWS | Anomaly Detection | Apache Spark | Cloud platform | Data ModelingContinuous learning | Mentorship | Remote work | Travel up to 30 percentSenior-level Full TimeUnited States R1d ago
-
Enterprise Applied AI Solution Specialist USD 90K-130KAPI Integration | Agent Frameworks | Conversational Design | Data Governance | Function CallingMid-level Full TimeWeston,FL,United States R1d ago
-
Senior AI Data Engineer USD 118K-178KAI Agent | BigQuery | CRM | Customer Data | Customer Data PlatformFlexible working model | Health insurance | Parental leave | Professional development stipend | Remote workSenior-level Full TimeRemote - US R1d ago
-
Argo CD | Big Data | Concurrency | Distributed Systems | Fine TuningEntry-level Full TimeAustin R1d ago
-
Machine Learning Data Scientist, Forecasting USD 230K-385KBayesian Methods | Causal Inference | Experimentation | Machine Learning | Model MonitoringHybrid work model | Relocation assistanceSenior-level Full TimeSan Francisco R1d ago
-
Data Engineer I - Salesforce Data 360 USD 87K-123KAPIs | Access Controls | Data Governance | Data Lineage | Data Modeling401k match | Career growth and development programs | Comprehensive onboarding | Conference participation | Employee resource groupsMid-level Full TimeMorrisville, North Carolina (NC), United States R1d ago
-
Lead Business Operations Data Engineer - 928 USD 158K-200KAirflow | Alerting | Azure Data | Azure Data Factory | DBTHybrid work | Remote work up to 2 days per week with approvalSenior-level Full TimeUS Broomfield, CO R1d ago