Senior research Scientist - Machine Learning Systems & Efficiency Engineer
Tasks
- Advise research and product teams on efficiency tradeoffs
- Build benchmarking frameworks and dashboards
- Define best practices and mentor engineers
- Design and optimize high throughput low latency inference systems
- Design scalable distributed serving systems
- Develop and maintain high performance GPU kernels
- Establish efficiency metrics and cost per million inferences
- Implement resource scheduling and elastic workload management
- Implement serving strategies including batching and caching
- Improve GPU utilization with kernel fusion and async pipelines
- Optimize end to end inference system performance
- Optimize model architectures for deployment efficiency
- Profile performance to identify compute memory and communication bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
AllGather | AllReduce | Artificial Intelligence | Asynchronous pipelines | Benchmarking | C++ | CUDA | Computer Vision | Diffusion Transformers | Distributed inference | Docker | GPU Kernel | GPU Kernel Development | GPU Performance | GPU performance tuning | GPU pooling | Inference Serving | Kernel Fusion | Kernel development | Kubernetes | Linux | Machine Learning | Mixture of Experts | Model Distillation | Model Pruning | Model Quantization | Multimodal Models | NCCL | NVIDIA Nsight | ONNX Runtime | Performance Tuning | PyTorch Profiler | Python | Resource scheduling | Scheduling optimization | TensorRT | Transformers | Triton
Education
Related jobs
-
Applied AI Engineer - AI Solutions USD 172K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25% | Employee stock options | Hybrid work | Professional developmentMid-level Full TimeNew York City, NY (Hybrid); Redwood … R14h ago
-
Product Analytics Engineer USD 130K-140KA/B | A/B Testing | Airflow | B testing | DBT401k retirement savings plan | Employer-sponsored healthcare | Flexible spending account | Health savings account | Paid parental leaveSenior-level Full TimeRemote, USA R19h ago
-
Principal Data Scientist USD 126K-255KAWS Bedrock | AWS Kinesis | AWS SageMaker | Amazon Athena | Apache KafkaEducational assistance | Health care coverage | Learning resources | Paid time off | Parental leaveSenior-level Full Time245 Summer St, Boston MA, United … R19h ago
-
Senior Manager-Data Science USD 123K-215KClickstream analytics | Clustering | Data Pipelines | Decision Trees | ExperimentationCareer development and training opportunities | Company retirement match | Confidential counseling support | Financial coaching | Flexible working modelSenior-level Full TimeNew York, NY, United States R20h ago
-
Sr. Data Engineer (Remote) USD 163K-192KAccess Control | Amazon Web Services | Apache Iceberg | Apache Kafka | Apache Spark401k plan | Dental insurance | Disability insurance | Employee assistance program | FSA/HSASenior-level Full TimeRemote - United States R21h ago
-
AWS | Agent Orchestration | CI/CD | Cloud platform | Databricks401k match | Counseling membership | Employer subsidized medical dental and vision | Flexible time away program | Life insuranceMid-level Full Time-REMOTE, USA- R21h ago
-
AI Engineer, Ecosystem USD 171K-240KAPI Integration | Access Management | Audit Logging | Authentication | AuthorizationHybrid work | Remote work up to 4 weeks per yearMid-level Full TimeSan Francisco, California, United States R22h ago
-
Forward Deployed AI Solutions Engineer USD 95K-145KAPIs | Agentic Workflows | Audit Logging | Cloud Computing | Command Line401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingMid-level Full TimeUS Remote R22h ago
-
Staff Analytics Engineer USD 159K-187KClaude | Claude Code | DBT | Data Contracts | Data Modeling401k company match | Accident insurance | Company funded HSA contributions | Critical illness insurance | Health, dental, vision coverageSenior-level Full TimeRemote (United States) R22h ago
-
AI Engineer, Product USD 171K-240KA/B | A/B Testing | API Design | B testing | Data ModelingHybrid work | Remote work up to four weeks per yearMid-level Full TimeSan Francisco, California, United States R22h ago
-
Senior Machine Learning Engineer, Shield USD 211K-263KAnomaly Detection | Apache Spark | Behavior analytics | BigQuery | Cloud DataflowSenior-level Full TimeRedwood City, CA, United States R23h ago
-
Senior Data Engineer USD 150K-175KAPI Development | AWS | Agile | Apache Airflow | Apache SparkHybrid/Remote flexibilitySenior-level Full TimeHerndon, VA R23h ago
-
Staff AI Engineer - Grafana AI/ML | USA | Remote USD 174K-220KAWS | Azure | Cloud platform | Docker | Generative AIAnnual leave | Bonus | Equity | RSUs | Remote workSenior-level Full TimeUnited States (Remote) R1d ago
-
Senior AI Engineer - Grafana AI/ML | USA | Remote USD 127K-203KAWS | Agent Frameworks | Agent workflows | Cloud Computing | Cloud platformBonus | Equity | Global annual leave policy | Remote workSenior-level Full TimeUnited States (Remote) R1d ago
-
Analytics Engineer USD 152K-179KAutomation | DBT | Data Contracts | Data Modeling | Data PipelinesQuarterly in person surges | Remote-firstMid-level Full TimeRemote - USA R1d ago
-
Member of Technical Staff USD 324K-396KAmazon Web Services | Apache Spark | Azure | BigQuery | C plus plusTelecommuting permittedSenior-level Full TimePalo Alto, CA R1d ago
-
AI-ML Engineer - Finance-Hybrid USD 130K-210KCI/CD | Cloud infrastructure | Computer Vision | Data Engineering | Data ScienceContinuing education | FSA | HSA | Health, dental, vision insurance | Hybrid workSenior-level Full TimeRochester, MN, United States R1d ago
-
Staff Forward Deployed AI Solutions Engineer USD 136K-209KAPI | Access Control | Authentication | Automation | CLI401k benefits | Baby bonding leave | Commuter benefits | Employee referral program | Fertility care benefitsSenior-level Full TimeUS Remote R1d ago
-
Sr. Data Engineer USD 100K-150KAirflow | Amazon QuickSight | Apache Flink | Apache Iceberg | Apache Spark401k match | Dental insurance | Flex remote days | Health insurance | Life insuranceSenior-level Full TimeChicago or Remote* R1d ago
-
Data Engineer 1 USD 107K-150KApache Beam | Apache Kafka | Cloud platform | Dataflow | GeminiExpensed lunches | Gym reimbursement | Learning and development opportunities | Virtual events | Wellness perksSenior-level Full TimeRemote in the United States R1d ago
-
Entry-level Full TimeRemote, United States R1d ago
-
Senior Applied AI Engineer USD 191K-250KAWS SageMaker | Amazon Bedrock | Azure Machine Learning | CI/CD | Cloud platform401k retirement savings plan | Annual cash bonus | Equity grants | Flexible time off | Generous parental leaveSenior-level Full TimeRemote, USA R1d ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS Glue | AWS Redshift | Amazon Web Services | Azure Data | Azure Data Factory401k plan | Bereavement | Employee assistance program | Employee discount program | Health dental vision careSenior-level Full TimeRemote - Nationwide, United States R1d ago
-
Lead Data Scientist USD 160K-220KAWS | Cloud Computing | Credit Risk | Credit risk modeling | Databricks401k match | Charitable donation match | Commuter benefits | Flexible time off | Flexible work arrangementSenior-level Full TimeRemote - United States R1d ago
-
Senior Staff Software Engineer - Data Platform USD 200K-250KAWS IAM | Amazon EMR | Amazon Glue | Amazon S3 | Apache AirflowAnnual development dollars | Coaching and legal advice | Employee stock purchase program | Flexible time off | Free therapy sessionsSenior-level Full TimeRemote, USA R1d ago