Machine Learning Infrastructure Engineer
Tasks
- Build request routing and batching systems
- Configure autoscaling for model serving
- Design inference platforms
- Implement caching strategies
- Implement end-to-end observability
- Operate high throughput low latency services
- Optimize GPU utilization
- Perform performance engineering and capacity planning
- Respond to production incidents
Perks/Benefits
- N/A
Skills/Tech-stack
Autoscaling | C++ | Capacity Planning | Distributed Systems | FinOps | GPU Architecture | GPU memory | Go | Kubernetes | Metrics | Model Compression | Model Distillation | Model Quantization | Observability | Performance Engineering | Python | Rust | Structured Logging | TensorRT-LLM | Tracing | VLLM
Education
Related jobs
-
Senior Machine Learning Engineer, Vehicle Perception USD 140K-230KAblation Studies | C plus plus | Cloud Computing | Computer Vision | Data CurationComprehensive benefits package | Hybrid work schedule | Incentive programsSenior-level Full TimePalo Alto, CA R11h ago
-
Senior Analytics Engineer USD 141K-176KAWS Glue | Amazon Athena | Apache Hive | Apache Spark | CI/CDGenerous time off | Healthcare | Occasional travel for in person meetings | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R11h ago
-
AI Engineer (Remote) USD 169K-230KAWS | Agent systems | Application development | Automation | Azure401k plan | Accident insurance | Dental insurance | Disability insurance | Flexible spending accountExecutive-level Full TimeFort Washington, PA, United States R15h ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Machine Learning | CI/CDRemote | USC OnlySenior-level Full TimeDallas, TX. R16h ago
-
ABAC | AWS CloudFormation | AWS Lambda | AWS Step Functions | AWS-APIsOnsite/hybrid workSenior-level Full TimeChantilly, Virginia R16h ago
-
Senior Site Reliability Engineer USD 168K-200KAWS | Alerting | Amazon S3 | Apache Kafka | AutoscalingSenior-level Full TimeRemote - United States R16h ago
-
Senior Machine Learning Engineer USD 216K-303KAd Ranking | Convolutional Neural Networks | Data Pipelines | Deep learning | Feature Engineering401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Health care benefitsSenior-level Full TimeRemote - United States R17h ago
-
AI Developer Builder USD 140K-180KAWS | Agentic Systems | Anthropic Bedrock | Context pipelines | DatadogDirect input on roadmap | High ownershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R19h ago
-
Cloud Service Security Platform DevOps & Maintenance USD 130K-225KAWS | Ansible | Azure | CI/CD | DNSSenior-level Full TimeSan Jose, CA / Austin, TX-%LABEL … R1d ago
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R1d ago
-
Senior Machine Learning Engineer, Ads ML Platform USD 216K-303KAnomaly Detection | Data Governance | Data Infrastructure | Data Lineage | Data Storage401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible remote workSenior-level Full TimeRemote - United States R1d ago
-
Sr. Platform Engineer, Kubernetes USD 117K-200KAWS EKS | Alluxio | Amazon S3 | Ansible | Apache FlyteEmployee benefits | Onsite collaboration flexible remote optionSenior-level Full TimePA - West Chester, 1354 Boot … R1d ago
-
Sr. Data Engineer - GM Motorsports USD 138K-211KAWS | Agile | Azure | Confluent | DatabricksHybrid work | Relocation benefitsSenior-level Full TimeAustin Technical Center - Austin Technical … R1d ago
-
AI/ML Computer Science Research and Development Engineer USD 121K-231KAdversarial Machine Learning | Benchmarking | Computer Vision | Convolutional Neural Networks | Data PreprocessingSenior-level Full TimePenn State University Park, United States R1d ago
-
AWS RDS | Apache Airflow | Aurora | Azure Database | BigQuerySenior-level Full TimePenn State University Park, United States R1d ago
-
Mid-level Full TimeRemote (TX), United States R1d ago
-
Data Analysis | Electromagnetics | MATLAB | Multiphysics Modeling | Numerical SimulationHealth insurance | Paid time off | Retirement plan | Tuition discountNone Full TimePenn State University Park, United States R1d ago
-
Senior HPC and Quantum Systems Engineer USD 184K-287KAPIs | AWS Braket | C plus plus | CUDA-Q | CalibrationSenior-level Full TimeUS, MA, Westford R1d ago
-
Data Engineer USD 130K-180KAPI | BigQuery | CI/CD | GraphQL | JavaFlexible schedule | Travel opportunitiesSenior-level Full TimeUS-Remote, United States R1d ago
-
Mid-level Full TimeNYC - 1211 Ave of the … R1d ago
-
Senior Machine Learning Engineer USD 168K-210KApache Beam | Apache Flink | C++ | Dataflow | Distributed TrainingHybrid work environmentSenior-level Full TimeUnited States - New York, United … R1d ago
-
AWS | Azure | Cassandra | Communication | Data Governance401k | Dental insurance | Hybrid work schedule | Life insurance | Medical insuranceEntry-level Full TimeCT, Bloomfield, 900 Cottage Grove Rd … R1d ago
-
AI/ML Engineer, Senior USD 99K-225KAPIs | Automation | Cloud Computing | Computer Vision | Data PipelinesDependent care | Health insurance | Paid leave | Professional development | Tuition assistanceSenior-level Full TimeUSA, VA, Alexandria (6361 Walker Ln), … R1d ago
-
AI Developer USD 77K-176KAPI Development | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Health insurance | Paid leave | Professional development | Remote or hybrid work optionsMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
AI Developer USD 77K-176KAsynchronous Messaging | Audit Logging | Automated testing | CI/CD | ContainerizationDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago