Software Engineer, Applied AI Infrastructure
Tasks
- Automate training experiment orchestration
- Build closed loop evaluation layer
- Build inference serving monitoring and observability
- Create model evaluation and regression detection
- Design isolation and permissioning model
- Develop agent orchestration sandboxing and isolation
- Implement agent autoresearch loop
- Integrate tool and skill frameworks with gateways
Perks/Benefits
- N/A
Skills/Tech-stack
Attention | Batching | CI Failure Attribution | Cloud infrastructure | Context handling | Data Pipelines | Deep learning | Distillation | Distributed Systems | Evaluation Pipelines | Experiment orchestration | Failure Attribution | Fine Tuning | Gateway Layers | Hyperparameter Tuning | Identity and Permissioning | Inference Serving | Isolation | KV cache | Knowledge Retrieval | LLM Inference | Language Models | Large Language Models | Machine Learning | Memory | Model routing | Observability | Orchestration | Preference optimization | Prefix caching | Python | Quantization | Queuing | Regression Detection | Reinforcement Learning | Retrieval-Augmented Generation | Sandboxing | Scheduling | Security isolation | Service Design | Speculative decoding | Storage | Supervised Fine Tuning | Tokenization | Tool use | Triage
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Regions
Countries
States
Related jobs
-
Analytics Engineer USD 110K-120KAmazon Redshift | BigQuery | Data Modeling | Data Pipelines | DatabricksCareer progression | Cross-functional collaboration | Equity | Remote-first workMid-level Full TimeRemote, United States R9h ago
-
AI Native Engineer USD 130K-240KAI Agents | API Integration | Anthropic | Backend Development | Cloud infrastructureFlexible independent work | In person working sessionsMid-level Full TimeNew York, NY9h ago
-
Telemetry Data Engineer USD 110K-128KAnomaly Detection | Azure Data | Azure Data Explorer | Data Engineering | Data Explorer401k retirement plan | Medical/Dental/VisionMid-level ContractRedmond, Washington, USA R10h ago
-
ETL Data Engineer W2 Hiring. USD 111K-150KAPIs | Access Control | Agile | Data Governance | Data ModelingSenior-level Contract Full TimeColumbus, OH, United States10h ago
-
Automated testing | Build Automation | C++ | CI/CD | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractDallas, Texas, USA R11h ago
-
AWS | AWS EC2 | Automation | Azure | Azure Virtual401k match | ESPP | Family leave programs | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R11h ago
-
Senior AI Engineer USD 144K-236KA/B | A/B Testing | B testing | Classification | Data MiningFlexible work arrangement | Health and wellness programs | Time off for employeesSenior-level Full TimeMountain View, CA, United States R11h ago
-
Staff AI Engineer USD 175K-287KA/B | A/B Testing | B testing | Classification | Data MiningHealth and wellness programs | Hybrid work | Mentorship | Time offSenior-level Full TimeMountain View, CA, United States R11h ago
-
AWS | Azure | CI/CD | Cloud platform | Containers401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R11h ago
-
Staff AI Engineer USD 198K-260KAgentic Workflows | Containerization | Docker | Experiment design | Generative AI401k plan participation | Annual performance bonuses | Company equity grants | Disability insurance | Life insuranceSenior-level Full TimeNew York, New York, United States R12h ago
-
Automated testing | C++ | CI/CD | Embedded Linux | Firmware401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractTampa, Florida, USA R12h ago
-
Automated testing | C++ | CI/CD | Firmware Build | Firmware Testing401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractAtlanta, Georgia, USA R12h ago
-
Software Engineer, ML Inference Platform USD 160K-240KC++ | Compilers | Data Pipelines | Distributed Systems | Hardware accelerationSenior-level Full TimeMountain View, California (HQ)12h ago
-
Senior/Staff Software Engineer, ML Inference Platform USD 193K-352KC++ | Compiler | Continuous Testing | Data pipeline | Distributed SystemsSenior-level Full TimeMountain View, California (HQ)12h ago
-
Machine Learning Engineer, II - 3D Perception USD 153K-183K3D Perception | BEV Representations | Birds Eye View | C++ | Cloud processing100 percent paid medical dental and vision | 401k employer match | Accidental death and dismemberment insurance | Company holiday office closures | Life insuranceMid-level Full TimeRemote, U.S, Ann Arbor, MI, Fort … R13h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KApache Hive | Microstrategy | MySQL | Oracle | Python401k | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States13h ago
-
Data Scientist – AI & Predictive Analytics USD 106K-142KData analytics | Hadoop | Hive | Machine Learning | NoSQL401k matching | Employee assistance program | Flexible spending account | Health insurance | Health savings accountEntry-level Full TimeSan Jose, CA, United States13h ago
-
Software Engineer, AI & Security USD 140K-265KAI Security | AI model | Data Pipelines | Distributed Systems | Golang401k matching | Dental | Education stipend | Healthy lunches | Home office stipendMid-level Full TimeMountain View, CA R14h ago
-
A/B | A/B Testing | B testing | CSAT | ChatbotRemote workMid-level Full TimeOak Brook, IL, United States14h ago
-
Lead AI Engineer USD 180K-280KAWS SageMaker | Azure ML | CI/CD | Cloud Computing | ColBERT401K retirement with match | Bonus eligibility | Childcare benefits | Gym access | Health Dental Vision Life Disability CoverageSenior-level Full TimeQuincy, MA, United States14h ago
-
Senior Cloud Data Ops Engineer USD 140K-180KAWS RDS | Amazon Aurora | Bash | BigQuery | CI/CD401k match | Childcare benefits | Gym access | Insurance coverage | Paid on-call rotationsSenior-level Full TimeQuincy, MA, United States14h ago
-
Data Analytics Engineer USD 139K-230KAWS | Azure | Azure Data | Azure Data Lake | Cloud platformDEI initiatives | Medical/Dental/Vision | Mental health support | Retirement plans | Rewards and recognitionSenior-level Full TimeRemote, United States14h ago
-
Data Engineer USD 126K-208KAPI Integration | AWS | Airflow | Azure | BigQueryDiversity, Equity, and Inclusion Initiatives | Employee rewards and recognition | Mental health support | Sustainability initiatives | Wellness programMid-level Full TimeRemote, United States14h ago
-
AWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon RedshiftCollaborative environment | Mentorship and growth | Mission-driven impactEntry-level Full TimeVaughan, Ontario; Remote, Canada; Remote, US … R15h ago
-
Amazon Web Services | Angular | Artificial Intelligence | Azure | CI/CDFlexible work from home | Onsite work 2 to 3 days per weekSenior-level Full TimeParamus, NJ, US15h ago