Software Engineer, Machine Learning Infrastructure - Gen AI
Tasks
- Build GenAI infrastructure for prototype to production
- Build open weights model serving and batch inference pipelines
- Build reliable production APIs and data pipelines for AI systems
- Create guardrails and cost attribution systems
- Design scalable systems for AI agent orchestration and tool execution
- Develop LLM gateway and agent gateway services
- Ensure latency scale observability SLOs and incident response readiness
- Implement evaluation workflows and model monitoring
Perks/Benefits
- 11 paid holidays
- 401k employer matching
- Basic life insurance
- Commuter benefits match
- Disability insurance
- Medical, dental, vision benefits
- Mental health program
- Paid parental leave
- Paid sick leave
- Paid time off
- Wellness benefits
Skills/Tech-stack
APIs | AWS | Batch inference | Data Pipelines | Distributed Systems | Evaluation | GCP | Kubernetes | LLM Gateway | Machine Learning | Model Serving | Observability | Python | RAG | Retrieval-Augmented Generation | Tracing | Vector Databases | Vector Search
Education
Regions
Countries
States
Related jobs
-
Data Analytics Engineer - Boulder, Colorado USD 100K-120KDBT | Data Modeling | Data Pipelines | Data Quality | Data Troubleshooting401k matching | Annual learning budget | Health coverage | Life insurance | Paid vacationMid-level Full TimeBoulder, Colorado, United States3h ago
-
Principal AI Platform Engineer USD 104K-166KAPIs | Access Control | Audit trails | Data Engineering | Data GovernanceSenior-level Full TimeSan Francisco, CA7h ago
-
Distinguished Machine Learning Engineer - Safety USD 399K-457KComputer Vision | Data Architecture | Data Processing | Distributed Systems | Language ModelsEquity compensation | Onsite work schedule | Workplace inclusion cultureSenior-level Full TimeSan Mateo, CA, United States R8h ago
-
AI Engineer USD 165K-240KAPI Design | AWS | Agentic Workflows | Asynchronous processing | BM25401k enrollment | Gym membership stipend | Health coverage | Hybrid work environment | Paid HolidaysSenior-level Full TimeNew York9h ago
-
Senior Embedded Software Engineer (C++) USD 141K-224KAutomated testing | C++ | CI/CD | CMake | Computer VisionCompany holidays | Health insurance | Life insurance | Long-term disability | Paid parental leaveSenior-level Full TimeTorrance, California, United States10h ago
-
AWS | AWS CDK | AWS Glue | Airflow | Athena401k | Health insurance | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R10h ago
-
Compression | Computer Vision | CoreML | Data Curation | Dense PredictionCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation and personal days | Global employee assistance programSenior-level Full TimeSan Francisco, CA, USA10h ago
-
Senior Machine Learning Engineer USD 130K-160KData Pipelines | Deep learning | Distributed Training | Experimentation | Feature Engineering401k plan | Company paid life insurance | Company-Provided Technology Package | Health savings account | Hybrid workSenior-level Full TimeSan Francisco R11h ago
-
Senior Data Engineer - AI USD 147K-198KAmazon Kinesis | Amazon Redshift | Apache Airflow | Apache Flink | Apache IcebergHybrid work model | Onsite two days per weekSenior-level Full TimePennsylvania-Remote, United States R11h ago
-
Data Infrastructure Engineer (contract) USD 126K-136KAlways On | Always On Availability | Always On Availability Groups | Availability Groups | CentOSMid-level ContractMountain View, CA11h ago
-
Senior AI Integrations Engineer USD 115K-173KC# | C++ | CPU caches | Compression | Data-Oriented ProgrammingCommute subsidy | Comprehensive health life and disability insurance | Employee resource groups | Employee stock ownership | Generous vacation and personal daysSenior-level Full TimeRemote, Washington, USA R11h ago
-
Senior AI Integrations Engineer USD 115K-173KAI | C# | C++ | Compression | DebuggingCommute subsidy | Employee assistance program | Employee resource groups | Employee stock ownership | Generous vacation and personal daysSenior-level Full TimeSan Francisco, CA, USA11h ago
-
Senior Software Engineer - Data Clean Room/ AI Data Hub USD 200K-287KAI/ML | Cloud Computing | Data Privacy | Database systems | Developer APIsSenior-level Full TimeUS-WA-Bellevue11h ago
-
Senior AI Engineer - Customer Agent USD 148K-222KAWS | Alembic | Amazon SQS | Apache Spark | Asynchronous processingSenior-level Full TimeBoston, MA12h ago
-
Sr. Lead AI Engineer USD 216K-324KAWS | Alembic | CI/CD | Celery | DjangoCross hub collaboration | Health and wellbeing benefits | Hybrid work 3x/week | Mentorship | Professional developmentSenior-level Full TimeBoston, MA12h ago
-
Senior Lead AI Software Engineer USD 216K-324KAPI Development | Agentic Workflows | Agile | Alerting | Coding assistantsSenior-level Full TimeBoston, MA12h ago
-
Senior Machine Learning Engineer, Search Relevance USD 211K-263KA inverted indexes | A/B | A/B Testing | B testing | C++Senior-level Full TimeRedwood City, CA12h ago
-
Staff, Analytics Engineer USD 155K-228KCI/CD | Cause analysis | DBT | Data Modeling | Data ObservabilityHealthcare | Paid parental leave | Paid personal time off | Paid sick time | Paid time offSenior-level Full TimeRemote - US R12h ago
-
AI Solutions Engineer USD 106K-171KAPIs | Alteryx | Analytics | Automation | Content GenerationDiscretionary paid time off | Emotional & mental wellness support | Employee resource groups | Fitness programs | Learning and development programsMid-level Full TimeScottsdale, Arizona, United States R12h ago
-
Staff Software Engineer, Machine Learning (Health) USD 170K-230KAPIs | AWS | Batch Processing | CI/CD | Cloud platformSenior-level Full TimeBoston, MA13h ago
-
Senior Solution Engineer USD 165K-216KAI code generation | Analytics | Cloud Computing | Code generation | Data Architecture401k | Flexible PTO | Health, dental, vision insurance | Professional development budgetSenior-level Full TimeUS-NY-New York13h ago
-
Lead, Finance Analytics & Enablement AI/ML USD 140K-225KAmplitude | Automation | Business Intelligence | Cloud platform | Data Governance401k plan | Co-working access | Disability insurance | Employer paid dental | Employer paid visionSenior-level Full TimeBoston - Remote R13h ago
-
Lead, Finance Analytics & Enablement AI/ML USD 400K-500KAmplitude | Automation | Business Intelligence | Cloud platform | Data Engineering401k plan | Co-working space access | Disability insurance | Flex Spending Account | Health reimbursement accountSenior-level Full TimeNew York - Remote R13h ago
-
Senior AI/ML Engineer USD 125K-156KAWS | Access Control | Agent Orchestration | Apache Spark | CI/CD401k | Commuter benefits | Disability insurance | Employee referral program | Fertility care benefitsSenior-level Full TimeUS Remote R13h ago
-
Analytics Engineer (Remote) USD 104K-170KAWS | Apache Airflow | CI/CD | Containerization | Docker401k match | Flexible time off | Medical/Dental/Vision insurance | Paid Holidays | Remote work flexibilityMid-level Full TimeUnited States, UNITED STATES, United States R13h ago