Senior AI Infrastructure Engineer, LLM/AI Platforms
Tasks
- Analyze GPU utilization and memory bottlenecks
- Apply quantization batching caching
- Architect data platforms for LLMs RAG and agentic systems
- Build evaluation frameworks for model performance accuracy reliability
- Collaborate to transform research prototypes into production services
- Deploy and optimize inference frameworks
- Develop production ready code with testing and maintainability
- Document architecture designs and communicate technical decisions
- Implement MLOps DataOps monitoring observability recovery
- Manage LLM model lifecycle versioning checkpointing reproducibility
- Mentor engineers and strengthen technical capabilities
- Model and normalize AI ML data and semantic catalogs
- Optimize LLM inference serving infrastructure
- Provision GPU clusters for LLM training
Perks/Benefits
- Competitive vacation and holidays
- Comprehensive wellness programs
- Employee networks
- Paid adoption leave
- Paid parental leave
- Professional development opportunities
- Remote work
- Volunteer opportunities
- World-class office amenities
Skills/Tech-stack
AWS | Airflow | Amazon SageMaker | Ansible | Batching | CUDA | Caching | Checkpointing | Cloud platform | Data Modeling | Data Normalization | DataOps | Distributed Training | Docker | GPU | Google Cloud | Google Cloud Platform | Google Vertex | Google Vertex AI | Inference Server | Infrastructure as Code | JAX | Kubernetes | LLM Inference | LLM Training | MLOps | MLflow | Megatron | Model Evaluation | Model versioning | Monitoring | NVIDIA | OCI | Observability | PyTorch | Python | Quantization | RAG | Ray | Reproducibility | Retrieval-Augmented Generation | Semantic Cataloging | Slurm | TPU | Terraform | Triton Inference | Triton Inference Server | VLLM | Vertex AI | Zero Touch | Zero Touch Recovery | “as-code”
Education
Related jobs
-
Senior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R5h ago
-
API Integration | APIs | Agent systems | Apache Spark | AutomationInternal talks | Learning platform | Remote days | Sports classes | Wellness benefitsEntry-level Full TimeBrooklyn, United States R10h ago
-
Manager, AI Engineering USD 219K-351KAI architecture | API Integration | Agentic Systems | Artificial Intelligence | AutomationIn-person onboarding | Remote work flexibilityMid-level Full TimeRemote - USA R16h ago
-
Senior Data Analytics Engineer USD 145K-206KAWS | CRM | DBT | Data Model | Data Modeling401k match | Disability insurance | Employee assistance program | Flexible spending account | Health Savings Account contributionSenior-level Full TimeBRIC, United States R20h ago
-
Agent systems | Enterprise Data | Fine Tuning | LLM Fine-tuning | Language ModelsRemote workSenior-level Full TimeAustin R1d ago
-
Product Data Architect - Evinova USD 65K-217KAuditability | CSV | Computerized System | Computerized System Validation | Data EngineeringHealth benefits | Paid Holidays | Paid leaves | Paid vacation | Qualified retirement planSenior-level Full TimeUS - Gaithersburg - MD, United … R1d ago
-
Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract to Hire | Irvine, CA (Hybrid) | A USD 147K-170KAWS RDS | Airflow | Amazon EMR | Amazon Redshift | Amazon Web ServicesContract-to-hire | Hybrid work | Mentorship opportunitiesSenior-level Full TimeIrvine, CA R2d ago
-
Data Engineer USD 99K-146KAirflow | Amazon Redshift | Amazon Web Services | Apache Kafka | Atlassian JiraMid-level Full TimeDearborn, MI, United States R2d ago
-
Technical Product Manager, AI Systems USD 195K-305KAlgorithms | Cost Optimization | Data Pipelines | Data Structures | Experiment designMid-level Full TimeUnited States R2d ago
-
Principal Machine Learning Engineer USD 172K-250KApache Arrow | Apache Spark | Bias Mitigation | DPO | Data-parallelSenior-level Full TimeUnited States R2d ago
-
Technical Lead, Machine Learning USD 172K-220KBias Evaluation | DPO | Data Pipelines | Evaluation | GPU OptimizationSenior-level Full TimeUnited States R2d ago
-
Staff Machine Learning Engineer USD 130K-200KBias Evaluation | DPO | Data Pipelines | GPU Optimization | Inference architectureSenior-level Full TimeUnited States R2d ago
-
Staff Machine Learning Engineer USD 165K-236KClass imbalance | Docker | Error Analysis | Feature Engineering | Feature Labeling401k | Bonus | Equity | Generous vacation time | Medical/Dental/Vision insuranceSenior-level Full TimeRemote USA R2d ago
-
Staff Data Engineer USD 135K-180KAI coding | AI coding tools | AWS EKS | Alerting | Amazon EC2401k match | Career development | Parental leaveSenior-level Full TimeTempe, Arizona R2d ago
-
Staff Machine Learning Engineer, Shopping Ads USD 230K-322KConversion modeling | Data Pipelines | Feature Engineering | Graph Neural Networks | Latency optimization401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefits programsSenior-level Full TimeRemote - United States R2d ago
-
AWS | Azure | CI/CD | Container Networking | Container networking interface401k company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R2d ago
-
AWS | Azure | CI/CD | Container Networking | Containers401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R2d ago
-
Senior-level Full TimeDenver, CO - Hybrid; New York, … R2d ago
-
Staff+ Software Engineer, Safeguards Data USD 320K-485KAWS | Access Control | Cloud platform | Data Governance | Data LineageFlexible working hours | Generous vacation | Hybrid office policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R2d ago
-
Software Engineer, Applied AI USD 170K-300KAWS | Agents | Benchmarking | Datadog | ECSFree coachingSenior-level Full TimeNew York R2d ago
-
Senior Robotics Software Engineer, Generalist USD 220K-292KAgent systems | Autonomy | Behavior Trees | C++ | Computer VisionHealth benefits | Recovery Benefits | Travel for testing and demonstrationsSenior-level Full TimeBoston, Massachusetts, United States R2d ago
-
Senior Solution Engineer USD 138K-181KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricTravel opportunitiesSenior-level Full TimeUS-GA-Remote R2d ago
-
Senior Database Engineer USD 130K-150KAWS | AWS CDK | AWS CloudFormation | Access Control | Amazon AuroraSenior-level Full TimeLas Vegas, Nevada, United States; Seattle, … R2d ago
-
Machine Learning Engineer USD 170K-300KData Lake | Data Pipelines | Data serving | Deep learning | Feature EngineeringFree access to coachingMid-level Full TimeSan Francisco R2d ago
-
Software Engineer, Data Products & Platform USD 170K-300KAWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatch | Amazon S3Work with coachesSenior-level Full TimeNew York R2d ago