AI Platform Engineer
Tasks
- Build AI model serving platforms
- Collaborate with ML teams to deploy production AI models
- Deploy and monitor AI services
- Design AI inference platforms
- Drive FinOps initiatives
- Ensure high availability
- Evaluate AI infrastructure technologies
- Implement autoscaling
- Implement caching strategies
- Implement observability, logging, and alerting
- Implement security controls
- Manage model deployment versioning rollback and lifecycle
- Mentor engineering teams and lead architecture reviews
- Optimize GPU utilization
- Optimize cloud resource utilization
- Optimize inference performance
- Optimize request routing
- Set up distributed tracing
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | AWS | Alerting | Authentication | Authorization | Autoscaling | C++ | CI/CD | CUDA | Cache optimization | Caching | Cloud platform | Compression | Distributed Systems | Distributed tracing | Docker | Git | GitOps | Go | Google Cloud | Google Cloud Platform | High Availability | Inference Server | Infrastructure as Code | KV cache | KV cache optimization | Kubernetes | Logging | MLOps | Microsoft Azure | Mixed Precision | Model Deployment | Model versioning | Monitoring | NVIDIA GPU | Observability | Performance optimization | Pruning | Python | Quantization | Ray Serve | Request Routing | Rollback | Rust | Security | Speculative decoding | TensorRT-LLM | Terraform | Traffic Management | Triton Inference | Triton Inference Server | VLLM | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R2h ago
-
Lead GenAI Engineer USD 150K-170KAgile | Azure | Cloud platform | Containerization | Cybersecurity401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilitySenior-level ContractMinneapolis, Minnesota, USA R5h ago
-
Enterprise - Software Engineer - Python, PySpark, AWS USD 185K-200KAWS Glue | AWS Lambda | Amazon DynamoDB | Amazon Web Services | PySparkBirthday off | Company events | Dental coverage | Flexible work schedule | Group life insuranceSenior-level Full TimeAnnapolis Junction, MD R9h ago
-
AI Security Architect USD 200K-220KAI Governance | AI Security | AI/ML | AI/ML system design | Access Management401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractBolingbrook, Illinois, USA R10h ago
-
Agile | Angular | Azure DevOps | CSS | Cloud DataHybrid RemoteMid-level Full TimeTampa R11h ago
-
AWS Glue | Amazon RDS | Amazon Redshift | Amazon S3 | Artificial Intelligence401k matching | Certification programs | Disability insurance | Employee resource groups | Fertility coverageEntry-level Full TimeRichmond, VA, United States R13h ago
-
Senior Full Stack & AI Engineer USD 100K-135K.NET | AI Foundry | Agile | Angular | Azure AIContinuous learning | Flexible schedule | Hybrid work modelSenior-level Full TimeMadrid, MD, Spain R15h ago
-
AWS Bedrock | AWS EC2 | AWS ECS | AWS EKS | AWS LambdaOn-site or hybrid work | Sabbaticals | Shared parental leave | Study assistance | Work-life balance initiativesSenior-level Full TimeUSA - Raleigh, NC (RDU), United … R1d ago
-
Senior Software Engineer, Decision Intelligence Platform USD 180K-225KCloud Computing | Data Modeling | Data Pipelines | Data Quality | Distributed SystemsEquity compensation | Hybrid work option | Medical benefits | Onsite collaboration daysSenior-level Full TimeSeattle, Washington United States, United States R1d ago
-
PAHO Consultant - Data, Analytics, and AI (ITS) USD 53K-53KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeOff Site, United States R1d ago
-
Senior Staff Engineer – AI Engineering USD 113K-188KGit | Hugging Face | Language Models | Language Processing | Large Language ModelsAdoption Assistance | Disability benefits | Employee assistance program | Health Coach access | Life insuranceSenior-level Full TimeNiskayuna, United States R1d ago
-
AI & Data Platform Engineering Manager USD 189K-260KAWS | Agent Orchestration | Azure | Cloud platform | Data Classification401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeEnglewood, CO - CO RMN, United … R1d ago
-
Data Quality and Solutions Lead Developer (Hybrid) USD 86K-165KChange Management | Dashboards | Data Catalog | Data Cleansing | Data Flow401k match | Adoption Assistance | Child and elder care services | Dental insurance | Disability coverageSenior-level Full TimeUS-TX-RICHARDSON-461 ~ 3200 E Renner Rd … R1d ago
-
ADA | ARINC 429 | Agile | C++ | Confluence401k matching | Counseling sessions | Dental insurance | Disability coverage | Employee assistance programMid-level Full TimeUS-PR-AGUADILLA-110 ~ Rd 110 N Km … R1d ago
-
AI / LLM Platform Engineer USD 108K-149KAPI Development | AWS | Azure | CICD | CMMC401k match | Dental insurance | Health insurance | Hybrid work option | Life insuranceMid-level Full TimeEnglewood, CO - CO RMN, United … R1d ago
-
AI Governance | AWS | Agentic AI | Analytics | AzureAchievement Awards | Child/adult backup care | Educational assistance | Flexible work schedules | Parental leaveMid-level Full TimeUS-CT-REMOTE, United States R1d ago
-
Staff Software Engineer-AI Solutions USD 131K-210KAJAX | Agentic AI | Artificial Intelligence | Business Rules | CMDB401k | Dental insurance | FSA/HSA | Hybrid work | Life insuranceSenior-level Full TimeAshburn, VA, United States R1d ago
-
Staff Software Test Engineer, Embedded Systems USD 140K-160KAgile | Automated testing | CI/CD | Embedded Systems | GitHub Actions401k plan | Dental insurance | Disability insurance | Employee assistance program | Employee stock purchase planSenior-level Full TimeUS - Work From Home, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Big Data Engineer USD 90K-110KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 86K-103KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseCareer growth potential | Direct W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Real-Time Data Engineer USD 135K-160KACLs | AWS MSK | Ansible | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior SIEM Data Engineer USD 680K-1445KApache Kafka | Batch Processing | CI/CD | CIM | Cribl StreamSenior-level Full TimeQuincy, Massachusetts, United States R1d ago
-
AI Data Engineer USD 80K-100KApache Beam | Apache Spark | CI/CD | Code review | Data LineageCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Embedded Robotics Engineer USD 125K-145KAutonomous Systems | C++ | Concurrent programming | Control | DebuggingRemote workSenior-level Full TimeUnited States - Remote R1d ago