AI Inference Engineer
Tasks
- Build inference engines
- Create performance and load testing suites
- Design autoscaling architectures for real time and batch inference
- Implement observability for performance metrics
- Optimize model serving for low latency
- Orchestrate inference routing with Kubernetes
- Profile and optimize models for hardware backends
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | C++ | CUDA | CoreML | Docker | GCP | Golang | Kubernetes | LLM | Llama CPP | MLOps | Ollama | PagedAttention | Python | Rust | SRE | Speculative decoding | TPU | TensorRT | Throughput | Time To First Token | Triton | VLLM
Education
N/A
Roles
Related jobs
-
.NET | AI Assisted Development | AI-Assisted Development Tools | API Integration | Automation401k | Employee discounts | Paid time offSenior-level Full TimeBrooklyn, NY, US19h ago
-
API Gateway | AWS | AWS Step Functions | Agile | Airflow401k match | Career development | Dental insurance | Employee referral bonuses | Health insuranceSenior-level Full TimeFort Meade, MD; Annapolis Junction, MD; …21h ago
-
Data Scientist - Mentorship and Training USD 49K-290KAPI Security | Apache Spark | Certificates | Code review | CondaReferral bonus | Training and mentoringSenior-level Full TimeMcLean, VA21h ago
-
Senior-level Full TimeHuntsville, United States23h ago
-
Senior Data Engineer USD 165K-184KAWS | Apache NiFi | Apache Spark | Data Modeling | Data PipelinesSenior-level Full TimeHuntsville, United States23h ago
-
Agile | Amazon Web Services | Apache Hive | Apache Spark | Apache ZeppelinMid-level ContractPortland, United States23h ago
-
Apache Flink | Apache Hive | Apache Kafka | Apache Spark | Apache ZookeeperSenior-level ContractPortland, United States23h ago
-
Amazon DynamoDB | Apache Hive | Java | NoSQL | Object-OrientedSenior-level ContractBeaverton, United States23h ago
-
Security Data Engineer USD 128K-214KAI | API Integration | API scaling | Anomaly Detection | Automated MonitoringDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-VA-Herndon23h ago
-
Data Engineer USD 94K-157KAWS | Air-gapped | Air-gapped environments | Bash | CRISP-DMHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Arlington, USA-Remote Work1d ago
-
Palantir MSS Developer / Engineer USD 84K-140KData Engineering | Data Modeling | Data Pipelines | Data Visualization | ELTMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …1d ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Apache Spark | Artificial Intelligence | Data Modeling | Data PipelinesDiscretionary annual incentive program | Mentorship | Professional development | Travel opportunitySenior-level Full TimeRosslyn, Virginia, United States1d ago
-
A/B | A/B Testing | B testing | Deep learning | Information RetrievalEntry-level Full TimeSeattle, Washington, United States1d ago
-
AWS | Accuracy | Apache Flink | Azure | Bias MitigationSenior-level Full TimeLos Angeles, California, United States1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatchBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeColumbus, OH, United States1d ago
-
Software Engineer III, Storage Infrastructure USD 147K-210KC++ | Code Reviews | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeNew York, NY, USA1d ago
-
Software Engineer, Search, AI/ML USD 147K-210KC++ | Data Governance | Data Governance Framework | Data Management | Data PrivacyMid-level Full TimeCambridge, MA, USA1d ago
-
C++ | Cloud Storage | Compute Technologies | Data Structures | Data Structures and AlgorithmsBonus | Equity | Health insurance | Paid time offSenior-level Full TimeNew York, NY, USA1d ago
-
Software Engineer, AI/ML, Google Research USD 147K-210KData Processing | Data Structures | Data Structures and Algorithms | Debugging | Language ProcessingMid-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer III, Computer Vision, Pixel Camera USD 147K-210KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSan Diego, CA, USA1d ago
-
Software Engineer III, Infrastructure, Infra Bigtable USD 147K-210KAsynchronous processing | Back-end | C++ | Concurrent programming | Consensus AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …1d ago
-
Senior Software Engineer, Infrastructure, Infra Bigtable USD 174K-252KAsynchronous processing | Backend Services | C++ | Concurrent programming | Consensus AlgorithmsSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …1d ago
-
C++ | Cloud Computing | Computer Vision | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA1d ago
-
Senior Software Engineer, Map Ads Machine Learning USD 174K-252KAds serving | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA1d ago
-
Algorithms | Artificial Intelligence | C++ | Code Quality | Data StorageSenior-level Full TimeSunnyvale, CA, USA1d ago