AI Inference Tools Engineer
United States, United Kingdom
R
USD 167K-242K Senior-level Full Time
Tasks
- Build agent native tooling for agents and humans
- Build developer tooling for AI inference
- Collaborate with kernel model and serving engineers to improve tools
- Create metrics and dashboards for deployments
- Create profiling and tracing tools
- Develop debuggers for correctness
- Improve orchestration layer tool integration
- Integrate tooling between MAX Mojo and driver APIs
- Participate in design reviews
- Profile and optimize based on real workloads
- Write agents for model launch and issue triage
Perks/Benefits
- 401k matching
- Flexible paid time off
- Health insurance
- Hybrid work options
- Local meetups
- Onsite onboarding
- Relocation assistance
- Team events
Skills/Tech-stack
Agent Frameworks | Benchmarking | C++ | CUDA | Dashboards | Debugging | GPU Programming | Go | JAX | Metrics | Observability | Profiling | PyTorch | Python | ROCm | Rust | TensorFlow | Tracing
Education
N/A
Related jobs
-
Data Engineer II USD 150K-225KAmazon EKS | Amazon MSK | Amazon Web Services | Apache Flink | Apache Kafka401k match | Dental insurance | Employee discounts | Medical insurance | Paid time offMid-level Full TimeUnited States, Aliso Viejo, CA R1d ago
-
APIs | Access Control | Agentic AI | Context engineering | Data GovernanceSenior-level Full TimeUK - Remote R1d ago
-
APIs | Access Control | Agentic Workflows | Cloud Computing | Context engineeringTravel opportunitiesSenior-level Full TimeUSA - Remote R1d ago
-
Sr. Software Engineer USD 150K-190KAI workflows | API | AWS | Agentic Workflows | Coordinate systems401k match | Dental insurance | Family plan benefits | Flexible time off | Hybrid work modelSenior-level Full TimeAtlanta, GA R1d ago
-
Apache Flink | Apache Iceberg | Apache Spark | Avro | Concurrency401k match | ESPP | Family leave | Flexible time away | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R1d ago
-
Senior Manager, AI Software Engineering USD 199K-235KAWS | Agile | Automated testing | CI/CD | Cloud Native401k match | Flexible time off | Hybrid work model | Medical insuranceSenior-level Full TimeNew York, NY R1d ago
-
Senior Manager, AI Software Engineering USD 177K-220KAWS | Agile | Automated testing | CI/CD | Claude401k match | Dental insurance | Family benefits | Flexible time off | Hybrid work modelSenior-level Full TimeAtlanta, GA R1d ago
-
API Integration | Access Control | Agent Packs | Agentic Workflows | Anthropic APICustomer facing delivery opportunities | Remote work | Travel 25 percentSenior-level Full TimeUSA - Remote R1d ago
-
Data and Analytics - AI Engineer II USD 100K-143KAI Foundry | AIOps | APIs | Azure | Azure AICollaborative team culture | Hybrid work environment | Professional developmentMid-level Full TimeOmaha, NE, 68102, USA R1d ago
-
Lead Full-Stack Engineer -- Advanced AI USD 132K-238KAPI Design | Agentic Systems | Application Architecture | CI/CD | Code review401k | Dental insurance | Employee discount | Health insurance | Life insuranceSenior-level Full Time7000 Target Pkwy N,NCD-0375 Brooklyn Park,MN … R1d ago
-
AI/ML Engineer USD 195K-264KAI RMF | AWS Bedrock | AWS SageMaker | Agentic AI | Azure Machine Learning401k matching | Career growth support | Paid time off | Remote work | Wellness packagesSenior-level Full TimeUSA LA Home Office (LAHOME), United … R1d ago
-
Data Platform Engineering, Student USD 165K-204KAzure Data | Azure Data Factory | Data Factory | Data Management | Data ModelingPart-time schedule | Remote workSenior-level Part Time(SUL) Remote - United States, United … R1d ago
-
AI Prompt Engineer USD 61K-122KAgile | Chain-of-Thought | Embeddings | Few-Shot Learning | Few-shotContinuing education | Financial benefits | Flexible time off | Healthcare benefits | Learning and developmentEntry-level Full Time405 ASHBURN VA (ASHBURN CACI/CLIENT REIMB … R1d ago
-
Mid-level Full TimeOhio WFH, United States R1d ago
-
AI Software Engineer, Senior USD 86K-198KAWS | Access Control | Agentic Workflows | Asynchronous programming | Automated testingDependent care | Paid leave | Professional development | Secret clearance | Tuition assistanceSenior-level Full TimeUSA, HI, Joint Base Pearl Harbor … R1d ago
-
Associate Engineer, Investment Data & Analytics USD 145K-175KAzure | Azure Data | Azure Data Factory | CI/CD | DBTHybrid work arrangement | Paid time off | Remote work days per quarter | Wellness programsMid-level Full TimeBoston, United States R1d ago
-
Data Engineer, Senior USD 77K-176K800-53 | AWS | AWS EMR | AWS Glue | Access ControlsDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, AL, Huntsville (4946 Fowler Rd), … R1d ago
-
Data Engineer USD 61K-141KAWS | AWS CloudFormation | AWS EMR | AWS Solutions | AWS Solutions ArchitectDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsEntry-level Full TimeUSA, CA, San Diego (1615 Murray … R1d ago
-
Manager, Data Scientist - Eso USD 86K-150KBias/fairness | Business Intelligence | CI/CD | CI/CD deployment | ContainerizationCollaborative team | Fully remote | Mentorship opportunities | Minimal travelMid-level Full TimePittsburgh, Pennsylvania R1d ago
-
A/B | A/B Testing | AWS | Asynchronous programming | Audit LoggingDependent care | Health life and disability benefits | Paid leave | Professional development | Retirement benefitsSenior-level Full TimeUSA, DC, Washington (1301 K St), … R1d ago
-
Cyber Machine Learning Engineer USD 86K-198KAmazon Web Services | Azure | Bash | Cloud Computing | Data StreamingDependent care | Paid leave | Professional development | Recognition awards | TS/SCI clearance eligibilityMid-level Full TimeUSA, VA, McLean (8283 Greensboro Dr, … R1d ago
-
Machine Learning Engineer USD 77K-176KC++ | Computer Vision | Data handling | Deep learning | Generative AISecret clearanceMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr … R1d ago
-
AI Engineer Intern (Summer 2027) USD 72K-85KAgile | CrewAI | Embeddings | Generative AI | GitDisability insurance | Donation matching | Employee assistance program | Hybrid working | Life insuranceEntry-level Full Time InternshipAtlanta, United States R1d ago
-
C++ | Deep learning | Distributed Training | ETL | GoSenior-level Full TimeMountain View, CALIFORNIA, United States R1d ago
-
Data Engineer I USD 80K-110KApache Airflow | Apache Kafka | Apache Spark | CI/CD | Cloud Data401k | Health dental vision HRA HSA | PTO and paid holidays | Parental leaveMid-level Full TimeDenver, CO or Long Beach, CA R1d ago