Inference Intern
Tasks
- Add robust error handling
- Build programming abstractions for model porting
- Build runtime for transformer inference
- Co-design hardware instructions and model operations
- Debug performance and correctness issues
- Develop testing capabilities for model porting
- Enhance intra node execution
- Enhance multi node inference
- Implement high performance software components for model toolkit
- Implement state management
- Optimize routing and communication layers
- Perform performance profiling
- Support model porting to accelerator architecture
- Use collective communication for inference performance
Perks/Benefits
Skills/Tech-stack
C++ | Collective communication | Compilers | Consensus Protocols | Consistency models | Debugging | Distributed Systems | Error Handling | High speed | High-speed interconnect | Infiniband | Intra Node Execution | JAX | Kernel Networking | Linux | MOE | Mixture of Experts | Multi node inference | Multi-node | NVLink | Performance Profiling | PyTorch | Python | Rust | SGLang | SIMD | State management | Transformer Architecture | User Space Networking | User space | VLLM
Education
Regions
Countries
States
Cities
Related jobs
-
AWS Bedrock | Agent systems | Anthropic API | Autogen | Azure401k matching program | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Contract Full TimeRemote, OR, United States R6h ago
-
API Testing | Cypher | Data Quality | DataOps | DevOpsBenefits | Competitive pay | Growth opportunity | Remote work | Travel requiredSenior-level Full TimeReston, VA, United States R10h ago
-
Principal AI/ML Scientist USD 150K-207KAWS | AWS GovCloud | Artificial Intelligence | Azure | Azure AIPublic trust suitabilitySenior-level Full TimeARLINGTON, VA, United States10h ago
-
Data Science Intern USD 60K-95KAnomaly Detection | Computer Vision | Data Analysis | Data Preprocessing | ExcelCareer Development Training Opportunities | Diversity and inclusion initiatives | Multicultural environmentEntry-level InternshipAUBURN HILLS HQ R&D,US-MI,United States12h ago
-
Agile | Automated testing | CI/CD | Cloud Computing | CrewAIDental insurance | Health insurance | Vision insuranceMid-level Full TimeAshburn, VA, United States12h ago
-
AI Machine Learning Skill 2-FFPP-8904 USD 78K-250KC# | Data Governance | Data Modeling | Data pipeline | Java401k plan with company match | Dental insurance | Diverse inclusive workplace | Employee referral programs | Flexible spending accountsMid-level Full TimeHanover, MD13h ago
-
AI Engineer USD 180KAgent Orchestration | Cost Management | Data Pipelines | Distributed Systems | LLM401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …14h ago
-
Machine Learning Leader - Optical Solutions USD 180K-300KAnomaly Detection | Data analytics | Image Processing | Java | Machine LearningAdoption Assistance | Disability insurance | Educational assistance | Flexible spending account | Health savings accountSenior-level Full TimeFremont, California15h ago
-
Software Engineer III, Generative AI USD 147K-211KComputer Vision | Data Processing | Debugging | Language Models | Language ProcessingSenior-level Full TimeKirkland, WA, USA16h ago
-
Staff Software Engineer, AI/ML, YouTube Ads USD 207K-301KA/B | A/B Testing | B testing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA16h ago
-
Senior Software Engineer - Database Engineering USD 200K-287KAutomated testing | Debugging | Distributed Systems | Distributed key-value stores | Failure recoverySenior-level Full TimeUS-CA-Menlo Park21h ago
-
Sr. Solutions Architect - Oil, Gas, and Energy USD 219K-301KAccount Management | Artificial Intelligence | Big Data | Cloud Computing | Data ScienceSenior-level Full TimeUnited States23h ago
-
Principal AI Architect Engineer USD 118K-195KAWS | AWS Lambda | Amazon Bedrock | Amazon EC2 | Amazon EKSSenior-level Full TimeNew York, United States1d ago
-
Senior Software Engineer (AI/ML) - Vice President USD 150K-210KAPI Security | Algorithms | Cloud Platforms | Data Structures | DatabricksSenior-level Full Time1 New York Plaza, United States1d ago
-
AI/ML Engineer USD 55K-126KAI architecture | Agile | JavaScript | MLflow | Machine LearningPaid leave | Professional development | Secret clearance eligibility | Tuition assistanceMid-level Full TimeUSA, VA, McLean (8251 Greensboro Dr), …1d ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, TX, San Antonio (3133 General …1d ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Financial benefits | Health insurance | Life insuranceMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr …1d ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), …1d ago
-
AI Developer USD 77K-176KAWS | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Disability insurance | Health benefits | Life insurance | Paid leaveMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr …1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Data Quality | Data labeling | Data quality monitoring100 percent remote | Career growth | Full-time employment | W2 employmentMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualityMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | Code review100 percent remote | Career growth | Full-time employment | H1B transfer support | W2 employmentMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data Modeling100 percent remote | Career growthMid-level Full TimeUnited States - Remote R1d ago
-
Senior Software Engineer - Data Platform USD 106K-147KAzure | Change Management | Cloud Cost Optimization | Cost Optimization | DSCSA401k retirement savings plan | Career development | Dental benefits | Life insurance | Long-term disabilitySenior-level Full TimeWaterside Bldg, United States1d ago
-
Prompt Engineer USD 100K-150KAgent architecture | Agent architectures | Agentic Workflows | Chunking | Deterministic systemsLong-term engagement | Mentorship | Remote workMid-level Full TimeUnited States - Remote R1d ago