Software Engineer II - AI/ML, AWS Neuron
Tasks
- Architect and implement distributed inference features
- Build infrastructure for model analysis and onboarding
- Collaborate with compiler, runtime, and hardware teams
- Conduct unit testing and end to end model testing
- Create metrics and implement automation
- Debug performance issues and optimize memory usage
- Deploy and release via CI pipelines
- Design and implement high performance ML kernels
- Develop and optimize machine learning models and frameworks for custom accelerators
- Enable and optimize customer ML models on AWS accelerators
- Implement fusion sharding tiling and scheduling optimizations
- Perform system level performance profiling and optimization
- Tune machine learning models for inference performance
Perks/Benefits
- N/A
Skills/Tech-stack
AOT Tracing | C++ | CI/CD | CUDA | CUDA kernels | Computer Architecture | Continuous Deployment | Deep learning | Distributed Computing | High Performance | High-Performance Computing | Inference Optimization | JAX | JIT Compilation | Level optimization | Low-level optimization | ML Compiler | Machine Learning | Memory Management | Model Inference | Model Training | Operating Systems | Parallel Computing | Performance Computing | Performance Profiling | PyTorch | Python | Runtime | System Architecture | Unit Testing
Roles
AI | AI Engineer | Engineer | Learning Engineer | Machine Learning Engineer | Software Engineer
Related jobs
-
A/AI Research Engineer Asc - E1 USD 67K-124KC++ | CIN? N/A | Computer Vision | Control Engineering | Control Systems401k match | Dental insurance | Education assistance | Flexible work arrangements | Life insuranceEntry-level Full TimeOrlando, FL, US4h ago
-
Data Engineer Senior - Level 3 USD 85K-158KAgile | Data Cleansing | Data Mining | Data Quality | Data Warehousing401k match | Education assistance | Employee assistance program | Flexible work arrangements and schedules | HolidaysSenior-level Full TimeFort Worth, TX, US4h ago
-
Embedded Software Engineering Asc Mgr USD 120K-224KAgile | Algorithm Implementation | C++ | Confluence | Critical softwareFlexible work schedule | Work-life balanceSenior-level Full TimeOrlando, FL, US4h ago
-
Agentic AI Engineer, Automation USD 220K-292KAgent Orchestration | C++ | Data Aggregation | Data Pipelines | Data SanitizationNone Full TimeCosta Mesa, California, United States8h ago
-
API Integration | Artificial Intelligence | Data Engineering | Data Pipelines | Data provenanceSenior-level Full TimeUS026 PA Spring House - 1400 …9h ago
-
Machine Learning Engineer, Relevance and Personalization USD 166K-195KA/B | A/B Testing | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeUnited States R10h ago
-
Data Platform Software Engineer USD 125K-194KCI/CD | Cloud Computing | Data Lakes | Data Modeling | Data Structures401k match | ESPP | Family leave programs | Flexible time off | Health plansEntry-level Full TimeSan Diego, CALIFORNIA, United States R10h ago
-
Senior AI Architect USD 130K-135KAI/ML Services | AWS | Anthropic | Autonomous Agents | Cloud Architecture401k match | Cell phone stipend | College savings | EAP | FSA optionsSenior-level Full TimeNew York, NY, United States11h ago
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R11h ago
-
Senior Embedded Engineer – Robotics & Sensor Systems USD 164K-220KAI Inference | AIS | AWS | Azure | C++Senior-level Full TimeArlington, VA11h ago
-
Mid-level Full TimeSan Francisco Bay Area11h ago
-
Senior Machine Learning (ML) Engineer USD 175K-200KAI Search | Artificial Intelligence | Attention Mechanisms | Autogen | Azure AI401k plan | Dental insurance | Flexible paid time off | Flexible work hours | Medical insuranceSenior-level Full TimeSeattle, WA R11h ago
-
Software Engineer, Data Runtime USD 29KAWS | Admission Policy | Arrow | Azure | Benchmarking401k | Additional company holidays | Enhanced parental leave | Generous vacation policy | Holiday breakSenior-level Full TimeSan Francisco, US (Hybrid) R11h ago
-
AI Engineer I USD 90K-119KAPI Integration | Azure | CI/CD | Docker | Embeddings401k match | Dental insurance | Holiday pay | Medical insurance | Paid time offEntry-level Full TimeRemote, CA, USA R12h ago
-
API | AWS | Automated testing | Cloud Computing | Code generation401k | Dental insurance | Discounts and perks | Fully remote | Medical insuranceSenior-level Full TimeUniversal City, CALIFORNIA, United States R12h ago
-
Staff Backend Engineer, Data Platform USD 140K-175KAsynchronous Service Design | Audit Logging | BigQuery | Cloud Run | Cloud Storage401k match | Company holidays | Dental insurance | Flexible paid time off | Health insuranceSenior-level Full TimeElizabeth, NJ R12h ago
-
Embedded Software Engineer - Drive Systems USD 150K-220KC# | C++ | CAN | ECU | FreeRTOSHealth insurance | Life insurance | Long-term care insurance | Long-term disability insurance | Paid time offMid-level Full TimeFoster City, CA13h ago
-
Senior Software Engineer (Data Platform) USD 185K-185K.NET | AWS | Authentication | Authorization Code | Authorization Code GrantSenior-level Full TimeUnited States (EST) R13h ago
-
Lead GenAI Engineer USD 150K-170KAgile | Azure | Cloud platform | Containerization | Cybersecurity401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilitySenior-level ContractMinneapolis, Minnesota, USA R13h ago
-
API Development | Agent systems | BigQuery | Data integration | Databricks401k matching | Cell phone stipend | College Savings Assistance | Counseling services | Dental insuranceSenior-level Full TimeNew York, NY, United States14h ago
-
Entry-level Full TimeWashington, DC16h ago
-
Applied AI Research (Capabilities) USD 300K-405KDeep learning | Evals | Evaluation | Finetuning | Language ModelsCompetitive benefits | Flexible working hours | Generous vacation | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R16h ago
-
AI Model Engineer USD 125K-150KAWS Glue | Agentic Workflow | Apache Airflow | Apache Spark | BashHybrid Remote Onsite | Public Trust requiredSenior-level Full TimeFAIRFAX, VA, United States16h ago
-
AI | AWS | Azure | Data Governance | Data LakesOnsite work location New York NYSenior-level Contract Full TimeNew York City, New York, United …17h ago
-
Mid-level Full TimeUnited States17h ago