AI Optimization Engineer
Tasks
- Apply compiler level optimizations using Triton XLA TorchInductor and TVM
- Build benchmark suites and regression frameworks
- Collaborate with ML and platform engineering teams to improve pipelines
- Document performance tuning playbooks and share findings
- Evaluate new hardware and software for adoption
- Identify bottlenecks in data compute communication and memory
- Implement quantization sparsity and pruning
- Improve cost efficiency through model architecture hardware selection and scheduling
- Optimize AI training and inference pipelines
- Optimize KV cache continuous batching and speculative decoding
- Optimize attention using FlashAttention and paged attention
- Optimize data pipelines sharding and storage access patterns
- Translate AI research into production performance improvements
- Tune distributed training using tensor parallelism pipeline parallelism FSDP and ZeRO style sharding
Perks/Benefits
Skills/Tech-stack
Benchmarking | C++ | CUDA | Continuous batching | Cutlass | DeepSpeed | FSDP | FlashAttention | GPU Architecture | KV cache | Memory Management | Model Parallelism | Paged Attention | Pipeline parallelism | Profiling | Pruning | Python | Quantization | Sparsity | Speculative decoding | TVM | Tensor Parallelism | TensorRT-LLM | TorchInductor | Triton | VLLM | XLA | Zero
Education
Roles
AI | AI Optimization Engineer | Engineer | Optimization Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R11h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R11h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R14h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R16h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R21h ago
-
Sr. Software Engineer (Data)-0336 USD 132K-203KAWS | Apache Spark | ClickHouse | Databricks | GitHubEmotional support | Financial benefits | Health benefits | Remote work days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R1d ago
-
Sr Staff Software Engineer- Data Platform USD 220K-255KAWS EMR | AWS Lambda | AWS S3 | Access Control | AlgorithmsDental insurance | Disability insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeCalifornia - Remote Office, United States R1d ago
-
Senior SW Engineer, Data Recording USD 129K-198KBackpressure | Bazel | Build systems | C plus plus | C#Senior-level Full TimeWork From Home - United States, … R1d ago
-
Lead Data Engineer USD 75KApache Airflow | Apache Beam | Autoscaling | BigQuery | CI/CD401k matching | Adoption reimbursement | Commuter benefits | Disability benefits | Discounts and savingsSenior-level Full Time112265-NJ-MetroPark, Iselin, United States R1d ago
-
Principal Embedded Software Engineer USD 150K-175K4G | Battery Management | Battery Management Systems | Board Bring-up | Bring-upSenior-level Full TimeMASSACHUSETTS - VIRTUAL - MA01, United … R1d ago
-
Mid-level Full TimeMASSACHUSETTS - VIRTUAL - MA01, United … R1d ago
-
Fullstack Engineer USD 85K-134KETL | Hadoop | Hive | Java | Linux401k plan | Continuing Education/Professional Development | Dental insurance | Employee assistance program | Life insuranceEntry-level Full TimeRemote, CA, United States R1d ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Alerting | Apache Spark | Azure HDInsightRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Streaming Data Engineer USD 100K-150KAccess Control | Access Control Lists | Ansible | Apache Kafka | Apache Kafka ConnectSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Infrastructure Engineer USD 100K-150KAPI Gateway | Abuse detection | Automated rollback | Autoscaling | C++Senior-level Full TimeUnited States - Remote R1d ago
-
AI Scientist USD 100K-150KAccelerator hardware | Computer Vision | Deep learning | Distributed Training | Experiment designRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code reviewSenior-level Full TimeUnited States - Remote R1d ago
-
Generative AI Engineer USD 100K-150KAdapters | Benchmarking | DPO | Deep learning | Distributed TrainingSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter based Fine Tuning | Attention Optimization | Cluster management | DPO | Distributed TrainingSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Director, Machine Learning & AI (BPD) USD 203K-304KAWS | Agentic Systems | Azure | Bias Testing | Cloud ComputingSenior-level Full TimeUS - Gaithersburg - MD, United … R1d ago
-
Prompt Engineer USD 100K-150KAgentic Workflows | Chunking | Embeddings | Evaluation | IndexingMentorship opportunities | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Robotics Engineer USD 100K-150KBehavior Trees | C++ | Cameras | Concurrent programming | Control SystemsSenior-level Full TimeUnited States - Remote R1d ago
-
Principal Engineer - AI FDE (Froward Deployed Engineer) USD 180K-252KAPI Integration | Artificial Intelligence | Debugging | Documentation | EvaluationSenior-level Full TimeRemote - Texas, United States R1d ago