Forward Deployed Engineer (Inference & Post-Training)
Tasks
- Advise customers on inference and post training system design
- Apply speculative decoding
- Deploy DPO training pipelines
- Deploy GRPO training pipelines
- Deploy LoRA fine tuning pipelines
- Deploy RLHF training pipelines
- Deploy SFT training pipelines
- Determine tensor parallelism
- Monitor and optimize production endpoint configurations
- Optimize inference engine for hardware and workload
- Run RL training and optimize post training systems
- Select quantization strategy
- Surface field insights to influence product roadmap
- Tune KV cache
- Tune configuration for throughput and latency
Perks/Benefits
Skills/Tech-stack
DPO | GRPO | KV cache | LoRA | Pipeline parallelism | Python | Quantization | RLHF | Reinforcement Learning | SFT | SGLang | Speculative decoding | Tensor Parallelism | TensorRT-LLM | VLLM
Education
N/A
Regions
Countries
States
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R7h ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA7h ago
-
Mid-level Full TimeSan Francisco8h ago
-
Mid-level Full TimeSan Francisco9h ago
-
Data Engineer Data Pipelines and ETL USD 99K-147KAnomaly Detection | Apache Airflow | CDC | Cloud Composer | Data Governance401k plan | Disability benefits | Life insurance | Life insurance coverage | Medical/Dental/VisionMid-level Full TimeBurbank, CA, US, 915059h ago
-
Senior Analytics Engineer, GTM USD 176K-265KAPI Integration | CI/CD | DBT | Data Modeling | Data QualityCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeSanta Clara, California10h ago
-
Senior AI Engineer – Developer Products USD 170K-250KAPI Design | LLMOps | Language Models | Large Language Models | MLOpsGenerous benefits | Health benefits | Remote work options | Stock optionsSenior-level Full TimeSan Francisco, California10h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Data Curation | Deep learning401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY10h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Cloud platform | Deep learning | Foundation Models401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeSan Francisco, CA10h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Data Curation | Deep learning401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY10h ago
-
BigQuery | Cloud Functions | Compute Engine | DBT | Fivetran11 paid holidays | 401k matching | Basic life insurance | Commuter benefits | Disability insuranceMid-level Full TimeNew York, NY10h ago
-
Senior Embedded Software Engineer - Future Forward USD 153K-201KAgile | Authentication | Board Bring-up | Bring-up | C#Senior-level Full TimeSunnyvale, CA, United States R11h ago
-
Principal Applied Scientist USD 200K-250KA/B | A/B Testing | Agent Orchestration | B testing | Continuous LearningCareer growth | Hybrid work flexibility | Mentorship | Remote work option | Training opportunitiesSenior-level Full TimeBellevue11h ago
-
Senior-level Full TimeUnited States11h ago
-
Embedded Device Firmware Engineer USD 145K-195KAutomated testing | C# | C++ | CI/CD | Circuit debuggingMid-level Full TimeSanta Clara, CA12h ago
-
Member of Technical Staff (Storage) USD 185K-200KAI Assisted Development | C++ | Concurrency Control | Data replication | Distributed SystemsDental insurance | Flexible time off | Life and disability insurance | Medical insurance | Mental wellbeing benefitsSenior-level Full TimeNew York, NY R12h ago
-
Senior Software Engineer - Data Platform USD 130K-220KAWS Lambda | AWS RDS | Airflow | Amundsen | Apache HiveHealth insurance | Parental leave | Professional development stipend | Remote workSenior-level Full TimeRemote - US R13h ago
-
Data Engineer, Palo Alto USD 110K-180KAWS | Data Modeling | Data Pipelines | DynamoDB | ETL401k matching | Dental insurance | Flexible spending accounts | Health insurance | HolidaysMid-level Full TimePalo Alto, California, United States13h ago
-
Ai Engineer USD 100K-150KAI Agents | API Development | AWS | AWS Bedrock | Agentic Workflows401k | Commuter benefits | Dental insurance | Disability coverage | EAPMid-level Full TimeColumbia, MD, United States14h ago
-
Senior-level Contract Full TimeReston, VA, United States14h ago
-
Staff AI Engineer (Audio) USD 185K-235KAudio Processing | Classification metrics | Data Drift | Data analytics | Datadog401k | Commuter benefits | Company offsite | Daily lunch | Dental/visionSenior-level Full TimeGlobal Remote R14h ago
-
Senior AI/ML Engineer: Python & Scientific Computing USD 175K-250KCelery | Distributed Computing | Flask | GraphQL | High PerformanceSenior-level Full TimeSan Francisco15h ago
-
Senior Staff AI Software Engineer USD 189K-301KGitHub | High Bandwidth | High Bandwidth Memory | Jira | Linux401k | Adoption support | Charitable giving match | Confidential Therapy Sessions | Fertility care stipendSenior-level Full TimeSan Jose, California, United States15h ago
-
Senior Robotics Software Engineer, Sensor Fusion USD 191K-253K*nix | C++ | CAN | Computer Vision | EthernetSenior-level Full TimeCosta Mesa, California, United States; Washington, …15h ago