Principal Software Engineer - LLM Optimization
Jersey City, NJ, United States
USD 176K-215K (estimate) Senior-level Full Time
Tasks
- Apply software development life cycle automation
- Architect agentic AI engineering workflows with guardrails
- Benchmark platform against external providers
- Build GPU efficiency scorecard
- Design GPU chaos engineering
- Design quantization experiments
- Drive speculative decoding strategy
- Evaluate inference engine upgrades
- Optimize KV cache and prefix caching
- Own LLM inference benchmarking
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- On-site health and wellness centers
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
AWQ | AWS | Amazon EKS | Asynchronous execution | CUDA | DCGM | Disaggregated serving | FP8 | GPTQ | GPU memory | GPU observability | INT4) | INT8 | KV cache | LLM Inference | Language Models | Large Language Models | ML observability | Machine Learning | NVML | Prefix caching | Quantization | SGLang | Speculative decoding | Tensor Parallelism | TensorRT-LLM | VLLM | XID
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
API Design | API Integration | Agentic AI | Conversational AI | DashboardsSenior-level ContractColumbus, United States5h ago
-
AI Governance | API Design | Benchmarking | BigQuery | CI/CDSenior-level ContractNashville, United States6h ago
-
Sr Consultant-Knowledge Graph - RAG Agentic AI Expert USD 150K-208KA/B | A/B Testing | B testing | Cypher | DPOSenior-level Full TimeRound Rock, TX, United States7h ago
-
Consultative Offerings - Government & Public Services - Summer Scholar - AI and Data Engineering USD 86KAlgorithms | Artificial Intelligence | Chatbots | Cognitive Services | Data EngineeringHands-on learning | Mentorship | Professional developmentEntry-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …7h ago
-
A/B | A/B Testing | ASIC | B testing | C#Entry-level Full TimeSan Diego, California, United States8h ago
-
Data Engineer II USD 92K-176KAWS | Apache Airflow | Azure | Azure Data | Azure Data Factory401k matching | Dental insurance | Health insurance | Onsite fitness center | Time offSenior-level Full TimeUS-Rhode Island-Providence8h ago
-
Data Processing | Deep learning | Distributed Computing | Feature Engineering | MLOpsMid-level Full TimeSan Jose, California, United States8h ago
-
A/B | A/B Testing | Apache Flink | Apache Spark | B testingEntry-level Full TimeSan Jose, California, United States8h ago
-
Algorithms | C++ | CUDA | Computer Systems | Continuous batchingCareer developmentEntry-level Full TimeSan Jose, California, United States8h ago
-
Algorithms | C++ | CUDA | Computer Systems | Continuous batchingEntry-level Full TimeSan Jose, California, United States8h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Foundation) - 2027 Start USD 118K-187KDeep learning | Generative Models | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeSeattle, Washington, United States8h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Foundation)- 2027 Start (PhD) USD 129K-256KDeep learning | Information Retrieval | Language Models | Language Processing | Large Language ModelsGrowth opportunities | Open collaboration culture | Research-driven environmentEntry-level Full TimeSeattle, Washington, United States8h ago
-
Machine Learning Engineer Intern (E-Commerce Recommendation Foundation) - 2027 Start (PhD） USD 129K-237KComputer Vision | Deep learning | Generative Recommendation | Language Models | Language ProcessingEntry-level InternshipSeattle, Washington, United States8h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Foundation)- 2027 Start (PhD) USD 129K-256KDeep learning | Generative Recommendation | Language Models | Large Language Models | Machine LearningEntry-level Full TimeSan Jose, California, United States8h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Foundation) - 2027 Start USD 118K-187KDeep learning | Generative Recommendation | Information Retrieval | Language Models | Language ProcessingEntry-level Full TimeSan Jose, California, United States8h ago
-
Agentic Systems | Causal Inference | Contrastive Learning | Debiasing | Deep learningOnboarding supportEntry-level Full TimeSan Jose, California, United States8h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Mall) - 2027 Start (PhD) USD 129K-256KCausal Inference | Contrastive Learning | Debiasing | Deep learning | Distributed TrainingEntry-level Full TimeSeattle, Washington, United States8h ago
-
Causal Inference | Deep learning | GPU Optimization | Generative Models | Information RetrievalEntry-level Full TimeSeattle, Washington, United States8h ago
-
Apache Flink | Apache Spark | C plus plus | Data Mining | Data ModelingEntry-level Full TimeSan Jose, California, United States8h ago
-
Senior AI Engineer – AI Platform USD 140K-160KAWS | Agentic AI | Alerting | Alignment | Distributed SystemsDaily meal specials | Dry cleaning | Free shuttle transportation | Gourmet cafeteria | Group fitness classesSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R9h ago
-
Senior ML Engineer – AI Platform USD 140K-175KCNN | Data Pipelines | Embeddings | Human-in-the-loop | InferenceDaily group classes | Dry cleaning | Free onsite fitness center | Gourmet cafeteria | In person interview flexibilitySenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States9h ago
-
Senior Software Engineer, Google Distributed Cloud AI USD 174K-252KBilling | Cloud Networking | Container Orchestration | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Staff Research Engineer, Applied AI, DeepMind USD 207K-300KAlgorithms | Data Mining | Data Structures | Dataset curation | Deep learningSenior-level Full TimeMountain View, CA, USA9h ago
-
Software Engineer III, AI/ML, Foundational Lanes USD 147K-210KAutomation | C++ | Computational Geometry | Computer Vision | Data ProcessingSenior-level Full TimeMountain View, CA, USA9h ago
-
Agent systems | Agentic Frameworks | Backend Development | C plus plus | Data PipelinesSenior-level Full TimeSan Bruno, CA, USA; Mountain View, …9h ago