Principal Engineer, LLM (Platform and Tooling)
Tasks
- Build platform components for model inference and tooling productivity
- Define and drive multi year technical roadmap for GenAI core platform
- Develop evaluation pipelines for model accuracy and safety
- Establish operational standards for GenAI integrations
- Identify and mitigate systemic technical risks for company wide AI initiatives
- Lead architecture and design for LLM inference orchestration and compliance
- Mentor principal engineers and senior engineers
Perks/Benefits
- 401k match
- Catered lunches
- Company holidays
- Employee assistance program
- Employee resource groups
- Employee stock purchase plan
- Financial wellness resources
- Health savings account contributions
- Income protection life insurance AD D and disability coverage
- Medical, dental & vision coverage
- Micro kitchens
- Paid family and parental leave
- Paid time off
- Productivity allowance
- Quarterly travel for onsite collaboration
- Remote work flexibility
- Sick and Safe Leave
- Wellness allowance
Skills/Tech-stack
Cloud Architecture | Cost Optimization | Data Privacy | Docker | Explainability | Fairness | FastAPI | Hallucination mitigation | Inference Optimization | Kubernetes | LLM Inference | LLM Inference Optimization | LLM-as-a-Judge | Langchain | Language Models | Large Language Models | Latency optimization | Learning platform | Llamaindex | Machine Learning | Machine Learning Model Evaluation | Machine learning platform | Model Deployment | Model Evaluation | ONNX | OpenAI API | Python | Quantization | RAG Architecture | React | Reliability Engineering | Retrieval-Augmented Generation | Spring | Streaming | Terraform | TypeScript | Vector Databases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI Expert USD 148K-175KAWS | Agile | Batch Processing | Data Mapping | Data ModelingHybrid work | Public Trust Clearance | Remote workSenior-level Full TimeMemphis, TN, United States R10h ago
-
Sr . SAP Datasphere + Databricks Engineer - Hybrid USD 180K-248KAPI | Access Control | CI/CD | Data Classification | Data GovernanceHybrid workSenior-level ContractDurham or Philadelphia, United States R14h ago
-
Principal Machine Learning Engineer USD 205K-230KAWS Lambda | BigQuery | C# | CI/CD | Cloud Functions401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeUnited States of America - Remote … R21h ago
-
Principal, Marketing Analytics USD 65K-184KAttribution Modeling | Automation | Business Intelligence | CRM Integration | Churn modelingFlexible paid time off | Flexible working hours | Home office budget | IT equipment budget | Learning budgetSenior-level Full TimeChicago, Illinois R21h ago
-
Freelance Machine Learning Engineer USD 180KLangchain | MLOps | Machine Learning | NumPy | PandasFlexible part-time hours | Project-based assignments | Remote workMid-level FreelanceTexas, United States - Remote R1d ago
-
Freelance Machine Learning Engineer USD 180KLangchain | Language Models | Large Language Models | MLOps | NumPyFlexible weekly hours | Part-time availability | Project based workMid-level FreelanceNew York, United States - Remote R1d ago
-
Freelance Machine Learning Engineer USD 180KLLM | Langchain | MLOps | NumPy | PandasProject based workMid-level FreelanceUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC plus plus | Core ML | Deep learning | Edge Computing | Embedded SystemsCareer growth | No third party employment | Remote work | W2 employmentSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 100K-150KAblation Studies | Accelerator hardware | Data Quality | Data Validation | Data labelingMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Caching | Code reviewCareer growth | Health benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
LLM Fine-Tuning Engineer USD 100K-150KAttention Optimization | DPO | Direct Preference Optimization | Distributed Training | EvaluationMid-level Full TimeUnited States - Remote R1d ago
-
LLM Fine-Tuning Engineer USD 100K-150KAdapter methods | DPO | Dataset curation | Distributed Training | Efficient AttentionMid-level Full TimeUnited States - Remote R1d ago
-
AI Performance Optimization Engineer USD 100K-150KAttention Mechanisms | Benchmarking | C++ | Continuous batching | Data pipelineCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit Logging | Backtesting | C++ | Cloud Computing | ConcurrencyMid-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backups | CRUSH | CSI | CephRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Concurrent Systems | Control Systems | DebuggingMentorship | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI/ML Implementation Engineer (m/f/d) USD 93K-155K8D | APQP | AWS | AWS Lambda | Amazon Bedrock12 paid holidays | Disability benefits | Employee assistance program | Life insurance | Medical, dental & vision coverageSenior-level Full TimeRemote, United States R1d ago
-
Rust, AI Engineer, Director USD 220K-275KAPI Gateway | AWS | Agile | ArgoCD | AzureFlexible time off | Healthcare | Leave benefits | Retirement benefits | Tuition reimbursementExecutive-level Full TimeNY7 - 50 Hudson Yards, New … R1d ago
-
AI Pipelines | Apache Beam | Batch inference | BigQuery | CI/CDContract-to-hire | MentoringMid-level Full TimeChicago, IL R1d ago
-
Mid-level Full TimeChicago, IL R1d ago
-
.NET | AI Foundry | Anthropic | Azure AI | Azure AI FoundryFull suite of benefits | Healthcare impact | Mentorship | Remote workSenior-level Full TimeOak Brook, IL, United States R1d ago
-
Associate Applied AI Engineer USD 85K-100KAPI Integration | Language Models | Large Language Models | Machine Learning | Prompt engineeringDental insurance | Flexible time off | Health insurance | Home internet allowance | Mobile phone allowanceMid-level Full TimeRemote R1d ago
-
Senior AI Engineer USD 200K-220KCI/CD | Code review | Deep learning | Generative AI | LLM Evaluation401k retirement savings plan | Employer sponsored health dental vision | Equity participation | Flexible spending account | Health savings accountSenior-level Full TimeRemote, USA R1d ago
-
Senior Data Engineer USD 166K-275KAWS | Agile | Apache Airflow | CI/CD | Data Governance401k matching | Flexible unlimited time off | HSA FSA matching funds | Medical, dental, vision benefits | OneMedical subscriptionSenior-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer USD 160K-175KAirflow | Apache Beam | Cloud platform | DBT | Dataflow401k | Flexible time off | Home office stipend | Medical/Dental/Vision insurance | Paid Company HolidaysSenior-level Full TimeRemote, US R1d ago