Principal Engineer, LLM (Platform and Tooling)
Tasks
- Build platform components for model inference and tooling productivity
- Define and drive multi year technical roadmap for GenAI core platform
- Develop evaluation pipelines for model accuracy and safety
- Establish operational standards for GenAI integrations
- Identify and mitigate systemic technical risks for company wide AI initiatives
- Lead architecture and design for LLM inference orchestration and compliance
- Mentor principal engineers and senior engineers
Perks/Benefits
- 401k match
- Catered lunches
- Company holidays
- Employee assistance program
- Employee resource groups
- Employee stock purchase plan
- Financial wellness resources
- Health savings account contributions
- Income protection life insurance AD D and disability coverage
- Medical, dental & vision coverage
- Micro kitchens
- Paid family and parental leave
- Paid time off
- Productivity allowance
- Quarterly travel for onsite collaboration
- Remote work flexibility
- Sick and Safe Leave
- Wellness allowance
Skills/Tech-stack
Cloud Architecture | Cost Optimization | Data Privacy | Docker | Explainability | Fairness | FastAPI | Hallucination mitigation | Inference Optimization | Kubernetes | LLM Inference | LLM Inference Optimization | LLM-as-a-Judge | Langchain | Language Models | Large Language Models | Latency optimization | Learning platform | Llamaindex | Machine Learning | Machine Learning Model Evaluation | Machine learning platform | Model Deployment | Model Evaluation | ONNX | OpenAI API | Python | Quantization | RAG Architecture | React | Reliability Engineering | Retrieval-Augmented Generation | Spring | Streaming | Terraform | TypeScript | Vector Databases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level Full TimeChicago, Illinois, USA R10h ago
-
Sr. Embedded Detection Analyst USD 140K-207KAI tools | Alert Correlation | Cause analysis | Data Analysis | Detection engineeringSenior-level Full TimeRemote - USA R11h ago
-
AWS | Benchmarking | Code Quality | Code review | Data Pipelines401k matching | Dining | Flexible spending accounts | Healthcare | Life insuranceSenior-level Full TimeBoston Office R12h ago
-
Cirq | Jupyter Notebook | Proof Of Production | Proof of Concept | Python401k matching | Home Technology Stipend | Medical, dental, vision plans | Paid Holidays | Parental/adoption leaveSenior-level Full TimeRemote, US R15h ago
-
Senior, Machine Learning Engineer - End-to-End USD 226K-271KBEV Models | Computer Vision | Diffusion Models | Distributed Training | Imitation Learning401k matching | AD and D insurance | Company holiday office closures | Flexible schedule | Life insuranceSenior-level Full TimeRemote - U.S, Ann Arbor, MI R15h ago
-
Principal, Data Engineer USD 105K-160KAWS | Airflow | Amazon Redshift | BigQuery | C++401k matching | Dental insurance | Health insurance | Paid Company Holidays | Paid time offSenior-level Full TimeUnited States R15h ago
-
API Integration | Asynchronous processing | Containerization | Data Pipelines | Deep learningSenior-level ContractAnnapolis, United States R19h ago
-
Engineer II, Data USD 108K-125KAWS Data | AWS Data Warehouse | AWS EC2 | AWS Glue | AWS Lambda401k safe harbor | Employee discounts | Flexible schedule | Floating holidays | HSA contributionMid-level Full TimeUnited States R19h ago
-
Principal Data Scientist USD 72K-97KBioinformatics | Data Quality | Data Visualization | Data pipeline | Data quality controlDental insurance | Disability insurance | ECO pass | Hybrid schedule | Life insuranceSenior-level Full TimeAurora R20h ago
-
Data Engineer II USD 82K-130KAWS | Airflow | Asana | CI/CD | DBTCollaborative work environment | Fixed term position with renewal possibility | Mentorship and guidance | Remote work within United StatesMid-level Full TimeUnited States R21h ago
-
Data Engineer USD 118K-159KAWS | Airflow | Apache Spark | Azure | BigQuery401k plan | Health and wellness benefits | Remote work options | Unlimited PTOMid-level Full TimeNew York, NY R1d ago
-
Lead Gameplay AI Engineer USD 195K-243KC# | C++ | Game AI | Machine Learning | Unreal Engine401k match | Dental insurance | Disability insurance | Flexible PTO | Life insuranceSenior-level Full TimeUnited States (Remote) R1d ago
-
Data analytics | Language Processing | Machine Learning | Natural Language | Natural Language ProcessingCollaborative environment | Mentorship | TrainingSenior-level Full TimeSan Francisco, California, United States - … R1d ago
-
AI Engineer USD 175K-226KAPI | AWS | Asynchronous Communication | Authentication | AuthorizationHealth benefits | Learning and growth | Professional development | Remote work | Travel opportunitiesSenior-level Full TimeUSA - Remote, United States R1d ago
-
Agile | Apache Spark | Azure | Azure Data | Azure Data Factory401k match | Company-Funded Pension | Dental insurance | Disability insurance | Education benefitSenior-level Full TimePrudential Tower, 655 Broad Street, Newark, … R1d ago
-
Staff Machine Learning Engineer USD 130K-260KAirflow | Artificial Intelligence | Batch inference | C# | C++401k match | Adoption Assistance | Career mentorship | Certification assistance | Fertility assistanceSenior-level Full TimeCA Palo Alto - JPS, United … R1d ago
-
Senior Data Engineer - Remote USD 42K-44KArgo CD | Azure DevOps | CI/CD | DBT Core | Data Governance401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeHome Office, United States R1d ago
-
Staff ML Engineer USD 190K-215KAWS CDK | AWS CloudFormation | AWS Lambda | AWS SageMaker | Airflow401k matching | Disability insurance | Employee assistance program | Health, dental, and vision insurance | In person interview requirementSenior-level Full TimeRemote Location, United States R1d ago
-
Senior Software Engineer USD 185K-213KAWS | Angular | Azure | Buildah | DockerCareer development | Employee resource groups | Flexible WFH policy | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-California-Remote, United States R1d ago
-
Staff Software Engineer, Enterprise AI Platform USD 165K-194KAWS | Azure | C plus plus | C# | Cloud platformCareer development | Employee resource groups | Flexible WFH policy | Generous PTO | Internet reimbursementSenior-level Full TimeUS-Texas-Austin, United States R1d ago
-
Computer Vision | Proprioception | PyTorch | Python | Reinforcement LearningMid-level Full TimeUS, HI, Virtual Location - Hawaii R1d ago
-
Agile | Anomaly Detection | Clustering | Confluence | Data Visualization401k match | Disability coverage | Employee assistance program | Employee scholar program | Hybrid work scheduleMid-level Full TimeUS-PR-AGUADILLA-110 ~ Rd 110 N Km … R1d ago
-
Senior AI Engineer - Agentic USD 161K-220KAI Agents | API Development | Autogen | Channel communication | Context engineeringSenior-level Full TimeLehi, Utah, Open to Remote R1d ago
-
Data Science Engineer USD 146K-222KAnomaly Detection | Computer Vision | Cybersecurity Analytics | Data Analysis | Data Visualization401k | Education reimbursement | Flexible schedule | Hybrid work | Relocation assistanceMid-level Full TimeLivermore, CA, United States R1d ago
-
Lead Data Engineer USD 316K-506KBig Data | Continuous Delivery | Data Architecture | Data Engineering | Data GovernanceFlexible work arrangements | Learning and development programs | Mentoring and coaching | Remote workSenior-level Full TimeChicago, Illinois, USA R1d ago