Staff Software Engineer - ML Observability
Boston, Massachusetts, USA; New York, New York, USA
R
USD 234K-300K Senior-level Full Time
Tasks
- Develop and extend tools for tracing evaluating and debugging LLMs
- Drive design and implementation of LLM observability features
- Ideate prototype and scale generative AI insights
- Improve observability for drift detection and model evaluation
- Influence architecture decisions
- Mentor engineers
- Monitor troubleshoot and optimize LLM applications in production
- Stay current with machine learning and observability trends
- Work cross functionally with engineering product UX and applied science
Perks/Benefits
Skills/Tech-stack
Architecture Design | Backend Development | Debugging | Distributed Systems | Drift Detection | Generative AI | Inference Pipelines | Language Models | Large Language Models | Machine Learning | Model Evaluation | Observability | Performance Engineering | Prompt engineering | Tracing
Education
Regions
Countries
States
Related jobs
-
Staff AI Engineer USD 176K-298KAgentic Workflows | Chroma | Cost Optimization | Embeddings | Evaluation401k plan | Flexible vacation policy | Medical, dental, and vision coverage | Paid Holidays | Parental leaveSenior-level Full TimeRemote - US R1d ago
-
AWS | Azure | CI/CD | Deep learning | Evaluation methodology401k | Equity options | Health, dental, and vision | Relocation package | Sign-on bonusSenior-level Full TimeSan Francisco R1d ago
-
APIs | Code Development | Evaluation | GraphQL | HubSpot401k matching | Childcare reimbursement | Dental insurance | Health insurance | Internet reimbursementEntry-level Full TimeSeattle Office R1d ago
-
AI workflows | API connectors | APIs | CRM automation | Evaluation401K company matching | Childcare reimbursements | Commuter reimbursements | Generous parental leave policy | Medical/Dental/Vision insuranceSenior-level Full TimeSan Francisco Office R1d ago
-
APIs | CRM automation | Code Automation | Evaluation | GraphQL401k match | Childcare reimbursement | Commuter reimbursement | Medical, dental, and vision insurance | Parental leaveEntry-level Full TimeNew York Office R1d ago
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R1d ago
-
Embedded Hardware Systems Engineer USD 130K-150KAltium Designer | BLE | Bluetooth Low Energy | Bring-up | C++401k matching | Corporate discounts | Dental insurance | Disability insurance | Employee assistance programMid-level Full TimeSan Jose, CA, US R2d ago
-
Staff ML Engineer, Foundation Models USD 251K-310KBayesian Inference | Foundation Models | Generative Modeling | Hierarchical learning | Language ModelsBonus | Equity incentiveSenior-level Full TimeMountain View, CA, USA R2d ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R2d ago
-
AIOps | Anomaly Detection | Anthos | CRD | Control Plane401k plan | Basic life insurance | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeResearch Triangle Park, North Carolina, United … R2d ago
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R2d ago
-
Senior Computer Vision & Machine Learning Engineer USD 140K-206KAblation Studies | CI/CD | Data Pipelines | Docker | Error AnalysisAutonomy | Client project impact | Support for professional growthSenior-level Full TimeRemote, US R2d ago
-
Computer Vision & Machine Learning Engineer USD 150K-200KAblation Studies | CI/CD | Computer Vision | Data Pipelines | DockerEntry-level Full TimeRemote, US R2d ago
-
Staff Data Engineer USD 162K-224KAmazon Managed Workflows for Apache Airflow | Apache Airflow | Apache Druid | Apache Iceberg | CCPA401k employer match | Annual WIN bonus | Flexible vacation | Mental health resources | Paid HolidaysSenior-level Full TimeU.S. Remote R2d ago
-
Sr Staff AI Engineer - Veza USD 190K-334KAgent Orchestration | Algorithms | C++ | Data Structures | Distributed Systems401k plan with match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeMinneapolis, Minnesota, United States R2d ago
-
AI/ML Engineer USD 152K-220K3D Reconstruction | 3D Scene | 3D Scene Understanding | AI Agents | Cloud ComputingAgile team collaboration | Fully remote | Production monitoring ownershipMid-level Full TimeSan Francisco, CA (Hybrid) or United … R2d ago
-
Senior GTM AI Engineer USD 154K-213KAgent Orchestration | Agent Performance | Agent Performance Monitoring | Anthropic Claude | App Development401k match | Catered lunch | Company events | Desk setup stipend | Flexible spending accountsSenior-level Full TimeOakland, California, United States R2d ago
-
Data Science Engineer USD 121K-154KData Visualization | Documentation | Entity Resolution | Fine Tuning | Git401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R2d ago
-
Sr Machine Learning Engineer USD 149K-275KActive Learning | Computer Vision | Data Analysis | Data Pipelines | Data PreprocessingSenior-level Full TimeSanta Clara, CA R2d ago
-
AI Architect USD 120K-197KAI orchestration | Automation | Cloud Computing | Data Governance | Distributed SystemsWeekly earned wage access optionSenior-level Full TimeDurant, OK, United States R2d ago
-
Senior Data Engineer (B2B) USD 105K-135KAutomated testing | BigQuery | DBT | Data Modeling | Data Quality401k matching | Annual class pass credits | Dental insurance | Extended holiday break | Flexible schedulesSenior-level Full TimeRemote, United States R2d ago
-
800-37 | 800-53 | AI Governance | AI orchestration | AI red teaming401k | Dental insurance | Disability insurance | Employee assistance program | Hybrid work scheduleSenior-level Full TimeWashington, DC R2d ago
-
IAA - Principal Data Engineer USD 171K-256KAzure | Azure Synapse | Azure Synapse Analytics | CI/CD | Data GovernanceHybrid work schedule | Onsite expectation 2 days per weekSenior-level Full TimeChicago, IL (Hybrid) R2d ago
-
Software Engineer I USD 97K-122KBatch inference | Cloud infrastructure | Docker | GPU Optimization | GoConference reimbursement | Education reimbursement | Employee assistance program | Flexible time off | Hybrid workEntry-level Full TimeSeattle R2d ago
-
Backend Engineer, Multi-cloud Inference Platform USD 234K-319KAmazon Web Services | Backend Engineering | Cloud platform | Distributed Systems | GenAI401k matching | Flexible paid time off | Health insurance | Local meetups | Remote workMid-level Full TimeUnited States / Canada R2d ago