Staff Software Engineer - ML Observability
Boston, Massachusetts, USA; New York, New York, USA
USD 234K-300K Senior-level Full Time
Tasks
- Collaborate cross-functionally to improve product offerings
- Design and implement observability tools for AI systems
- Develop tracing evaluation and debugging tools for LLMs
- Lead development of LLM observability features
- Mentor engineers and influence architecture decisions
- Monitor industry trends in machine learning and observability
Perks/Benefits
- 401k and match
- Dental insurance
- Health insurance
- Inclusive benefits
- Mental health benefits
- Paid time off
- Parental planning
- Professional development
Skills/Tech-stack
Backend architecture | Distributed Systems | Evaluation Techniques | Generative AI | Inference Pipelines | Language Models | Large Language Models | Model internals | Observability Platforms | Prompt engineering | Software Engineering
Education
Roles
Regions
Countries
States
Related jobs
-
Senior-level Full TimeUSA - Atlanta, GA; USA - …9h ago
-
Staff Software Engineer - Distributed Data Systems USD 182K-247KACID transactions | Algorithms | Apache Spark | C++ | Data StructuresSenior-level Full TimeBellevue, Washington11h ago
-
Senior Software Engineer - Distributed Data Systems USD 157K-213KACID transactions | Algorithms | Apache Spark | C++ | Data StructuresSenior-level Full TimeBellevue, Washington11h ago
-
Senior Developer, Data & IT - AI Solutions USD 120K-142KAI Agents | API Integration | AWS | AWS Bedrock | AWS SageMakerDental insurance | Dependent Care Account | Health insurance | Health savings account | Mental health counseling supportSenior-level Full TimeNew York, NY, United States14h ago
-
AI Engineer (Hybrid @ Bellevue, WA or Remote @ Florida) USD 140K-160KAWS | Artificial Intelligence | Asyncio | Evals | Function Calling401k match | Disability benefits | Family leave | Health insurance | Life insuranceEntry-level Full TimeHybrid @ Bellevue, WA or Remote … R14h ago
-
AI Research Engineer USD 190K-280KAgentic AI | Clinical data | Data Pipelines | Data integration | Deep learningDiversity and inclusion initiatives | Flexible work environment | Friendly work environment | Professional developmentMid-level Full TimeSeattle, Washington, United States; South San …15h ago
-
Principal AI Engineer - Nexus Black USD 135K-160KCI/CD | Cloud Native | Cloud Native Architecture | Distributed Systems | EvaluationHybrid workSenior-level Full TimeItasca, United States16h ago
-
Senior MLOps Platform Engineer {S} USD 120K-185KAWS EKS | Airflow | Amazon S3 | Argo CD | Batching401k match | Dental insurance | Employee assistance program | HSA contributions | Health insuranceSenior-level Full TimeColorado Springs, Colorado, United States R16h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI Inference | AI Training | Batch Processing | Compliance | Data InfrastructureExecutive-level Full TimeMountain View, CA, United States16h ago
-
Senior Generative AI Engineer USD 125K-188KAI Safety | AI Search | AWS Bedrock | Amazon SageMaker | Amazon Web ServicesSenior-level Full TimeRidgefield Park, NJ, United States16h ago
-
Senior-level Full TimeMorristown, NJ, United States17h ago
-
Senior Software Engineer - AI Coding Agents USD 160K-235KAI SDK | API Routes | Auth | CI/CD | DockerSenior-level Full TimeUSA - Atlanta, GA; USA - …17h ago
-
Applied AI Engineer USD 137K-275KAI Agent | AI Agent Development | API Integration | Agent Development | AuthenticationFlexible schedule | Free snacks | Sabbatical | Time offMid-level Full TimeAustin, Texas17h ago
-
Manager, Data Engineering USD 130K-166KAWS | Access Controls | Apache Airflow | Audit Logging | AzureCollaborative team culture | Remote work | Work-life balanceSenior-level Full TimeRemote, United States R18h ago
-
AI Search | API Development | AWS | AWS Bedrock | Azure401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States18h ago
-
Prompt Engineer, Claude Code USD 300K-405KAI Safety | Behavioral evaluation | Prompt engineering | Python | System promptsFlexible working hours | Generous vacation | Health benefits | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York …20h ago
-
Staff Software Engineer, Data USD 270KApache Flink | Apache Kafka | Apache Spark | Cloud Data | Cloud data warehousing401k matching | ADND Insurance | Company holidays | Extended parental leave | Flexible spending accountSenior-level Full TimeUSA, Palo Alto20h ago
-
AI Transformation Manager USD 133K-204KArtificial Intelligence | Context engineering | Data Governance | Data Privacy | Data SecurityCareer development | Paid training | Resources and supportMid-level Full TimeReno, NV21h ago
-
Software Engineer, Data Security - USDS USD 118K-237KData Security | Distributed Systems | Language Models | Large Language Models | Performance optimizationEntry-level Full TimeSan Jose, California, United States22h ago
-
Partner Engineering GenAI - US USD 133K-203KAPIs | Artificial Intelligence | C plus plus | Claude | Cloud ComputingSenior-level Full TimeMenlo Park, CA | Seattle, WA …23h ago
-
Software Developer, Scaled Ops AI Acceleration Team USD 147K-203KAI infrastructure | Data Mining | Fine Tuning | Hack | JavaScriptSenior-level Full TimeSunnyvale, CA | Austin, TX | …23h ago
-
Software Engineer - Language (Technical Leadership) USD 213K-293KASR | Benchmarking | C# | C++ | Conversational AISenior-level Full TimeMenlo Park, CA | Seattle, WA …23h ago
-
Code review | Contamination Checking | Data Generation | Data Pipelines | Data ProcessingEntry-level Full TimeMenlo Park, CA23h ago
-
Business Support Engineer USD 136K-197KCall Support | Cloud Computing | Data Analysis | Data Mining | Docker24x7 on-call rotationEntry-level Full TimeMenlo Park, CA23h ago
-
Business Support Engineer USD 159K-223KCloud Computing | Data Analysis | Data Mining | Distributed Systems | Docker24x7 on-call rotation | Cross-functional team collaboration | Global partner supportSenior-level Full TimeMenlo Park, CA23h ago