Backend Software Engineer (Evals)
Tasks
- Build backend services and APIs
- Build continuous eval monitoring frameworks
- Build scalable maintainable systems
- Collaborate with data science and research teams
- Design eval pipelines
- Integrate and transform data for AI workflows
- Own development lifecycle for backend systems
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Agent systems | Data Processing | Data Processing Pipelines | Distributed Systems | Drift monitoring | FastAPI | Golden datasets | LLM Evaluation | Language Models | Large Language Models | Machine Learning | Multi-Agent | Multi-Agent Systems | PostgreSQL | Processing pipelines | Prompting | Python | Regression Monitoring | Tool use
Education
N/A
Roles
Backend | Backend Software Engineer | Engineer | Software Engineer
Regions
Countries
States
Related jobs
-
Senior Data Engineer, Strategic Partnerships & IMPACT360 USD 154K-209KAWS Glue | AWS Lake Formation | AWS Lambda | Amazon Athena | Apache AirflowSenior-level Full TimeSeattle, Washington, USA13h ago
-
Software Engineer, Privacy & Data Governance USD 150K-350KAPI Development | Anonymization | By Design | C++ | Compliance MonitoringSenior-level Full TimeSan Jose, CA13h ago
-
Applied AI Engineer, Silicon Engineering USD 150K-275KC++ | CI/CD | Context engineering | Continuous integration | Coverage analysisDaily meals | Housing subsidy | Medical, dental & vision coverage | Relocation support | Unlimited compute budgetMid-level Full TimeSan Jose14h ago
-
AI Agent | AI Agent Development | Agent Development | Analytics | BI reportingMid-level Full TimeUS-CA-Menlo Park23h ago
-
Embedded Systems Engineer USD 110K-150KARM Cortex | ARM Cortex A | ARM Cortex-M | C plus plus | CANDental insurance | Employee stock options | Equity compensation | Health insurance | Paid time offMid-level Full TimeKearny, NJ1d ago
-
MLOps Engineer USD 140K-180KA/B | A/B Testing | AWS Lambda | AWS Step Functions | Airflow401k matching | Dental insurance | Educational expenses | Flexible PTO | Flexible spending accountSenior-level Full TimeSan Antonio, Texas, United States1d ago
-
Senior AI Engineer, Gen AI USD 170K-210KAgents SDK | Embeddings | FastAPI | Hugging Face | LLM-as-judge401k match | Flexible time off | HSA employer contributions | ISO stock options | Medical/Dental/Vision insuranceSenior-level Full TimeChicago, IL1d ago
-
Senior Staff MLOps Engineer USD 190K-315KAWS | Apache Airflow | Apache Spark | Bash | CI/CD401k match | Cell phone stipend | Fertility and family building support | Flexible vacation | Gender-affirming careSenior-level Full TimeSan Francisco1d ago
-
Staff AI engineer USD 167K-250KAI Evaluation | AWS | Agent Orchestration | Caching | Data PipelinesEquity participation | Flexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
Space Operations Engineer (Embedded Software) USD 119K-160KARM | C# | C++ | Communication Protocols | Data ProcessingMid-level Full TimeSan Francisco, CA1d ago
-
Data Engineer USD 107K-143KApache Cassandra | Apache Hadoop | Apache Spark | Big Data | Data ModelingSenior-level Full TimeMountain View, CA1d ago
-
Mechatronic/Robotics Engineer or Systems Integration Engineer - Camera and Sensor Calibration USD 132K-200KAutomation | Bash | C++ | Camera Calibration | Computer VisionOnsite workMid-level Full TimeMountain View, CA1d ago
-
AI Engineer USD 140K-180KAgent workflows | Airtable | Atlassian | ChatGPT enterprise | EmbeddingsHybrid work modelMid-level Full TimeNew York, New York1d ago
-
Senior Machine Learning Engineer USD 150K-175KAWS SageMaker | Airflow | Argo | Azure Machine Learning | CI/CDSenior-level Full TimeNew York, NY1d ago
-
Senior Software Engineer USD 140K-185KAutomated testing | CI/CD | Cloud infrastructure | Containerization | Docker401K company matching | Dental insurance | Dependent care benefits | FSA | Life insuranceSenior-level Full TimeBoulder, CO1d ago
-
Enablement Engineer USD 105K-122KAPI Integration | Ansible | Bash | Connectwise | Git401k match | Dental insurance | Health insurance | Life insurance | Long-term disability insuranceSenior-level Full TimeDallas, TX, US1d ago
-
API Gateway | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHouston, TX, United States1d ago
-
ML Engineer, Agentic Systems USD 175K-275KDeep learning | Experiment design | Fine Tuning | Language Models | Large Language Models401k match | Catered lunch | Commuter benefits | Dental insurance | Health insuranceMid-level Full TimeUnion Square, New York City1d ago
-
ML Engineer, Generative Video USD 175K-275KAutoregressive models | CUDA | Debugging | Deep learning | Diffusion Models401k match | Catered lunch | Commuter benefits | Dinner stipend | Grubhub subscriptionMid-level Full TimeUnion Square, New York City1d ago
-
Forward Deployed Engineer, DeepMind USD 174K-253KAPI Integration | Benchmarking | Generative AI | JavaScript | Language ModelsMid-level Full TimeMountain View, CA, USA; New York, …2d ago
-
Software Engineer III, AI/ML, Retail Ads USD 147K-211KA/B | A/B Testing | B testing | C++ | Data StructuresSenior-level Full TimeMountain View, CA, USA2d ago
-
C++ | Co-design | Compilers | Data Analysis | DebuggingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA2d ago
-
Data Engineer, Quality Intelligence USD 144K-191KAutomated Monitoring | CI/CD | Cause analysis | Confluence | DBTOnsite work | Travel 10 to 20 percentMid-level Full TimeCosta Mesa, California, United States2d ago
-
Senior-level Full TimeUnited States R2d ago
-
Software Engineer, Inference Platform USD 220K-260KC++ | CI/CD | Debugging | Distributed Systems | GoMid-level Full TimeSunnyvale, CA2d ago