Senior Software Engineer II - Applied AI and Evaluations (Remote Eligible)
Tasks
- Build regression gates
- Collaborate on agent architecture tradeoffs
- Create golden datasets and scorers
- Design LLM evaluation systems
- Diagnose agent failures
- Establish quality improvement methodology
- Improve prompt and context quality
- Run online evaluation on production traffic
- Tune RAG retrieval performance
- Validate measurable quality gains
Perks/Benefits
- 401k match
- Counseling membership
- Dental insurance
- Flexible time off
- Health insurance
- Life insurance
- Long-term disability
- Monthly stipend
- Paid Holidays
- Parental leave
- Short-term disability
- Teleworking options
- Udemy Courses Access
- Vision insurance
- Volunteer day
Skills/Tech-stack
Agent Orchestration | CI/CD | Chunking Strategies | Context engineering | Databricks | Delta Tables | Embedding Models | MLflow | Machine Learning | Multi-Agent | Multi-agent orchestration | Prompt engineering | Python | RAG evaluation | Retrieval-Augmented Generation
Education
Related jobs
-
2 Tower Architecture | Bias Mitigation | Cross-team | Cross-team Collaboration | EthicsSenior-level Full TimeSan Francisco, CA, US; Remote, CA, … R15h ago
-
Analytics Engineer USD 150K-187KAirflow | Azure Data | Azure Data Factory | DBT | Data Factory401k with company match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimeDallas, TX - Hybrid (3x in … R15h ago
-
Machine Learning Engineer USD 120K-160KAdaptive modulation | Anomaly Detection | Beamforming | C++ | Cognitive radioHybrid work scheduleMid-level Full TimeLos Angeles CA R16h ago
-
Lead Machine Learning Engineer USD 172K-276KAWS | Azure | CI/CD | Databricks | Distributed SystemsRemote workSenior-level Full TimeChicago, Illinois, USA R16h ago
-
Senior Data Engineer, Data Infrastructure USD 115K-205KAmazon Web Services | Apache Airflow | Apache Iceberg | Apache Kafka | AutomationEquity package | Flexible vacation | Medical/Dental/Vision insurance | Pet discount plans | Remote workSenior-level Full TimeWashington, DC - Remote R18h ago
-
Senior Data Engineer USD 120K-150KAI | AWS | Apache Airflow | Azure | Cloud platformDental insurance | Health insurance | Inclusive collaborative work environment | Professional growth | Remote workSenior-level Full TimeRemote-USA R19h ago
-
Senior AI Engineer USD 180K-190KAWS | Alerting | Asynchronous programming | Data Parsing | Data Pipelines401k plan | Commuter benefits | Dental insurance | Medical insurance | Remote work Hybrid workSenior-level Full TimeLos Angeles, CA, US; Remote, US R20h ago
-
Staff Embedded Software Engineer (RTOS/FreeRTOS) USD 174K-261KARM | Bazel | C++ | Concurrent programming | Docker401k match | Dental insurance | Health insurance | Paid parental leave | Professional development reimbursementSenior-level Full TimeDearborn, Michigan, United States, Palo Alto, … R21h ago
-
Senior Machine Learning Engineer I // II USD 140K-190KApache Spark | Experimentation | Feature Engineering | Fraud Detection | ML pipelines401k match | Dedicated learning budget | On-demand therapy | Paid parental leave | Stock optionsSenior-level Full TimeDenver, CO; Seattle, WA; Chicago, IL … R22h ago
-
Staff AI Engineer | US | Remote USD 174K-209KAPI Design | Agent systems | BigQuery | CI/CD | ChromaDBAnnual leave policy | Bonus | Equity | In-person onboarding | Remote workSenior-level Full TimeUnited States (Remote) R22h ago
-
Staff Software Engineer, Data Platform USD 180K-275KAPIs | Access Control | Amazon EMR | Apache Kafka | Apache Spark401k match | Catered lunch | Cell phone reimbursement | Commuter benefits | Employee resource groupsSenior-level Full TimeNew York, NY; USA Remote R22h ago
-
Staff Software Engineer, Data USD 180K-275KAWS | Airflow | Apache Hudi | Athena | CI/CD401k match | Catered lunch | Cell phone reimbursement | Commuter benefits | Corporate wellness programSenior-level Full TimeNew York, NY; USA Remote R22h ago
-
Senior Geospatial AI/ML Engineer USD 160K-228KComputer Vision | Deep learning | Docker | Geospatial analysis | KubernetesCommuter benefits | Employee assistance program | Equity | Health savings account | Home office reimbursementSenior-level Full TimeUnited States, Remote R23h ago
-
Senior Data Engineer 2026 - US,UK USD 148K-178KAWS | AWS Redshift | Apache Spark | Azure | Azure SynapseRegional office access | Remote work | Travel opportunitySenior-level Full TimeAtlanta, GA / London, GB - … R1d ago
-
Senior Machine Learning Engineer USD 134K-168KA/B | A/B Testing | B testing | CI/CD | DatabricksGaming license requiredSenior-level Full TimeRemote - US, United States R1d ago
-
Lead AI Engineer USD 98K-206KAWS | Agile | Best practices | CI/CD | ContainerizationFlexible time off | Healthcare benefits | Learning resources | Retirement benefits | Wellness benefitsSenior-level Full Time999 REMOTE, United States R1d ago
-
Senior Applied AI Expert - Federal USD 200K-250KData Preparation | Data Science | Data integration | Generative AI | Machine LearningDental insurance | Flexible time off program | Global Employee Assistance Program EAP | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Washington DC, United States R1d ago
-
Integration Engineer - AI Agentic Solutions - Remote USD 122K-224KAWS | Amazon SNS | Amazon SQS | Authentication | AuthorizationSenior-level Full TimeDallas, TX, US R1d ago
-
AI Engineer - Tech Lead (Remote) USD 132K-221KAWS | Agentic Workflows | Azure | CI/CD | Cloud NativeCareer growth | Mentorship | Remote workSenior-level Full TimeDallas, TX, US R1d ago
-
Platform Engineer (AWS) - Remote USD 110K-181KAWS CodePipeline | Amazon DynamoDB | Amazon EKS | Amazon IAM | Amazon RDSRemote workSenior-level Full Timedallas, TX, US R1d ago
-
Senior AI Engineer - Remote USD 121K-207KAPI Integration | Artificial Intelligence | Conversational AI | Deployment | GitRemote workSenior-level Full TimeDallas, TX, US R1d ago
-
AI Data Engineer - Hybrid/Onsite USD 101K-166KArtificial Intelligence | Batch Processing | Data Analysis | Data Ingestion | Data StreamingHybrid workMid-level Full TimeDallas, TX, US R1d ago
-
Machine Learning Engineer USD 120K-160K3GPP | 802 11 | Adaptive modulation | Anomaly Detection | Beamforming401k with company match | Employee stock purchase plan | Hybrid schedule | Medical, dental, vision benefits | Paid HolidaysMid-level Full TimeLos Angeles, CA, United States R1d ago
-
Frontend/UI Engineer w/ React and AI - Hybrid/Onsite USD 101K-172KArtificial Intelligence | Batch Processing | Data Engineering | Distributed Computing | JavaScriptFlexible work arrangements | Hybrid work | In office attendance as needed for meetings or eventsMid-level Full TimePlano, TX, US R1d ago
-
Apache Spark | C plus plus | FastAPI | Next.js | PandasHybrid work schedule | In office work Monday to Wednesday | Remote work Thursday and FridayMid-level Full TimeHybrid - San Francisco, CA R1d ago