Software Engineer, Model Evaluation and Improvement
Tasks
- Analyze model failure modes
- Build datasets for model evaluation
- Build scalable data pipelines
- Collaborate with AI labs to improve models
- Curate transform validate scientific data
- Run experiments across frontier models
- Translate scientific judgment into evaluation criteria
Perks/Benefits
Skills/Tech-stack
Data Curation | Data Pipelines | Data Validation | Evaluation | Experimentation | Language Models | Language Processing | Large Language Models | Machine Learning | Natural Language | Natural Language Processing | Python
Education
N/A
Regions
Countries
States
Related jobs
-
AI Developer USD 36K-40KAPI Integration | Chatbot | Conversational AI | Data Analysis | Flow DesignerRemote work flexibilityMid-level Full Time Part TimeAnywhere - US (Remote/Work from Home), …15h ago
-
Senior Machine Learning Engineer USD 171K-270KAWS | Agentic Systems | Amazon EKS | Azure | CI/CD25 annual days of vacations | Coffee and fruit | Flexible working hours | Gym allowance | Health insuranceSenior-level Full TimeLisbon IT Campus - Swiss Post16h ago
-
Senior Full Stack AI Developer USD 125K-185KAWS | Application development | Azure | CI/CD | Cloud EngineeringEmployee benefits | Government security clearance assistance | Remote workSenior-level Full TimeWork from home, VA, United States16h ago
-
Mid-level Full TimeARLINGTON, VA, United States16h ago
-
AI Software Engineer USD 91K-169KAgile | Bash | C++ | Cloud Computing | Containers401k match | Dental insurance | Education assistance | Employee assistance program | Flexible schedulesMid-level Full TimeManassas, VA, US19h ago
-
Software Engineer Algorithms and Analysis USD 98K-182KADA | C++ | Cameo | Java | MATLAB401k match | Education assistance | Flexible work arrangements | Holidays | Paid time offMid-level Full TimeHuntsville, AL, US19h ago
-
Software Engineer Algorithms & Analysis USD 81K-150KADA | C++ | Linux | MATLAB | Modeling and Simulation401k match | Dental insurance | Education assistance | Employee assistance program | Flexible work arrangementsMid-level Full TimeHuntsville, AL, US19h ago
-
Entry-level Full TimeCambridge, MA, Arlington, VA, Seattle, WA20h ago
-
Entry-level Full TimeCambridge, MA20h ago
-
Senior-level Full TimeCambridge, MA20h ago
-
AI Engineer USD 180K-225KAWS | Agentic Workflows | Airflow | BigQuery | CI/CD401k match | Dental and vision coverage | Employee Assistance Program (EAP) | Employee discounts | HSA contributionsSenior-level Full TimeRemote, US R22h ago
-
Data Scientist Graduate Co-op USD 76K-125KAgile | Artificial Intelligence | Computer Vision | Data Modeling | Data VisualizationAgile work environment | Collaborative team cultureEntry-level Full TimeCambridge, MA, Arlington, VA23h ago
-
Staff Machine Learning Engineer, Financial Connections USD 212K-318KApache Spark | Data Pipelines | Language Models | Large Language Models | Machine LearningSenior-level Full TimeNew York23h ago
-
AI/ML Solutions Engineer USD 139K-200KAI Explainability | AWS Glue | AWS SageMaker | AWS Step Functions | Amazon AthenaMid-level Full TimeMiami Lakes, FL, United States1d ago
-
Principal Machine Learning Engineer USD 240K-420KAgent systems | Architecture | C plus plus | Compliance | Deep learning401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R1d ago
-
Agent architecture | Benchmarking | Biomedicine | Context engineering | Data integrationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveMid-level Full TimeSan Francisco, CA | New York … R1d ago
-
Solutions Architect - Media USD 152K-209KAWS | Apache Spark | Azure | Delta Lake | Distributed SystemsSenior-level Full TimeLos Angeles, California1d ago
-
Staff Applied AI Inference Engineer USD 185K-225KC++ | CUDA | Docker | High Throughput | KubernetesCommuter benefits | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeDenver, CO - US1d ago
-
Senior Data Engineer USD 140K-170KAPIs | Azure DevOps | DBT | Data Architecture | Data GovernanceDiscretionary bonus | Hybrid work schedule | Training and developmentSenior-level Full TimeNew York, New York, United States R1d ago
-
Mid-level Full TimeNew York, Austin, Miami, Dallas, City …1d ago
-
Data Architect / Engineer USD 150K-206KAirflow | Change Data Capture | Data Capture | Data Governance | Data IngestionSenior-level Full TimeNew York, Austin, Miami, Dallas, City …1d ago
-
Staff Software Engineer, Data Warehouse Foundation USD 177K-364KApache Airflow | Apache Flink | Apache Spark | Apache Superset | Data PipelinesSenior-level Full TimePalo Alto, CA, US; Remote, US R1d ago
-
Senior-level Full TimePeachtree Corners, GA1d ago
-
Tech Lead, Software Infrastructure and Fleet Management USD 150K-294KAPIs | Alerting | C plus plus | CI/CD | Configuration ManagementSenior-level Full TimePalo Alto1d ago
-
Senior Data Engineer USD 109K-164KAI Services | Azure AI | Azure AI Services | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeAustin, Texas, USA R1d ago