Senior Automation Specialist, AI Operations

Remote R

USD 75K-85K Senior-level Full Time

@ F...

Apply Save

Found 2d ago

Tasks

Build dataset creation automations
Build evaluation pipelines
Collaborate cross-functionally
Create lightweight operational processes
Define and track performance metrics
Define evaluation approaches
Design gold datasets
Develop automated evals
Develop manual evals
Ensure real world scenario coverage
Identify next steps and unblock progress
Implement LLM as judge evaluations
Improve evaluation data workflows
Refine datasets evaluations and workflows
Translate ambiguous problems into evaluation frameworks

Perks/Benefits

Skills/Tech-stack

Education

N/A

Roles

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Senior Staff Engineer, PLM, AI ML Integration INR 2500K-4500K

AI-enabled | AI-enabled automation | API Integration | Artificial Intelligence | BOM structures

Senior-level Full Time

Remote, India R

4h ago
AI Automation Specialist A USD 82K-90K

API | Airtable | Automation Anywhere | CRM | Google AI

Google Workspace | Project management tools | Remote work | Slack

Entry-level Full Time

Pakistan - Remote R

12h ago
Principal Architect, AI/ML USD 180K-250K

Agent Builder | Agentic Systems | Agentic Workflows | Artificial Intelligence | Bias Mitigation

Senior-level Full Time

Remote R

19h ago
ML Engineer Summer Intern (Remote & Paid) USD 40K-42K

Artificial Intelligence | Classification | Data Visualization | Data Wrangling | Generative AI

401k participation | Flexible work schedule | Remote work | Volunteer time off

Entry-level Internship

United States, United States R

19h ago
Data Analyst & AI Intern USD 59K-67K

Audio signal processing | Convolutional Neural Networks | Data Documentation | Data Preprocessing | Data Visualization

Dental insurance | Holiday pay | Medical insurance | On-site work | Sick leave

Entry-level Full Time Internship

Columbia, MARYLAND, United States R

19h ago
AI Solution Architect USD 184K-287K

Ansible | CI/CD | Containerization | Docker | Experiment tracking

Additional fully paid sick leave days | Additional vacation days | Allowance for life events and birthdays | Flexible working hours | Free snacks and drinks

Senior-level Full Time

Poland, Serbia, Lithuania, Cyprus, Georgia R

20h ago
AI Data Engineer

AWS EventBridge | AWS Lambda | AWS S3 | CI/CD | Data Modeling

DEI initiatives | Employee development programs | Fully remote options | Healthcare stipend | Mental health recharge days

Mid-level Full Time

Remote - Mexico R

20h ago
AI Data Engineer USD 95K-124K

AWS | AWS Lambda | CI/CD | Data Modeling | Embeddings

Full Remote or Hybrid Work | Healthcare stipend | National holidays | Paid mental health days | Unlimited time off

Mid-level Full Time

Remote - Argentina R

20h ago
AI Data Engineer BRL 150K-240K

AWS | AWS EventBridge | AWS Lambda | AWS S3 | Automated testing

DEI initiatives opportunities | Fully remote or hybrid work | Healthcare stipend | National holidays | Paid mental health recharge days

Mid-level Full Time

Remote - Brazil R

20h ago
AI Data Engineer COP 42000K-42000K

AWS | CI/CD | Data Modeling | Data Quality | Data quality monitoring

EAP benefits | Employee assistance program | Employee growth and leadership opportunities | Full remote work | Hybrid work

Mid-level Full Time

Remote - Colombia R

20h ago
Head of AI Engineering (M/F/D) EUR 90K-120K

Artificial Intelligence | Change Management | Code review | Deployment | Fine Tuning

Family care policy | Flexible work environment | Health insurance | Home office equipment support | Lunch vouchers

Executive-level Full Time

Paris, IDF, France R

22h ago
Technical Lead, AI Initiatives - India INR 2500K-4500K

A/B | A/B Testing | APIs | AWS | Agent evaluation

Hybrid work options | Remote work flexibility

Senior-level Full Time

India R

1d ago
Senior AI Fullstack Engineer USD 147K-203K

AI orchestration | AWS Lambda | Asynchronous programming | Deployment | Fine Tuning

Certifications | Corporate English classes | Courses | Flexible working hours | Hybrid work

Senior-level Full Time

Belgrade, Belgrade, Serbia R

1d ago
(Senior) AI Engineer (all genders) EUR 65K-85K

Cloud Platforms | Containerization | DevOps | Docker | Language Models

30 days vacation | Bike leasing | Company fitness | E-learning reimbursement | Family friendly policy

Mid-level Full Time

Bremen, Munich, Mannheim, Mainz, Berlin, Remote R

1d ago
AI Engineer A ILS 225K-280K

A/B | A/B Testing | B testing | Benchmarking | Data Analysis

Autonomy | Company provided MacBook | Continuous learning | Fully remote | Paid national holidays

Mid-level Full Time

Israel R

1d ago
Senior AI Engineer USD 150K-220K

A/B | A/B Testing | API contracts | AWS | Alerting

Health benefits | Learning and development | Paid time off | Remote work

Senior-level Full Time

Argentina R

1d ago
AI Research Engineer USD 292K-417K

Blockchain | Cryptography | Decentralized networks | Distributed Systems | Federated Learning

Entry-level Full Time

Anywhere R

1d ago
AI Researcher USD 295K-365K

Cryptography | Distributed Training | Distributed inference | Federated Learning | Incentive design

Mid-level Full Time

Anywhere R

1d ago
AI Research Scientist USD 155K-258K

C++ | Computer Vision | Data Analysis | Data Visualization | Deep learning

Senior-level Contract Full Time

Remote job R

1d ago
AI Solutions Architect USD 127K-191K

AWS | Architecture Design | Azure | C++ | Deep learning

Senior-level Contract Full Time

Remote job R

1d ago
Computer Vision Specialist USD 149K-200K

C plus plus | Computer Vision | Image Processing | Java | Machine Learning

Senior-level Full Time

Remote job R

1d ago
AI Workflow Engineer - Freelance AI Trainer USD 120K-120K

AI Workflow Orchestration | AI workflow | API Integration | Automation | Content Generation

Flexible schedule | Performance-based bonus | Remote work | Stable internet required

Mid-level Freelance

Romania - Remote R

1d ago
AI Workflow Engineer - Freelance AI Trainer USD 100K-100K

API Integration | Anthropic Claude | Automation systems | Context handling | Data Preprocessing

Flexible schedule | Fully remote | Performance-based bonus | Stable internet required

Mid-level Freelance

Spain - Remote R

1d ago
AI Workflow Engineer - Freelance AI Trainer USD 120K-120K

API Integration | Automation | Bias Mitigation | Chaining Logic | Content Generation

Flexible schedule | Performance bonus | Remote work

Mid-level Freelance

Germany - Remote R

1d ago
AI Workflow Engineer - Freelance AI Trainer USD 120K-120K

API Integration | Accuracy Optimization | Automation | Content Generation | Data Preprocessing

Bonus programs | Flexible schedule | Fully remote | Performance bonuses | Stable internet required

Mid-level Freelance

France - Remote R

1d ago