Machine Learning Engineer (Agent Intelligence & Evaluations)
Tasks
- Build LLM as judge evaluation rubrics
- Correlate audio packets STT hypotheses and tool calls by conversation ID
- Create adversarial conversational datasets
- Design audio native evaluation frameworks
- Generate fine tuning data and prompt updates
- Implement end to end observability for voice agents
- Mine production traces for failure patterns
- Validate fixes under adversarial replay
Perks/Benefits
Skills/Tech-stack
Adversarial Training | Arize | Audio Processing | Automatic Speech Recognition | Dataset Synthesis | LLM Evaluation | LLM tracing | Langfuse | Language Processing | Latency analysis | Machine Learning | Natural Language | Natural Language Processing | OpenTelemetry | Prompt engineering | Python | Speech Recognition | Tool use
Education
N/A
Related jobs
-
(Senior) AI Engineer - Data & AI Organisation (all genders) 1 INR 2500K-5000KAPI Development | Amazon Web Services | Apache Spark | CI/CD | DBTSenior-level Full TimeBangalore, Karnataka, IN, 5601004h ago
-
(Senior) Software Engineer (all genders) 1 INR 3600K-4720KAI Safety | AWS | Amazon Web Services | Apache Spark | Automated testingSenior-level Full TimeBangalore, Karnataka, IN, 5601004h ago
-
AI Engineer (India, China) INR 2500K-4064KAPIs | AWS | Airflow | Apache Spark | AutogenAnnual leave | Flexible working | Life insurance | Medical insurance | Parental leaveMid-level Full TimeBangalore, IN5h ago
-
Mid-level Full TimeIndia - Bengaluru6h ago
-
AWS S3 | AWS storage | AWS storage services | Active Directory | Ansible100 percent remote work | Flexible time off | Holiday allowance | Medical insurance | Shift allowanceMid-level Full TimeIndia R8h ago
-
Senior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN9h ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R11h ago
-
API Testing | AWS | Azure | BLEU | Bias TestingOnsite workSenior-level Full TimeBengaluru, India11h ago
-
Senior Developer - Java/LLMs/RAG/AI Agents (7-12 years) INR 1900K-3000KAI Agents | AI Core | Benchmarking | CAP | Cloud loggingConstant learning | Flexible working models | Great benefits | Health and well-being | Skill growthSenior-level Full TimeBangalore, IN, 56006611h ago
-
Mid-level Full TimeBengaluru East, Karnataka, India R17h ago
-
Data Engineer - DataOps (Position located in Bengaluru, India) INR 1500K-2500KAI/ML | Analytics | Data Lake | Data Modeling | Data PipelinesAdoption Assistance | Certification completion bonus | Certification reimbursement | Employee referral bonus | Tuition reimbursementSenior-level Full TimeBengaluru, India18h ago
-
Analytics Engineer(Position located in Bengaluru, India) INR 2500K-3380KArtificial Intelligence | DBT | Data Governance | Data Quality | Data TestingAdoption Assistance | Certification completion bonus | Certification reimbursement | Company bonuses | Employee referral bonusSenior-level Full TimeBengaluru, India18h ago
-
IT Automation and AI Engineer INR 1200K-2100KAsynchronous Python | CI/CD | Cloud Native | Cloud Native Architecture | Distributed SystemsHybrid work | Onsite onboarding | Professional developmentMid-level Full TimeBengaluru, India21h ago
-
Data Engineer II INR 1000K-1000KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Amazon Web ServicesEmployee assistance program | Hybrid work environment | Learning stipend | Medical coverage | Role-specific trainingMid-level Full TimeMumbai R21h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkComplimentary games | Family leave | Health insurance | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India21h ago
-
Senior-level Full TimeHyderabad, India21h ago
-
API Design | Apache Airflow | Apache Beam | Apache Flink | Async messagingContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R22h ago
-
Senior BI Engineer - Tableau & Python INR 3000K-4000KBusiness Intelligence | Data Modeling | Data Visualization | Data Warehousing | DatabricksCareer growth | Certification support | Flexible collaboration | Innovation time | MentorshipSenior-level Full TimeHyderabad, TS, India23h ago
-
Applied AI ML Senior Associate INR 3264K-5000KAWS | Azure | CI/CD | Cloud platform | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Associate Program Manager INR 2000K-4000KAI Agents | AI Foundry | AI Governance | AI orchestration | APIsMid-level Full TimeChandigarh, India23h ago
-
AI/ML Engineer INR 1860K-4000KAI Agent Builder | AI Pipelines | AI vector search | Agent Builder | AirflowMid-level Full TimeChennai, Tamil Nadu, India23h ago
-
GenAI Developer INR 1500K-2129KDeep learning | Docker | GenAI | Language Processing | Machine LearningWell-being focusEntry-level Full TimePune, Maharashtra, India1d ago
-
Senior Data Engineer INR 3600K-5400KAPI Development | AWS | Apache Airflow | Automation | AzureDiscretionary bonus scheme | Family-friendly leave | Flexible working | Hybrid working | Life assuranceSenior-level Full TimeDelhi R1d ago
-
Senior-level Full TimeHyderabad, Telangana, India1d ago
-
Engineering-L2-Bengaluru-Analyst-Software Engineering INR 1500K-2500KApache Spark | Avro | CI/CD | Data Clustering | Data ModelingEntry-level Full TimeBengaluru, Karnataka, India1d ago