Machine Learning Engineer - Evaluation
Hybrid in Bangalore, India
R
INR 2500K-4600K (estimate) Mid-level Full Time
Tasks
- Audit evaluation for bias
- Build LLM powered evaluation pipelines
- Build RAG pipelines
- Define evaluation benchmarking infrastructure
- Design and run evaluation experiments
- Detect evaluation model drift
- Fine tune evaluation workflows
- Own evaluation methodology end to end
- Translate model behavior into product outcomes
Perks/Benefits
- N/A
Skills/Tech-stack
AI systems | AI systems engineering | Benchmarking | Bias auditing | Drift Detection | Experiment design | Fine Tuning | LLM Evaluation | Language Models | Language Processing | Large Language Models | Machine Learning | Model Drift | Model Drift Detection | Natural Language | Natural Language Processing | Prompting | RAG | Retrieval-Augmented Generation | Systems engineering
Education
N/A
Related jobs
-
Senior Principal Engineer - Data Engineering INR 3000K-4000KAWS | Apache Spark | Automation | Azure Data | Azure Data FactoryHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimePune - Panchshil, India R19h ago
-
Applied AI Engineer, Agentic Systems INR 2755K-5500K.NET | API Development | Agent Orchestration | Anthropic API | C SharpSenior-level Full TimeRemote - India R1d ago
-
AI Developer GBP 97K-120KC++ | CrewAI | Elixir | Langchain | Language ModelsFully remote | Globally distributed teamMid-level Full TimeAustria; United Kingdom; India; Portugal; Romania; … R1d ago
-
Vice President, Data Quality Lead Engineer INR 3000K-4000KAPI Design | Airflow | Anomaly Detection | CI/CD | DBTFlexible time off | Flexible working model | Healthcare | Retirement plan | Tuition reimbursementSenior-level Full TimeM11 - Commers III, 43, 44 … R1d ago
-
Senior GenAI Developer INR 2500K-4800KAPI Gateway | AWS Bedrock | Agent systems | Agentic RAG | Amazon LambdaCertification programs | Global client projects | Health insurance | Internship opportunities | Language coursesSenior-level Full TimeAll Cities, India R2d ago
-
Associate Principal Engineer, Data Science INR 1500K-2000KANOVA | CI/CD | Cloud Architecture | Deep learning | GCPMid-level Full TimeRemote, India R2d ago
-
Mid-level Full TimeRemote, India R2d ago
-
Associate Principal Engineer, Data Science INR 1800K-2500KANOVA | AWS | Azure | CI/CD | Cloud ArchitectureMid-level Full TimeRemote, India R2d ago
-
Associate Principal Engineer, Data Science INR 1500K-2000KANOVA | AWS | Azure | CI/CD | Cloud ArchitectureMid-level Full TimeRemote, India R2d ago
-
Mid-level Full TimePune - Tower 6, India R2d ago
-
AI Engineer, LLM Systems & Agentic Workflows GBP 97K-130KAgentic Workflows | Anthropic API | Constrained decoding | Evaluation Pipelines | Go100 percent remote | Employee referral bonuses | Flexible time off | Fun events | Room to growSenior-level Full TimeArgentina; Brazil; Chile; Colombia; Costa Rica; … R2d ago
-
Sr. AI engineer (Remote) USD 50K-120KAWS | AWS CloudWatch | AWS SageMaker | Apache Spark | CI/CDRemote workSenior-level Full TimeIndia, Remote R3d ago
-
AI Engineer INR 2755K-4600KAI Safety | API Integration | Access Controls | Agent Orchestration | Data Leakage PreventionAsynchronous work | Continuous learning | High-performance culture | Knowledge sharing | Remote workSenior-level Full TimeRemote, Bangalore R3d ago
-
Senior AI Engineer INR 2500K-4000KAPI Gateway | API Integration | AWS CloudFormation | AWS Lambda | Amazon ECREmployee assistance program | Flexible work | Free Apps Access | Free Economist subscription | Free Podcasts AccessSenior-level Full TimeGurugram R3d ago
-
Senior AI Engineer INR 2500K-4000KAPI Gateway | AWS Lambda | Agile | Airflow | Amazon ECRAnnual leave | Employee assistance program | Flexible working | Free access to Economist content | Moving home supportSenior-level Full TimeBengaluru, Karnataka, India R3d ago
-
APIs | AWS | Automated testing | Azure | ClassificationEducational assistance | Flexible working hours | In-house soft skills training | Medical insuranceSenior-level Full TimeRemote - India R3d ago
-
Senior Staff Applied ML Engineer INR 3000K-4000KAPIs | Amazon SageMaker | Classification | Clustering | Dimensionality ReductionSenior-level Full TimeIndia - Remote R3d ago
-
Remote Senior Data Engineer (ETL Data Modeling) INR 2040K-3500KAPIs | AWS EMR | AWS Glue | AWS Lake Formation | Amazon RedshiftDynamic working environment | Flexible schedule | Flexible working hours | International work environment | Low hierarchySenior-level Full TimeKarnataka, Bengaluru, India R3d ago
-
Cloud Platform & AI Engineer INR 1500K-2400KAWS Bedrock | AWS CloudFormation | Amazon SageMaker | Amazon Web Services | Artificial IntelligenceHybrid work transition | Remote work flexibilityMid-level Full TimeRemote- India- Gurugram R3d ago
-
Senior-level Full TimeBangalore (Flexible), India R3d ago
-
Mid-level Full TimeIndia Virtual R3d ago
-
Senior Lead Engineer INR 2500K-4500KAPI Integration | Agent systems | Agentic AI | Autogen | CrewAISenior-level Full TimeRemote Working, India R4d ago
-
Senior-level Full TimeNoida, India R4d ago
-
Sr. Engineer - Data & ML Platform (Hybrid, IND) INR 3000K-4000KAirflow | Apache Flink | Apache Spark | Blob Storage | CI/CDEmployee networks | Great Place to Work certified | Paid Holidays | Paid adoption leave | Paid parental leaveSenior-level Full TimeBangalore, India R4d ago
-
FastAPI | Fine Tuning | Flask | Hugging Face | LangchainAutonomy | Mission-driven work | Paid learning Saturdays | Paid vipassana breaks | Remote-firstSenior-level Full TimeIndia (Remote) R5d ago