AI Engineer, Evaluation & Quality - 11319
Tasks
- Analyze evaluation results to identify failure modes and report
- Build and maintain automated evaluation pipelines for AI model quality
- Build comparison frameworks for side by side evaluation
- Design quality dashboards for accuracy regression and safety metrics
- Implement automated regression testing for model iterations
- Implement task specific benchmarks and test suites
- Maintain evaluation datasets with versioning and quality validation
- Support A B testing infrastructure for production model validation
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | B testing | CI/CD | Dashboards | Data Visualization | F1-score | Machine Learning | Model Evaluation | Precisión | Python | Recall | Regression testing | Statistical Analysis | Test automation
Education
Roles
AI | AI Engineer | Engineer | Learning Engineer | Machine Learning Engineer
Related jobs
-
Manager, Machine Learning INR 1500K-3000KArtificial Intelligence | Computer Vision | Data Pipelines | Deep learning | Distributed SystemsHealth and wellness programs | Hybrid work model | Time away from workMid-level Full TimeBengaluru, KA, India4h ago
-
Staff Software Engineer, Machine Learning INR 2520K-3880KA/B | A/B Testing | Alerting | B testing | BackpressureEqual opportunity workplace | Health and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India4h ago
-
Sr. Staff Software Engineer, Machine Learning INR 3200K-4725KC++ | Data Pipelines | Deep learning | Experimentation | Generative AIHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India4h ago
-
Principal Staff Software Engineer, Machine Learning INR 1800K-4000KA/B | A/B Testing | B testing | Backpressure Control | CachingHealth and wellness programs | Time awayExecutive-level Full TimeBengaluru, KA, India4h ago
-
Data Scientist I INR 2520K-4500KAWS | Amazon Bedrock | Amazon SageMaker | Autogen | BERTCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600665h ago
-
Senior-level Full TimePune, India6h ago
-
AI Solutions Architect INR 2500K-4500KAWS | Convolutional Neural Networks | Data Governance | Distributed Systems | DockerSenior-level Full TimeIndia - Remote R11h ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R11h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India11h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India11h ago
-
EY - GDS Consulting - AI And DATA -Azure Databricks - Senior INR 2040K-2400KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCoaching and feedback | Flexible working arrangements | Professional development opportunitiesSenior-level Full TimeBengaluru, KA, IN, 56001611h ago
-
Senior-level Full TimeGurugram, India18h ago
-
Mid-level Full TimeGurugram, India18h ago
-
Software Engineer III - Data INR 2520K-3380KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureERG events | Equipment provided | Health coverage | Learning and development | Paid HolidaysSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior Data & Analytics Systems Engineer INR 2520K-3380KApache Airflow | Apache Spark | Cloud Functions | Cloud Storage | Cloud platformSenior-level Full TimeGurugram, India19h ago
-
Mid-level Full TimeGurugram, India20h ago
-
FinOps Data Engineer INR 2520K-3380KAPI Gateway | AWS Glue | Agile | Amazon Athena | Amazon RedshiftSenior-level Full TimeGurugram, India20h ago
-
Senior Data Engineer INR 2520K-3380KAirflow | Apache Dataproc | CI/CD | Databricks | DataformDiversity & inclusion culture | Growth opportunitiesSenior-level Full TimeGurugram, India20h ago
-
Senior-level Full TimeGurugram, India20h ago
-
Data & Analytics Systems Engineer INR 2700K-3880KApache Airflow | Apache Spark | BigQuery | Cloud Functions | Cloud StorageMid-level Full TimeGurugram, India20h ago
-
Senior Data Scientist #3081 INR 2500K-3200KAWS SageMaker | Azure ML | Azure OpenAI | CI/CD | DatabricksFlexible working hours | Global collaboration opportunities | Professional development programs | Recognition programsSenior-level Full TimeChennai, India21h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KAI/ML | CD pipelines | CI/CD | CI/CD pipelines | DockerCompetitive INR salary | Innovative projects | Legal presence in India | Local meet-ups | Remote workSenior-level Full TimePune City, India22h ago
-
AI ML Proactive INR 2500K-3500KAI Stack | API Integration | Agent Builder | BigQuery Vector Search | Cloud ArchitectureSenior-level Full TimeIN-AP-Hyderabad22h ago
-
Senior-level Full TimeIN-KA-Bangalore22h ago
-
Senior-level Full TimeIN-AP-Hyderabad22h ago