AI Data Analyst
Tasks
- Categorize AI failure modes
- Collaborate on pre and post change quality reads
- Follow labeling guidelines and rubrics
- Generate quality reporting with recommendations
- Maintain labeled benchmark datasets
- Monitor coverage drift leakage and difficulty distribution
- Perform qualitative analysis for hallucinations and retrieval failures
- Run human labeling for AI response quality
- Triage bad query reports and downvotes
- Validate LLM as a judge against human labels
Perks/Benefits
Skills/Tech-stack
Data Analysis | Data labeling | Information Retrieval | LLM Evaluation | Language Processing | Machine Learning | Natural Language | Natural Language Processing | Quality Assurance | SQL | Spreadsheets
Education
N/A
Roles
AI | AI Data Analyst | Analyst | Data Analyst
Related jobs
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R16h ago
-
Analyst, Data Analysis INR 700K-1000KExcel | Excel Macros | Hadoop | Hive | Microsoft OfficeConference opportunities | Flexible time off | Tuition reimbursement | Workplace flexibilityMid-level Full TimePune, India R22h ago
-
Senior Technical Specialist, AI Solutions : Delhi INR 2500K-4800KAWS | Agent Orchestration | Authentication | Azure | CI/CDHybrid work | Onsite client workSenior-level Full TimeIndia Remote R1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
AI/ML Engineer INR 2000K-3500KAzure | Data Pretraining | Data Structures | DeepSpeed | Distributed SystemsCar lease benefits | Career advancement programs | Certification programs | Continuous learning opportunities | Corporate NPSMid-level Full TimeBangalore, Karnataka, India R1d ago
-
Junior AI Specialist INR 336K-480KAWS | Airflow | Azure | DBT | Data AnalysisCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities , India R1d ago
-
APIs | BigQuery | Clustering | Data Modeling | Data PipelinesCareer autonomy | Flexible working schedules | High-impact projects | Meritocracy driven culture | Remote-friendlySenior-level Full TimeIndia R1d ago
-
Mid-level Full TimeBangalore, KA, IN R1d ago
-
Principal Applied AI Analyst - AI/ML | Data Scientist INR 2771K-4500KCode Documentation | Data Validation | Feature Engineering | GenAI | Language ProcessingSenior-level Full TimeIND - KA - Bangalore - … R1d ago
-
Applied AI Engineer INR 3000K-4500KAI Foundry | AI Governance | AIOps | Azure AI | Azure AI FoundrySenior-level Full TimeIndia - Remote R1d ago
-
Sr Engr Cslt-Data Science INR 2817K-4995KBigQuery | Chatbot | Conversational Analytics | Data Modeling | Data ValidationHybrid work | Work from homeSenior-level Full TimeVDSI, OLYMPIA TECH PARK BLOCK-B 1, … R1d ago
-
Data Analyst, Specialist (Marketing Analytics) INR 800K-1200KA/B | A/B Testing | Adobe Analytics | Adobe Workfront | B testingFinancial wellness programs | Hybrid working model | Personal wellness resources | Physical wellness benefits | Wellness supportMid-level Full TimeHyderabad, India R1d ago
-
Data Analyst / Engineer INR 3000K-4000KBusiness Intelligence | Dashboard Development | Data Engineering | Data Governance | Data LineageBe Well programs | Hybrid-friendly work environmentSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India R1d ago
-
Data Analyst / Engineer INR 3000K-4000KBusiness Intelligence | Dashboard Development | Data Analysis | Data Engineering | Data GovernanceBe Well programs | Employee development | Flexible supportive environment | Hybrid workSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India R1d ago
-
Machine Learning Associate Analyst - HIH - Evernorth INR 1200K-2500KAPIs | CSV | Classification | Cloud Computing | ClusteringMid-level Full TimeHIH - Hyderabad, India R1d ago
-
Analytics and Insights Partner INR 792K-900KDashboarding | Data Analysis | Data Modeling | Databricks | Dataset StructuringBonus scheme | Colleague discount | Family care leave | Hybrid work policy | Life and disability insuranceMid-level Full TimeIndia Mumbai Off-Site R1d ago
-
Machine Learning Associate Analyst - HIH - Evernorth INR 1200K-2500KAPIs | Classification | Cloud Computing | Clustering | Data AnalysisMid-level Full TimeHyderabad, Telangāna, India R1d ago
-
Business Optimization & AI Model Specialist INR 3000K-5000KAgile | Architecture Search | Artificial Intelligence | Combinatorial Optimization | Exact SolversSenior-level Full TimeBangalore - RGA Tech Park, India R1d ago
-
Manager - Senior AI/ML Engineer INR 3000K-5000KAPI Design | AWS | Agent Orchestration | Agent systems | Asynchronous Workflows401k match | Dental insurance | Health insurance | Paid time off | Vision insuranceSenior-level Full TimePune, IN R3d ago
-
Senior Associate – AI ML Engineer INR 1860K-4000KAWS | Agentic Workflows | Azure | CI/CD | Data Pipelines401k match | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimePune, IN R3d ago
-
AI / Generative AI Sr. Associate INR 2000K-4500KAI Governance | AI guardrails | AWS Bedrock | Agentic AI | Azure OpenAIFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India R3d ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 1860K-3900KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureSenior-level Full TimeRemote - India R4d ago
-
Enterprise GenAI Platform Engineering /Senior Associate Director INR 2000K-3000KAPI Design | Agentic Workflows | Agile | Automated testing | CI/CDMid-level Full TimePune, Maharashtra, India R4d ago
-
Anomaly Detection | Big Data | Dashboarding | Data Monitoring | Data QualityFlexible location | Remote workEntry-level Full TimeIndia R4d ago
-
AI Trainer - Freelance Data Annotator INR 300K-420KArtificial Intelligence | Data Annotation | Data labeling | Fact-checking | Logical reasoningFlexible schedule | Freelance work | Part-time work | Remote workEntry-level FreelanceIndia - Remote R4d ago