Senior Developer, AI Engineering
Tasks
- Build evaluation datasets ground truth and adversarial test cases
- Collaborate define acceptance criteria quality thresholds
- Design AI ML test strategies
- Develop automated test frameworks
- Document defects edge cases failure patterns
- Evaluate model outputs accuracy consistency relevance hallucination bias
- Monitor models for drift degradation anomalous behavior
- Perform bias audits and explainability checks
- Test RAG pipelines and AI chatbots
- Validate data quality data pipelines and feature stores
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Amazon SageMaker | B testing | DBT | Data Pipelines | Data Quality | DeepEval | Feature Stores | Google Vertex | Google Vertex AI | Great Expectations | LLM Evaluation | Langsmith | ML Lifecycle | MLflow | Model Monitoring | Postman | Prompt engineering | Promptfoo | Pytest | Python | Ragas | Red Teaming | Retrieval-Augmented Generation | Selenium | Shadow Deployment | Vector Databases | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level Full TimeHyderabad, India8h ago
-
Senior-level Full TimeHyderabad, India8h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeChennai, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeAhmedabad, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Drift Detection | FastAPIAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workSenior-level Full TimeNew Delhi, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAPI Integration | AWS | Anthropic API | CD pipeline | CI/CDAnnual learning budget | Flexible hours | Learning opportunities | Mentorship | Performance reviewsSenior-level Full TimeHyderabad, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionFlexible hours | Internal TechTalks | Learning budget | Mentorship | People focused supportSenior-level Full TimeKolkata, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeIndore, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Drift Detection | FastAPIAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeJaipur, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic API | CI/CD | Cloud Security | Drift DetectionAnnual TechTalks | Flexible hours | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeJalalabad, India9h ago
-
Senior Security Software Engineer ID80139 JPY 8600K-11800KAPI Integration | AWS | Anthropic | CI/CD | FastAPIAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workSenior-level Full TimeKochi, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeCollaborative culture | Flexible hours | Learning budget | Mentorship | Performance reviewsSenior-level Full TimePune City, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Drift Detection | FastAPIFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeMumbai, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | Cloud Security | Drift DetectionAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeBangalore North, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeCoimbatore South, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic API | CI/CD | Drift Detection | FastAPIAnnual learning budget | Flexible hours | Local people focused support | Mentorship | Performance reviewsSenior-level Full TimeNoida, India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Performance reviewsSenior-level Full TimeGurgaon Kty., India9h ago
-
Senior Security Software Engineer ID80139 INR 2000K-5000KAWS | Anthropic | CI/CD | FastAPI | Infrastructure as CodeAnnual learning budget | Flexible hours | Learning support programs | Mentorship | Performance reviewsSenior-level Full TimeTrivandrum, India9h ago
-
AWS | Airflow | Anomaly Detection | BigQuery | CI/CDSenior-level Full TimeNoida,UP,India10h ago
-
AI/ML Engineer INR 3000K-5000KAccess Management | Agentic AI | Automated testing | CI/CD | Cloud ComputingSenior-level Full TimeChennai, Tamil Nadu, India10h ago
-
DBA/Reliability and Automation Engineer INR 500K-1500KAnsible | Bash | CI/CD | CloudFormation | DatadogMid-level Full TimeIndia10h ago
-
Software Engineer, AI/ML, PhD, Early Career, 2026 INR 4000K-6000KC# | C++ | Data Mining | Data Processing | Data StorageSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Software Engineer, Core Data Indexing INR 3000K-3800KAI for Personal Productivity | Artificial Intelligence | C++ | Data Processing | Data Processing PipelinesOncall experience | Technical leadership opportunitiesSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon CloudWatch | Amazon RedshiftSenior-level Full TimeBangalore, Karnataka, India11h ago
-
Mid-level Full TimeKarnataka, India11h ago