Python Developer (AI Evaluation Frameworks)
Tasks
- Apply static analysis and code quality
- Build LLM evaluation pipelines
- Build data preprocessing for evaluations
- Compute evaluation metrics
- Create automated testing for LLMs
- Deploy evaluation components on Azure
- Design AI evaluation frameworks
- Develop Python production applications
- Implement infrastructure-as-code
- Implement restful APIs
- Instrument audit trails
- Maintain evaluation documentation
- Mentor junior developers
- Orchestrate test workflows
- Report evaluation results
- Set up monitoring logging and alerting
Perks/Benefits
- N/A
Skills/Tech-stack
Agent architecture | Alerting | App Service | Azure App | Azure App Service | Azure DevOps | Azure Functions | Azure Kubernetes | Azure Kubernetes Service | Azure Storage | Benchmarking | CI/CD | Data Preprocessing | Django | FastAPI | Flask | GenAI | Infrastructure as Code | Integration Testing | Kubernetes Service | LLM | Logging | Metric computation | Monitoring | Object-Oriented | Object-oriented programming | Observability | Python | RAG | REST API | SonarQube | Static Analysis | Test-Driven | Test-Driven Development | Unit Testing | “as-code”
Education
N/A
Roles
AI | AI Engineer | Developer | Engineer | Python | Python Developer | Software Engineer
Related jobs
-
Principal consultant GenAI LLM Ops Engineer INR 3125K-5000KAWS | Alerting | Azure | Azure OpenAI | BashSenior-level Full TimeIndia-Bangalore6h ago
-
Senior Principal Consultant, Gen_AI Technical Lead INR 2500K-4500KA/B | A/B Testing | AWS | Azure | Azure OpenAISenior-level Full TimeIndia-Bangalore6h ago
-
Software Developer – QA Automation & AI Integration (Backend) INR 1170K-2500KAPI Integration | Automated testing | BDD | CI/CD | CucumberAI certifications | Mentorship | TrainingMid-level Full TimeIndia-Hyderabad6h ago
-
Senior-level Full TimeIN-MH-Pune7h ago
-
Python - AI ML INR 2500K-4225KActiveMQ | Advanced search | Advanced search algorithms | Agile | ChromaDBSenior-level Full TimeIN-AP-Hyderabad7h ago
-
Mid-level Full TimeIN-AP-Hyderabad7h ago
-
AI Engineer (Fresher) – Mobile Radio Tester INR 180K-180KData Preprocessing | Deep learning | Machine Learning | Model Evaluation | PyTorchEntry-level Full TimeNew Delhi7h ago
-
Senior Software Engineer INR 2500K-2829KAWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EKSFamily well-being benefits | Health benefits | Hybrid work | Paid time offSenior-level Full TimeHyderabad, India7h ago
-
Forward Deployed Engineering Manager, GenAI, Google Cloud INR 2500K-4500KAgent systems | Artificial Intelligence | Cloud Computing | Cloud platform | Generative AISenior-level Full TimeBengaluru, Karnataka, India; Gurgaon, Haryana, India8h ago
-
Data Engineer, Play Data Science and Analytics INR 1500K-2000KAI | Automation | C++ | Data Analysis | Data ModelingMid-level Full TimeBengaluru, Karnataka, India8h ago
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India9h ago
-
Senior Data Engineer-Digital Banking Kotak 811-Regional Sales INR 2000K-2300KAgile | Apache Hadoop | Apache Hive | Apache Spark | Batch ProcessingSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Senior Data Engineer INR 1000K-2000KAmazon DynamoDB | Apache Airflow | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeTelangana, Hyderabad, India10h ago
-
ML Engineer INR 1400K-2000K.NET | API Development | Apache Spark | Azure Cognitive | Azure Cognitive ServicesMid-level Full TimeHyderabad, TG, India10h ago
-
Software Engineer II - Java Fullstack + React + Python(AI/ML) INR 1000K-2200KAWS | AWS CodeDeploy | Agile | CI/CD | CucumberMid-level Full TimeHyderabad, Telangana, India10h ago
-
Principal Engineer, Data Analytics Engineering (Data Engineering , GenAI , Python , SQL) INR 2500K-5000KAWS | AWS Glue | AWS Lambda | Airflow | Amazon BedrockSenior-level Full TimeBengaluru, KA, India10h ago
-
Senior-level Full Timebangalore, India11h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India11h ago
-
Vice President - Data Scientist INR 1500K-6000KAWS | Agile | Azure | Data Pipelines | Data VisualizationExecutive-level Full TimeTelangana, India11h ago
-
Data Quality Engineer-Azure Data Platform Testing INR 1200K-1500KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimePune, Maharashtra, India12h ago
-
Mid-level Full TimeHyderabad, IN12h ago
-
Data Engineer INR 1500K-2000KADLS | AWS | Airflow | Azure | DBTBonuses | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceMid-level Full TimeIndia - Remote R13h ago
-
Agentic AI - Lead Engineer INR 2500K-3500KAPIs | Agentic AI | CI/CD | Data Engineering | Data VisualizationSenior-level Full TimeChennai, Tamil Nadu, India13h ago
-
AI Engineer INR 950K-1050KAWS | Airflow | Algorithms | Apache Spark | Data StructuresGlobal team collaboration | Hybrid workMid-level Full TimeBengaluru, INDIA, India14h ago