Python Developer (AI Evaluation Frameworks)
Tasks
- Apply static analysis and code quality
- Build LLM evaluation pipelines
- Build data preprocessing for evaluations
- Compute evaluation metrics
- Create automated testing for LLMs
- Deploy evaluation components on Azure
- Design AI evaluation frameworks
- Develop Python production applications
- Implement infrastructure-as-code
- Implement restful APIs
- Instrument audit trails
- Maintain evaluation documentation
- Mentor junior developers
- Orchestrate test workflows
- Report evaluation results
- Set up monitoring logging and alerting
Perks/Benefits
- N/A
Skills/Tech-stack
Agent architecture | Alerting | App Service | Azure App | Azure App Service | Azure DevOps | Azure Functions | Azure Kubernetes | Azure Kubernetes Service | Azure Storage | Benchmarking | CI/CD | Data Preprocessing | Django | FastAPI | Flask | GenAI | Infrastructure as Code | Integration Testing | Kubernetes Service | LLM | Logging | Metric computation | Monitoring | Object-Oriented | Object-oriented programming | Observability | Python | RAG | REST API | SonarQube | Static Analysis | Test-Driven | Test-Driven Development | Unit Testing | “as-code”
Education
N/A
Roles
AI | AI Engineer | Developer | Engineer | Python | Python Developer | Software Engineer
Related jobs
-
Staff Software Engineer, Android Embedded Software INR 2000K-3200KAndroid | C++ | Distributed Systems | Java | Performance optimizationSenior-level Full TimeBengaluru, Karnataka, India2h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India2h ago
-
Senior-level Full TimeHyderabad, India7h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600377h ago
-
Senior-level Full TimeGurgaon, Haryana, India7h ago
-
Software Engineer INR 1000K-1496KBitbucket | Data Architecture | Data Modeling | Data Pipelines | LinuxEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India7h ago
-
Data Scientist- GenAI Engineer INR 2000K-3000KA/B | A/B Testing | B testing | Causal Inference | ClusteringMid-level Full TimeNoida, Uttar Pradesh, India7h ago
-
Applied AI ML Associate INR 2000K-3000KAI Agents | AWS Cloud | Advanced Analytics | Big Data | CI/CDSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Analytics Solutions Associate - Data Strategy INR 800K-1250KAWS Databricks | AWS Redshift | Data Governance | Data Privacy | Data QualityMid-level Full TimeBengaluru, Karnataka, India8h ago
-
GIS Data Engineer II INR 2000K-2400KAWS | Amazon Athena | Amazon EC2 | Amazon RDS | Amazon S3MentorshipSenior-level Full TimeMumbai, MH, India9h ago
-
C# | C++ | Go | Infrastructure automation | JavaSenior-level Full TimeBengaluru, Karnataka, IND13h ago
-
Amazon S3 | C# | C++ | Data Migration | Data replicationSenior-level Full TimeBengaluru, Karnataka, IND13h ago
-
ARM | ASPICE | AUTOSAR | AUTOSAR OS | AgileAccess to fitness clubs | Employee assistance program | Higher education opportunities | Life and accident insurance | Shift allowancesEntry-level Full TimeIND - India Tech Center13h ago
-
Software Engineer - Embedded & Functional Safety Software INR 1753K-3440KAgile | Automated testing | C# | C++ | CAN busSenior-level Full TimeBangalore, IN13h ago
-
32-bit | 32-bit microcontroller | ARM | ASPICE | AUTOSARAccess to fitness clubs | Employee assistance program | Health insurance | Higher education opportunities | Life and accident insuranceEntry-level Full TimeIND - India Tech Center13h ago
-
Software Engineer - Robot Navigation, Localization & SLAM INR 1753K-2372K3D camera | Agile | Automated testing | C++ | CI/CDMid-level Full TimeBangalore, IN13h ago
-
Software Engineer - Robot Connectivity & Wi Fi Systems INR 1000K-2000KAgile | Automated testing | CI/CD | GRPC | GitCustomer-facing workSenior-level Full TimeBangalore, IN13h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agent/tool use | Apache Spark | Azure | ContainersContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India13h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India13h ago
-
IN_Manager_SSIS_Data & Analytics_Advisory_Noida INR 1500K-2000KAWS | Azure | CI/CD | Cloud Data | Cloud Data PlatformsFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeNoida, India13h ago
-
EY - GDS Consulting - AIA - Gen AI - Staff INR 3334K-5000KAWS | AWS Bedrock | Azure OpenAI | CD | CISenior-level Full TimePune, MH, IN, 41101413h ago
-
Combinatorics | Graph theory | Mathematical Statistics | NumPy | Number theoryPart time freelance projects | Project based workSenior-level FreelanceIndia - Remote R13h ago
-
EY - GDS Consulting - AI And DATA -Snowflake Architect -Manager INR 3000K-4000KAgile | Batch Processing | Cloud Data | Cloud Data Warehouse | DBTCareer development | Coaching and feedback | Flexible work arrangementSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
Senior Executive - Information Technology INR 2000K-4225KAdvanced Analytics | Bagging | Boosting | Decision Trees | Machine LearningSenior-level Full TimeAiroli, MH, IN13h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agentic AI | Azure | CI/CD | Code reviewContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India13h ago