Senior Software Engineer - Model Training & AI Evals
Tasks
- Build CI integrated regression suites
- Build benchmarking pipelines
- Build scalable eval pipelines
- Create capability gap reports
- Design LLM evaluation frameworks
- Develop domain-specific benchmarks
- Ensure experiment reproducibility
- Generate synthetic training data
- Implement alignment techniques
- Lead DPO training runs
- Lead RLAIF training runs
- Lead RLHF training runs
- Lead SFT training runs
- Maintain eval leaderboards
- Maintain model cards
- Run ablation studies
- Track model regressions
- Train reward models
- Validate synthetic data quality
Perks/Benefits
- N/A
Skills/Tech-stack
AI Feedback | Ablation Studies | Benchmarking | CI/CD | Data Generation | Deduplication | Deduplication Pipelines | Direct Preference Optimization | Experiment tracking | Fine Tuning | Human Feedback | JAX | Language Models | Large Language Models | Learning from Human Feedback | MLflow | Machine Learning | Model Evaluation | Policy Optimization | Preference data | Preference optimization | Proximal Policy Optimization | PyTorch | Python | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Rejection Sampling | Reward Modeling | Supervised Fine Tuning | Synthetic Data Generation | Synthetic data | Weights and Biases
Education
N/A
Related jobs
-
Senior .NET AI Engineer- 3188 (Remote) INR 2500K-4500K.NET | Azure | C# | Distributed Systems | Event DrivenFlexible working hours | L and D programs | Remote work | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India R9h ago
-
Airframe Data Scientist - Robust AI/ML INR 2000K-3500KAWS | Computer Aided Design | Computer Vision | Data extraction | Deep learningSenior-level Full TimeBangalore (Airbus), India R23h ago
-
Software Engineer (ETL with Snowflake) INR 1500K-2500KBitbucket | CI/CD | Data Modeling | Data Pipelines | ETLFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal and family care leavesMid-level Full TimeHyderabad, India R1d ago
-
Data Scientist III, Forecasting INR 3000K-4000KAnomaly Detection | Azure | Computer Vision | Data Engineering | Data PipelinesAccidental insurance | Casual leave | Earned Leave | Maternity leave | Medical insuranceSenior-level Full TimeRemote - India R1d ago
-
Senior Data Engineer - Full Stack (US, Remote) INR 2000K-3000KAPI | AWS | CI/CD | CLI | Data GovernanceCollaborative team | Developer productivity focus | Remote workSenior-level Full TimeMaharashtra, Pune, India R1d ago
-
GCP Data & Analytics Engineer/Senior Consultant Specialist INR 2000K-3000KAccess Management | BI Dashboards | BigQuery | Cloud platform | Customer funnelsContinuous professional development | Flexible working | Inclusive workplace | Opportunities for growthSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
AI Engineer, (Full Stack Development) INR 1800K-3000KAPI Integration | AWS | Anthropic | Authentication | Cloud FunctionsMid-level Full TimeMumbai, Maharashtra, India - Remote R1d ago
-
Machine Learning Engineer 4 INR 3000K-5000KAgile | Automation | C++ | Data Analysis | Data refinementSenior-level Full TimeNoida, India R1d ago
-
Software Development Engineer INR 3000K-3500KAI Assisted Development | AI-Assisted Development Tools | Automated testing | Azure | CI/CDMid-level Full TimeNoida, India R1d ago
-
Sr. Analytics Engineer - Data Warehouse (Hybrid, Bangalore) INR 2515K-3500KAWS | Airflow | Amazon EC2 | Amazon S3 | AmplitudeCareer growth opportunities | Hybrid work | MentorshipSenior-level Full TimeBangalore, INDIA R2d ago
-
Senior Lead, Support INR 2000K-4800KAI Foundry | Amazon Bedrock | Anthropic Claude | Authentication | AuthorizationSenior-level Full TimeRemote Working, India R2d ago
-
Ansible | CAP Theorem | CI/CD | ClickHouse | Consensus ProtocolsHealth & wellness support | High ownership autonomy | Mentorship learning environment | Professional development support | Remote-first cultureSenior-level Full TimeIndia R2d ago
-
Senior Full-Stack AI Engineer- 3185 (Remote) INR 2000K-4500KAI Foundry | AWS Bedrock | Agile | Anthropic | Azure AIFlexible working hours | Learning and development programs | Recognition rewards | Remote workSenior-level Full TimeChennai, India R2d ago
-
Full-Stack AI Engineer - 3184 (Remote) INR 2000K-4500K.NET | AI Foundry | Agile | Azure AI | Azure AI FoundryFlexible working hours | L and D programs | Professional development | Remote work | Rewards and recognitionSenior-level Full TimeChennai, India R2d ago
-
Data Platform Engineer/Consultant Specialist INR 1500K-2500KAmazon S3 | Ansible | Atlassian Confluence | Atlassian Jira | AutomationFlexible workingMid-level Full TimeHyderabad, Telangana, India R2d ago
-
AWS | Agile | Amazon Web Services | Authentication | AuthorizationFlexible working | Inclusive work culture | Opportunities for growth | Professional developmentMid-level Full TimeHyderabad, Telangana, India R2d ago
-
CLIP | Deep learning | Diffusers | Diffusion Models | Fine TuningAnnual vacation | Corporate discounts | Fully remote | Health allowance | Home office reimbursementSenior-level Full TimeIndia R2d ago
-
Senior Gcp Data Engineer/Senior Consultant Specialist INR 1500K-2500KAccess Control | Apache Airflow | Apache Kafka | Apache NiFi | Audit LoggingSenior-level Full TimePune, Maharashtra, India R2d ago
-
AI alignment | Agent Frameworks | Chat orchestration | Direct Preference Optimization | Distributed TrainingConference support | Fully remote | Health support budget | Home office stipend | Language learning discountsSenior-level Full TimeIndia R2d ago
-
Senior Software Engineer INR 2800K-4000KAI | Access Control | Airflow | Artificial Intelligence | AstronomerSenior-level Full TimePune, India R2d ago
-
AI Data Engineer INR 2500K-3380KAPI | AWS | Agile | DBT | Data EnrichmentEmployee incentive programs | Flex my way policies | Headspace app access | Hybrid work model | Mental health daysMid-level Full TimeIndia, Hyderabad, Telangana R2d ago
-
Staff Enterprise AI Engineer - Agentic Workflows & Productivity INR 3000K-5000KAPI Integration | CI/CD | Confluence | Cost Optimization | Data PrivacyFlexible work schedule | Hybrid workSenior-level Full TimeBangalore, India R2d ago
-
AWS | Autogen | Embedding Models | Generative AI | GoCollaborative team environment | Mentorship opportunities | Remote work optionsSenior-level Full TimeBangalore - Carina, India R2d ago
-
Data Quality Governance and Strategy Associate Engineer INR 2000K-3000KAI | Collibra | Data Controls | Data Governance | Data LineageFlexible hybrid model | Health insurance | Life insurance | Paid time off | Personal/family careMid-level Full TimeHyderabad, India R3d ago
-
Sr Principal Data Scientist INR 3000K-4000KAgentic AI | Causal Inference | Causal ML | Contextual Bandits | DatabricksSenior-level Full TimeBangalore, INDIA R3d ago