Senior Software Engineer - Model Training & AI Evals
Tasks
- Build CI integrated regression suites
- Build benchmarking pipelines
- Build scalable eval pipelines
- Create capability gap reports
- Design LLM evaluation frameworks
- Develop domain-specific benchmarks
- Ensure experiment reproducibility
- Generate synthetic training data
- Implement alignment techniques
- Lead DPO training runs
- Lead RLAIF training runs
- Lead RLHF training runs
- Lead SFT training runs
- Maintain eval leaderboards
- Maintain model cards
- Run ablation studies
- Track model regressions
- Train reward models
- Validate synthetic data quality
Perks/Benefits
- N/A
Skills/Tech-stack
AI Feedback | Ablation Studies | Benchmarking | CI/CD | Data Generation | Deduplication | Deduplication Pipelines | Direct Preference Optimization | Experiment tracking | Fine Tuning | Human Feedback | JAX | Language Models | Large Language Models | Learning from Human Feedback | MLflow | Machine Learning | Model Evaluation | Policy Optimization | Preference data | Preference optimization | Proximal Policy Optimization | PyTorch | Python | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Rejection Sampling | Reward Modeling | Supervised Fine Tuning | Synthetic Data Generation | Synthetic data | Weights and Biases
Education
N/A
Related jobs
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R4h ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
AIOps | APIs | AWS | Anomaly Detection | AzureFlexible working hours | Fully remote | Remote collaborationMid-level Full TimeIndia R1d ago
-
AI Engineer - India INR 1800K-3000KAzure APIM | Cloud platform | Cypher | Embeddings | FastAPICareer pathing | Flexi benefit plan | Focus time Fridays | Food at work | Group medical coverageMid-level Full TimeChennai R2d ago
-
Business Intelligence Engineer - Snowflake Developer INR 2500K-4132KAgile | Airflow | Bitbucket | CI/CD | Common table expressionsFlexible remote days | Health insurance | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeHyderabad, India R3d ago
-
Algorithms | C++ | Code Refactoring | Code review | Data StructuresExposure to AI development projects | Fast onboarding | Flexible schedule | Part time contractor | Performance-based compensationSenior-level Contract Full TimeIndia R3d ago
-
VP - Senior Data Engineer INR 3715K-4720KAmazon Web Services | Apache Airflow | Artificial Intelligence | Azure | CI/CDComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeBL4 - KNG Tower 1, Indiqube … R3d ago
-
Senior Software Engineer (India) INR 3500K-4500KAWS | AWS CDK | Asyncio | Authentication | AuthorizationRemote work | Work from homeSenior-level Full TimeIndia - Remote R3d ago
-
Forward Deployed AI Engineer INR 3000K-3500KAI Foundry | AIOps | Automated testing | Azure AI | Azure AI FoundryHybrid workSenior-level Full TimeIndia - Remote R3d ago
-
Senior-level Full TimeIndia - Remote R3d ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Glue | AWS Lambda | Agile | Amazon AthenaCab allowance | Flexible leave policies | Free meals | Health insurance | Home office setup allowanceSenior-level Full TimeHyderabad, India R3d ago
-
Lead Data Integration Engineer INR 2000K-3000KAgile Scrum | CI/CD | Data Lake | Data Modeling | Data PipelinesHealth and life insurance | Hybrid work model | Paid time off | Pension/retirement benefits | Personal/family careSenior-level Full TimeChennai, India R4d ago
-
AWS Data Engineer (Contract) INR 1500K-3000KAWS CloudFormation | AWS Glue | AWS Glue Data Catalog | AWS IAM | AWS Lake FormationContract employment | Remote workSenior-level ContractIndia, Remote R4d ago
-
Senior Data Engineer - Remote INR 2520K-3380KAWS Athena | AWS CloudWatch | AWS Glue | AWS IAM | Amazon SQSFlexible schedule | Night shift flexibility | Remote workSenior-level Full TimeChennai, TN, IN R4d ago
-
Software Engineering Expert (AI Training) USD 200K-460KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingFast onboarding | Flexible contractor schedule | Remote workMid-level Contract Full TimeIndia - Remote R4d ago
-
Computer Scientist II INR 3000K-3500KAPI | Authentication | CI/CD | Code review | Distributed SystemsSenior-level Full TimeNoida, India R4d ago
-
Sr. ML Engineer INR 3470K-4500KADLS | AKS | Apache Spark | Azure | Azure DataFull-time employment | Mentoring | Remote workSenior-level ContractIndia - Remote R4d ago
-
Senior Software Engineer (India) INR 3000K-4200KAWS | AWS CDK | Asyncio | CI/CD | DatadogRemote work opportunity | Work from homeSenior-level Full TimeIndia - Remote R4d ago
-
Forward Deployment Engineer INR 2500K-3900KAI guardrails | APIs | Apache Superset | CI/CD | CrewAICustomer facing collaboration | Flexible shift schedule | Professional growth opportunities | Remote workSenior-level Full TimeBengaluru, Karnataka, India - Remote R4d ago
-
Senior-level Full TimeIndia - Remote R4d ago
-
AI machine learning | Apache Spark | Automation | Big Data | CassandraComprehensive healthcare | Flexible time off | Retirement plan | Tuition reimbursementExecutive-level Full TimeM11 - Commers III, 43, 44 … R4d ago
-
AI Engineer II (Remote) USD 39K-72KAWS | CI/CD | Docker | Embeddings | Entity recognitionFull-time role | Remote workMid-level Full TimeIndia, Remote R4d ago
-
Mid-level Full TimeBangalore, Karnataka, India R4d ago
-
Senior-level Full TimeNoida,UP,India R4d ago
-
AWS | Apache Spark | Asynchronous programming | Azure | ChromaDBAccidental death and dismemberment coverage | Dental insurance | Flexible paid time off | Health insurance | Life insuranceMid-level Full TimeIndia R4d ago