Data Engineer
Tasks
- Automate model training and deployment
- Build PySpark pipelines for feature engineering
- Build maintain structured datasets
- Collaborate with DevOps teams for containerization
- Design data architectures for analytics and modeling
- Design scalable ETL/ELT workflows
- Implement model versioning and artifact tracking
- Monitor data pipelines and troubleshoot failures
- Monitor data quality and drift detection
- Optimize Spark jobs for large scale data processing
- Support CI CD integration for ML pipelines
- Work with Data Scientists to productionize ML code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Anomaly Detection | Apache Airflow | Apache Spark | Azure | DVC | Data Anomaly Detection | Data Architecture | Data Modeling | Data Monitoring | Data Pipeline Development | Data pipeline | Docker | Feature Store | GCP | Kubernetes | ML Lifecycle | MLflow | Pipeline Development | PySpark | PyTorch | SQL | Scikit-learn | TensorFlow
Education
Roles
Related jobs
-
Data Science Engineer INR 2400K-3500KCloud Database | Data Modeling | Database Design | ELT | ETLCommercial awareness | Onshore Offshore model experience | UK client experienceSenior-level Full TimeMumbai, MH, India3h ago
-
Engineering Manager- DevOps(Vendor) INR 2200K-4000KAWS Lambda | Agile | Amazon S3 | Amazon Web Services | AnsibleSenior-level Full TimeNoida, Uttar Pradesh3h ago
-
Engineering Manager- Data Devops(Vendor) INR 1500K-2000KAWS CloudFormation | AWS IAM | AWS Lambda | Amazon CloudFront | Amazon CloudWatchMid-level Full TimeNoida, Uttar Pradesh3h ago
-
Senior Data Engineer INR 2516K-3356KAWS | Airflow | Apache Iceberg | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India4h ago
-
Lead Machine Learning Engineer INR 3100K-4500KApache Airflow | Argo Workflows | Deep learning | GenAI | JavaSenior-level Full TimeBangalore, India R4h ago
-
Senior-level Contract Full TimeBengaluru, Karnataka, India5h ago
-
Senior-level Full TimeIND - Bengaluru - Esko-Graphics India …10h ago
-
Data Engineer (5+ Years of Exp in Data Warehouse Modeling + Big Data + SSIS + BI + Agile + PowerApps + Shell + SQL) INR 1500K-2000KAI | AWS | Agile | Azure | Azure DevOpsMid-level Full TimeBengaluru, India10h ago
-
IN_Associate_Chatbots/Voicebots_GCC_Advisory_Bangalore INR 1000K-1400KAPI | AWS | AWS Lex | Agent Assist | Auto-QAMid-level Full TimeBengaluru Millenia, India10h ago
-
Mid-level Full TimeIndia Offsite (ZIN99) R10h ago
-
Cloud Engineer AIOps INR 2000K-2700KApache Spark | Auto Scaling | CI/CD | Compliance | Data LineageAccident insurance | Childcare assistance reimbursement | Coaching | Continuous learning culture | Employee assistance programEntry-level Full TimePune - Business Bay, India10h ago
-
Analytics Engineer INR 1800K-2500KApache Airflow | Cloud Composer | DBT | Data Modeling | Data WarehousingInsurance package | Learning and development resourcesMid-level Full TimeNoida, Uttar Pradesh1d ago
-
Principal Engineer INR 2500K-4500KAPI Integration | AWS Glue | Amazon Redshift | Apache Airflow | Apache KafkaSenior-level Full TimeNoida1d ago
-
C Engineer - Bangalore/Pune INR 2000K-2500KBash | C# | Character sets | Code generation | Compiler WritingMid-level Full TimeBangalore, India1d ago
-
Lead Data Engineer - R01553055 INR 1500K-2000KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CDCompetitive benefits | Growth opportunities | Remote flexibilitySenior-level Full TimeBangalore, Karnataka, India1d ago
-
Staff Software Developer, AI/ML INR 2500K-3100KAWS | Argo CD | Automation Testing | Azure | Big DataFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programsSenior-level Full TimeBangalore, KA, India1d ago
-
IN_Associate_AI Engineer_GCC_Advisory_Bangalore INR 3000K-4800KAPI Development | Agent evaluation | Anthropic API | Async Programming | AutogenFlexibility programmes | Inclusive benefits | Mentorship | Work-life balance supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
ADO | Agile | Amazon Web Services | Angular | Asynchronous programmingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimePune, India1d ago
-
Artificial Intelligence | Audit | Compliance | Data Analysis | Data ModelingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 8 B, India1d ago
-
Python Developer INR 300K-420KAgile | CSS | Git | HTML | JavaScriptCareer growth | Health insurance | Performance bonuses | Professional developmentEntry-level Full TimeAhmedabad, India1d ago
-
Mid-level Full TimeHyderabad, Telangana, India1d ago
-
AWS With GenAI INR 1300K-1700KAPI Gateway | AWS Fargate | AWS Glue | AWS IAM | AWS KMSRemote Working | Work-life balanceMid-level Full TimeBangalore, KA, IN, 5601002d ago
-
SR. DEVOPS ENGINEER and MLOps Engineer INR 2500K-3880KAI Agents | AWS | Alerting | CI/CD | ChatbotsCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600762d ago
-
EY - GDS Consulting - AI And DATA - Azure Data Engineer - Senior INR 2520K-3500KAgile | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryCareer development opportunities | Flexible working | Support coaching feedbackSenior-level Full TimeHyderabad, TG, IN, 5000812d ago
-
Engineer AI/ML INR 1800K-2500KCloud Computing | Data Pipelines | Generative AI | Machine Learning | Model DeploymentFlexible work environment | Internal mobility | Remote or hybrid work option | Volunteering opportunities | Well-beingMid-level Full TimeKA Bangalore, India2d ago