Associate Data Engineer
Tasks
- Build ETL/ELT workflows
- Collaborate in agile environment
- Create and maintain pipeline documentation
- Develop data pipelines
- Follow version control, testing, and deployment best practices
- Ingest transform and process data
- Monitor scheduled jobs and workflows
- Optimize Spark jobs and Databricks notebooks
- Perform data cleansing validation and quality checks
- Support AI/ML data preparation
- Troubleshoot pipeline failures and performance issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Apache Spark | Azure | Batch Processing | CI/CD | CSV | Data Governance | Data Lake | Data Quality | Data Warehouse | Databricks | Delta Lake | Delta Tables | ELT | ETL | Feature Engineering | Git | Google Cloud | JSON | Lakehouse | MLflow | Machine Learning | Parquet | Power BI | PySpark | Python | SQL | Scikit-learn | Security | Semi-structured | Semi-structured Data | Spark SQL | Structured data | Tableau | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Associate | Associate Data Engineer | Data Engineer | Engineer
Related jobs
-
Microsoft Fabric Data Engineer - India INR 1500K-2400KApache Spark | Azure Cognitive | Azure Cognitive Search | Azure Data | Azure Data FactoryMid-level Full TimeNew Delhi, India3h ago
-
Senior-level Full TimeIN-KA-Bangalore4h ago
-
Senior-level Full TimeIN-KA-Bangalore4h ago
-
Senior-level Full TimeIN-KA-Bangalore4h ago
-
Senior-level Full TimePune, MAHĀRĀSHTRA, India4h ago
-
DE&A - Core - Project Management - Project Management INR 3000K-4000KAWS | Apache Airflow | Apache Spark | Azure | CCPASenior-level Full TimePune, Maharashtra, India4h ago
-
Senior-level Full TimeGurugram, Haryana, India5h ago
-
Mid-level Full TimeBengaluru, Karnataka, India5h ago
-
Senior-KDNI INR 3700K-5000KAmazon Web Services | Azure | Bayesian Methods | Cloud Computing | Cloud platformSenior-level Full TimeBangalore, Karnataka, India5h ago
-
Senior-level Full TimeBangalore, Karnataka, India5h ago
-
Senior-level Full TimeBangalore, Karnataka, India6h ago
-
Senior-KDNI INR 3700K-5000KAmazon Web Services | Autogen | Azure | Bayesian Methods | Cloud platformSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Associate Consultant - Technology Solutions Delivery INR 800K-1000KActive Directory | Agile | Amazon Web Services | Artificial Intelligence | Automation24 7 systems escalation availabilityMid-level Full TimeNoida, Uttar Pradesh, India6h ago
-
Quant Analytics Associate - Paid Media Marketing Analytics INR 1000K-1890KA/B | A/B Testing | Ad Spend | Attribution | B testingMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Mid-level Full TimePune, Maharashtra, India8h ago
-
Senior Data Engineer - Managed Services INR 3000K-4000KARM Templates | Azure Cloud | Azure Cloud Adoption | Azure Cloud adoption framework | Azure DataOccasional out of hours support | Remote work flexibilitySenior-level Full TimePune, MH, India9h ago
-
AWS | AWS Glue | AWS IAM | AWS Lambda | Amazon EMRMid-level Full TimeHyderabad, Telangana, India9h ago
-
Senior-level Full Timetelengana, India10h ago
-
Sr. Data Engineer INR 2700K-3900KAWS Lambda | AWS S3 | AWS SageMaker | AWS Step Functions | AlertingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Flexible benefits | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56007610h ago
-
Staff Data and AI Engineer, Finance INR 2500K-3900KAnomaly Detection | Apache Spark | Business Intelligence | CI/CD | DashboardsSenior-level Full TimeBengaluru, India11h ago
-
Senior Data and AI Engineer - Finance INR 2000K-3584KAnomaly Detection | Apache Spark | CI/CD | Dashboards | Data ModelingSenior-level Full TimeBengaluru, India11h ago
-
Mid-level Full TimeBangalore, Karnataka, India11h ago
-
Assistant Manager - AWS Data Engineering INR 1500K-2541KAWS Data | AWS Data Pipeline | Amazon Web Services | Data Modeling | Data pipelineMid-level Full TimeHyderabad, Telangana, India11h ago
-
Lead Consultant_Python MachineLearning INR 1500K-2500KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureHybrid workSenior-level Full TimeBangalore, IN, 56006611h ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | CI/CDSenior-level Full TimeChennai, IN, 60003211h ago