Associate Data Engineer
Tasks
- Build ETL/ELT workflows
- Collaborate in agile environment
- Create and maintain pipeline documentation
- Develop data pipelines
- Follow version control, testing, and deployment best practices
- Ingest transform and process data
- Monitor scheduled jobs and workflows
- Optimize Spark jobs and Databricks notebooks
- Perform data cleansing validation and quality checks
- Support AI/ML data preparation
- Troubleshoot pipeline failures and performance issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Apache Spark | Azure | Batch Processing | CI/CD | CSV | Data Governance | Data Lake | Data Quality | Data Warehouse | Databricks | Delta Lake | Delta Tables | ELT | ETL | Feature Engineering | Git | Google Cloud | JSON | Lakehouse | MLflow | Machine Learning | Parquet | Power BI | PySpark | Python | SQL | Scikit-learn | Security | Semi-structured | Semi-structured Data | Spark SQL | Structured data | Tableau | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Associate | Associate Data Engineer | Data Engineer | Engineer
Related jobs
-
Senior-level Full TimePune City, India2h ago
-
AI Engineer – Reliability & Warranty Analytics INR 1800K-3000KBacktesting | BigQuery | CI/CD | Calibration | Cloud RunMid-level Full TimeChennai, Tamil Nadu, India3h ago
-
Associate III Business Intelligence-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 800K-1800KBig Data | Big data concepts | C++ | Data Visualization | Data conceptsMid-level Full TimeBangalore, Karnataka, India4h ago
-
AI Engineer – Retail/CPG Domain INR 1800K-2500KAWS | Azure | Data Governance | Data Modeling | Data SecurityMid-level Full TimeGurugram, Haryana, India5h ago
-
Associate Principal Engineer (India Office) INR 1500K-2000KADLS | Azure Data | Azure Data Factory | Azure DevOps | CDCMid-level Full TimeBangalore, Karnataka, India6h ago
-
Senior-level Full TimePune, Maharashtra, India6h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India6h ago
-
Applied AI ML Lead INR 2500K-4800KAI Agents | AWS Lambda | AWS S3 | AWS Step Functions | Agentic AISenior-level Full TimeHyderabad, Telangana, India6h ago
-
Agentic AI | Agile | DAX | Data Governance | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Lead Software Engineer - Java/Python, LLM, AWS INR 3000K-5000KA/B | A/B Testing | AWS | Agile | Amazon AuroraSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Platform Engineering Professional - Data Engineer INR 2200K-3500KAWS | Amazon Kinesis | Apache NiFi | Apache Spark | CI/CDMid-level Full TimeBengaluru, IN, 5601037h ago
-
AWS Data Engineer INR 1500K-6000KAWS | Automation | Cloud Architecture | Data Governance | Data IngestionExecutive-level Full TimeHyderabad, Telangana, India7h ago
-
Lead - Data & AI INR 2000K-4500KArtificial Intelligence | Data analytics | Data platform | Data platform engineering | MLOpsSenior-level Full TimeAhmedabad, Gujarat, India8h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India9h ago
-
FastAPI | Flask | GIS | Git | MultiprocessingMid-level Full TimeNoida, Uttar Pradesh, India10h ago
-
SDET- India (Chennai/Bangalore) INR 1500K-2000KAWS S3 | Apache Airflow | Apache Superset | BDD | Big DataMid-level Full TimeIndia10h ago
-
Amazon Web Services | Cloud platform | Data Modeling | Databricks | Distributed SystemsBroadband reimbursement | Continuous learning support | Global enterprise client exposure | Health insurance | Paid certificationsSenior-level Full TimeIndia10h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Career growth opportunities | Entrepreneurial-minded team | Friendly relaxed atmosphere | Remote/distributed workMid-level Full TimeBangalore, India11h ago
-
Analytics Engineer - Associate INR 1800K-2800KAirflow | Alerting | Azure Data | Azure Data Factory | DagsterSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Competitive compensation | Flexible management | Friendly atmosphereMid-level Full TimeMumbai, India11h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeNoida, India11h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Friendly work environment | Impactful product | Professional development opportunitiesMid-level Full TimeAhmedabad, India11h ago
-
Software Engineer III - AI/ML, Prompt Engineer INR 2475K-4132KA/B | A/B Testing | API Integration | B testing | Chain-of-ThoughtSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Sr SW Engineer, Machine Learning INR 2475K-3380KA/B Testing | Airflow | Amazon EMR | Amazon S3 | Apache KafkaCommuter benefits | Disability insurance | Financial wellness support | Healthcare (Medical Dental Vision) | Hybrid work scheduleSenior-level Full TimeBengaluru, India12h ago
-
IT&D Data Engineer INR 2200K-4000KAnalytics | Cyber Security | Data Engineering | Data Governance | Data PrivacyEmployee assistance program | Employee share plans | Global employee resource groups | Life insurance | Parental benefitsEntry-level Full TimeHyderabad, Telangana, IN, N/A16h ago