Associate Data Engineer
Tasks
- Coordinate with data providers and DevOps teams
- Identify and implement process automation opportunities
- Implement and monitor end to end data pipelines
- Investigate pipeline failures and perform root cause analysis
- Maintain and modify ETL scripts
- Maintain pipeline documentation and job schedules
- Manage data storage and exchanges in cloud
- Participate in data quality validation
- Track file flows and log exceptions
- Trigger and validate jobs using APIs
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS S3 | Amazon EMR | Amazon Redshift | Data pipeline | ETL | Git | Monitoring | Pandas | Postman | PySpark | Python | SQL | Troubleshooting | Version control | WinScp
Education
N/A
Roles
Associate | Associate Data Engineer | Data Engineer | Engineer
Related jobs
-
Senior-level Full TimeBangalore, India Office (BANGALORE)7h ago
-
Associate Analyst - Operations Performance & Analytics INR 1500K-1910KApache Spark | GitHub Copilot | Microsoft SQL | Microsoft SQL Server | Power BIHealth and wellness benefits | Travel opportunitiesMid-level Full TimeGurugram, Haryana, India10h ago
-
Data Engineer II INR 1300K-2500KAmazon Web Services | Apache Airflow | Avro | BigQuery | CassandraComplimentary games | Family Leaves | Healthcare coverage | Mental well-being support | Paid time offMid-level Full TimeLocations: Hyderabad, Telangana, India11h ago
-
Mid-level Full TimeIndia, West Bengal, Kolkata11h ago
-
Senior Data Engineer INR 1500K-2600KAWS | Data Architecture | Data Governance | Data Modeling | Data PipelinesSenior-level Full TimeGurugram - Haryana - India11h ago
-
Data Governance & Portfolio Enablement Specialist_GSO INR 1500K-2600KA/B | A/B Testing | AWS | Azure | B testingSenior-level Full TimeGurugram - Haryana - India11h ago
-
Software Engineer - AI/ML with Python INR 2475K-3500KAWS | Airflow | Amazon SageMaker | Apache Spark | Artificial IntelligenceFive days onsite | Professional development | Work from OfficeMid-level Full TimeBangalore - Karnataka, India - Kalyani …11h ago
-
Entry-level Full TimePune, India11h ago
-
Senior MDM Data Engineer INR 3000K-4000KAWS Glue | CI/CD | Data Deduplication | Data Governance | Data ManagementSenior-level Full TimeBengaluru, Karnataka12h ago
-
Mid-level Full TimeBangalore, India12h ago
-
Senior AI/ML Engineer I INR 2000K-3465KAI Search | Asynchronous programming | Azure | Azure AI | Azure AI SearchCareer growth opportunities | Certification programs | Education reimbursement programs | Employee assistance program | Employee stock purchase planSenior-level Full TimeBangalore, Karnataka, India R12h ago
-
Senior AI - ML Engineer INR 3242K-5000KAgent systems | Agentic AI | Airflow | Amazon Web Services | AnthropicSenior-level Full TimeBengaluru East, Karnataka, India R13h ago
-
Senior-level Full TimeBangalore, Karnataka, India14h ago
-
Senior Data Engineer, Cloud Supply Chain, Data Engineering INR 1500K-2500KBigQuery | Dashboarding | Data Governance | Data Modeling | Data QualitySenior-level Full TimeBengaluru, Karnataka, India14h ago
-
IBM Datastage, Pyspark, Control-M/Consultant Specialist INR 800K-2000KApache Spark | Control-M | ETL | IBM DataStage | LinuxContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R14h ago
-
Senior AI Engineer INR 2000K-5000KAPI Development | AWS | AWS Bedrock | Agent workflows | Agentic SystemsSenior-level Full TimeMumbai, India14h ago
-
Researcher: AI/ML enhanced Computational Engineering for Scientific AI and Optimization INR 2500K-4680KAI Agents | Bayesian optimization | Cloud Computing | Computational Mechanics | Differential EquationsMid-level Full TimeBengaluru, India14h ago
-
Analyst-Data Science INR 4000K-5400KAPIs | Attention | CUDA | Constrained Generation | Continuous batchingCareer growth opportunities | Holistic well-being support | Learning opportunities | Supportive cultureEntry-level Full TimeGurugram, HR, India15h ago
-
Mid-level Full TimeBangalore, Karnataka, India15h ago
-
Associate Principal Engineer, AI Architect INR 2000K-4000KAgent Orchestration | Backend architecture | BigQuery | CI/CD | Cloud platformMid-level Full TimeGurugram, India15h ago
-
Lead Software Engineer - Python, AWS, BigData INR 2500K-4300KAI Assisted Development | AWS Glue | AWS Lambda | AWS Step Functions | Amazon BedrockSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Senior Technical Anchor INR 4000K-5500KApache Spark | Batch Processing | BigQuery | CI/CD | Cloud BuildSenior-level Full TimeChennai, Tamil Nadu, India R16h ago
-
Senior Applied Scientist INR 2500K-5000KC# | Causal Inference | Deep learning | Java | Linear AlgebraSenior-level Full TimeIndia, Karnataka, Bangalore16h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101317h ago
-
Senior Data Engineer INR 1200K-3000KAgile | Apache Spark | Azure Data | Azure Data Services | CI/CDSenior-level Full TimeChandigarh, India17h ago