Data Engineer - Chennai / Bengaluru
Tasks
- Build ELT workflows
- Design data CI/CD pipelines
- Develop data pipelines
- Document data workflows and technical specifications
- Ingest data sources
- Monitor and troubleshoot pipelines
- Orchestrate workflows with Apache Airflow
- Perform data validation and testing
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | CI/CD | Data CI/CD | Data Ingestion | Data Validation | PySpark | Python | SQL | Snowflake | Trino
Education
N/A
Roles
Related jobs
-
Senior Software Engineer, AI/ML INR 2000K-5000K3D mathematics | Agent systems | Autonomous Agents | C plus plus | Computational GeometrySenior-level Full TimeBengaluru, Karnataka, India1h ago
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN5h ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageMid-level Full TimePune, India5h ago
-
Mid-level Full TimePune, India5h ago
-
Associate Software Engineer INR 1300K-2000KAgile | Design Patterns | JavaScript | Python | REST APIMid-level Full TimePune, India5h ago
-
Tech Lead Data Engineer INR 1500K-2600KAWS Data | AWS Glue | AWS data warehousing | Amazon Athena | Amazon EKSGreat Place to Work recognitionSenior-level Full TimePune, India5h ago
-
Senior-level Full TimePune, India5h ago
-
Data Engineer INR 1500K-2500KAWS Glue | Agile methodology | Amazon Athena | Amazon EMR | Amazon KinesisMid-level Full TimePune, India5h ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 1860K-3900KAWS | Agent systems | Apache Spark | Apache Spark SQL | AzureSenior-level Full TimeRemote - India R5h ago
-
Senior Staff Engineer, Supply chain optimization INR 3000K-4500KAMPL | AWS | Agent-Based Simulation | Agent-based | AnyLogicSenior-level Full TimeRemote, India R5h ago
-
Senior AI-ML Platform Engineer / Tech Lead INR 2500K-5000KAI Foundry | API Gateway | API Keys | AWS Bedrock | AWS CloudFormationInclusion and Belonging CultureSenior-level Full TimeBangalore, Karnataka, IN, 5601006h ago
-
Senior-level Full TimeHyderabad R6h ago
-
Automation | Azure | Azure Data | Azure Data Explorer | Azure Log AnalyticsCross-functional collaboration | Professional growth | Remote workMid-level Full TimeIndia R7h ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch ProcessingSenior-level Full TimeBangalore, India8h ago
-
Staff Engineer (Cloudera CDP & Hadoop Administration) INR 1500K-3300KAnsible | ArgoCD | Automation | CI/CD | Cloudera CDPSenior-level Full TimeBengaluru, India8h ago
-
CI/CD | Claude | Code Analysis | Code modernization | Code remediationBusiness resource groups | Career progression | Disability insurance | Employee stock purchase plan | Family leaveSenior-level Full TimeIndia R8h ago
-
API Development | AWS EMR | Amazon EC2 | Amazon IAM | Amazon S3Flexible paid time off | Professional growth opportunities | Remote work from India | Stock grantsSenior-level Full TimeIndia R8h ago
-
AWS | Agile | Azure | Debugging | Deep learningConference access | Financial and legal consultation support | Internal mobility | Language learning resources | Learning and development initiativesSenior-level Full TimeIndia R11h ago
-
AWS | Agent Serving | Ansible | Argo CD | ArgoCDSenior-level Full TimeBangalore (SDC) - Bagmane Tech Park, …13h ago
-
Senior-level Full TimePune, IN13h ago
-
Sr Technical Lead-App Development INR 2500K-5000KAWS | Amazon Bedrock | Azure | Data Lake | ElasticsearchImmediate joiner onlySenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN13h ago
-
Senior-level Full TimeIndia - Hyderabad13h ago
-
Subcontractor - AI OPS INR 1200K-2500KAWS Glue | AWS Lambda | Amazon Bedrock | Amazon Redshift | GitHub CopilotMid-level ContractINDIA - BENGALURU - HP, IN13h ago
-
TTT - Data Science - Senior INR 3000K-4000KAI Foundry | ARIMA | Artificial Intelligence | Azure AI | Azure AI FoundryCoaching and Mentorship | Continuous learning | Flexible work tools | Inclusive cultureSenior-level Full TimeBengaluru, KA, IN, 56001613h ago
-
Senior Database Engineer / Senior Consultant Specialist INR 2000K-3200KBigQuery | CI/CD | Cassandra | Cloud SQL | Cloud StorageSenior-level Full TimePune, MH, IN, 41100613h ago