Data Engineer
Tasks
- Design data pipelines
- Develop ETL processes
- Document code for team handover
- Ensure data quality validation
- Implement ETL pipelines
- Migrate data across systems
- Monitor and troubleshoot pipelines
- Optimize pipelines for cost and scalability
- Support incremental loads
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Step Functions | Amazon CloudWatch | Amazon EventBridge | Amazon Lambda | Apache Iceberg | Astronomer | Data Pipeline Architecture | Data Quality | Data Quality Validation | Data Warehousing | Data pipeline | ETL | Incremental load | Pipeline architecture | PySpark | Quality validation | SQL | Step Functions | Unix
Education
Roles
Related jobs
-
Mid-level Full TimeHyderabad, IND-TG, India6h ago
-
Associate Data Engineer INR 1500K-2500KAgile | Apache NiFi | Azure DevOps | C plus plus | Database systemsMid-level Full TimePune, India9h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde9h ago
-
Senior Software Engineer - Data License Analytics, Pune INR 3000K-4720KAWS S3 | Agent to Agent | Agent to Agent A2A | Apache Airflow | Apache IcebergSenior-level Full TimePune9h ago
-
Spark, Scala, Hadoop & Quantexa/Senior Consultant Specialist INR 2000K-2800KApache Airflow | Apache Spark | CI/CD | DevOps | ElasticsearchFlexible working hours | On-call support | Shift workSenior-level Full TimeBangalore, Karnataka, India R10h ago
-
Assistant Director - Insights And Analytics INR 3000K-5199KCode reuse | Data Governance | Data Quality | Data Wrangling | Machine LearningExecutive-level Full TimeBangalore, Karnataka, India R10h ago
-
Senior-level Full TimeBangalore - Karnataka - India10h ago
-
Java Full Stack Engineer - Professional INR 1200K-3000KAngular | Apache Airflow | Apache Spark | Azure Kubernetes | Azure Kubernetes ServiceSenior-level Full TimeIndia11h ago
-
Lead Data Platform Engineer INR 2040K-3900KAPI Integration | AWS | AWS CloudWatch | AWS DataZone | AWS GlueEnhanced medical benefits | Family well-being benefits | Hybrid work | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India11h ago
-
Anomaly Detection | Autoencoders | Bayesian optimization | Classification | ClusteringOnsite workEntry-level Full TimeHyderabad, India12h ago
-
Data Engineer INR 1300K-2000KAPI Integration | Data Modeling | Data Transformation | Data pipeline | Power BIMid-level Full TimeHyderabad, Telangana, India12h ago
-
Senior Software Engineer INR 3000K-4000KALB | API Gateway | AWS ECS | AWS Glue | AWS LambdaFamily well-being benefits | Health benefits | Hybrid work | Paid time offSenior-level Full TimeHyderabad, India12h ago
-
Senior QA Engineer (Data Platform Testing) INR 2500K-3000KAPI Gateway | API Testing | AWS Lambda | CI/CD | CloudWatchSenior-level Full TimeHyderabad, India12h ago
-
Consultant - Cloud Data Engineer INR 1500K-2500KApache Airflow | Apache Kafka | Apache Spark | Azure | Azure DataMid-level Full TimeGurgaon, Haryana, India12h ago
-
Generative AI Lead INR 3264K-5876KAI Governance | APIs | Cloud Architecture | Cloud infrastructure | Data LakeHybrid workSenior-level Full TimeHyderabad, India12h ago
-
Mid-level Full TimePune, Maharashtra, India12h ago
-
Site Reliability Engineer II - Incident Management INR 2000K-3000KAlerting | Amazon Web Services | Automation | Cause analysis | DatabricksMid-level Full TimeHyderabad, Telangana, India13h ago
-
Mid-level Full TimePune, Maharashtra, India13h ago
-
Database Track Sr.Engineer INR 2000K-3000KCapacity Planning | Data Architecture | Database Design | Database performance | Database performance tuningSenior-level Full TimeIndia13h ago
-
Database Track Sr.Engineer INR 2000K-2700KAlways On | Always On Availability | Always On Availability Groups | Availability Groups | Azure MigrateSenior-level Full TimeIndia13h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India14h ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Kafka | Apache NiFi | BigQueryFlexible workingSenior-level Full TimeHyderabad, Telangana, India R15h ago
-
AWS | Ansible | Azure | Bash | CI/CDMid-level Full TimeHyderabad, Telangana, India16h ago
-
Mid-level Full TimePune, Maharashtra, India16h ago
-
Mid-level Full TimePune, Maharashtra, India16h ago