Data Engineer
Tasks
- Apply governance aligned practices for data
- Build batch and streaming data pipelines
- Build event-driven integrations with Kafka
- Develop curated datasets and dimensional models
- Develop replay and backfill strategies
- Ensure data quality and validation
- Implement idempotency handling
- Implement workflow orchestration and automation
- Improve pipeline observability and monitoring
- Optimize production data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Redshift | Apache Airflow | Apache Beam | Apache Flink | Apache Hadoop | Apache Spark | Azure Synapse | Azure Synapse Analytics | BigQuery | Bigtable | Cloud Composer | Cloud Dataflow | Cloud platform | Data Lineage | Data Modeling | Data Observability | Data Validation | Databricks SQL | Google Cloud | Google Cloud Composer | Google Cloud Dataflow | Google Cloud Platform | Idempotency | Kafka | Late data | Metadata governance | MongoDB | Monitoring | Prefect | Replay backfill | SQL | SQL Server | Snowflake | Synapse Analytics | Windowing
Education
Roles
Related jobs
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai5h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad5h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad5h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad5h ago
-
Senior-level Full TimeIndia6h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India7h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India7h ago
-
Mid-level Full TimeMumbai, Maharashtra, India7h ago
-
Manager - Python with Gen AI INR 1800K-3000KAutogen | Claude | CrewAI | Data Pipelines | Event DrivenMid-level Full TimeBangalore, Karnataka, India11h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Mid-level Full TimeBangalore, Karnataka, India11h ago
-
Senior-level Full TimeBangalore, Karnataka, India11h ago
-
Senior-level Full TimeHyderabad, India12h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 56003712h ago
-
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500KAWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CDSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Senior-level Full TimeGurgaon, Haryana, India12h ago
-
Software Engineer INR 1000K-1496KBitbucket | Data Architecture | Data Modeling | Data Pipelines | LinuxEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India12h ago
-
Database Reliability/Automation Engineer INR 1000K-1820KAnsible | Bash | CI/CD | CloudFormation | DockerMid-level Full TimeIndia12h ago
-
Analytics Solutions Associate - Data Strategy INR 800K-1250KAWS Databricks | AWS Redshift | Data Governance | Data Privacy | Data QualityMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior AI Engineer- Consultant INR 3000K-4800KAgent Orchestration | Agentic AI | Azure | Classification | ClusteringCareer advancement opportunities | Collaborative work culture | Continuous learning | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, India13h ago
-
GIS Data Engineer II INR 2000K-2400KAWS | Amazon Athena | Amazon EC2 | Amazon RDS | Amazon S3MentorshipSenior-level Full TimeMumbai, MH, India14h ago
-
Sr Engineer-Data Engg INR 1500K-2300KAzure AI | Azure SQL | Azure Synapse | Azure Synapse Analytics | DAXSenior-level Full TimeINDIA - BENGALURU - HP, IN18h ago
-
Software Engineer - Embedded & Functional Safety Software INR 1753K-3440KAgile | Automated testing | C# | C++ | CAN busSenior-level Full TimeBangalore, IN18h ago