Data Engineer (SDE 2)
Tasks
- Automate AWS infrastructure with IaC
- Build ETL and ELT frameworks
- Build unified batch and streaming pipelines
- Collaborate in design reviews and technical planning
- Design and optimize table formats
- Develop lakehouse platform
- Handle schema evolution and deduplication
- Implement domain models for OLAP
- Ingest high throughput data from RDBMS
- Manage CDC flows
- Monitor data quality and freshness
- Optimize distributed query engines
- Orchestrate scheduled and durable workflows
- Perform source to lake reconciliation
- Tune Trino or ClickHouse for analytics
Perks/Benefits
- Access to latest gadgets and tools
- Free office meals
- Generous leave policy
- Health insurance
- Mental health support
- Referral program
- Relocation assistance
- Retirement perks
- Tax benefits
Skills/Tech-stack
AWS | AWS EMR | AWS Glue | Airflow | Amazon EKS | Amazon MSK | Amazon S3 | Apache Hudi | Apache Iceberg | ClickHouse | CloudWatch | Debezium | Delta Lake | Flink | GitHub Actions | GitLab | Go | Grafana | Infrastructure as Code | Java | Kafka | Kubernetes | Metabase | OpenMetadata | Power BI | PySpark | Python | SQL | Scala | Spark Structured Streaming | Structured Streaming | Superset | Tableau | Temporal | Terraform | Trino | UPI | “as-code”
Education
N/A
Related jobs
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India18h ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE)19h ago
-
Senior-level Full TimeHyderabad, Noida, Chennai, India20h ago
-
Engineer, Storage and Data Protection INR 1500K-2600KAlerting | Ansible | Automation | Backup | BashMid-level Full TimeGurugram, Haryana21h ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India22h ago
-
Associate Engineer - Data engineer INR 1000K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative work environment | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …22h ago
-
Senior-level Full TimeGurugram, India1d ago
-
Senior Software Engineer, AI/ML INR 2000K-5000K3D mathematics | Agent systems | Autonomous Agents | C plus plus | Computational GeometrySenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer (GCP, Azure) INR 1500K-2500KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Data PipelinesSenior-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Applied AI/ML Senior Associate INR 2817K-4680KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Engineer - Workflow INR 3715K-5000KAWS | Apache Flink | Apache Kafka | Apache Spark | AzureSenior-level Full TimeIndia (Bengaluru)1d ago
-
Member of Technical Staff INR 3242K-4580KConcurrency | Containerization | Go | Idempotency | KubernetesCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeBangalore, India1d ago
-
Software Engineer, Data Science INR 1000K-2000KD3 | Data Governance | Data Modeling | Data Pipelines | ETLHealth and wellness programs | Time awayMid-level Full TimeBengaluru, KA, India R1d ago
-
Entry-level Full TimePune, Maharashtra, India1d ago
-
Data Engineer 3 INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Continuous integration | Data CatalogMid-level Full TimePune, Maharashtra, India1d ago
-
Senior Consultant - Data Engineering-Data Analysis INR 2400K-3500KAWS Redshift | Confluence | ETL | Git | NumPySenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Lead Software Engineer - Java AWS Kafka INR 2500K-3500KAWS | Agile | Apache Kafka | CI/CD | CachingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN1d ago
-
Senior Database Engineer / Senior Consultant Specialist INR 2000K-3200KAccess Control | Backup and Recovery | BigQuery | CI/CD | CassandraSenior-level Full TimePune, Maharashtra, India R1d ago
-
Software Engineer INR 1500K-2200KAgile | Cloud services | Code Reviews | Data Modeling | Data StorageMid-level Full TimePune, India1d ago
-
Mid-level Full TimePune, India1d ago
-
Associate Software Engineer INR 1300K-2000KAgile | Design Patterns | JavaScript | Python | REST APIMid-level Full TimePune, India1d ago
-
Tech Lead Data Engineer INR 1500K-2600KAWS Data | AWS Glue | AWS data warehousing | Amazon Athena | Amazon EKSGreat Place to Work recognitionSenior-level Full TimePune, India1d ago
-
Senior-level Full TimePune, India1d ago