Data Engineer – Specialist
Ecospace Campus 3A, 4th Floor, Outer Ring Road, Bellandur, Bengaluru- 560103, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build medallion layer ingestion and transformation patterns
- Contribute to incident triage and reliability improvements
- Create pipeline test coverage
- Design and build scalable data pipelines
- Develop and optimize Iceberg datasets
- Emit lineage and metadata events
- Implement CI/CD for data pipelines
- Implement automated data quality checks
- Implement schema evolution and partitioning
- Mentor junior engineers and define lakehouse standards
- Register assets in enterprise data catalog
- Set up observability metrics logs and alerts
- Support IAM least privilege and access controls
Perks/Benefits
- Employee assistance programme
- Flexible schedules
- Health insurance
- Holiday purchase scheme
- Parental leave
- Professional development opportunities
- Retirement savings plan
Skills/Tech-stack
AWS | AWS Glue | Amazon Kinesis | Amazon S3 | Apache Airflow | Apache Iceberg | Automated testing | Batch Processing | CI/CD | Data Governance | Data Lineage | Data Processing | Data Quality | Data Validation | Data pipeline | DataOps | IAM | Least Privilege | Metadata Management | Observability | OpenLineage | Partitioning | Python | SQL | Schema evolution | Streaming Data | Streaming data processing
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeIN-AP-Hyderabad4h ago
-
AI Engineer INR 1500K-3000KAzure Databricks | Data Engineering | Data engineering pipelines | Embeddings | Engineering PipelinesMid-level Full TimeBengaluru, Karnataka, India5h ago
-
Senior Engineer Digital & AI Solutions INR 4000K-6000KAPI Development | Agent systems | CI/CD | Cloud Computing | ContainerizationFood allowance | Health insurance | Hybrid work | Internet allowance | Learning and development programsSenior-level Full TimeHyderabad, Telengana, India6h ago
-
Manager of Software Engineering-Java, Flink,Kafka INR 1500K-2200KAWS | Agile | Amazon EKS | Apache Flink | Apache KafkaMid-level Full TimeHyderabad, Telangana, India6h ago
-
Software Engineer II,Python, Spark INR 1500K-2200KAWS | AWS Glue | AWS Glue Catalog | AWS KMS | AWS Lake FormationMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Lead Software Engineer - Java/Python, AWS,LLM INR 3500K-5000KA/B | A/B Testing | AWS Lambda | Agentic AI | AgileSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Staff Engineer, Data Analytics Engineering INR 2500K-3500KAPIs | AWS Glue | AWS Lambda | AWS S3 | Amazon BedrockSenior-level Full TimeBengaluru, KA, India7h ago
-
Senior Associate - Data Science/Applied AI ML INR 1400K-2400KAnomaly Detection | Backtesting | Bias/fairness | CI/CD | ClassificationMid-level Full TimeMumbai, Maharashtra, India9h ago
-
Senior Associate - Data Science/Applied AI ML INR 1400K-2400KAnomaly Detection | Bias and fairness | CI/CD | Classification | ClusteringMid-level Full TimeMumbai, Maharashtra, India9h ago
-
Data Engineer (GCP) INR 1500K-2040KAPIs | Airflow | Authentication | Authorization | BigQueryAgile collaboration | Autonomy | Flexible environmentMid-level Full TimePune, Maharashtra, India10h ago
-
Senior-level Full Timetelengana, India10h ago
-
Associate Specialist - Cloud & Application Engineering INR 800K-1000KAWS | Azure | Cloud Data | Cloud Data Platforms | Cloud platformMid-level Full TimeMumbai, Maharashtra, India10h ago
-
Product Manager (Vice President) - Fusion Data Platform INR 3000K-6000KAgent systems | Async Programming | Audit trails | Autogen | ChunkingExecutive-level Full TimeHyderabad, Telangana, India10h ago
-
Mid-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Software Engineer, Data Engineering INR 3000K-4000KAWS | Apache Airflow | Apache Spark | Data Modeling | Data PipelinesAccident insurance | Commuter benefits | Dental benefits | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India12h ago
-
Senior Machine Learning Engineer - Advertising Engineering INR 2520K-3880KAttribution Modeling | C++ | Classification | Data Lake | Data PipelinesFlexible remote work on Fridays | Health and wellness support | Hybrid work schedule | Paid time offSenior-level Full TimeBengaluru, India12h ago
-
Mid-level Full TimePune, Maharashtra, India14h ago
-
Technical specialist- Data Engineer, AS INR 2475K-3465KAgile | Airflow | Apache Beam | Apache Hadoop | Apache SparkAccident insurance | Best in class leave policy | Certification sponsorship | Childcare assistance reimbursement | Employee assistance programMid-level Full TimePune - Margarpatta, India17h ago
-
Technical specialist- Data Engineer, AS INR 2475K-3465KAgile | Airflow | Apache Beam | Apache Spark | Cause analysisAccident and term life insurance | Childcare assistance reimbursement | Employee assistance program | Flexible leave policy | Gender neutral parental leavesMid-level Full TimePune - Margarpatta, India17h ago
-
Data Platform Engineer INR 1000K-2000KAWS | Data Modeling | Data Warehouse | Data integration | ETLMid-level Full TimeBengaluru, BDC7A, India17h ago
-
Mid-level Full TimeBengaluru, BDC14A, India17h ago
-
Mid-level Full TimeKolkata, KDC1A, India17h ago
-
Mid-level Full TimeKolkata, KDC1A, India17h ago
-
Infra Tech Support Practitioner INR 1500K-2500KAKS | API Gateway | AWS | Ansible | Application Lifecycle ManagementMid-level Full TimeKolkata, KDC1A, India17h ago
-
Infra Tech Support Practitioner INR 1000K-1820KAKS | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSMid-level Full TimePune, PDC3C, India17h ago