Data Engineer – Specialist
Ecospace Campus 3A, 4th Floor, Outer Ring Road, Bellandur, Bengaluru- 560103, India
INR 2000K-2500K (estimate) Senior-level Full Time
Tasks
- Apply open standards for interoperability
- Build lakehouse datasets
- Collaborate on IAM and governed data access
- Create metadata and lineage with OpenLineage
- Design data pipelines for batch and streaming
- Implement CI/CD for data pipelines
- Implement automated data quality checks
- Implement medallion pattern ingestion and transformation
- Mentor engineers and define lakehouse standards
- Optimize Iceberg datasets for multi engine access
- Register datasets in enterprise catalog
- Set up observability for data pipelines
Perks/Benefits
- Employee assistance programme
- Flexible schedules
- Health insurance
- Holiday purchase scheme
- Parental leave
- Professional development opportunities
- Retirement savings plan
Skills/Tech-stack
AWS Glue | AWS S3 | Amazon Athena | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache Iceberg | CI/CD | Data Governance | Data Quality | DataOps | Databricks | EMR | IAM | Metadata Management | Observability | OpenLineage | Python | SQL | Snowflake | Trino
Education
N/A
Roles
Related jobs
-
Lead Data engineer, Sr. Specialist INR 2800K-3880KAWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Domestic relocation | Flexible work arrangements | Hybrid work arrangements | Travel 10 percentSenior-level Full TimeIND - Telangana - Hyderabad, India4h ago
-
Entry-level InternshipHyderabad, India13h ago
-
Entry-level InternshipHyderabad, India13h ago
-
Assistant Manager INR 1000K-2000KBusiness Intelligence | Data Modeling | Data Quality | Logistic Regression | Machine LearningMid-level Full TimeIndia14h ago
-
DTICI_T8_Data_engineer_Manufacturing_Operations INR 1500K-2500KAgile | Apache Spark | Azure | Azure Blob | Azure Blob StorageSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
AWS | Airflow | Apache Spark | Azure | Cause analysisSenior-level Full TimePune, Maharashtra, India14h ago
-
AWS Snowflake INR 1500K-2000KAmazon Web Services | DBT | Data Modeling | Data Pipelines | Data WarehousingMid-level Full TimeIN-TN-Chennai14h ago
-
Confluent Kafka Data Engineer INR 1500K-2500KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-KA-Bangalore14h ago
-
GEN AI Developer INR 2000K-5000KAgile | Continuous integration | Data Modeling | Generative AI | Language ProcessingSenior-level Full TimeIN-KA-Bangalore14h ago
-
AI Automation Expert INR 2000K-5000KAgentic AI | Azure OpenAI | Confluence | Copilot Studio | Enterprise IntegrationSenior-level Full TimeIN-KA-Bangalore14h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeIN-MH-Mumbai14h ago
-
GCP Data Engineer INR 1500K-2500KADLS Gen2 | Airflow | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-MH-Mumbai14h ago
-
Mid-level Full TimeIndia14h ago
-
Principal AI Engineer with Java INR 2475K-4800KAI Services | Agent Framework | Agentic AI | Alembic | AutogenEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India15h ago
-
Sr. Associate Director, Software Engineering Specialist INR 1600K-2400KAirflow | Apache Beam | Apache Flink | BigQuery | CI/CDFlexible working | Inclusive workplace | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R15h ago
-
Mid-level Full TimePune, Maharashtra, India15h ago
-
Senior Software Engineer, AI/ML Computer Vision, Google Cloud INR 3000K-5000KC++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Lead Assistant Manager INR 1500K-2800KAccess Control | Caching | Data Governance | Databricks | Databricks SQLSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Associate Director - Forward Deployed Engineer/AI Engineer INR 1500K-3000KAI Foundry | AWS Bedrock | Agent systems | App Service | Artificial IntelligenceMid-level Full TimeBangalore, Karnataka, India16h ago
-
Senior-GDC INR 2400K-3500KAPIs | Azure | Azure Data | Azure Data Factory | Azure DatabricksCoaching junior engineers | Knowledge transferSenior-level Full TimeBangalore, Karnataka, India16h ago
-
Associate Director- AI Engineer - Solution Architect INR 1500K-3000KAI Act | Agent systems | App Service | Azure App | Azure App ServiceMid-level Full TimeBangalore, Karnataka, India16h ago
-
Assistant Manager - Azure Data Engineer INR 1500K-2000KApache Spark | Azure | DBX Notebooks | Data Infrastructure | Data ModelingMid-level Full TimeBangalore, Karnataka, India17h ago
-
Security Services Data Modelling and Engineering - Associate INR 1500K-2400KAI enablement | Apache Spark | Data Architecture | Data Catalog | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India17h ago
-
Associate - Java Developer - Prime Brokerage INR 1500K-2000KAgile | Crystal Reports | Data Warehousing | Database Triggers | Database functionsMid-level Full TimePune, India17h ago
-
BI Developer (Gen AI) – (BI and Analytics)-Analyst INR 2500K-4000KCI/CD | Control-M | Data Modeling | Database Design | DatabricksSenior-level Full TimeMumbai, Maharashtra, India17h ago