Lead Data Engineering, Integration & Governance
Bangalore, Karnataka, India
INR 2000K-3500K (estimate) Senior-level Full Time
Tasks
- Build data integration pipelines
- Create reusable data products
- Design data engineering architectures
- Develop APIs for data integration
- Enable semantic mapping for knowledge graphs
- Establish metadata management practices
- Handle data governance and compliance controls
- Implement ETL and ELT workflows
- Implement data quality, validation, and monitoring
- Manage access management and auditing
- Manage data lineage and traceability
- Operate data platform pipelines and workflows
- Optimize data platform performance
- Perform data preparation transformation and harmonization
- Plan disaster recovery and availability
- Publish data to catalogs and registries
- Support downstream digital twin consumption
Perks/Benefits
- N/A
Skills/Tech-stack
API | Access Management | Auditing | Azure Data | Azure Data Factory | Data Catalog | Data Factory | Data Governance | Data Lineage | Data Quality | Data pipeline | Databricks | ELT | ETL | Metadata Management
Related jobs
-
Sr. Principal Business Systems Analyst 1 INR 3700K-5000KAgentic Frameworks | Azure DevOps | Big Data | C# | C++Senior-level Full TimeBengaluru, KA, IN5h ago
-
Mid-level Full TimeBangalore, KA, IN, 5600768h ago
-
AWS | Airbyte | Airflow | Azure | CI/CDCollaboration across teams | Inclusive work environment | Learning opportunities | Professional growth | Remote workSenior-level Full TimeIndia9h ago
-
Senior Analytics Engineer – Data Applications INR 2771K-4064KAirflow | Anomaly Detection | Apache Spark | CI/CD | DBTSenior-level Full TimeBengaluru, INDIA, India10h ago
-
Senior Data Engineer INR 3000K-4000KA/B | A/B Testing | AWS | Apache Airflow | Apache HiveAccident insurance | Disability insurance | Financial wellness support | Flexible work schedule | Healthcare benefitsSenior-level Full TimeBengaluru, India10h ago
-
IN-Senior Associate_ Data Engineer Databricks_Data and Analytics_Advisory_ Bangalore INR 1500K-2500KAWS | Agile | Amazon Web Services | Apache Spark | Auto LoaderSenior-level Full TimeBengaluru Millenia, India14h ago
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1500K-2400KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud StorageMid-level Full TimePune, Maharashtra, India R22h ago
-
Senior-level Full TimeIndia, Bengaluru (Hybrid) R22h ago
-
Data Engineer II INR 2800K-3584KApache Airflow | BigQuery | CI/CD | Cloud Run | Cloud Run FunctionsSenior-level Full TimeIndia, Chennai22h ago
-
Sr. Cloud Engineer - Databricks/AI focus ( 5-9 years) Bangalore INR 2400K-3000KAKS | Bash | BigQuery | CI/CD | Cloud SecuritySenior-level Full TimeBengaluru, KA, India1d ago
-
Data Engineer (Python ETL) INR 800K-2000KETL | Oracle Database | PL/SQL | Performance Tuning | PythonMid-level Full TimeIN-MH-Pune1d ago
-
Mid-level Full TimeIN-MH-Pune1d ago
-
Snowflake Data Engineer- Consultant INR 1500K-2000KAWS Glue | AWS Lambda | AWS S3 | Access policies | AirflowCorporate social responsibility programs | Discounts on products and services | Maternity leave | Networking opportunities | Paternity leaveMid-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeIndia1d ago
-
Manager, Data Engineering INR 2000K-2500KAWS | Amazon Redshift | Apache Airflow | Apache Flink | Apache SparkMid-level Full TimeBengaluru1d ago
-
AI Data Foundation Engineer INR 3000K-5000KApache Airflow | Apache Beam | Apache Kafka | Apache Spark | CI/CDSenior-level Full TimeIndia1d ago
-
QA Engineer(Databricks) INR 1500K-2000KAzure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksMid-level Full TimeBengaluru,KA,India1d ago
-
Lead Data Engineer (Databricks) INR 2400K-3900KAWS Glue | AWS Redshift | Amazon S3 | Apache Spark | Automated testingSenior-level Full TimeHybrid (Bengaluru, Karnataka, IN) R1d ago
-
Data Engineer –GCP BigQuery INR 3000K-4000KAdobe Experience | Adobe Experience Platform | BigQuery | Cloud Data | Cloud Data ArchitectureSenior-level Full TimeIndia1d ago
-
AI Agents | Amplitude | DBT | Databricks | LLMDirect visibility to senior leadership | Documentation and training support | Hybrid workSenior-level Full TimeBangalore, INDIA R1d ago
-
Sr IT Analyst INR 1500K-2500KETL | Informatica IDMC | Informatica PowerCenter | Linux | Python24 7 shift model | On-call supportSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer INR 1500K-2000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible accommodations | Hybrid workMid-level Full TimeChennai, India1d ago
-
Sr.Data Engineering INR 2000K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full Timebengaluru, India1d ago
-
Sr.Data Engineering INR 2000K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full Timebengaluru, India1d ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Audit Logging | CI/CD | Cloud ComposerContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R1d ago