Data Eng, Mgmt & Governance Specialist
Bengaluru, BDC9A, India
INR 2000K-2040K (estimate) Senior-level Full Time
Tasks
- Align ingestion schemas with downstream analytics and AI workflows
- Containerize ETL workflows for execution and scheduling
- Create data pipelines data flows and data models
- Design and build ETL solutions using Azure Data Factory
- Identify data gaps and communicate findings to stakeholders
- Implement monitoring and logging with Azure Application Insights
- Maintain Redis cache for intermediate processing states
- Maintain data ingestion and integration with client teams
- Manage infrastructure provisioning and deployment consistency using Ansible
- Set up Azure Data Factory pipelines with linked services triggers and parameterization
Perks/Benefits
- N/A
Skills/Tech-stack
Ansible | Application Insights | Azure Application Insights | Azure Container | Azure Container Apps | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure SQL | Azure Service | Azure Service Bus | Container Apps | Data Factory | Data Lake Storage | Redis | Service Bus
Education
Roles
Data Engineer | Data Management Specialist | Engineer | Specialist
Related jobs
-
Sr. DevOps Engineer INR 2500K-3500KAIOps | AKS | ARM | Azure Container | Azure Container RegistryRotational on-call supportSenior-level Full TimeHyderabad, India4h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai6h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai6h ago
-
Senior-level Full TimeHyderabad, India12h ago
-
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500KAWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CDSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Database Reliability/Automation Engineer INR 1000K-1820KAnsible | Bash | CI/CD | CloudFormation | DockerMid-level Full TimeIndia12h ago
-
Sr Engineer-Data Engg INR 1500K-2300KAzure AI | Azure SQL | Azure Synapse | Azure Synapse Analytics | DAXSenior-level Full TimeINDIA - BENGALURU - HP, IN18h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India18h ago
-
Senior Data Engineer II INR 2800K-4000KAWS | Airflow | CDC | CI/CD | Control-MComprehensive benefits package | Flexible workingSenior-level Full TimeFIL Bengaluru Office, India18h ago
-
Senior Software Engineer - Gen AI INR 2000K-2800KAJAX | AWS | Agile | Angular | AnsibleContinuous learningSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India18h ago
-
Azure Data Engineer INR 2000K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBengaluru, India18h ago
-
Sr. Data Engineer (Big Data & Analytics Engineering) INR 3000K-3880KAWS | Apache Airflow | Apache Hudi | Apache Iceberg | Apache KafkaSenior-level Full TimePune, India18h ago
-
Sr. Data Engineer (Big Data & Analytics Engineering) INR 3000K-3880KAccess Controls | Apache Airflow | Apache Hudi | Apache Iceberg | Apache NiFiOn-call rotations | Operational rotationsSenior-level Full TimePune, India18h ago
-
Lead, Big Data Analytics & Engineering INR 3000K-4000KAWS | Apache Airflow | Apache NiFi | Azure | Azure DataSenior-level Full TimePune, India18h ago
-
Senior Software Engineer (Data Engineering, Python, SQL, Snowflake, Cloud and Devops) INR 2500K-3380KAWS | AWS Step Functions | Airbyte | Airflow | Apache HudiCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningSenior-level Full TimeChennai, TN, India1d ago
-
Azure Data & Fabric Developer / ETL pipeline & SQL ( 5 + yrs Assistant Manager - RNA INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, MH, India1d ago
-
Senior Software Engineer - Analytics INR 2000K-3200KAgile Scrum | Amazon Redshift | Apache Hadoop | Apache Hive | Apache KafkaSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Data Engineer Azure - Senior INR 3000K-4000KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeGlobal scale | Inclusive culture | Learning culture | Supportive teamSenior-level Full TimePune, MH, IN, 4110141d ago
-
.NET | ASP.NET | Amazon Web Services | Angular | Apache AirflowFlexible work arrangements | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India1d ago
-
IN_Senior Associate_SCM_Data and Analytics_Advisory_Bangalore INR 2040K-3380KAgile | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India1d ago
-
Lead Engineer - Investment Data Platform INR 3000K-4000K.Net Framework | API Management | Agile | Apigee | AzureHybrid work | Work from office 3 days per weekSenior-level Full TimePune, India1d ago
-
Data Engineer (Azure + Databricks) INR 800K-1500KAirflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Data Engineer (Azure + Databricks) INR 1200K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Associate Data Engineer - Azure Data Factory and SQL INR 1019K-1593KAzure Data | Azure Data Factory | Data Factory | Data Testing | Data pipelinePermanent employmentMid-level Full TimeIN - TDC 1 (IN110), India1d ago
-
Data Engineer INR 3000K-4000KAWS RDS | Azure SQL | Azure SQL Database | Backup and Recovery | Cloud DatabasesBe Well programs | Certification support | Coaching | Hands-on learning | Hybrid work environmentSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India1d ago