Data Eng, Mgmt & Governance Specialist
Bengaluru, BDC9A, India
INR 2000K-2040K (estimate) Senior-level Full Time
Tasks
- Align ingestion schemas with downstream analytics and AI workflows
- Containerize ETL workflows for execution and scheduling
- Create data pipelines data flows and data models
- Design and build ETL solutions using Azure Data Factory
- Identify data gaps and communicate findings to stakeholders
- Implement monitoring and logging with Azure Application Insights
- Maintain Redis cache for intermediate processing states
- Maintain data ingestion and integration with client teams
- Manage infrastructure provisioning and deployment consistency using Ansible
- Set up Azure Data Factory pipelines with linked services triggers and parameterization
Perks/Benefits
- N/A
Skills/Tech-stack
Ansible | Application Insights | Azure Application Insights | Azure Container | Azure Container Apps | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure SQL | Azure Service | Azure Service Bus | Container Apps | Data Factory | Data Lake Storage | Redis | Service Bus
Education
Roles
Data Engineer | Data Management Specialist | Engineer | Specialist
Related jobs
-
Staff Engineer, Data Engineering INR 2400K-3100KAPIs | Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, India3h ago
-
Senior Software Engineer (Microsoft .NET/Azure cloud) INR 2829K-4000K.NET | API Management | APIM | Angular | App ServicesHealth insurance | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India6h ago
-
AM - Cloud Data Engineer INR 1500K-2400KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure CosmosClient-facing consulting experience | Growth mindset | Professional development opportunitiesSenior-level Full TimePune, Maharashtra, India9h ago
-
Mid-level Full TimeBengaluru, Karnataka, India11h ago
-
Access Control | Azure Databricks | Azure Purview | Compliance Monitoring | Data Access ControlSenior-level Full TimeHyderabad - Salarpuria, India16h ago
-
API Testing | Agile | App Service | Azure App | Azure App ServiceHybrid workExecutive-level Full TimePune, India16h ago
-
Senior Engineer - Data INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Flows | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePune, India16h ago
-
Access Control | Azure Databricks | Azure Purview | CI/CD | Compliance MonitoringFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeHyderabad - Salarpuria, India16h ago
-
Software Engineering INR 1800K-2500KAPI Development | Application Insights | Azure Data | Azure Data Explorer | Azure Data FactoryMid-level Full TimeBengaluru, KA, IN22h ago
-
Senior Azure Data Engineer INR 3000K-3900KAPI Integration | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIndia23h ago
-
Lead Engineer -.NET INR 2000K-4800K.NET | AI Coding Assistants | AI coding | ASP.NET Web | ASP.NET Web APISenior-level Full TimeBengaluru, KA, India1d ago
-
Senior Data Engineer INR 2000K-3000KAI integrations | API Integration | Automation workflows | Azure Data | Azure Data FactoryClient-facing work | Fast-paced environment | Independent ownershipSenior-level Full TimeBangalore North, India1d ago
-
Entry-level Full TimeHyderabad, Telangana, India1d ago
-
Data Engineer INR 1400K-1800KAnomaly Detection | Apache Spark | Azure DevOps | Azure DevOps Pipelines | CDCHybrid work modelSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Engineer Senior - Data Engineering INR 3000K-4000KApache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBengaluru, India1d ago
-
Senior Data Engineer INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data FactoryFlexible work environment | Hybrid work model | Learning and development supportSenior-level Full TimeIndia R1d ago
-
Staff Software Engineer - Data INR 3200K-4600KAWS Lambda | Airflow | Ansible | Apache Flink | Apache SparkSenior-level Full TimeBengaluru, INDIA, India1d ago
-
Executive-level Full TimePune, Gera Commerzone SEZ, India1d ago
-
Applications Development Sr Programmer Analyst - Python Spark INR 2000K-3200KAirflow | Apache Spark | Avro | Azure Data | Azure Data FactorySenior-level Full TimeTRIL INFO PARK, CAMBRIDGE TOWER, India1d ago
-
Azure Data | Azure Data Ecosystem | Azure Data Factory | CI/CD | ClusteringFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India1d ago
-
Site Reliability Engineer INR 2000K-2156KAWS | Ansible | Bash | CI/CD | ChefGuided career tracks | Healthcare benefits | Hybrid work setting | Mentorship | Online learning platformSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India1d ago
-
Agile | Ansible | Azure DevOps | Bitbucket | BuildrootEmployee assistance program | Flexible schedule | Health insurance | Paid leave | Professional developmentMid-level Full TimeBuilding No: 12C, Floor 9,10,11, Building …1d ago
-
Data Engineer - Product Delivery INR 1500K-2000KAWS Glue | Amazon AWS | Amazon AWS Glue | Amazon EMR | Amazon RedshiftSenior-level Full TimePune Cerebrum, India1d ago
-
Senior Software Engineer - Java Full Stack, GenAI, Payments /Capital Markets Experience INR 2000K-3000KAgile | Angular | Apache Ignite | Azure | CI/CDSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Techno Functional ETL Migration Engineer INR 2000K-2500KAWS Glue | Apache Spark | Azure Data | Azure Data Factory | Azure SynapseMid-level Full TimeChennai, TN, IN1d ago