IN_Senior Associate_Data Engineer_Emerging Businesses_Advisory_Bangalore
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Apply security and governance controls
- Build Azure data lakes
- Collaborate on modeled datasets for BI ML applications
- Configure cluster performance and cost
- Design ETL/ELT pipelines
- Handle incidents and run postmortems
- Implement data quality testing and observability
- Implement infrastructure as code and CI CD for data workflows
- Manage curated data layers
- Monitor log and alert pipeline executions
- Optimize Spark jobs
- Orchestrate data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | AKS | Active Directory | Adaptive Query | Adaptive query execution | Apache Spark | Autoscaling | Avro | Azure | Azure Active Directory | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Event | Azure Event Hubs | Azure Functions | Azure HDInsight | Azure Key Vault | Azure Monitor | Bicep | Blob Storage | CI/CD | Data Factory | Data Lake Storage Gen2 | Databricks | Dedicated SQL Pools | Delta Lake | Docker | Encryption with CMK | Event Hubs | Git | GitHub Actions | Great Expectations | HDFS | Hive | Kafka | Key Vault | Log Analytics | Managed Identity | Metastore | Microsoft Purview | ORC | OpenLineage | Parquet | Photon | Power BI | Private Endpoint | PySpark | Query Execution | SQL | SQL Pools | Scala | Snowflake | Spot VMs | Synapse Dedicated SQL Pools | Synapse Serverless | Terraform | Unity Catalog | VNet integration | Window Functions | YARN
Roles
Related jobs
-
Asynchronous processing | Backend architecture | CI/CD | Caching | Computer VisionCareer growth opportunities | Collaborative and inclusive culture | High ownership and autonomy | Opportunity to work on cutting-edge AISenior-level Full TimeIndia3h ago
-
Senior-level Full TimeIndia Office12h ago
-
Senior Software Engineer (Java Full Stack /AWS) INR 2775K-4200KAWS | AWS Security | Agile | CI/CD | Container OrchestrationFamily well-being benefits | Health benefits | Paid time offSenior-level Full TimeHyderabad, India17h ago
-
Data Engineer INR 2000K-3000K.NET | API Development | Data Ingestion | Data Modeling | Data TransformationSenior-level Full TimeBangalore North, India17h ago
-
Sr. Data Engineer INR 1500K-2400KAWS Glue | Amazon S3 | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore North, India17h ago
-
Bash | Data Pipelines | Distributed Systems | Docker | GCPAccess to cutting-edge technologies | Autonomy | Bonus opportunities | Collaborative culture | Distributed first work environmentSenior-level Full TimeIndia R18h ago
-
Specialist, Data Management & Quantitative Analysis II INR 1400K-2000KAmazon S3 | CI/CD | Dashboards | Data APIs | Data VisualizationFlexible benefits | Paid time off | Paid volunteer time | Training and demos | Wellbeing programsMid-level Full TimePune, MH, India18h ago
-
Senior Clinical Data Engineer INR 2000K-2500K21 CFR Part 11 | Audit trails | CDISC | CFR Part 11 | Dashboard DevelopmentSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Senior-level Full TimeIN-MH-Pune19h ago
-
Senior Software Engineer INR 2500K-3380KAPI Development | AWS | Apache Airflow | Apache Hive | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Lead Data Engineer #3194 INR 3000K-5000KAccess Control | Code Repository | Compute Optimization | Data Governance | Data LineageFlexible working hours | Global collaboration | Learning and development programs | Opportunity for advanced tools and technologies | Performance rewards and recognitionSenior-level Full TimeChennai, India19h ago
-
Lead AI/ML Engineer INR 3000K-5000KAzure | Data Normalization | Data Preprocessing | Data cleaning | Deep learningCar lease | Career advancement opportunities | Certification programs | Corporate NPS | Dental insuranceSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agent Orchestration | Ansible | Artifact management | AzureBusiness development | Client advisory | Client relationship management | Growth mindset | MentorshipSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Assistant Manager - Cloud & AI Architect INR 3000K-5000KAI Foundry | Agentic AI | Ansible | Artifact management | AzureSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Databricks Developer / Data Architect INR 1500K-2500KAWS | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimePune, Maharashtra, India20h ago
-
AI | Android | Bandwidth Optimization | C# | C++Remote work optionSenior-level Full TimeIndiranagar, India20h ago
-
SQL,GCP/Consultant Specialist INR 500K-1500KAWS | Agile Scrum | Backup and Recovery | Cloud Computing | Cloud Platform (GCPMid-level Full TimePune, Maharashtra, India R20h ago
-
AWS | Algorithms | Apache Calcite | Apache Hive | Apache ImpalaCareer development opportunities | Employee resource groups | Health and wellness programs | Internet reimbursement | Paid time offSenior-level Full TimeIndia21h ago
-
Data Scientist - Senior INR 3000K-5000KAgile | Amazon Web Services | Anomaly Detection | Azure | Big DataSenior-level Full TimePune, Maharashtra, India21h ago
-
Digital Finance CoE - Azure Data Engineer - Executive INR 1500K-6000KAWS Glue | Azure | Azure Data | Azure Data Factory | Azure DatabricksExecutive-level Full TimeBangalore, Karnataka, India21h ago
-
Senior-level Full TimeIndia21h ago
-
Consultant - AI Engineer with Claude INR 2500K-5000KAWS | Autogen | Azure | Cloud platform | ContainerizationSenior-level Full TimeBangalore, Karnataka, India21h ago
-
Group Manager - Data Engineering INR 1500K-2500KAgile | Apache Airflow | Apache Spark | BigQuery | CI/CDMid-level Full TimeGurgaon, HR, India22h ago
-
Quality Assurance Engineer III INR 1500K-2500KAgile | Apache Airflow | BigQuery | CI/CD | Cloud platformSenior-level Full TimeChennai, Tamil Nadu, India1d ago