IN-Senior Associate_ Data Engineer Databricks_Data and Analytics_Advisory_ Bangalore
Bengaluru Millenia, India
INR 3000K-3900K (estimate) Senior-level Full Time
Tasks
- Adhere to enterprise security access control and compliance
- Build scalable data infrastructure
- Collaborate with analytics AI ML and business teams
- Design data pipelines
- Develop data transformations
- Document technical designs data flows and runbooks
- Ensure data quality reliability lineage and governance
- Implement batch and incremental processing
- Ingest and curate structured and semi structured data
- Mentor junior engineers and share best practices
- Optimize Databricks notebooks jobs and workflows
- Optimize Spark jobs for performance and cost
- Support analytics reporting and downstream consumption
- Troubleshoot production pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Amazon Web Services | Amazon Web Services (AWS) | Apache Airflow | Apache Hadoop | Apache Spark | Auto Loader | Azure | Azure Data | Azure Data Factory | CI/CD | Cloud Platform (GCP | Data Factory | Data Governance | Data Warehousing | Databricks | Delta Lake | ELT | ETL | Google Cloud | Google Cloud Platform | Google Cloud Platform (GCP) | Lakehouse | PySpark | Python | SQL | Spark SQL | Streaming | Unity Catalog
Roles
Related jobs
-
Senior DevOps Engineer INR 2000K-4000KAKS | Amazon Aurora | Amazon EMR | Amazon Redshift | Amazon S3Senior-level Full TimeBangalore, India7h ago
-
Technology Leader-Data Engineering-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 2000K-2600KAPI | CI/CD | Java | Jira | LinuxSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Senior-level Full TimeIN-MH-Pune8h ago
-
Deputy Manager-Data Engineering INR 1500K-2500KAmazon Web Services | Azure | CI/CD | Cloud platform | ContainerizationMid-level Full TimeNoida, UP, India9h ago
-
Senior Software Engineer, Server AI Foundations, Core INR 2000K-4500KAgentic Frameworks | Agents | Agile Development | CI/CD | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-3500KAI Foundry | Access Management | Active Directory | Agent Builder | Agent OrchestrationC level presentations | Client advisory | Mentoring junior resources | Professional developmentSenior-level Full TimeBangalore, Karnataka, India11h ago
-
Data Engineer - Senior INR 2000K-2800KAnomaly Detection | Apache Hive | Apache Kafka | Application Insights | AzureSenior-level Full TimePune, Maharashtra, India11h ago
-
AWS Data Engineer INR 1500K-2000KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeIndia11h ago
-
Senior-level Full TimePune, Maharashtra, India11h ago
-
Agile | Apache Spark | Data Architecture | Data Catalog | Data GovernanceSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Azure Data Engineer - Assistant Manager INR 1500K-2000KAnalysis Services | Apache Spark | Azure Analysis | Azure Analysis Services | Azure CosmosMid-level Full TimeBangalore, Karnataka, India11h ago
-
SAP Gen AI Developer ACON US Inv INR 1317K-2000KAI Core | AI Launchpad | Business Technology Platform | DevOps | DockerMid-level Full TimeBangalore, Karnataka, India11h ago
-
Azure Databricks INR 2400K-3900KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksClient Customer Interactions | Health insurance | Learning aids | Meal vouchers | Unlimited growth potentialSenior-level Full TimeHyderabad, Telangana, India11h ago
-
Senior Research Engineer - Applied AI/ML INR 2000K-4170KA/B | A/B Testing | AWS | Amazon SageMaker | Apache AirflowHybrid workSenior-level Full TimeGurugram, India12h ago
-
Senior-level Full TimeHyderabad, India13h ago
-
Applied AI /ML INR 950K-1250KAlgorithms | Amazon Web Services | Azure | Computer Vision | Data MiningMid-level Full TimeHyderabad, Telangana, India13h ago
-
Lead Assistant Manager INR 2000K-3000KANSI SQL | Agile | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimePune, Maharashtra, India13h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3000KAnthropic API | Azure OpenAI | CI/CD | Code Analysis | CypressHybrid work modelMid-level Full TimePune, Maharashtra, India14h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS Athena | AWS Data | AWS Data Pipeline | AWS Glue | AWS LambdaCorporate social responsibility programs | Maternity leave | Networking opportunities | Paternity leave | Product and service discountsMid-level Full TimeBangalore, Karnataka, India14h ago
-
AI Engineer INR 1800K-3000KAPI Integration | Azure | Azure OpenAI | Chroma | DockerFast-learning culture | Flexible locationMid-level Full TimeNavi Mumbai, Maharashtra, India14h ago
-
Genetics Data Engineer INR 1500K-2500KAWS | Azure | BGEN | Bcftools | Biobank trusted research environmentsMid-level Full TimeBangalore, Karnataka, IN, 56003714h ago
-
Azure Data Engineer_Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeHyderabad, HYDERABAD, India14h ago
-
Lead Software Engineer - Applied AI Engineer (Agentic/ Gen AI) INR 2000K-3500KAPI Design | AWS | Accuracy Monitoring | Agentic architecture | CI/CDSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Java Spark Engineer INR 2000K-3500KAWS | Apache Spark | Azure | CI/CD | Cloud platformAgile team culture | Career growth opportunitiesSenior-level Full TimeIndia - Bengaluru15h ago
-
AI Engineer - Tieto Tech Consulting (m/f/d) INR 2200K-4200KAI Builder | AI Search | AI Solution | AI solution testing | Agent OrchestrationHybrid work model | Open culture | Professional growth | Work-life balanceMid-level Full TimeBangalore, India15h ago