IN-Senior Associate_ Data Engineer Databricks_Data and Analytics_Advisory_ Bangalore
Bengaluru Millenia, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Design data pipelines
- Develop Delta Lake transformations
- Document technical designs data flows and runbooks
- Ensure data governance and lineage
- Ensure data quality and reliability
- Implement batch processing
- Implement enterprise security access control and compliance
- Implement incremental processing
- Ingest semi structured datasets
- Ingest structured datasets
- Maintain data pipelines
- Mentor junior engineers
- Optimize Databricks notebooks jobs and workflows
- Optimize Spark jobs performance and cost
- Support analytics and reporting
- Transform data with Spark
- Troubleshoot production data pipeline issues
Perks/Benefits
Skills/Tech-stack
Agile | Amazon Web Services | Apache Spark | Azure | Cloud platform | Data Warehousing | Databricks | Delta Lake | Distributed Computing | ELT | ETL | Google Cloud | Google Cloud Platform | Lakehouse | Lakehouse Architecture | PySpark | SQL | Spark SQL | Web Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Software Engineer INR 1300K-2000KAgile | Cloud services | Code review | Data Modeling | Design PatternsMid-level Full TimePune, India11h ago
-
Software Engineer INR 1300K-2000KAgile | Cloud Computing | Code review | Data Storage | Database ModelingMid-level Full TimePune, India11h ago
-
Senior Data Engineer INR 3264K-4995KAWS | Agile | DBT | Data Governance | Data ModelingFlexible work options | Life leave days | Professional development days | Retirement savings options | Vacation timeSenior-level Full TimePune, MH, India14h ago
-
Data Engineer INR 1500K-2000KApache Airflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud FunctionsMid-level Full TimeIndia-Telangana-Hyderabad14h ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)15h ago
-
Data Scientist Associate INR 1400K-2400KAnalytics | Artificial Intelligence | Compliance | Data Analysis | Fraud DetectionMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Advanced Specialist, Technology Data Analyst INR 2200K-4000KAccess Control | Bash | CI/CD | Cause analysis | Collibra24/7 on-call rotationSenior-level Full TimeChennai, Tamil Nadu, India16h ago
-
Forward Deployed Engineer, Generative AI, GECX, Google Cloud INR 2000K-3500KAPIs | Cloud infrastructure | Cloud platform | Debugging | Full StackAccess to advanced AI portfolio | Collaborative culture | Direct access to engineering and research teams | High travelMid-level Full TimeBengaluru, Karnataka, India16h ago
-
Gen AI - Consultant INR 2000K-4500KAWS SageMaker | Apache Airflow | Apache Spark | Azure Machine Learning | CI/CDSenior-level Full TimeBangalore, Karnataka, India16h ago
-
Alerting | Automated testing | Business Intelligence | CI/CD | Dashboard DevelopmentMid-level Full TimeBangalore, Karnataka, India17h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India17h ago
-
Senior Specialist, Business Data Architecture INR 1500K-2500KAzure Data | Azure Data Factory | CI/CD | Cloud Data | Cloud Data PlatformsSenior-level Full TimePune, MH, India17h ago
-
Software Engineer I INR 1500K-2210KAlgorithms | Amazon Web Services | Cloud platform | Data Structures | Distributed SystemsCareer growth | Comprehensive support for holistic well being | Opportunities to learn new skillsEntry-level Full TimeGurugram, HR, India17h ago
-
Senior-level Full TimeGurugram, Haryana, India18h ago
-
AI Builder | AWS | Agile | Amazon Redshift | AzureMid-level Full TimeBangalore, Karnataka, India18h ago
-
Senior-level Full TimeBengaluru North, Karnataka, India R19h ago
-
Senior Data Engineer INR 3264K-5012KAWS | Agile | Airflow | Alerting | CSVFlexible work options | Life leave days | Professional development days | Vacation time | Volunteer daysSenior-level Full TimePune, MH, India19h ago
-
Senior Engineer (India Office) INR 1500K-2500KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Semantic Data Engineer INR 3000K-3500KAPI Integration | Apache Airflow | Apache Superset | BigQuery | Cube.devSenior-level Full TimeNoida,Uttar Pradesh,India20h ago
-
Associate Distinguished Engineer (Agentic AI Architect) INR 2000K-3300KAgent SDK | AgentOps | Amazon Web Services | Autogen | AzureMid-level Full TimeIndia, India20h ago
-
DE&A - Core - Big Data Engineering - Hadoop Ecosystem INR 3000K-4000KACID transactions | Apache Airflow | Apache Hive | Apache Iceberg | Apache OzoneSenior-level Full TimeIndia21h ago
-
Alerting | Automated testing | Business Intelligence | CI/CD | Dashboard governanceEntry-level Full TimeBangalore, Karnataka, India21h ago
-
DevOps Engineer INR 1600K-2525KAWS | Azure | Azure DevOps | Bash | CI/CDGlobal diverse environment | Hybrid work flexibility | Inclusive workplace | Sustainability focused teamMid-level Full TimePune, Maharashtra, India21h ago
-
Azure Data Engineer - Con - MFT KGS CH INR 1500K-2800KAgile | Azure Cloud | Azure Cloud Services | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India21h ago
-
Azure Data Engineer - Con - MFT KGS CH INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India21h ago