Sr. Databricks Data Engineer - Assistant Manager
Tasks
- Build and test data ingestion pipelines
- Design and develop data pipelines
- Develop and deploy ETL pipelines
- Integrate testing and deployment
- Maintain data and environments
- Manage software development lifecycle
- Optimize and tune Databricks jobs
- Perform root cause analysis
- Troubleshoot data issues
Perks/Benefits
- Employee networks
- Flexible work/life support
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
API | AWS | Agile | Azure | Batch Processing | Data Lakehouse | Data Pipelines | Databricks | Databricks SQL | DevOps | ETL | Event Driven | Event-driven architecture | Microservices | PySpark | Query Optimization | Resource Management | Scala | Streaming
Education
Roles
Related jobs
-
Associate Software Engineer INR 1500K-2000KAgile | Application development | Data Storage | Design Patterns | Software DesignMid-level Full TimePune, India6h ago
-
Associate Software Engineer INR 1500K-2000KAgile | Code review | Data | Debugging | Design PatternsMid-level Full TimePune, India6h ago
-
Mid-level Full TimePune, India6h ago
-
Mid-level Full TimeKarnataka, Bengaluru, India8h ago
-
Expert Data Engineer (Databricks) INR 1500K-2400KAPI Design | API Key | AWS Glue | AWS IAM | AWS LambdaSenior-level Full TimeMaharashtra, Pune, India8h ago
-
Senior Data Engineer (Databricks) INR 2000K-2800KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Senior-level Full TimeMaharashtra, Pune, India8h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Local connection | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeMumbai, India9h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureGrowth education budget | Local compliance in India | Remote work | Team meet-ups | Wellness budgetSenior-level Full TimeBangalore North, India9h ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileHybrid work modelSenior-level ContractShaikpet, India10h ago
-
MLOps Engineer INR 1200K-1680KAWS | AWS Lambda | Amazon Bedrock | Amazon S3 | Amazon SQSEmployee Share Savings Plan | Hybrid work | Learning programs | Mentoring | Paid volunteer dayMid-level Full TimeBengaluru10h ago
-
Data Engineer INR 1500K-2500KAWS Glue | AWS Step Functions | Amazon Athena | Amazon Kinesis | Amazon Web ServicesSenior-level Full TimeIN-MH-Pune10h ago
-
Software Engineer - ML Ops DevOps INR 2500K-3465KAWS | Argo CD | Azure | CI/CD | Data PipelinesCollaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Associate Engineer - Embedded AI & Data Analytics INR 1000K-1141KC plus plus | Classification | Data Modeling | Data Observability | Data PipelinesCollaborative work environment | On-site work schedule | Professional development opportunities | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Testing Senior Associate - Power BI/Power Automate Tester INR 1000K-2000KAgile | Case design | Dashboard Verification | Data Reconciliation | Data ValidationFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Personal/family careMid-level Full TimeHyderabad, India R11h ago
-
Senior Data Engineer - Big Data & Automation INR 1500K-2500KAgile | Ansible | Apache Hive | Apache Spark | ArgoCDFlexible work policy | Work from homeSenior-level Full TimeIndia13h ago
-
Lead Database Engineer INR 1800K-3000KASH | AWR | AWS CloudWatch | AWS RDS | Access GovernanceHealth and life insurance | Hybrid schedule | Paid time off | Pension and retirement benefits | Professional development supportSenior-level Full TimeHyderabad, India R13h ago
-
Senior Data Engineer - ETL Framework INR 1500K-2500KApache Doris | Apache Hive | Apache Iceberg | Apache Spark | Apache TezFlexible work policy | Work from homeSenior-level Full TimeIndia13h ago
-
Specialist - Data Engineering-Google BigQuery INR 302K-562KData Modeling | Data Pipelines | Data Warehousing | ETL | Google BigQueryEntry-level Full TimeMumbai, Maharashtra, India14h ago
-
Data Engineer INR 1000K-1200KAzure | Azure Data | Azure Data Factory | Data Bricks | Data FactoryEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India14h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India14h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India15h ago
-
Lead Software Engineer - Java/Python, AWS, Spark INR 1500K-3000KAWS | AWS CloudFormation | AWS Step Functions | Airflow | Amazon S3Senior-level Full TimePune, Maharashtra, India15h ago
-
Consultant INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India15h ago
-
Executive-KDNI - Data & Analytics INR 1500K-5199KAWS | Azure | Dashboarding | Data Governance | Data ModelingExecutive-level Full TimeGurgaon, Haryana, India16h ago
-
Senior Data Engineer – Snowflake Migration Lead INR 1500K-2800KAmazon S3 | Apache Airflow | Azure Data | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeGurugram, Haryana, India16h ago