Senior Databricks Data Engineer
Tasks
- Build ETL and ELT pipelines
- Build scalable data solutions on cloud
- Contribute to Agile planning and roadmap discussions
- Define batch and real time data architectures
- Design Databricks Lakehouse architecture
- Design data ingestion transformation storage and consumption patterns
- Develop Delta Lake Unity Catalog Databricks Workflows and Delta Live Tables solutions
- Establish data quality validation reconciliation lineage and governance
- Implement HIPAA and PHI and PII compliant data security
- Integrate healthcare data sources
- Lead performance optimization and cost management
- Provide technical leadership and mentoring
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Agile | Azure | CI/CD | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Security | Data Validation | Databricks | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | DevOps | ELT | ETL | GCP | Git | HIPAA | Lakehouse Architecture | PII | Phi | PySpark | SQL | Scrum | Unity Catalog
Education
N/A
Related jobs
-
ML-Ops INR 3700K-5000KAsyncio | CI/CD | CProfile | Caching | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India5h ago
-
Generative AI Engineer INR 1200K-2500KAI Services | AWS | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development | Training programsMid-level Full TimeMumbai, Maharashtra, India5h ago
-
Staff GenAI Engineer INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ClassificationCollaborative team environment | Global consulting environment | Leadership development program | Mentorship programs | Training sessionsSenior-level Full TimeMumbai, MH, India5h ago
-
Mid-level Full TimeMumbai, Maharashtra, India5h ago
-
Senior-level Full TimeMumbai, Maharashtra, India5h ago
-
D&T Technical Solutions Manager - Marketing and Commercial INR 2000K-3814KAPI Design | API LED | API-led Architecture | Access Control | AgileMid-level Full TimePune, IN6h ago
-
Lead Data Engineer - Azure + Fabric INR 1200K-2700KAzure | Azure DevOps | CDC | CI/CD | Data GovernanceSenior-level Full TimeGurugram, Haryana, India6h ago
-
Databricks Engineer - Senior/ Lead INR 1500K-2800KACID | ADLS Gen2 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, TS, India7h ago
-
Data Engineer - Azure + Fabric INR 1400K-2700KAccess Control | Apache Spark | Azure Data | Azure DevOps | Azure SynapseSenior-level Full TimeGurugram, Haryana, India7h ago
-
Mid-level Full TimeNoida R7h ago
-
Staff Software Engineer (Python) INR 3700K-5000KAPI Development | Alerting | Amazon Web Services | Authentication | Batch ProcessingCollaborative team environment | Global projects | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India7h ago
-
AI / ML Data Scientist I INR 1000K-1890KAWS | Apache Spark | Artificial Intelligence | Cloud platform | ConfluenceMid-level Full TimeBengaluru, India7h ago
-
Lead - Data Platform Engineering INR 2500K-4500KAWS | Azure | Cloud Data | Cloud Data Platforms | Customer 360Senior-level Full TimeChennai, India8h ago
-
GEN AI/Prompt engineer INR 1200K-2500KAI Agents | API Integration | API deployment | AWS Bedrock | Azure OpenAIMid-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Software Engineer 2 INR 1500K-2500KAPI Design | AWS | Asynchronous Communication | Data Structures | Distributed SystemsMid-level Full TimeHybrid - Bangalore, India R8h ago
-
Lead Software Engineer (Full Stack) INR 506K.NET | AWS | Angular | Asynchronous programming | AzureRemote work flexibility | Supportive team culture | Work-life balanceSenior-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India8h ago
-
Senior-level Full TimeBangalore, India R8h ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Managed Airflow | Airflow | Apache Spark | AzureMedical insurance | Remote-first workplace | Term Life and Personal Accident | Wellness allowanceSenior-level Full TimeIndia - Bangalore R9h ago
-
Mid-level Full TimeIndia, Karnataka, Bangalore9h ago
-
Airflow | Apache Spark | CI/CD | Contextual Bandits | Data DriftExposure to advanced ML technologies | Ownership across full ML lifecycle | Professional development | Supportive collaboration environmentSenior-level Full TimeIndia9h ago
-
Developer III INR 1400K-2500KAgile Scrum | Azure Data | Azure Data Factory | Cloud Storage | Cloud platformSenior-level Full TimeHitech City, TG, India9h ago
-
Senior Software Engineer - Data + AI Observability INR 1500K-3000KAIOps | AWS | Azure | C++ | Cloud platformSenior-level Full TimeBengaluru, India10h ago
-
Senior Data Engineer INR 3000K-4000KAmazon Web Services | Apache Spark | Cloud platform | Continuous Delivery | Data GovernanceSenior-level Full TimeBangalore, India; Chennai, India; Hyderabad, India; …11h ago
-
Data Engineer, Flex Analytics INR 1500K-2400KAWS Glue | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Data ArchitectureInclusive cultureEntry-level Full TimeHyderabad, Telangana, IND13h ago
-
Business Intelligence Engineer, Flex Analytics INR 2000K-2700KAmazon QuickSight | Amazon Redshift | Data Modeling | Data Visualization | Data pipelineEntry-level Full TimeHyderabad, Telangana, IND13h ago