Senior Databricks Engineer
Tasks
- Apply data warehousing dimensional modeling
- Automate Databricks deployments with CI CD
- Build PySpark and SQL ETL ELT jobs
- Conduct code reviews and mentor engineers
- Deploy Databricks data pipelines
- Design scalable data pipelines
- Develop Databricks Delta Live Tables pipelines
- Develop data infrastructure
- Develop native Databricks dashboards
- Develop reusable Python libraries
- Establish data quality standards
- Implement Slowly Changing Dimensions
- Implement medallion architecture
- Implement structured streaming pipelines
- Integrate data ingestion from REST APIs
- Manage infrastructure as code
- Monitor data quality dashboards
- Share data with external BI tools
- Tune Spark jobs and Databricks clusters
Perks/Benefits
- 401k matching
- Dental insurance
- Flexible spending accounts
- Health insurance
- Paid Holidays
- Paid time off
- Remote work
- Vision insurance
Skills/Tech-stack
Asset bundles | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Key Vault | CI/CD | Data Lake Storage Gen2 | Data Quality | Data Vault | Data Vault 2.0 | Data Warehousing | Data quality monitoring | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Delta | Databricks Delta Live Tables | Delta Lake | Delta Live Tables | Dimensional Modeling | Elasticsearch | Git | HTTP | Infrastructure as Code | Jupyter Notebooks | Key Vault | Lucene | Medallion Architecture | Oracle PL | Oracle PL/SQL | PL/SQL | PeopleSoft | Power BI | PySpark | Python | Quality monitoring | REST APIs | SAP BusinessObjects | SQL | Slowly Changing Dimensions | Solr | Structured Streaming | Tableau | “as-code”
Education
N/A
Roles
Related jobs
-
Featured Feat. Software Engineer USD 40K-150K.NET | APIs | AWS | Angular | AzureContractor hours flexibility | Remote workMid-level ContractRemote R6d ago
-
Featured Feat. Senior Software Engineer USD 80K-170KAlgorithms | C++ | Data Structures | Go | JavaContractor flexibility | Remote workSenior-level ContractRemote R6d ago
-
Mid-level Full TimeRemote R6h ago
-
Data Engineer (Remote) PHP 216K-216KApache Airflow | BigQuery | Cloud Composer | Cloud Storage | Cloud platformCareer development | Healthcare benefits | Paid time off | Tuition reimbursement | Wellness benefitsMid-level Full TimePH-National Capital-Pasay City, Metro Manila R7h ago
-
Cloud platform | ELT | ETL | Google Cloud | Google Cloud PlatformHands-on training | Healthcare benefits | Mentorship | Paid time off | Tuition reimbursementMid-level Full TimePH-National Capital-Pasay City, Metro Manila R7h ago
-
Data Engineer EUR 38K-53KAWS | Agile | Airflow | Apache Spark | Artificial IntelligenceCorporate discounts | Digital learning | Four-day work week | Health insurance | Hybrid working flexibilityMid-level Full TimeMriehel R7h ago
-
AI& Data Engineer (Hybrid) USD 150K-200KAWS | Airflow | Azure | CI/CD | Computer VisionHealth insurance | Hybrid work environment | Paid time off | Professional developmentSenior-level Full TimeCairo Governorate, Cairo, Egypt R7h ago
-
Full Stack Engineer / Applied AI GBP 80K-120KAI coding | AI coding assistant | AI workflows | API Design | Agentic AIAI-first engineering culture | Access to Product Leadership | Experimentation freedom | Fully remoteSenior-level Full TimeLondon, United Kingdom R9h ago
-
Senior Analytics Engineer - Security Insights AUD 118K-130KAlerting | Batch Processing | Cost Optimization | DBT | Data GovernanceEquity packages | Flexible leave | Parental leave | Wellbeing allowanceSenior-level Full TimeSydney, Australia R14h ago
-
AI Agents | AWS | Amazon Bedrock | Autogen | CI/CDEnglish communication environment | Flexible contractor schedule | International team collaboration | Remote workMid-level Contract Full TimeBrazil R14h ago
-
Analytics Engineer - Personalisation AUD 110K-140KDBT | Data Modeling | Data Pipelines | Data Warehousing | ELTEquity packages | Flexible leave options | Flexible remote work | Inclusive parental leave | Wellbeing allowanceMid-level Full TimeSydney, Australia R15h ago
-
Applied AI Engineer - AI Solutions USD 172K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25% | Employee stock options | Hybrid work | Professional developmentMid-level Full TimeNew York City, NY (Hybrid); Redwood … R15h ago
-
Data Engineer PHP 150K-200KAPI Integration | Change Data Capture | Data Capture | Data Governance | Data LakesRemote-firstEntry-level Contract Full TimeQuezon City, NCR, Philippines R15h ago
-
Architecte Data GenAI EUR 48K-66KCI/CD | Dashboarding | Data Pipelines | Data Quality | Data TestingCareer coaching | Continuous learning | Discounted activities | Employee stock purchase plan | Flexible mobilitySenior-level Full TimePau, FR R18h ago
-
Senior Data engineer USD 120K-160KAWS | Anomaly Detection | Aurora | Cause analysis | Code reviewDental insurance | Education reimbursement | Flex work | Life insurance | Medical insuranceSenior-level Full TimeHeredia, Heredia, Costa Rica R19h ago
-
Product Analytics Engineer USD 130K-140KA/B | A/B Testing | Airflow | B testing | DBT401k retirement savings plan | Employer-sponsored healthcare | Flexible spending account | Health savings account | Paid parental leaveSenior-level Full TimeRemote, USA R20h ago
-
Business Engagement and AI Solutions Lead SGD 162K-220KAI Governance | AWS | Azure | CI/CD | DockerBenefits and rewards for well-being | Flexible remote work | Hybrid work | Inclusive culture | Professional development opportunitiesSenior-level Full TimeSingapore - Marina View R20h ago
-
AI Solution Specialist SGD 114K-184KAPI Design | AWS | Azure | Code review | Data PreprocessingHybrid work | Inclusive culture | Professional development | Supportive leadershipSenior-level Full TimeSingapore - Marina View R20h ago
-
AI & Automation Engineer INR 3264K-5876KAPIs | Data Pipelines | Data Warehousing | Data models | EvaluationCareer development | Flexible vacation | Headspace app access | Hybrid work model | Mental health daysSenior-level Full TimeIndia, Bengaluru, Karnataka R20h ago
-
Lead Data Engineer/ Data Architect INR 2000K-2800KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India - Remote R20h ago
-
AI And A - Machine Learning Engineer - VG - W4 - CDAO0230 INR 3799K-5876KData Engineering | Data Mining | Data Pipelines | Data Quality | Data discoveryCareer development | Coaching and feedback | Discounts and offers | Flexible working | Health and well-being supportSenior-level Full TimeHyderabad, TG, IN, 500081 R20h ago
-
Vice President, Data Quality Lead Engineer INR 4000K-5000KAPI Design | Anomaly Detection | Audit trails | CD | CIComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R20h ago
-
Data Engineer, AI (Hybrid) INR 2000K-2700KAWS | Access Control | Alerting | Confluence | Data GovernanceMid-level Full TimeKAP Bangalore IND, India R20h ago
-
Sr. Data Engineer (Remote) USD 163K-192KAccess Control | Amazon Web Services | Apache Iceberg | Apache Kafka | Apache Spark401k plan | Dental insurance | Disability insurance | Employee assistance program | FSA/HSASenior-level Full TimeRemote - United States R21h ago
-
AWS | Agent Orchestration | CI/CD | Cloud platform | Databricks401k match | Counseling membership | Employer subsidized medical dental and vision | Flexible time away program | Life insuranceMid-level Full Time-REMOTE, USA- R22h ago