Senior Databricks Engineer
Tasks
- Apply data warehousing dimensional modeling
- Automate Databricks deployments with CI CD
- Build PySpark and SQL ETL ELT jobs
- Conduct code reviews and mentor engineers
- Deploy Databricks data pipelines
- Design scalable data pipelines
- Develop Databricks Delta Live Tables pipelines
- Develop data infrastructure
- Develop native Databricks dashboards
- Develop reusable Python libraries
- Establish data quality standards
- Implement Slowly Changing Dimensions
- Implement medallion architecture
- Implement structured streaming pipelines
- Integrate data ingestion from REST APIs
- Manage infrastructure as code
- Monitor data quality dashboards
- Share data with external BI tools
- Tune Spark jobs and Databricks clusters
Perks/Benefits
- 401k matching
- Dental insurance
- Flexible spending accounts
- Health insurance
- Paid Holidays
- Paid time off
- Remote work
- Vision insurance
Skills/Tech-stack
Asset bundles | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Key Vault | CI/CD | Data Lake Storage Gen2 | Data Quality | Data Vault | Data Vault 2.0 | Data Warehousing | Data quality monitoring | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Delta | Databricks Delta Live Tables | Delta Lake | Delta Live Tables | Dimensional Modeling | Elasticsearch | Git | HTTP | Infrastructure as Code | Jupyter Notebooks | Key Vault | Lucene | Medallion Architecture | Oracle PL | Oracle PL/SQL | PL/SQL | PeopleSoft | Power BI | PySpark | Python | Quality monitoring | REST APIs | SAP BusinessObjects | SQL | Slowly Changing Dimensions | Solr | Structured Streaming | Tableau | “as-code”
Education
N/A
Roles
Related jobs
-
Senior Data Engineer-JT0224 USD 120K-180K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R12h ago
-
Data Engineer (Databricks/Unity Catalog) PLN 276K-276KArtificial Intelligence | CI/CD | Databricks | Identity Management | Infrastructure as CodeExtra days off December 24 | Extra days off December 31 | Flexible schedule | Paid time off | Permanent contractMid-level Full TimeTeletrabajo R13h ago
-
Staff Backend Engineer (AI Platform team) USD 185K-242KAWS | Agent Frameworks | Compliance | Data Privacy | DatadogEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - United States & Canada R15h ago
-
Technical Lead Data Architect EUR 65K-70KCI/CD | Cast | Cloud Computing | Deep learning | DockerFlexible Mobility Pass | Learning and development | Paid time off | RTT days | TeleworkSenior-level Full TimeEurope, France, Ile-de-France, 92 - Hauts-De-Seine R15h ago
-
APIs | AWS | Amazon SageMaker | Azure | CI/CDAnnual leave | HMO coverage with dependent | Night differential pay | Remote workSenior-level Full TimeRemote R15h ago
-
Anthropic | AutoGluon | CUDA | CatBoost | Computer VisionHigh ownership role | Remote workMid-level Full TimeRemote R15h ago
-
Data Engineer PHP 150K-220KAccess Control | BSON | Change Data Capture | Data Capture | Data GovernanceFlexible schedule | Remote-first work environmentEntry-level Contract Full TimeQuezon City, NCR, Philippines R16h ago
-
JAVA Data Engineering/Associate Director Software Engineering INR 1400K-2200KApache Beam | Apache Flink | Apache Kafka | Apache Spark | Data PipelinesContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R19h ago
-
MLOps Engineering Specialist GBP 55K-58KAWS | AWS CDK | AWS CloudFormation | AWS Glue | AlertingDiscounted mobile and broadband | Gym membership discounts | Holiday purchase scheme | Online GP service | Paid Maternity LeaveMid-level Full TimeLondon, GB, E1 8EP R20h ago
-
Senior ML/AI Modeler, Risk Automation Machine Learning USD 160K-283KAPI Integration | AWS | Airflow | Artificial Intelligence | Batch ProcessingFlexible time off | Medical insurance | Modern family planning | Remote work | Retirement savings plansSenior-level Full TimeSeattle, WA, United States of America R23h ago
-
CI/CD | Code review | Data Modeling | Database Design | DockerFlexible work across Brazil | Fully remote | Growth potentialSenior-level Full TimeBrazil R23h ago
-
API Design | AWS | Automation Anywhere | Blue Prism | CrewAIDental insurance | Fully remote | Gym membership | Health insurance | Home-office allowanceSenior-level Full TimeBrazil R1d ago
-
Business Intelligence Engineer INR 1628K-2443KActive Directory | Amazon QuickSight | Azure Active Directory | CICD | DB2Health and life insurance | Hybrid work model | On-call support | Paid time off | Professional development supportSenior-level Full TimeChennai, India R1d ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k | Health insurance | Paid time offMid-level Full TimeSan Carlos - Hybrid R1d ago
-
Autonomy | C++ | DDS | Edge Computing | Embedded Systems401k plan | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R1d ago
-
AWS | AWS Glue | AWS Step Functions | Agile | Amazon EMRFlexible start and finish times | Flexible working hours | Hybrid work model | Job-sharing | Part-time arrangementsSenior-level Contract Full Time TemporarySydney, NSW - CBP North, 1 … R1d ago
-
Alteryx | Azure Data | Azure Data Factory | CI/CD | CloverDXMid-level Full TimeMakati City, Metro Manila, Philippines R1d ago
-
.NET | AKS | ASP.Net Core | Application Insights | AzureCultural and sports activities | Flexible compensation plan | Flexible schedule | Health and wellbeing program | Hybrid workMid-level Full TimeZaragoza, ES R1d ago
-
Alteryx | Azure Data Factory | CI/CD | CloverDX | Data ComplianceMid-level Full TimeMakati City, Metro Manila, Philippines R1d ago
-
Alteryx | Amazon Web Services | Azure | CSV | Cloud StorageCollaboration culture | Continuous improvement | Hybrid work environmentSenior-level Full TimeMakati City, Metro Manila, Philippines R1d ago
-
Agent Orchestration | Context engineering | Evaluation | FastAPI | KubernetesExtra vacation days | Health insurance | High-spec hardware | Hybrid work options | Pension benefitsSenior-level Full TimeVilnius, Vilnius City Municipality, Lithuania R1d ago
-
Data Engineer II INR 1163K-2000KAPI | Alteryx | Dataverse | Microsoft Power | Microsoft Power PlatformCross-functional collaboration | Remote work flexibilityEntry-level Full TimeGurgaon, India R1d ago
-
Senior Data Engineer INR 2000K-2695KAPIs | Alteryx | Automation | Business Process | Business Process MappingSenior-level Full TimeGurgaon, India R1d ago
-
AI Engineer USD 132K-205KBatch inference | CI/CD | Continuous Evaluation | Data Drift | Data Drift Detection401k retirement plan | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote - Michigan, United States R1d ago
-
Data Engineer USD 119K-165KAutomated testing | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeRemote, United States R1d ago