Databricks Migration Engineer (Remote)
Rosslyn, VA, United States
R
USD 115K-171K (estimate) Mid-level Full Time
Tasks
- Align Lakehouse RBAC with Entra ID
- Build ETL and ELT pipelines
- Conduct code reviews and workshops
- Configure liquid clustering and materialized views
- Create technical documentation and design playbooks
- Define governance for cluster sizing and autoscaling
- Deliver knowledge transfer and training
- Design Bronze Silver Gold Lakehouse layers
- Design Delta Lake partitioning and file size management
- Develop dimensional models and star schemas
- Enforce row level and column level security
- Implement Unity Catalog security model
- Implement Z ordering and data skipping
- Implement monitoring dashboards for DBU cost
- Lead legacy data migration to Databricks Lakehouse
- Optimize Databricks SQL Warehouses for Power BI
Perks/Benefits
Skills/Tech-stack
Active Directory | Apache Spark | Azure Active Directory | Azure Data | Azure Data Factory | Data Factory | Data Partitioning | Data Quality | Data Skipping | Data loading | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | DirectQuery | Distributed Computing | ELT | ETL | Entra ID | File Size Management | Import | Incremental data loading | Liquid clustering | Materialized views | Metadata Driven | Metadata Driven Ingestion | Microsoft Entra | Microsoft Entra ID | Power BI | PySpark | RBAC | SQL Server | Star Schema | Unity Catalog | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R1d ago
-
Lead Data Engineer USD 160K-193KAmazon Redshift | CI/CD | DBT | ELT | ETL401k match | Adoption benefits | Employee resource groups | Flexible time off | Health insuranceSenior-level Full TimeDeerfield, IL, United States R12h ago
-
Senior Data Engineer II USD 134K-203KAPI Gateway | API Management | AWS | AWS API | AWS API GatewayHealth insurance | Health leave | Parental leave | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - US R13h ago
-
Forward Deployed ML/AI Engineer USD 167K-200KAWS | Azure | CI/CD | Databricks | DockerAnnual company retreat | Company winter break | Education bonus | High-performance culture | Optional in person events and meetupsSenior-level Full TimeUnited States R13h ago
-
Senior Analytics Engineer USD 135K-225KAirflow | CI/CD | DBT | Data Modeling | Data TransformationFlexible time off | Health, dental, and vision insurance | LinkedIn Learning access | Paid Holidays | Paid parental leaveSenior-level Full TimeUnited States (Remote) R14h ago
-
Alerting | BigQuery | Buildkite | CI/CD | Container OrchestrationDental and vision coverage | ESPP | Employee stock purchase plan | Flexible spending wallets | Health care coverageSenior-level Full TimeRemote US R16h ago
-
Ansible | C# | C++ | CMake | CUDAMentorship | Remote work | Training workshopsMid-level Full TimeBaltimore, MD, United States R22h ago
-
Senior Data Engineer USD 171K-207KAWS | Access Control | Apache Airflow | Apache Iceberg | Change Data Capture401k match | Dental insurance | Digital tools access | Enhanced mental health support | Fertility healthcareSenior-level Full TimeUnited States, Remote R1d ago
-
AI Engineer - AI/ML USD 98K-176KAWS | Access Control | Agentic Workflows | Agile | AuditabilityCareer development | Comprehensive benefits | Inclusion culture | TelecommuteMid-level Full TimeMinnetonka, Minnesota, UNITED STATES; REMOTE R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labelingMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hudi | Apache Spark | Data GovernanceBenefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Cloud Data DevOps Engineer USD 109K-149KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | Apache Spark401k match | Employee discounts | Floating holidays | Health coverage | Paid parental leaveMid-level Full TimeWork From Home - Coppell - … R1d ago
-
Senior Data Engineer USD 135K-170KAWS Fargate | AWS Glue | AWS Lambda | AWS S3 | AWS Secrets401k company match | Commuter savings | Dental insurance | Disability insurance | Employee resource groupsSenior-level Full TimeNew Jersey, United States R1d ago
-
Senior Machine Learning Operations Engineer USD 135K-170KAWS SageMaker | Amazon Bedrock | Anthropic API | Batch Transform | CI/CD401k match | Commuter savings | Dental insurance | Disability insurance | Employee resource groupsSenior-level Full TimeNew Jersey, United States R1d ago
-
Applied AI Engineer - Federal (TS Required) USD 170K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25 percent | Federal clearance supportMid-level Full TimeUnited States (Remote); Washington, D.C. (Remote) R1d ago
-
Business Intelligence Engineer USD 105K-144KCloud Data | Cloud Data Platforms | DAX | Data Modeling | Data performanceFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesMid-level Full TimeJersey City, NJ, United States R1d ago
-
Data Engineer USD 77K-90KAPI Integration | Automation | Batch Processing | CI/CD | CSV401k | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeRemote, USA, United States R1d ago
-
Machine Learning Engineer III - AI Agent Engineer - Digital and Technology Partners - Onsite/Hybrid USD 132K-198KAI Foundry | AI Search | AWS | Agent Orchestration | Agent systemsSenior-level Full TimeUnited States R1d ago
-
Data Modeling, Fraud Analytics Consulting (Remote) USD 104K-174KAWS | Data Analysis | Data Modeling | Fraud Detection | Machine LearningPeriodic travel | Remote work | Variable pay opportunityMid-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
Lead Data Engineer USD 160K-193KAPI | Access Control | Amazon Redshift | CI/CD | DBT100% remote | 401k match | Adoption benefits | Employee resource groups | Flexible time offSenior-level Full TimeDeerfield, IL, United States R1d ago
-
Sr. Data Engineer USD 150K-198KAWS | AWS Lambda | CI/CD | DBT | DatabricksEmployee recognition program | Generous time off | Hybrid work option | In-office collaboration | Learning and development resourcesSenior-level Full TimeUS-REMOTE-Florida R1d ago
-
Lead Data Engineer – Snowflake & Data Platforms USD 121K-159KAgile | Amazon QuickSight | Bitbucket | CI/CD | Change ManagementEmployee development support | Flexible remote days | Health insurance | Hybrid work model | Life insuranceSenior-level Full TimeJersey City, NJ, United States R1d ago
-
AWS | BI Data modeling | Cloud Data | Cloud Data Platforms | DAXHealth and life insurance | Hybrid work model | Paid time off | Pension/retirement benefitsSenior-level Full TimeJersey City, NJ, United States R1d ago
-
Associate Data Solutions Engineer USD 95K-140KAI workflows | Apache Iceberg | DBT | Data Governance | Data Modeling401k plan | Employer match | Flexible spending account | Health benefits package | Long-term disability insuranceMid-level Full TimeUS-Remote R1d ago