Databricks Engineer
Tasks
- Define data platform architectures and migration roadmaps
- Design lakehouse architecture with Databricks
- Develop and implement PySpark jobs
- Develop models using Unity Catalog for classification lineage and auditability
- Develop reference architectures and reusable frameworks
- Enable secure data sharing with Databricks Apps and Delta Sharing
- Establish data governance security and operational standards
- Implement role based access control and data masking
- Integrate real time and streaming data
- Orchestrate workflows with Airflow
- Set up CI CD methods
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision insurance
- Paid time off
- Retirement savings plan
Skills/Tech-stack
Access Control | Airflow | Auditability | CI/CD | Data Classification | Data Governance | Data Lineage | Data Security | Data integration | Data masking | Databricks | Databricks Apps | Delta Sharing | ETL | Lakehouse | PySpark | Real Time | Real-Time Data Integration | Real-time Data | Role-Based Access | Role-Based Access Control | Streaming | Time data integration | Unity Catalog
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R14d ago
-
Data Visualization Engineer - Advanced Engineering USD 74K-125KAccess Control | Alarm Prioritization | Change Management | Client-Server | CybersecurityMid-level Full TimeHeath, OH, United States6h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract award contingent | Remote workMid-level Full TimeWork from home, VA, United States R8h ago
-
Senior-level Full TimeWork from home, VA, United States R8h ago
-
Scientific Computing and Data Management SME USD 150K-185KAgile | Data Lifecycle Management | Data Security | Data lifecycle | DevOpsPublic Trust Clearance | Remote work | Security clearance based access | Travel as neededSenior-level Full TimeWork from home, VA, United States R8h ago
-
Data Engineer USD 145K-160KAWS | AWS Glue | Apache Airflow | Apache Spark | Data QualityContract award contingent | Hybrid work | Public trust clearance support | Technical documentation updates | Travel 15 percent or lessMid-level Full TimeFAIRFAX, VA, United States8h ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Secret clearance | Travel as neededSenior-level Full TimeWork from home, VA, United States R8h ago
-
Mid-level Full TimeFAIRFAX, VA, United States8h ago
-
Senior Databricks Migration Engineer USD 130K-158KActive Directory | Apache Spark | Azure Active Directory | Data Quality | Data SkippingOnsite work | Public Trust background investigationSenior-level Full TimeArlington, VA, United States8h ago
-
Senior-level Full TimeWork from home, VA, United States R8h ago
-
Data Engineer USD 110K-165KCause analysis | Data Formats | Data Pipelines | Data Processing | Data TransformationCompetitive benefits | Hybrid remote onsite work | TS SCI clearance with poly eligibilitySenior-level Full TimeFAIRFAX, VA, United States8h ago
-
AI Requirements Engineer USD 120K-145KAI Model Integration | AI model | API Integration | AWS | AgileMid-level Full TimeArlington, VA, United States8h ago
-
Data Engineer – Microsoft D365 F&O USD 119K-200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Platform | Azure DevOpsMid-level Full TimeSaint Louis, MO, United States8h ago
-
Strategy & AI Consulting USD 129K-172KAWS | Artificial Intelligence | Azure | Cloud Computing | Cloud platformMid-level Full TimeAtlanta, United States10h ago
-
Data Engineer, gUP Engineering USD 106K-151KApache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data ModelingMid-level Full TimeBoulder, CO, USA13h ago
-
Senior Embedded Software Engineer, Microcontroller OS USD 174K-253KBSP | BSP Development | Bazel | C++ | CMakeSenior-level Full TimeSan Francisco, CA, USA; San Jose, …13h ago
-
Data Engineer, GCS Data Science USD 106K-151KBig Data | C plus plus | Data Documentation | Data Modeling | Data ValidationEntry-level Full TimeNew York, NY, USA; Mountain View, …13h ago
-
GCP Data Engineering Lead USD 147K-190KAcxiom | Amperity | Apache Airflow | Apache Dataflow | BigQuery401k match | Dental insurance | Hybrid work arrangement | Medical insurance | Vision insuranceSenior-level Full TimeAtlanta, GA, United States18h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | ClickHouse | Data Contracts | Data Modeling401k | Catered lunches | Commuter benefits | Continued education benefit | Equity compensationSenior-level Full TimeNew York, New York, United States19h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | Data Contracts | Data Modeling | Data Quality401k | Catered lunches | Commuter benefits | Company wellness day off | Continued education benefitSenior-level Full TimeLos Angeles, California, United States19h ago
-
Senior Data Engineer USD 170K-200KApache Airflow | Apache Spark | Data Contracts | Data Modeling | Data Quality401k | Catered lunches | Commuter benefits | Continued education benefit | FSASenior-level Full TimeSan Francisco, California, United States19h ago
-
AI Engineer USD 113K-180KAngular | Apache Kafka | CI/CD | Context Management | DevOps401k matching | Charitable matching | Community outreach groups | Flexible paid time off | Life insuranceMid-level Full TimeLeawood, KS, US R19h ago
-
Azure Data Engineer USD 119K-219KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Autonomy | Career growth | Collaborative team | Community | Supportive cultureMid-level Full TimeIndianapolis, IN, US22h ago
-
Principal AI Engineer USD 140K-150KAI Search | Amazon Bedrock | Azure AI | Azure AI Search | Azure DataCommuter benefits | Flexible work arrangements | Insurance coverage | Learning and development training | Maternity leaveSenior-level Full TimeDallas, TX, United States1d ago
-
Data Engineer USD 90K-110KAlerting | Azure SQL | BI semantic models | CI/CD | Data ModelingHealth, dental, and vision insurance | Paid Holidays | Paid time off | Professional development supportMid-level Full TimeNorth Richland Hills, TX1d ago