Sr Data Architect, Databricks
USD 124K-206K Senior-level Full Time
Tasks
- Define enterprise data engineering strategy
- Define ingestion accelerators and reusable pipeline templates
- Design Unity Catalog governance
- Design fine grained access control with Unity Catalog ABAC RBAC and row column level security
- Establish medallion lakehouse standards
- Evaluate build vs buy platform toolchain
- Implement CI CD deployment patterns
- Lead Delta Lake performance engineering
- Mentor engineers and establish design reviews ADRs and documentation standards
- Optimize Databricks compute cost
- Own end to end Databricks on Azure lakehouse architecture
- Plan workspace scaling and networking
- Provide PHI PII data handling architecture guidance
Perks/Benefits
- N/A
Skills/Tech-stack
ABAC | ACID | ADLS Gen2 | Auto Loader | Azure | Azure Bicep | Azure Data | Azure Data Factory | Azure Key Vault | Azure Private Endpoint | CI/CD | Change Data Feed | Column-Level Security | Data Factory | Data feed | Databricks | Databricks Auto Loader | Delta Lake | Delta Live Tables | Delta Live) | Delta Sharing | Entra ID | Infrastructure as Code | Kafka | Key Vault | Liquid clustering | NSG | Networking | Okta | Optimize | Photon | Private Endpoint | Qlik | RBAC | Row Level Security | SCIM | SCIM integration | SFTP | SQL | SailPoint | Schema evolution | Structured Streaming | Terraform | Time Travel | Unity Catalog | VACUUM | VNet | Z-Order | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Architect | Data Architect | Lead | Lead Data | Lead Data Architect
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Data Architect USD 112K-181KData Modeling | Database Administration | Database Design | Microsoft Office | SQLSenior-level Full TimeAtlanta, GA, United States4h ago
-
Artificial Intelligence | Artificial Intelligence Governance | Client Requirements Analysis | Client requirements | Cloud DataSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Washington, District …8h ago
-
Sr. Manager Data Engineering USD 125K-188KAutomated testing | Bitbucket | CI/CD | Cloud Functions | Cloud RunSenior-level Full TimeSouthlake, TX, United States17h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States19h ago
-
Data Engineer / Architect USD 156K-204KDAX | DBT | Data Governance | Data Modeling | Data QualityFinancial benefits | Health and wellness benefitsSenior-level Full TimeCanonsburg, Pennsylvania, UNITED STATES21h ago
-
AWS | Access Control | Access Management | Alerting | Audit Logging401k matching | Business resource groups | Dental insurance | Flexible work environment | Internal mobilitySenior-level Full TimeKS Overland Park, United States21h ago
-
Lead Data Analyst, Product Analytics USD 150K-180KA/B | A/B Testing | Analytics engineering | B testing | BigQuerySenior-level Full TimeRemote, US R1d ago
-
Solutions Architect USD 180K-247KAccount Management | Apache Spark | Artificial Intelligence | Big Data | Cloud ComputingAnnual performance bonus | Equity | Remote work optionsSenior-level Full TimeCentral - United States1d ago
-
Lead Data Modeler USD 130K-165KAWS Databricks | Azure DevOps | Business Data Analysis | Business data | Conceptual data modelingSenior-level Full TimeNew York, NY, United States1d ago
-
Applied AI Engineer USD 150K-250KAPI Integration | AWS | Architecture | Audio Processing | Audio codecsRemote-first work environment | Travel opportunitiesSenior-level Full TimeNew York City / San Francisco …1d ago
-
Analytics Lead, Full Stack USD 185K-245KAI | Excel | Python | SQL | SigmaESPP (Employee Stock Purchase Plan) | Flexible spending wallets | Health care coverage | Remote-first work | Time offSenior-level Full TimeRemote US R1d ago
-
Lead Architect, GenAI Platform & Agentic AI USD 170K-220KAPI Gateway | API driven LLM | API-driven | AWS | AWS CDK401k with profit sharing | Disability coverage | Life insurance | Medical, prescription, dental and vision coverage | Paid HolidaysSenior-level Full TimeWoodbridge, NJ, United States1d ago
-
Director, AI & Machine Learning USD 220K-240KAgent systems | Agentic AI | Artificial Intelligence | Conversational AI | Data GovernanceExecutive-level Full TimeFlower Mound, TX, US1d ago
-
AWS | Azure | Cloud Run | Django | Docker401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeSan Jose, CA, United States1d ago
-
Data Architect USD 85KAgile | Data Architecture | Data Catalog | Data Migration | Data MiningDental insurance | Health insurance | Life insurance | Long-term disability insurance | Paid parental leaveSenior-level Full TimeREMOTE OPTIONS R1d ago
-
Lead Software Engineer - ML Engineer for Agent Platform USD 170K-215KA2A | Agent Orchestration | Agent systems | Application Resiliency | Automated testingSenior-level Full TimeJersey City, NJ, United States1d ago
-
Data Science Lead, Quant Modeling USD 159K-229KA/B | A/B Testing | B testing | Causal Inference | ClassificationSenior-level Full TimeSan Jose, California, United States1d ago
-
Azure Databricks Senior Architect USD 160K-190KAzure | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data FactoryCareer development opportunities | Equal employment opportunitySenior-level Full TimeDallas, Texas, United States - Remote R1d ago
-
Access Controls | Automated testing | Azure | Azure OpenAI | Change ManagementHybrid work | Long-term contractSenior-level Full TimeHouston, Texas, United States1d ago
-
Staff AI Solutions Architect USD 250K-350KAWS | Artificial Intelligence | Azure | CI/CD | Data GovernanceSenior-level Full TimeSan Jose, CA1d ago
-
Data Analytics Architect USD 136K-220KArtificial Intelligence | Business Intelligence | Data Engineering | Data Governance | Data LakeHybrid work | One day per week remoteSenior-level Full TimeCenter, Center District, IL1d ago
-
AI Solutions Architect I USD 142K-242KAutomation | Azure DevOps | CI/CD | Dashboards | GitHub ActionsDental insurance | Health insurance | Paid time off | Professional development | Retirement planSenior-level Full TimeRichardson, TX, United States1d ago
-
Data Engineering Lead USD 148K-196KAccess Management | Apache Airflow | Apache Kafka | Cloud Dataflow | Cloud StorageOn-site collaborationSenior-level Full TimeSouthlake, TX, United States1d ago
-
Senior-level Full TimeMcLean, VA, United States1d ago