Principal Data Solution Architect (Databricks)
Tasks
- Architect Databricks lakehouse environments
- Build scalable ingestion and transformation pipelines
- Collaborate with data science AI ML and MLOps teams
- Create reusable architecture patterns and playbooks
- Define data standards and data contracts
- Design data serving layers for analytics and AI
- Design end-to-end data platform architecture
- Develop enterprise data modeling and semantic layers
- Implement data governance and lineage
- Lead architecture reviews and performance evaluations
- Mentor data engineering and architecture teams
- Modernize enterprise data ecosystems
- Optimize storage compute orchestration and network design
- Select and integrate enterprise data platforms
- Support cybersecurity compliance and zero trust access
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon Redshift | Apache Spark | Azure | Azure Synapse | Azure Synapse Analytics | BigQuery | CDC | Cloud Architecture | Cloud platform | Data Catalog | Data Governance | Data Lineage | Data mesh | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Delta Sharing | Domain-Driven Design | Event Driven | Event-driven architecture | Flink | Google Cloud | Google Cloud Platform | Kafka | MDM | ML pipelines | MLOps | Metadata Management | Python | REST APIs | SQL | Snowflake | Structured Streaming | Synapse Analytics | TOGAF | Unity Catalog | Zero Trust
Education
Related jobs
-
Director, AI Solutions Architect (Remote) USD 152K-223KAPI Gateway | Amazon Bedrock | Azure OpenAI | BigQuery | CI/CDFlexible after hours support for releases | Occasional travel | Overtime available | Remote workSenior-level Full TimeOak Brook, IL, United States R3h ago
-
Agile | Data Management | Data Management Cloud | Data Modeling | ERStudioSenior-level ContractAustin, United States5h ago
-
AI prompt engineering | Cloud Data | Cloud Data Warehouse | Data Architecture | Data GovernanceSenior-level ContractAustin, United States5h ago
-
Sr. Solutions Architect - Agencies USD 219K-301KApache Spark | Cloud Computing | Data Engineering | Data analytics | JavaSenior-level Full TimeNew Jersey; New York City, New … R15h ago
-
Solutions Architect - Sports USD 180K-247KAnalytics architecture | Apache Spark | Cloud Proof of Concept | Data Analytics Architecture | Data analyticsTravel up to 30 percentSenior-level Full TimeCentral - United States; Minnesota; Northeast … R15h ago
-
Data Architect | Onsite - Delaware USD 72K-252KAPI Integration | Batch Processing | Data Architecture | Data Dictionary | Data Governance401k retirement plan | Dental benefits | Independent contractor | Medical benefits | Paid HolidaysSenior-level Full TimeUnited States17h ago
-
Prin AI & Analytics Data Architect USD 160K-235KAPIs | AWS | BI | Cloud Computing | DSPM401k matching | Education reimbursement | Flexible work options | Health and well-being programs | Life and disability insuranceSenior-level Full TimeUnited States - Shakopee, MN (GHQ), …19h ago
-
Director, AI and Agentic Engineering USD 168K-210KAI Governance | API first | AWS Bedrock | Agent Orchestration | Agent systemsCompany holidays vacation sick days | Mental health services | Paid parental leave | Paid time off | Personal daysExecutive-level Full TimeCarmel - Indiana, United States19h ago
-
Principal Engineer, Data Platform USD 227K-340KAPI Design | Airflow | Automation | Backend Development | CI/CDCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacation and personal daysSenior-level Full TimeMountain View, CA, USA21h ago
-
Principal Engineer, Data Platform USD 227K-340KAPI Design | Airflow | Automation | Backend Development | CI/CDCommute subsidy | Employee assistance program | Employee resource groups | Employee stock ownership | Generous vacation and personal daysSenior-level Full TimeSan Francisco, CA, USA21h ago
-
Staff Software Architect (AI) - Remote USD 139K-204KAI Governance | API Gateways | API Integration | API first | API-first designComprehensive benefits package | Remote work | Variable pay opportunitySenior-level Full TimeAllen, TX, United States R22h ago
-
Urgent Hiring: NLP Architect (Security Architect) | Hybrid Role | Local to Texas Preferred USD 124K-188KAI Governance | AI platforms | Agent systems | Cloud AI | Cloud AI Platforms1 week onsite every month | Hybrid workSenior-level Contract Full TimeHouston, TX, United States R1d ago
-
Data Engineering Lead Senior Manager USD 135K-278KAWS | Agile | Data Architecture | Data Modeling | Data QualitySenior-level Full TimeWashington, DC1d ago
-
Principal Data Architect USD 123K-224KAccess Control | Agile | Apache Spark | Azure Data | Azure Data FactoryCareer pathing | Employee groups | Health benefits | Product training | Professional developmentSenior-level Full TimeUnited States R1d ago
-
Wealth Management - Data Strategy & Architecture, Client Acquisition Lifecycle, Analytics, and Applied AI Director USD 176K-205KAccount Master | Analytics | Applied AI | CRM | Conceptual modelingBackup childcare | Financial coaching | Health care coverage | Mental health support | On Site Health Wellness CentersSenior-level Full TimeJersey City, NJ, United States1d ago
-
Cloud Architecture | Data Architecture | Data Governance | Data policy | Financial ModelingSenior-level ContractAustin, United States1d ago
-
Principal Embedded Systems Engineer (T05) USD 135K-175KAnalog Hardware | Bare Metal | C plus plus | C# | CANAD and D insurance | Disability benefits | Employee assistance resources | Healthcare coverage | Learning and development resourcesSenior-level Full TimeIndianapolis, Indiana, United States1d ago
-
Staff Datacloud Blackbelt Engineer, Data and AI USD 183K-266KAI/ML | AI/ML workflows | BigQuery | Cloud Architecture | Computer VisionSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1d ago
-
Energy Data Analytics Lead USD 83K-144KApps Script | BI | BigQuery | Cloud Data | Cloud Data ServicesSenior-level Full TimeRemote, United States R1d ago
-
Principal Scientist, Machine Learning - Biomolecules USD 208K-286KAWS Batch | AWS ECS | AWS EKS | AWS S3 | AWS SageMakerAnnual incentive program | Healthcare coverage | Retirement benefitsSenior-level Full TimeCambridge, MA USA1d ago
-
Senior-level Full TimeOne Destiny Way, Westlake TX, United …1d ago
-
Principal Data Engineer USD 141K-166KAWS | Agile | Amazon Web Services | CI/CD | ConfluenceRemote work within United StatesSenior-level Full Time245 Summer St, Boston MA, United … R1d ago
-
Senior-level Full Time100 New Millennium Way, Bldg 1, …1d ago
-
Principal Software Engineer/Developer USD 149K-181KA/B | A/B Testing | Adobe Dynamic Tag Manager | Adobe Launch | Adobe SiteCatalystSenior-level Full Time300 New Millennium Way, Durham NC, …1d ago
-
Senior-level Full Time245 Summer St, Boston MA, United …1d ago