Principal Data Solution Architect (Databricks)
Tasks
- Architect Databricks lakehouse environments
- Build scalable ingestion and transformation pipelines
- Collaborate with data science AI ML and MLOps teams
- Create reusable architecture patterns and playbooks
- Define data standards and data contracts
- Design data serving layers for analytics and AI
- Design end-to-end data platform architecture
- Develop enterprise data modeling and semantic layers
- Implement data governance and lineage
- Lead architecture reviews and performance evaluations
- Mentor data engineering and architecture teams
- Modernize enterprise data ecosystems
- Optimize storage compute orchestration and network design
- Select and integrate enterprise data platforms
- Support cybersecurity compliance and zero trust access
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon Redshift | Apache Spark | Azure | Azure Synapse | Azure Synapse Analytics | BigQuery | CDC | Cloud Architecture | Cloud platform | Data Catalog | Data Governance | Data Lineage | Data mesh | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Delta Sharing | Domain-Driven Design | Event Driven | Event-driven architecture | Flink | Google Cloud | Google Cloud Platform | Kafka | MDM | ML pipelines | MLOps | Metadata Management | Python | REST APIs | SQL | Snowflake | Structured Streaming | Synapse Analytics | TOGAF | Unity Catalog | Zero Trust
Education
Related jobs
-
Senior Data Platform Engineer, Remote USD 135K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatchSenior-level Full TimeUnited States, UNITED STATES, United States R5h ago
-
Member of Technical Staff - Principal ML Engineer USD 200K-300KAPI Design | Access Management | Auth0 | Cloud Architecture | Entra ID401k | Equity incentives | FSA | Health insurance | Mental health benefitsSenior-level Full TimeRemote (USA) R13h ago
-
Architect, Data & Analytics USD 119K-231KAWS | Azure | Business Intelligence | Data Governance | Data ModelingSenior-level Full TimeRemote, United States R14h ago
-
Tech Lead Manager, Data Engineer USD 251K-310KBigQuery | C++ | Data Governance | Data Lake | Data ModelingBonus program | Company benefits program | Equity incentive plan | Hybrid work scheduleSenior-level Full TimeMountain View, CA14h ago
-
Principle Engineer -In Bayesian, Large Foundational Systems, and Distributional Reinforcement Learning USD 296K-370KBayesian Networks | Bayesian Neural Networks | Bayesian learning | C++ | Distributed SystemsSenior-level Full TimeUnited States16h ago
-
Forward Deployed Engineer (West) USD 220K-250KAI Prototyping | API Integration | AWS | Automation | Cloud NetworkingMid-level Full TimePacific or Mountain Time Zone (Remote) R17h ago
-
Agent systems | Air gapped deployment | Air-gapped | Artificial Intelligence | Cost Optimization401k | Dental insurance | Equity incentives | FSA | Health insuranceSenior-level Full TimeSeattle, WA or McLean, VA or … R17h ago
-
Agent systems | Agentic Systems | Air gapped deployments | Air-gapped | Artificial Intelligence401k | Career advancement | Employer paid health care | Equity incentives | FSASenior-level Full TimeSeattle, WA or McLean, VA or … R17h ago
-
Apache Hive | Apache Iceberg | Apache Kafka | Authentication | AuthorizationSenior-level Contract Full TimeCincinnati, Ohio, United States17h ago
-
Data Architect (Remote) USD 156KDDL | DML | Data Architecture | Data Documentation | Data Governance401k matching | Disability coverage | Healthcare | Life insurance | Paid parental leaveSenior-level Full TimeBoston, Massachusetts, United States; New York, … R18h ago
-
Power BI Architect - SME USD 120K-175KCybersecurity compliance | Dashboard Development | Data Governance | Data Modeling | Data integrationSenior-level Full TimeFAIRFAX, VA, United States18h ago
-
Technical Director, Embedded Vehicle Software USD 249K-300KAUTOSAR | Abstraction layer | Automotive Software | C# | C++Hybrid work | Inclusive work environment | Work from homeExecutive-level Full TimeSunnyvale18h ago
-
ADMET modeling | Affinity prediction | Alphafold | ChemProp | Co-folding401k match | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeBoston, MA19h ago
-
Principal Data AI Architect USD 197K-337KAnalytics | Artificial Intelligence | Big Data | Cloud | Data ArchitectureCareer development support | Coaching and mentoring | Learning and development programsSenior-level Full TimeChicago, Illinois, USA R20h ago
-
Principal AI Researcher USD 139K-304KAWS Bedrock | AWS SageMaker | Agent systems | Artificial Intelligence | Autogen401k match | Dental insurance | Medical insurance | Time off | Training and developmentSenior-level Full TimeRemote, Europe; Remote, UK; Remote, US R20h ago
-
AI Solution Architect USD 90K-148KAPI Design | Agent Orchestration | Data Governance | Distributed Systems | Event DrivenHybrid work schedule | Relocation not availableSenior-level Full TimeDallas, TX, United States21h ago
-
Cybersecurity strategy | Data analytics | Executive Communication | ISO 27001 | Information security401k | Long Term Incentive Program Eligible | Medical/Dental/Vision insurance | Paid time offSenior-level Full TimeMettawa, IL, United States R21h ago
-
Solution Architect (AI & Data Applications) USD 145K-260KAngular | Autogen | CI/CD | Databricks | Distributed SystemsMentoring systemSenior-level Full TimeJersey City, NJ, United States1d ago
-
Delivery Solutions Architect - Public Sector USD 180K-247KData Engineering | Data Governance | Data analytics | Distributed Systems | Program ManagementHybrid work | Travel up to 30%Senior-level Full TimeCharlotte, North Carolina1d ago
-
Principal Data Scientist USD 140K-188KCI/CD | Causal Inference | Data Pipelines | Forecasting | Language ModelsSenior-level Full TimeAustin, TX, United States1d ago
-
Adaptive Systems | Apache Spark | C++ | CUDA | Data ProcessingBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara, United States1d ago
-
Active Learning | Bayesian optimization | Benchmarking | Computational pipelines | Diffusion Models401k plan | Dental insurance | Disability insurance | Employee assistance program | Flexible time offSenior-level Full TimeSan Diego Campus Point - CA, …1d ago
-
AI systems | APIs | Agent Frameworks | Architecture Design | DebuggingCompetitive equity | Relocation support | Remote work | Travel occasionallySenior-level Full TimePalo Alto, CA; Onsite R1d ago
-
AI Architect USD 149K-248KAWS | Agentic AI | Azure | CI/CD | Cloud platform401k retirement plan | Adoption Assistance | Employee referral program | Health savings account | Parental Leave and Adoption AssistanceSenior-level Full TimeHome Office: Tysons, VA, United States1d ago
-
Algorithm Software Engineer 5 USD 169K-253KAlgorithm Design | C++ | Data Analysis | Data Visualization | DebuggingEducation assistance | Flexible work arrangements | Health plan | Paid time off | Relocation assistance noSenior-level Full TimeMDLI18, United States1d ago