Principal Data & AI Platform Architect – Azure Databricks
USD 114K-155K (estimate) Senior-level Full Time
Tasks
- Administer Unity Catalog
- Apply row level and column level security
- Build batch and streaming ETL pipelines
- Build semantic models and metric views
- Communicate technical decisions to stakeholders
- Configure governed KPI definitions
- Design data platform architecture
- Develop Databricks AI BI dashboards
- Develop Delta Lake medallion transformations
- Develop dimensional and physical data models
- Enforce data governance controls
- Establish data quality and observability
- Implement CI/CD for data pipelines
- Implement data classification and lineage standards
- Implement dataops practices
- Manage Azure data environments
- Monitor and optimize Databricks performance
- Orchestrate data pipelines
- Perform FinOps cost optimization
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure SQL | CI/CD | Column Level Masking | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Quality | DataOps | Databricks SQL | Delta Lake | Delta Lake Optimization | HIPAA | Lakehouse | Least Privilege | Medallion Architecture | Observability | PII | Phi | PySpark | Python | Query profiling | Row Level Security | SQL | SQL Warehouse | Serverless compute | Structured Streaming | Unity Catalog
Education
N/A
Related jobs
-
API Integration | Artificial Intelligence | Data Engineering | Data Pipelines | Data provenanceSenior-level Full TimeUS026 PA Spring House - 1400 …10h ago
-
Senior AI Architect USD 130K-135KAI/ML Services | AWS | Anthropic | Autonomous Agents | Cloud Architecture401k match | Cell phone stipend | College savings | EAP | FSA optionsSenior-level Full TimeNew York, NY, United States11h ago
-
Google Cloud Data And AI Solutions Architect USD 125K-190KBigQuery | Cloud Composer | Cloud SQL | Cloud Storage | Cloud platform401k retirement plan | Employee assistance program | Health benefits | Health savings account | Life insuranceSenior-level Full TimeDallas, Texas, USA R12h ago
-
Databricks Solutions Architect USD 125K-190KAI | AWS | AWS CodeBuild | Agile | Architecture401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeDallas, Texas, USA R12h ago
-
Senior-level Full TimeRemote, USA, United States R17h ago
-
AI Security Architect USD 200K-220KAI Governance | AI Security | AI/ML | AI/ML system design | Access Management401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractBolingbrook, Illinois, USA R18h ago
-
Agent systems | Agentic Workflows | Amazon Web Services | Azure | C#Customer site travel | Remote workSenior-level Contract Full TimeJersey City, NJ, United States R19h ago
-
AI Architect & RAG Data Science Engineer USD 147K-206KAccess Management | Azure | Azure DevOps | BM25 | C#Onsite collaboration | Security clearance support | Telework optionsSenior-level Full TimeHuntsville, AL, USA20h ago
-
Senior Machine Learning Engineer USD 130K-200KAWS Lambda | AWS SageMaker | Amazon S3 | Apache Kafka | AuthorizationSenior-level Full TimeRemote, United States R1d ago
-
AI Principal Machine Learning Engineer (10189) USD 170K-240KAI Agents | AWS | Amazon SageMaker | Anomaly Detection | AzureSenior-level Full TimeSeattle, Washington, United States1d ago
-
Sr. Data and AI Architect (Hybrid) USD 147K-211K.NET | AI Explainability | AI Governance | ASP.Net Core | AWS401k match | Company paid professional courses | Counseling benefits | Discounted tickets | Education reimbursementSenior-level Full TimeMCK-Henneman Way, United States R1d ago
-
Principal Data Analyst, Internal Analytics - Remote USD 91K-163KBusiness Intelligence | CMS Rules | Data Governance | Data Visualization | Healthcare Claims401k contribution | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programs | Remote work flexibilitySenior-level Full TimePrimary location: Eden Prairie, Minnesota1d ago
-
Data Scientist / Principal Investigator USD 108K-227KAPIs | Artifact management | CI/CD | Computer Vision | Data PipelinesFlexible time off | Healthcare benefits | Learning and development | Relocation assistance | Retirement benefitsSenior-level Full Time437 DENVER CO, United States1d ago
-
AI Governance | AWS | Agentic AI | Analytics | AzureAchievement Awards | Child/adult backup care | Educational assistance | Flexible work schedules | Parental leaveMid-level Full TimeUS-CT-REMOTE, United States R1d ago
-
Data Architect USD 155K-233KAI machine learning | API Design | Access Control | Cloud Computing | ComplianceSenior-level Full TimeChantilly, United States R1d ago
-
Senior AI Architect, Semantic Layer & Algorithm Ar USD 120K-150KAI Governance | Data Architecture | Data Contracts | Data Governance | Data LineageSenior-level Full TimeHome Office (TX), United States1d ago
-
Data Platform Architect USD 140K-180KAWS | Access Management | Amazon Redshift | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI/ML Engineer SME USD 195K-264K800-53 | AWS | AWS Cloud | AWS Cloud Development Kit | AWS SageMakerSenior-level Full TimeUSA LA Home Office (LAHOME), United … R1d ago
-
Artificial Intelligence & Machine Learning Architect SME USD 195K-264K800-53 | AWS CloudFormation | AWS SageMaker | Airflow | Artificial IntelligenceSenior-level Full TimeUSA LA Home Office (LAHOME), United … R1d ago
-
Action Representation | Admittance control | Bimanual coordination | C++ | Compliant behaviors401k plan | Maternity and parental leave | Medical, dental & vision coverage | Paid time offSenior-level Full TimeNorth Reading, Massachusetts, USA R1d ago
-
Agentic Workflows | Analytics | Artificial Intelligence | Biomarker Data | Clinical dataSenior-level Full TimeUS338 MA Cambridge - 320 Bent …1d ago
-
Analytics | Data Architecture | Data Governance | Data Lake | Data SecurityCalPERS retirement | Dental insurance | Disability insurance | Health insurance | Hybrid work scheduleSenior-level Full TimeSouthern California, San Marcos R1d ago
-
Apache Spark | Canonical Data | Canonical Data Model | Data Architecture | Data GovernanceRemote work | Strict security environmentSenior-level Full TimeAtlanta, Georgia, United States2d ago
-
AWS | Azure | CI/CD | Deep learning | Evaluation methodology401k | Equity options | Health, dental, and vision | Relocation package | Sign-on bonusSenior-level Full TimeSan Francisco R2d ago
-
AI Solution Architect USD 38KArtificial Intelligence | Deep learning | Language Processing | MLOps | Machine LearningSenior-level Full TimeMorrisville, North Carolina, États-Unis d’Amérique2d ago