Data Platform Architect (Databricks)
Tasks
- Define CI CD development standards
- Define ingestion transformation and serving patterns
- Define reusable frameworks and templates
- Design analytics and data platform architecture
- Establish Unity Catalog and Delta Lake best practices
- Implement data governance with Unity Catalog
- Integrate Databricks with Azure ecosystem and Power BI
- Mentor engineering teams
- Monitor cost anomalies and runtime variability
- Optimize pipelines for performance and cost
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | CI/CD | Data Factory | Data Lake | Databricks | Delta Lake | ETL | Microsoft Fabric | Power BI | Unity Catalog
Education
N/A
Related jobs
-
AI Solutions Architect- Federal USD 170K-240KAWS | Adversarial Machine Learning | Agentic AI | Air-gapped | Air-gapped environmentsAnnual workspace upgrades | Flexible time off | Fully remote | Home office stipend | Internet and phone stipendSenior-level Full TimeRemote- US R11h ago
-
Director, AI Solutions Architect (Remote) USD 152K-223KAPI Gateway | Amazon Bedrock | Azure OpenAI | BigQuery | CI/CDFlexible after hours support for releases | Occasional travel | Overtime available | Remote workSenior-level Full TimeOak Brook, IL, United States R14h ago
-
Aggregation | AlloyDB | Apache Airflow | CI/CD | Cloud ComposerB2B contract | CET timezone | Fully remote | Part-timeSenior-level Part TimeMadrid, Spain R19h ago
-
Senior-level Contract Full TimeRemote job R1d ago
-
Sr. Solutions Architect - Agencies USD 219K-301KApache Spark | Cloud Computing | Data Engineering | Data analytics | JavaSenior-level Full TimeNew Jersey; New York City, New … R1d ago
-
Solutions Architect - Sports USD 180K-247KAnalytics architecture | Apache Spark | Cloud Proof of Concept | Data Analytics Architecture | Data analyticsTravel up to 30 percentSenior-level Full TimeCentral - United States; Minnesota; Northeast … R1d ago
-
Mid-level Full TimeIND GBS Bangalore - Office, India R1d ago
-
AWS Solutions Architect- AI/ML USD 138K-207KAWS | AWS Bedrock | AWS CloudFormation | AWS Glue | AWS SecurityFully remote | Travel requiredSenior-level Full TimeUnited States - Remote R1d ago
-
AI Software Architect EUR 38K-50KAgentic AI | Cloud Architecture | Cloud platform | Data Architecture | DatabricksLife insurance | Medical insurance | Private time wellbeing | Professional training | Sports activitiesSenior-level Full TimeMADRID, Spain R1d ago
-
Automation and AI Solutions Lead INR 2475K-3465KAWS | AWS AgentCore | Agent systems | Amazon Bedrock | AsyncAccess to Headspace | Flexible work-life balance | Hybrid work model | Mental health days | Retirement savingsSenior-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
Azure | CI/CD | Cloud Data | Cloud Data Platform Administration | Cloud data platformBenefits allowance | Comprehensive health and dental benefits | Defined benefit pension plan | Employee and family assistance program | One day remote per weekSenior-level Full TimeCA Vancouver, Canada R1d ago
-
Database Platform Distinguished Engineer USD 140K-251KAI | AWS | Access Control | Auditing | Automation401k match | 401k plan | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R1d ago
-
Staff Software Architect (AI) - Remote USD 139K-204KAI Governance | API Gateways | API Integration | API first | API-first designComprehensive benefits package | Remote work | Variable pay opportunitySenior-level Full TimeAllen, TX, United States R1d ago
-
Principal Data Architect USD 123K-224KAccess Control | Agile | Apache Spark | Azure Data | Azure Data FactoryCareer pathing | Employee groups | Health benefits | Product training | Professional developmentSenior-level Full TimeUnited States R1d ago
-
Agile project management | Architecture Reviews | Big Data | Cloud Computing | Data GovernanceRemoteSenior-level ContractRemote R1d ago
-
AWS | Data Governance | Data Integrity | Data Lineage | Data ModelingAttendance bonus | Company-provided equipment | HMO coverage | Paid time off | Training and career growthSenior-level Full TimeManila, Metro Manila, Philippines R1d ago
-
AWS | Amazon Redshift | Apache Airflow | Apache Flink | Apache IcebergBirthday off | Health insurance | Mobility program | Work-life balanceSenior-level Full TimeLeiria, Portugal R1d ago
-
Energy Data Analytics Lead USD 83K-144KApps Script | BI | BigQuery | Cloud Data | Cloud Data ServicesSenior-level Full TimeRemote, United States R2d ago
-
Senior-level Full TimeUS - VA - Remote, United … R2d ago
-
Data Platform Architect USD 100K-150KAWS | Access Management | Alation | Amazon Redshift | Apache FlinkSenior-level Full TimeUnited States - Remote R2d ago
-
Data Platform Architect USD 100K-150KAWS | Access Management | Alation | Amazon Redshift | Apache FlinkCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Data Architect USD 106K-170KAWS | Apache Spark | Big Data | Data Governance | Data Ingestion401k retirement plan | Dental insurance | Employee assistance program | Holidays | Medical insuranceSenior-level Full TimeUSA, KS, Work-at-Home, United States R2d ago
-
Senior Solutions Architect, Enterprise (PNW) USD 186K-225KBoomi | DBT | Data Modeling | Data Vault | Data Vault Modeling401k company contribution | Flexible office space stipend | Health and wellness stipend | Healthcare coverage | Home office setup stipendSenior-level Full TimeUS West - Remote R2d ago
-
Data Management | Data Modeling | ERStudio | ETL | Enterprise information managementRemote work | Temporary projectSenior-level Full TimeAustin, TX R2d ago
-
Principal Architect (Data Architecture) USD 100K-150KAWS Glue | Amazon Redshift | Apache NiFi | Architecture Principles | Azure Data401k retirement plan | Dental insurance | Disability coverage | Flexible spending account | Health insuranceSenior-level Full TimeRemote, United States R2d ago