Data Platform Architect (Databricks)
Tasks
- Define CI CD development standards
- Define ingestion transformation and serving patterns
- Define reusable frameworks and templates
- Design analytics and data platform architecture
- Establish Unity Catalog and Delta Lake best practices
- Implement data governance with Unity Catalog
- Integrate Databricks with Azure ecosystem and Power BI
- Mentor engineering teams
- Monitor cost anomalies and runtime variability
- Optimize pipelines for performance and cost
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | CI/CD | Data Factory | Data Lake | Databricks | Delta Lake | ETL | Microsoft Fabric | Power BI | Unity Catalog
Education
N/A
Related jobs
-
Batch Processing | BigQuery | CI/CD | Cloud Run | Cloud SQLAutonomy | Flexible work location | Fully remote | Inclusive workplace | Knowledge sharing cultureSenior-level Full TimeRomania R3h ago
-
Alerting | BigQuery | CI/CD | Cloud Run | Cloud SQLFully remote | High autonomy | Knowledge sharing culture | Minimal bureaucracy | Professional development opportunitiesSenior-level Full TimePortugal R3h ago
-
BigQuery | CI/CD | Cloud Run | Cloud SQL | Cloud StorageFlexible work location | Fully remote | High autonomy | Knowledge sharing culture | Minimal bureaucracySenior-level Full TimeNetherlands R3h ago
-
Batch Processing | BigQuery | CI/CD | Cloud Run | Cloud SQLAutonomy | Collaborative team culture | Equal opportunity | Fully remote | Professional developmentSenior-level Full TimeSwitzerland R3h ago
-
BigQuery | CI/CD | Cloud Run | Cloud SQL | Cloud StorageAutonomy and trust | Flexible work from anywhere | Fully remote work | Knowledge sharing culture | Minimal bureaucracySenior-level Full TimeFrance R3h ago
-
BigQuery | CI/CD | Cloud Run | Cloud SQL | Cloud StorageAutonomy and trust | Fully remote work | Inclusive workplace | Minimal bureaucracy | Professional development networkSenior-level Full TimeSpain R3h ago
-
BigQuery | CI/CD | Cloud Run | Cloud SQL | Cloud StorageAutonomy and trust | Fully remote work | International collaboration | Knowledge sharing culture | Minimal bureaucracySenior-level Full TimeGermany R3h ago
-
Solutions Architect INR 2400K-3500KADLS | AWS | Airflow | Azure | CassandraBootcamp training | Broadband reimbursement | Continuous learning opportunities | Medical insurance | Paid certificationsSenior-level Full TimeIndia - Remote R3h ago
-
AI Solutions Architect- Federal USD 170K-240KAWS | Adversarial Machine Learning | Agentic AI | Air-gapped | Air-gapped environmentsAnnual workspace upgrades | Flexible time off | Fully remote | Home office stipend | Internet and phone stipendSenior-level Full TimeRemote- US R13h ago
-
Director, AI Solutions Architect (Remote) USD 152K-223KAPI Gateway | Amazon Bedrock | Azure OpenAI | BigQuery | CI/CDFlexible after hours support for releases | Occasional travel | Overtime available | Remote workSenior-level Full TimeOak Brook, IL, United States R15h ago
-
Data Architect - Remote CAD 170K-225KAzure Data | Azure Data Factory | Azure SQL | CRM data | Data Factory401k match | Dental insurance | Employee assistance program | Health insurance | Infertility benefitsSenior-level Full TimeAssociations R18h ago
-
Lead Data Platform Engineer USD 140K-198KAI-assisted coding | Assisted coding | BigQuery | CI/CD | Cloud RunFlexibility | Friendly team | High trust autonomy | Low bureaucracy | Remote workSenior-level Full TimeEurope, Remote R19h ago
-
Aggregation | AlloyDB | Apache Airflow | CI/CD | Cloud ComposerB2B contract | CET timezone | Fully remote | Part-timeSenior-level Part TimeMadrid, Spain R21h ago
-
Senior-level Contract Full TimeRemote job R1d ago
-
Sr. Solutions Architect - Agencies USD 219K-301KApache Spark | Cloud Computing | Data Engineering | Data analytics | JavaSenior-level Full TimeNew Jersey; New York City, New … R1d ago
-
Solutions Architect - Sports USD 180K-247KAnalytics architecture | Apache Spark | Cloud Proof of Concept | Data Analytics Architecture | Data analyticsTravel up to 30 percentSenior-level Full TimeCentral - United States; Minnesota; Northeast … R1d ago
-
Mid-level Full TimeIND GBS Bangalore - Office, India R1d ago
-
AWS Solutions Architect- AI/ML USD 138K-207KAWS | AWS Bedrock | AWS CloudFormation | AWS Glue | AWS SecurityFully remote | Travel requiredSenior-level Full TimeUnited States - Remote R1d ago
-
AI Software Architect EUR 38K-50KAgentic AI | Cloud Architecture | Cloud platform | Data Architecture | DatabricksLife insurance | Medical insurance | Private time wellbeing | Professional training | Sports activitiesSenior-level Full TimeMADRID, Spain R1d ago
-
Automation and AI Solutions Lead INR 2475K-3465KAWS | AWS AgentCore | Agent systems | Amazon Bedrock | AsyncAccess to Headspace | Flexible work-life balance | Hybrid work model | Mental health days | Retirement savingsSenior-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
Azure | CI/CD | Cloud Data | Cloud Data Platform Administration | Cloud data platformBenefits allowance | Comprehensive health and dental benefits | Defined benefit pension plan | Employee and family assistance program | One day remote per weekSenior-level Full TimeCA Vancouver, Canada R1d ago
-
Database Platform Distinguished Engineer USD 140K-251KAI | AWS | Access Control | Auditing | Automation401k match | 401k plan | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R1d ago
-
Staff Software Architect (AI) - Remote USD 139K-204KAI Governance | API Gateways | API Integration | API first | API-first designComprehensive benefits package | Remote work | Variable pay opportunitySenior-level Full TimeAllen, TX, United States R1d ago
-
Principal Data Architect USD 123K-224KAccess Control | Agile | Apache Spark | Azure Data | Azure Data FactoryCareer pathing | Employee groups | Health benefits | Product training | Professional developmentSenior-level Full TimeUnited States R1d ago
-
Agile project management | Architecture Reviews | Big Data | Cloud Computing | Data GovernanceRemoteSenior-level ContractRemote R1d ago