Principal Data Platform Engineer (Databricks)
Tasks
- Build data models and transformation frameworks
- Collaborate with cross-functional teams
- Create reusable data engineering frameworks
- Define data governance frameworks
- Design and implement data pipelines
- Enforce testing and optimization standards
- Establish data engineering best practices
- Guide stakeholders through data decisions
- Identify and mitigate delivery risks
- Implement Lakehouse architecture
- Implement medallion architecture
- Lead and mentor delivery teams
- Optimize data pipelines
- Own end-to-end data platform architecture
- Perform code reviews
- Support proposals and client discussions
- Translate business requirements into technical plans
Perks/Benefits
- Career growth through leadership and mentoring
- Healthcare and life sciences domain exposure
- Remote work
Skills/Tech-stack
AWS | Airflow | Apache Spark | CI/CD | Cloud platform | DBT | Data Modeling | Data Pipelines | Databricks | Delta Lake | DevOps | ELT | ETL | Google Cloud | Google Cloud Platform | Infrastructure as Code | Microsoft Azure | Python | SQL | “as-code”
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Anomaly Detection | Data Engineering | Data Lakes | Data Pipelines | Data ProcessingRegular team sessions | Remote friendly schedule | Team collaborationSenior-level Full TimeRemote, Canada (EST); San Francisco, California R4h ago
-
C++ | Compiler design | Computer Architecture | Linux | Machine LearningHealth insurance | Hybrid work model | Life insurance | Paid time off | Retirement savings matchSenior-level Full TimeRemote, Canada R4h ago
-
Aerospike | Ansible | Capacity Planning | Ceph | Configuration ManagementSenior-level Full TimeRemote, Canada; Toronto, Ontario; San Francisco, … R4h ago
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R4h ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R4h ago
-
Agile | Cloud Storage | Google Cloud | Google Cloud Storage | GraphQLMid-level Full TimeSan Francisco, California; Remote, Canada, US, … R4h ago
-
Artificial Intelligence | Cloud Computing | Data integration | Generative AI | High AvailabilityMid-level Full TimeNew York City, NY; Toronto, Ontario; … R4h ago
-
AI | AWS | Apache Kafka | Azure | C#Collaborative culture | Fully remote | Leadership opportunitySenior-level Full TimeRemote, Toronto R4h ago
-
AWS | AWS Bedrock | AWS CDK | Anthropic | CelerySenior-level Full TimeKitchener, Ontario; Remote, Canada; Remote, Canada; … R4h ago
-
Senior-level Full TimeRemote, Canada; Remote, Canada; Toronto, Ontario; … R4h ago
-
AWS | Azure | Data Analysis | Data Visualization | Deep learningMid-level Full TimeRemote, Canada; San Francisco, California; Toronto, … R4h ago
-
Data Curation | Experimentation | MLOps | Machine Learning | Machine learning modelingSenior-level Full TimeToronto, Canada; Remote, Canada; Kitchener, Ontario; … R4h ago
-
Data Warehousing | Deep learning | Experimentation | Infrastructure | LLMSenior-level Full TimeRemote, Canada or US; Remote, Canada … R4h ago
-
Senior-level Full TimeCanada or US, N/A; Toronto, Ontario; … R4h ago
-
AWS | Azure | Data Annotation | Data Pipelines | Docker100% remote in Quebec | AI coding tool subscription | Bilingual support | Travel up to 25 percentMid-level Full TimeMontreal or Quebec City, Quebec; Toronto, … R4h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Kitchener/Waterloo, Ontario; Remote, Canada … R4h ago
-
Anomaly Detection | Classification | Clustering | Data Modeling | Data PipelinesHealth benefits | Hybrid work arrangement | Paid time off | Professional developmentSenior-level Full TimeToronto, Ontario; Kitchener, Ontario; The Valley, … R4h ago
-
AWS Data | AWS Data Lakes | Amazon Web Services | Apache Spark | Data AnalysisFlexible work schedule | Hybrid work modelSenior-level Full TimeToronto, Ontario; Remote, Canada; Toronto, Ontario; … R4h ago
-
AI frameworks | API Development | AWS | AWS GenAI | Agentic SystemsSenior-level Full TimeRemote, Canada; Remote, Canada; Remote, Canada; … R4h ago
-
Azure | Azure Data | Azure Data Services | Data Services | Data WarehousingAnnual leave | Comprehensive benefits | Employer RRSP contribution | Flexible-hybrid work | Healthy work-life balanceMid-level Full TimeToronto, Ontario; Remote, Canada; Remote, Canada; … R4h ago
-
API Design | Distributed Systems | LLM | Python | RAGEarly-stage environment | Enterprise customer impact | High autonomySenior-level Full TimeRemote, Canada or US; Remote, Canada; … R4h ago
-
AWS | Agentic AI | Agile | Amazon Bedrock | Apache AirflowSenior-level Full TimeToronto, Ontario; New York, USA; Bay … R4h ago
-
Data Scientist - Biomedical Signal Processing USD 140K-180KFeature extraction | Noise Reduction | NumPy | Pandas | PythonConsulting to implementation opportunity | Remote workEntry-level Full TimeRemotely, Anywhere R4h ago
-
Data Architect / Analytics Engineer (Databricks) USD 175K-248KAWS Redshift | Azure Synapse | Data Modeling | Data Warehousing | DatabricksRemote workSenior-level Full TimeUSA, Remote; USA, Remote R4h ago