Databricks Data Engineer
Tasks
- Architect and implement data ingestion pipelines
- Build data lake datasets for business intelligence
- Design and develop data frameworks
- Design and secure Delta tables
- Integrate data with Power BI
- Migrate Hive Metastore to Unity Catalog
- Transform datasets using medallion architecture
- Troubleshoot data engineering pipelines and Azure services
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | Data Factory | Databricks | Databricks SQL | Delta Lake | Hive | Medallion Architecture | Power BI | PySpark | Python | SQL | Scala | Unity Catalog | Unix
Education
Roles
Related jobs
-
Freelance Machine Learning Engineer CAD 110KComputational Algorithms | Machine Learning | NumPy | Numerical Methods | PandasFlexible schedule | Part-time freelance | Remote workMid-level FreelanceCanada - Remote R19h ago
-
Senior Platform Analytics Engineer CAD 156K-214KAWS | Apache Airflow | Apache Spark | Big Data | DBTBenefits | Equity | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON23h ago
-
Staff Analytics Engineer, Growth CAD 120K-140KDBT | Data Modeling | Data Pipelines | Data Quality | Feature EngineeringCareer growth and learning opportunities | Fitness membership discount | Flexible-hybrid work | Generous vacation and PTO | Health and dental benefitsSenior-level Full TimeToronto, Ontario, Canada23h ago
-
Senior-level Full TimeMontreal1d ago
-
Senior-level Full TimeMontreal1d ago
-
AWS | CCPA | CDC | DBT | Data GovernanceCritical illness coverage | Dental coverage | Flexible work arrangement | Health insurance | Life insuranceSenior-level Full TimeOttawa, Canada1d ago
-
Senior AI Engineer CAD 122K-162KA/B | A/B Testing | AWS | Azure | B testingCommunity days | DEI initiatives | Employee assistance program | Extended health benefits | Flexible working hoursSenior-level Full TimeCanada Remote R1d ago
-
Senior Data Engineer CAD 105K-130KAWS | CCPA | CDC | DBT | Data GovernanceAccidental death and dismemberment cover | Critical illness cover | Dental coverage | Enhanced parental leave | Flexible workingSenior-level Full TimeOttawa, Canada1d ago
-
Android | Android Development | CNN | CUDA | Cause analysisSenior-level Full TimeMARKHAM, ON, Canada1d ago
-
Senior Backend Software Developer, Platform & Services CAD 123K-161KAPI Design | AWS | ClickHouse | Data pipeline | Database DesignDental insurance | Flexible work hours | Health insurance | Open PTO policy | Parental leave top-upSenior-level Full TimeCanada (Remote) R1d ago
-
Senior Data Engineer CAD 132K-208KAccess Management | Cassandra | Data Governance | Data Modeling | Data QualitySenior-level Full TimeRemote - Toronto, Ontario, Canada R1d ago
-
Senior AI Business Process Engineer CAD 120K-170KAPI Design | Agile | BPMN 2.0 | Backlog Management | Camunda 8Career development opportunitiesSenior-level Full TimeOntario, Canada - Remote R1d ago
-
AI Solution Specialist (Hybrid) CAD 100K-176KAPI Integration | Architecture Design | Automation | Document analysis | LLM Prompt EngineeringEmployee benefits | Hybrid work environmentSenior-level Full TimeMontreal 700, Canada1d ago
-
Sr. Databricks Data Engineer, Onsite AVP CAD 91K-140KAPI | AWS | Azure | Batch Processing | Data IngestionEmployee networks | Flexible work/life support | Medical insurance | Paid volunteer days | Savings plansSenior-level Full TimeToronto, Ontario, Canada1d ago
-
Senior Snowflake Data Engineer, AVP CAD 91K-140KAPI | Airflow | Apache Airflow | Azure | Azure DevOpsDevelopment programs | Educational support | Employee networks | Flexible work options | Insurance plansSenior-level Full TimeToronto, Ontario, Canada1d ago
-
Software Developer (API & Data Engine Integration) CAD 270K-270KAWS | Azure | CI/CD | Cloud Storage | Data IngestionContract position | Fully remoteSenior-level ContractToronto, ON, Canada R1d ago
-
Data Engineer CAD 100KAPI | AWS Lambda | Amazon S3 | Amazon SageMaker | Amazon Web ServicesFlexible vacation and sick days | Health and wellness benefits | Paid time off | Professional development paid training | Team events and activitiesSenior-level Full TimeToronto, Canada2d ago
-
A/B | A/B Testing | Agents | B testing | EmbeddingsAsynchronous collaboration | Equity opportunities | Flexible schedule | Mentorship | Portfolio Ready ProjectsEntry-level InternshipOntario, Canada2d ago
-
Applied AI Engineer CAD 115K-145KAI orchestration | API Development | AWS | AWS Bedrock | Anthropic Claude401k match | Annual professional development budget | Charitable donation match | Commuter benefits | Flexible time offMid-level Full TimeRemote - Ontario, Canada R2d ago
-
Analysis algorithms | Cloud Computing | Coordinate systems | Data Structures | DockerMid-level Full TimeMontréal, Québec, Canada2d ago
-
APIs | Agentic Systems | Cloud Computing | Deep learning | Fine TuningGym reimbursement | Health insurance | Meal stipend | PTO | Pension matchingEntry-level Full TimeMontreal3d ago
-
Senior Data Engineer CAD 113K-139KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeCare days | Defined benefit pension | Extra statutory holidays | Flexible work arrangement | Generous vacationSenior-level Full TimeVancouver, British Columbia, Canada3d ago
-
Senior-level Full TimeCanada4d ago
-
Commissioning Specialist - Robotics CAD 80K-110KAutomation | Documentation | Hardware Integration | Project Management | PythonCareer development plans | Comprehensive benefits plan | Hybrid work | Mentorship program | Professional developmentMid-level Full TimeMontreal, QC, Canada4d ago
-
API Integration | Agent Frameworks | Artificial Intelligence | Backend Services | Content ModerationCollaborative team environment | High impact AI applications | Modern development tools and resources | Remote work flexibilitySenior-level Full TimeCanada R4d ago