Lead Data Engineer (Azure / Databricks / Python)
Vancouver, British Columbia, Canada
CAD 115K-165K (estimate) Senior-level Full Time
Tasks
- Build and test data pipelines
- Collaborate with product and marketing teams
- Design scalable data platform solutions
- Develop data products
- Establish CI/CD pipelines
- Implement data engineering best practices
- Monitor pipeline performance
- Optimize data workflows
- Write maintainable code
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure DevOps | Azure Functions | CI/CD | Data Factory | Databricks | PySpark | Python | SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Senior Software Engineer, Data Platform USD 163K-247KAWS | Amazon EMR | Amazon Kinesis | Amazon MSK | Amazon RedshiftHybrid workSenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Los … R16h ago
-
Data Developer - TG Quality Engineering TGQF CAD 85K-107K.NET | AWS | Agile | Apache Flume | Apache NiFiSenior-level Full TimeQuebec City, QC, Canada20h ago
-
Data Engineer USD 133K-182KAWS | Airbyte | Airflow | Alerting | CI/CD401k contribution | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeCanada - Remote R22h ago
-
Senior Data Engineer CAD 120K-145KApache Hadoop | Apache Kafka | Apache Spark | Azure Fabric | CI/CDFlexible working hours | Health and wellness benefits | Learning and development | Parental leave | Retirement planningSenior-level Full TimeToronto1d ago
-
Data Architect CAD 120K-150KA/B | A/B Testing | API Design | API Development | Amazon RedshiftAnnual tech allowance | Annual travel allowance | Flexible working hours | Health insurance | Learning and developmentSenior-level Full TimeToronto1d ago
-
DSP | FPGA | FPGA Integration | FPGA implementation | Hardware DesignDental insurance | Employee assistance program | Employer matching retirement savings | Flexible work hours | Health insuranceMid-level Full TimeMontreal (CAN), Canada1d ago
-
Data Engineer Co-op (8-12 Months) CAD 45K-45KAirflow | BI Dashboards | CI/CD | Cloud platform | Data ModelingCorporate partner discounts | Employee purchase program | Free Kobo device | Free weekly ebooks or audiobooks | Hybrid work modelNone Full TimeON-John Street, Canada1d ago
-
Lead Engineer 1 - Embedded SW Development CAD 96K-145KC++ | CI/CD | Code review | EEPROM | Embedded LinuxSenior-level Full TimeMarkham, Canada1d ago
-
Senior-level Full Time661 University Avenue, Toronto, Ontario, Canada1d ago
-
Machine Learning Engineer II CAD 154K-199KAzure | Cloud Architecture | Data Engineering | Deep learning | Generative AIBanking benefits and discounts | Career development | Health and well-being benefits | Mentoring programs | Paid time offSenior-level Full Time661 University Avenue, Toronto, Ontario, Canada1d ago
-
GenAI Testing CAD 90K-115KAgile | BDD | CI/CD | Cucumber | End to EndCompany-Paid Holidays | Disability insurance | Employee assistance program | Life insurance | Medical, dental & vision coverageMid-level Full TimeToronto, CA1d ago
-
Expert MLOps Platform Engineer CAD 108K-214KAWS SageMaker | Apache Kafka | ArgoCD | Azure Event | Azure Event HubsSenior-level Full TimeVancouver, British Columbia, CA, V6B 1A91d ago
-
QA Data Engineer CAD 94K-118KAirflow | Amazon Web Services | Apache Spark | Azure | Azure DataCareer progression | Company pension plan | Development opportunities | Free parking | Team member offersMid-level Full TimeLangley Office - Langley BC, Canada1d ago
-
Senior Data Quality Automation Engineer CAD 100K-106KAnomaly Detection | CI/CD | Data Quality | Data Validation | ETLEmployee discounts | Flexible health benefits | Matched pension plan | RRSP program | TFSA programSenior-level Full Time00000 Canadian Headquarters, Canada1d ago
-
Data Engineer (Azure / Databricks / Python) CAD 115K-163KAzure Data | Azure Data Factory | Azure DevOps | Azure Functions | CI/CDCollaborative environment | Impactful work | Innovative culture | Professional growthSenior-level Full TimeVancouver, British Columbia, Canada1d ago
-
Data Engineer CAD 100K-140KAWS | Apache Spark | Azure | CI/CD | Data GovernanceContinuous learning opportunities | Coverage for dependents | Dental insurance | Health insurance | Hybrid workMid-level Full TimeToronto, Ontario1d ago
-
.NET | AWS | Agile | Apache Flume | Apache IcebergEntry-level Full TimeQuebec City, QC, Canada1d ago
-
AWS CDK | AWS EventBridge | AWS Lambda | AWS Step Functions | Amazon DynamoDBMid-level Full TimeToronto, Ontario1d ago
-
AWS CDK | AWS EventBridge | AWS Glue | AWS Lambda | AWS SQSSenior-level Full TimeToronto, Ontario1d ago
-
Automated testing | CI/CD | Cloud Security | Cloud platform | Distributed SystemsHigh stakes fast paced environment | Startup experience favoredSenior-level Full TimeOttawa, Ontario1d ago
-
A/B | A/B Testing | B testing | Data Warehousing | DatabasesSenior-level Full TimeRemote, Canada or US R1d ago
-
SENIOR AI ENGINEER (Canada) CAD 125K-160KAWS ECS | Amazon S3 | Background job | Background job processing | DockerComprehensive training program | Global multicultural team | Great referral programs | Growth opportunities | Product DiscountsSenior-level Full TimeCanada1d ago
-
Embedded Software Developer-Team Lead CAD 130K-140KAgile | Automated testing | Bare Metal | C# | C++In-office workSenior-level Full TimeOttawa, Ontario, Canada1d ago
-
Senior Data Engineering Developer CAD 83K-139KAPI Management | Azure API | Azure API Management | Azure Data | Azure Data FactoryEmployee assistance program | Flexible work options | Group retirement savings plans | Health and wellness programs | Mental health supportSenior-level Full TimeGuelph, Ontario, Canada; Quebec, Quebec, Canada1d ago
-
APIs | AWS | Code Refactoring | Data Modeling | Distributed SystemsContinuing education benefits | Disability | Employee stock purchase plan | Family-forming benefits | Four weeks vacationSenior-level Full TimeBurnaby, British Columbia, Canada2d ago