Big Data Engineer
Tasks
- Configure data ingestion frameworks
- Create data snapshots
- Design data pipelines
- Develop data models for analytics
- Develop test plans and success criteria
- Enforce data security and access controls
- Implement CDC ingestion
- Integrate RDBMS and file data
- Optimize Spark execution plans
- Orchestrate ETL workflows
- Transform and process large data volumes
- Write complex SQL and Python
Perks/Benefits
- Employee assistance program
- Employee discounts
- Health benefits
- Paid vacation
- Parental leave top-up
- Retirement savings plan
- Sick leave
Skills/Tech-stack
AWS S3 | Airflow | Apache Hive | Apache Spark | Bash | CDC | Data Modeling | Debezium | ETL | Git | HVR | Linux | Medallion Architecture | Microsoft SQL | Microsoft SQL Server | Oracle | PostgreSQL | PySpark | Python | SQL | SQL Server | Tableau | Trino
Education
N/A
Roles
Related jobs
-
Software Engineer CAD 115K-165K3D Rendering | Amazon Web Services | C++ | Computer Vision | Database DevelopmentMid-level Full TimeNorth Vancouver, British Columbia15h ago
-
Senior-level Full TimeEast Toronto (Studio District), Canada16h ago
-
Embedded Engineer, Research & Development CAD 112K-140KARM | Bare Metal | Board Bring-up | Bring-up | C#Senior-level Full TimeEdmonton, AB, CA19h ago
-
AWS Glue | AWS Lambda | AWS S3 | Access Control | Data GovernanceCareer growth opportunities | Collaborative and inclusive work environment | Diverse and inclusive culture | Flexible work arrangements | Permanent remote working modelSenior-level Full TimeCanada R1d ago
-
Big Data Senior Developer, Marketing & Advertising Data (French Services) (Telework/Hybrid) CAD 80K-106KApache Airflow | Apache Spark | Azure | Azure Event | Azure Event HubsBackground checks support for onboarding | Career growth opportunities | Employee resource groups | Flexible hours | Hybrid work environmentSenior-level Contract Full TimeQuebec (36.25), Canada R1d ago
-
Senior Embedded Software Engineer CAD 110K-149KC++ | Debian | Docker | Embedded Systems | Embedded architectureCareer growth support | Collaborative & Inclusive Culture | Employee stock options | Flexible time off | Free Coffee & TeaSenior-level Full TimeCanada - Ottawa (Bill Leathem)1d ago
-
Data Engineer / MLOps and AI Engineer CAD 115K-151K21 CFR | 21 CFR Part 11 | Access Control | Airflow | Amazon SageMakerFlexible working hours | In-person collaboration | Three days per week office minimumMid-level Full TimeCanada - Mississauga1d ago
-
Client Technology - ETL Developer CAD 94K-141KAmazon S3 | Apache Airflow | Apache Spark | Data Modeling | Data PipelinesMid-level Full TimeLocation(s): Mississauga, Ontario, Canada1d ago
-
APIs | Data Governance | Data Migration | Data Modeling | Data WarehousingSenior-level Full TimeOntario, Canada1d ago
-
Lead Azure Data Engineer USD 139K-264KAzure SQL | CDC | DBT | Data Governance | Data LakehouseDental insurance | Flexible work policy | LTD insurance | Life insurance | Medical insuranceSenior-level Full TimeCanada2d ago
-
Senior Machine Learning Engineer CAD 129K-180KAWS | Airflow | Computer Vision | Data Ingestion | Face detectionSenior-level Full TimeMontreal3d ago
-
Azure | Azure Data | Azure Data Services | Data Partitioning | Data ServicesComprehensive benefits program | Employer RRSP contribution | Flexible annual leave | Flexible work schedule | Hybrid workMid-level Full TimeToronto, Ontario3d ago
-
Data & Analytics Engineer, MS Fabric CAD 105K-125KCI/CD | DAX | Data Modeling | Data Pipelines | DatabricksDental insurance | Disability benefits | Health insurance | Life insurance | RRSP matchingSenior-level Full TimeVancouver, British Columbia, Canada3d ago
-
Data & Analytics Engineer, MS Fabric CAD 105K-125KAzure SQL | CI/CD | DAX | Data Governance | Data ModelingComplimentary train tickets | Dental insurance | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeVancouver, British Columbia, Canada3d ago
-
Senior Analytics Developer CAD 129K-160KAnonymization | BI best practices | Best practices | DBT | Data GovernanceAnnual L and D budget | Health, dental, vision coverage | Home office stipend | Remote work option | Unlimited PTOSenior-level Full TimeMontreal, Canada R3d ago
-
CI/CD | Cloud Computing | DevOps | GCP | Infrastructure as CodeBilingual French and EnglishSenior-level Full TimeMontréal, Canada3d ago
-
API | AWS | AWS Kinesis | Agile | AnsibleCareer growth | Employee benefits | Hybrid work environmentSenior-level Full TimeMontreal 700, Canada R4d ago
-
Data Platform Engineer II CAD 126K-156KAirflow | Databricks | Event Driven | Event-driven architecture | JavaMid-level Full TimeTD Centre - TD Tower - …4d ago
-
Entry-level Full TimeNorth Vancouver, British Columbia, Canada4d ago
-
Mid-level Full TimeCanada Remote - Consultant use only R4d ago
-
Senior AI Engineer CAD 111K-130KAWS | Apache Spark | CI/CD | Cloud platform | Data EngineeringDefined benefit pension | Extra vacation days | Flexible work schedule | Health dental disability and life insurance | Hybrid work modelSenior-level Full TimeOttawa (Downtown), ON, CA4d ago
-
Expert AI Enablement Consultant (On-Call) CAD 120K-160KAPI Development | Agentic Workflows | Backend Development | Cloud deployment | Cost Optimization401k matching | Donation matching | Employee stock purchase plan | Flexible work arrangements | Professional development resourcesSenior-level Part TimeCanada Remote Office (CD99) R4d ago
-
Senior AI Engineer CAD 131K-165KAWS | Agent Orchestration | Agent evaluation | Agent systems | AzureSenior-level Full TimeToronto, Canada4d ago
-
Amazon Web Services | Backend Development | Code review | Debugging | Distributed SystemsDental and vision coverage | Employee stock purchase plan | Flexible spending wallets | Health care coverage | Remote-first work flexibilityMid-level Full TimeRemote Canada R4d ago
-
Staff Software Engineer Data - DC Tech Lead USD 148K-242KDBT | Databricks | ETL | PySpark | Python401k match | Flexible remote work | Health and wellness benefits | Home office stipend | Mental health supportSenior-level Full TimeRemote - Toronto, Ontario, Canada R4d ago