Data Engineer
Tasks
- Automate pipeline orchestration and deployments
- Build analytics tools using data pipelines
- Build data pipelines
- Create reports and insights for stakeholders
- Define data governance lineage and validation frameworks
- Design and develop data solutions
- Design data models
- Develop and maintain scalable batch and streaming pipelines
- Extract, transform and load data
- Implement data integration and data quality standards
- Monitor data quality and reliability
- Partner with stakeholders for data platform strategy
- Perform root cause analysis for data problems
- Standardize data ingestion
- Translate business logic into technical deliverables
- Troubleshoot data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Asset bundles | Auto Loader | Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Contracts | Data Factory | Data Governance | Data Lineage | Data Quality | Data Validation | Data quality monitoring | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Auto Loader | Databricks Dashboards | Databricks Wheel packaging | Delta Live Tables | Delta Live) | Java | Metadata Management | Power BI | Powershell | PySpark | Python | Quality monitoring | R | Regression testing | SQL | Schema evolution | Synapse Analytics | Unit Testing | Wheel Packaging | Workload Orchestration | YAML
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R7h ago
-
Senior Data Engineer CAD 150K-175KAWS | Amazon Redshift | Apache Airflow | BigQuery | CDCCellphone stipend | Company-Paid Holidays | Dental insurance | Flexible work hours | Health & wellness stipendSenior-level Full TimeRemote - Canada R13h ago
-
Senior-level Full TimeBengaluru, Karnataka, India; London, England, United …15h ago
-
Data Platform Engineer CAD 90K-113KAWS | Airflow | Automated testing | Bash | BigQueryDocumentation and knowledge sharing culture | On demand incident response | On-call support | Remote-first workSenior-level Full TimeCanada R16h ago
-
Data Platform Engineer CAD 90K-113KAWS | Airflow | BigQuery | CI/CD | Cloud IAMFlexible work approach | On-call support rotation | Remote-first work environmentSenior-level Full TimeCanada R16h ago
-
Staff Back End Engineer (Data Platform) CAD 130K-170KAWS | Apache Spark | C# | Data Modeling | Distributed SystemsDental insurance | Disability insurance | Employee stock ownership plan | Health insurance | Life insuranceSenior-level Full TimeToronto, Canada16h ago
-
Staff Machine Learning Engineer, Merchants CAD 213K-314KA/B | A/B Testing | B testing | Data labeling | Deep learningSenior-level Full TimeToronto, ON, CA, Remote, Canada R17h ago
-
Backend Development | Cause analysis | ClickHouse | Cloud Native | Data IntegrityEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, Canada; Remote, US R17h ago
-
Senior-level ContractDowntown Toronto (Ryerson), Canada22h ago
-
Senior Data Engineer, EIM CAD 129K-174KAPIs | Amazon Redshift | Automated testing | Continuous integration | Data MappingAgile environment | Hybrid work option | Remote work optionSenior-level Full TimeCanada - Remote (0002) R22h ago
-
AI Foundry | AI Services | API Gateway | AWS Lambda | AgileSenior-level ContractToronto, Canada22h ago
-
Senior AI DevEx Engineer USD 169K-220KAI-assisted coding | Application Lifecycle Management | Application lifecycle | Assisted coding | AutomationEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - Canada R23h ago
-
AI Governance | APIs | Access Management | Agentic AI | Artificial Intelligence401k retirement plan | Dental insurance | Flexible work arrangements | Fully remote | Medical insuranceSenior-level Full TimeCanada R1d ago
-
Data Engineer CAD 0K-0KAPI Integration | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkAgile team collaboration | Continuous improvement culture | Hybrid work environment | Mentorship opportunitiesMid-level Full TimeToronto, Ontario, Canada1d ago
-
Data Engineer CAD 0K-0KAWS | Apache Airflow | Apache Flink | Apache Spark | ArgoCDAgile environment | Hybrid work environment | Mentorship | Remote collaborationMid-level Full TimeToronto, Ontario, Canada1d ago
-
Principal AI Engineer CAD 150K-190KBigQuery | C++ | Cloud SQL | CrewAI | CsharpCareer growth and development | Community volunteering opportunities | Health & wellbeing resources | Hybrid work model | Paid sick daysSenior-level Full TimeToronto, ON, M2M 4K2, CA1d ago
-
API Design | Airflow | Amazon Web Services | BigQuery | Cloud platformCollaborative remote culture | Competitive salary | Comprehensive benefits | Fully remote | High ownershipSenior-level Full TimeCanada R1d ago
-
Principal Java Data Engineer CAD 110K-152KAWS | Apache Hudi | Apache Trino | Azure | Azure DataAllyship and inclusion communities | Caregiver leave | Continuous development support program | Employee assistance program | Employee recognitionSenior-level Full TimeMississauga R1d ago
-
AI Engineer CAD 110K-150KAudio Processing | Automatic Speech Recognition | Bit-depth | Channels | Data CurationDiscount program | Flexible medical spending account | Health benefits | RRSP matching | Tuition reimbursementEntry-level Full TimeGreater Toronto Area, ON, Canada1d ago
-
Machine Learning/Operations Research Platform Engineer CAD 120K-165KC++ | Containerization | Data Structures | Data Structures and Algorithms | Design PatternsFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programsSenior-level Full TimeRemote, Canada R1d ago
-
AI Engineer - Senior CAD 126K-165KAI Foundry | AI Services | API Gateway | AWS Lambda | Amazon BedrockSenior-level Full TimeToronto, Canada1d ago
-
Software Developer - ETL - Senior CAD 123K-157KApache Spark | Automl | Azure Data | Azure Data Factory | Azure Data GovernanceSenior-level Full TimeToronto, Canada1d ago
-
DataOps/Cloud Data Engineer - Senior CAD 136K-175KAWS Glue | AWS Lambda | AWS Redshift | AWS Step Functions | Agile1 year contract extension | Onsite workSenior-level Full TimeToronto, Canada1d ago
-
Software Developer - ETL - Senior CAD 141K-212KAWS Glue | Amazon Aurora | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeToronto, Canada1d ago
-
Machine Learning Engineer CAD 120K-154KAWS | Azure | Databricks | Databricks Vector Search | Design PatternsEmployee and family assistance program | Employee share ownership plan | Health and dental benefits | In-store discount | Learning and development opportunitiesSenior-level Full TimeToronto, ON, M5V 1X6, CAN1d ago