RQ08100: Software Developer - ETL
Toronto, ON, Canada
A CAD 120K-145K (estimate) Senior-level Full Time
Tasks
- Build Databricks notebooks and jobs
- Conduct end-to-end integration testing
- Design ETL processes
- Develop ETL pipelines
- Develop incremental and full load pipelines
- Document ETL design and troubleshooting steps
- Handle streaming data transformations
- Implement Change Data Capture
- Maintain ETL workflows
- Monitor pipeline performance
- Optimize overall ETL performance
- Perform schema validation and data quality checks
- Perform unit testing
- Prepare production deployment
- Provide go-live support
- Troubleshoot ETL and data issues
Perks/Benefits
Skills/Tech-stack
ACID | Apache Spark | Autoscaling | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Databricks | Blob Storage | Change Data Capture | Data Capture | Data Factory | Data Modeling | Data Quality | Data Validation | Data Versioning | Databricks | Debezium | Delta Lake | Delta Live Tables | Delta Live) | ETL | Medallion Architecture | Oracle | Oracle GoldenGate | PL/SQL | PySpark | Python | SQL | Schema evolution | Stored Procedures | Structured Streaming | T-SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Senior Advisor, Data engineering CAD 105K-129KAlgorithms | Azure Data | Azure Data Factory | Azure Databricks | Azure SynapseDefined benefit pension plan | Flexible vacation | Group insurance | Health and wellness reimbursement | TelemedicineSenior-level Full Time1, Complexe Desjardins, Montréal, Canada20h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Friendly work environment | Opportunity to make impactMid-level Full TimeToronto, Canada1d ago
-
Senior Manager, Data Science CAD 120K-150KArtificial Intelligence | Attribution | Calibration | Data Fusion | Data MiningDiscount program | Education reimbursement | Health and dental | Hybrid work | Leadership trainingSenior-level Full TimeToronto, ON - Remote R1d ago
-
AI guardrails | API Development | Cache optimization | Deep learning | Distributed ComputingSenior-level Full TimeToronto, ON, Canada1d ago
-
C# | CAN | Debugging | Embedded Linux | GitMid-level Full TimeSt. Laurent, Quebec, Canada1d ago
-
Member of Technical Staff, Data Analysis and Evaluation USD 150K-175KData collection | Distributed Training | Experimental Design | JAX | Machine LearningCo working Benefit | Community events | Daily lunch program | Remote-friendly | SnacksSenior-level Full TimeLondon1d ago
-
Senior-level Full TimeCA-ON-Toronto2d ago
-
Data Platform DevOps Engineer - Senior Consultant CAD 80K-138KAWS | Alerting | Azure | Azure DevOps | Azure MonitorBilingual client interaction opportunities | Deloitte Days | Development and Innovation Days | Flexible benefits | Flexible spending accountSenior-level Full TimeToronto, ON, CA, M5C 3G72d ago
-
AWS | Actors | Angular | C++ | Concurrent programmingCareer development support | Coaching | Flexible working models | Learning sessions | MentoringEntry-level InternshipVancouver, British Columbia, CA, V6B 1A92d ago
-
Software Engineer - (StorageGRID/C++) CAD 117K-151KAWS S3 | Agile | C++ | CQL | CassandraPaid volunteeringMid-level Full TimeVancouver, Canada Office (VANCOUVER)3d ago
-
Senior Data Engineer INR 1500K-2800KApache Spark | Data Governance | Data Pipelines | Data Privacy | Data SecurityLocal presence requiredSenior-level Full TimeOntario Centre (Queensville), India3d ago
-
AWS | Alteryx | Azure Data | Azure Data Factory | Business AnalyticsGroup medical insurance | Group pension scheme | Gym membership assistance | Hybrid work | Paid HolidaysSenior-level Contract Full TimeVancouver, BC, Canada3d ago
-
Scientifique en IA (AI Scientist) CAD 46K-56KCloud Computing | Computer Vision | Data Analysis | Deep learning | Edge ComputingFitness stipend | Flexible schedule | Health insurance | Hybrid work | Internet and mobile stipendEntry-level Full TimeMontréal, Quebec, Canada; Québec, Quebec, Canada3d ago
-
AWS | Alteryx Designer | Azure Data | Azure Data Factory | DAXGroup medical insurance | Group pension scheme | Gym membership assistance | Hybrid working | Paid HolidaysSenior-level Contract Full TimeToronto, ON, Canada3d ago
-
AWS | AWS Glue | AWS Glue Data Catalog | AWS Lake Formation | AWS LambdaAutonomy and ownership | Career growth | Collaborative global team | Flexible work culture | Fully remote workSenior-level Full TimeCanada R3d ago
-
AWS Glue | Amazon Aurora | Amazon Relational Database Service | Azure | Azure DataMid-level ContractDowntown Toronto (Ryerson), Canada3d ago
-
Sourcing Data Analyst, Advanced Analytics CAD 62K-72KChange Management | Data Governance | Data Modeling | Data Quality | Data ReconciliationCOVID-19 vaccination requirement | Comprehensive benefits package | Flexible remote work options | Travel opportunityMid-level Full TimeToronto, ON, M5G 2L5, CA3d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon S3 | Azure DataOnsite workSenior-level Full TimeToronto, ON, Canada3d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon RedshiftSenior-level Full TimeToronto, ON, Canada3d ago
-
Senior Machine Learning Engineer CAD 125K-170KCI/CD | Distributed Computing | Flask | GPU Computing | Generative AICompany Offsites and Meetups | Family assistance program | Group insurance plan | Home office budget | Lifestyle daysSenior-level Full TimeCanada R3d ago
-
AI Agents | AWS | Access Management | Alerting | BashFlexible PTO | Fully remote friendly | Learning and development budget | Medical, dental & vision coverage | Mental health and wellness supportSenior-level Full TimeCanada R3d ago
-
API Integration | Agentic Workflows | Conversational AI | Distributed Systems | End to EndFast iteration cycles | Flexible schedule | Fully remote | Global work location | High ownershipSenior-level Full TimeCanada R3d ago
-
Machine Learning Analyst CAD 68K-93KAWS | Azure | Databricks | Faiss | GCPEmployee assistance program | Employee share ownership plan | Health and dental benefits | In-store discount | Learning and development opportunitiesEntry-level Full TimeToronto, ON, M5V 1X6, CAN3d ago
-
Agentic Systems | Analytics infrastructure | Artificial Intelligence | Automation | Churn PredictionDental insurance | Flexible work from anywhere in Canada | Health insurance | Pre-IPO equity | Remote-first workSenior-level Full TimeCanada R3d ago
-
API Development | AWS | Agentic Workflows | Automated testing | Cost OptimizationContinuous learning opportunities | Flexible work arrangements | Health benefits (medical, dental, vision) | Inclusive workplace culture | MentorshipSenior-level Full TimeCanada3d ago