RQ08100: Software Developer - ETL
Toronto, ON, Canada
A CAD 120K-145K (estimate) Senior-level Full Time
Tasks
- Build Databricks notebooks and jobs
- Conduct end-to-end integration testing
- Design ETL processes
- Develop ETL pipelines
- Develop incremental and full load pipelines
- Document ETL design and troubleshooting steps
- Handle streaming data transformations
- Implement Change Data Capture
- Maintain ETL workflows
- Monitor pipeline performance
- Optimize overall ETL performance
- Perform schema validation and data quality checks
- Perform unit testing
- Prepare production deployment
- Provide go-live support
- Troubleshoot ETL and data issues
Perks/Benefits
Skills/Tech-stack
ACID | Apache Spark | Autoscaling | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Databricks | Blob Storage | Change Data Capture | Data Capture | Data Factory | Data Modeling | Data Quality | Data Validation | Data Versioning | Databricks | Debezium | Delta Lake | Delta Live Tables | Delta Live) | ETL | Medallion Architecture | Oracle | Oracle GoldenGate | PL/SQL | PySpark | Python | SQL | Schema evolution | Stored Procedures | Structured Streaming | T-SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Senior Analytics Engineer USD 148K-218KAutomation | BI tools | CCPA | CI/CD | DBTDental insurance | Equity | Medical insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, USA ; Remote, Canada R1d ago
-
Innovative Data Platform Solution Engineer CAD 96K-177KAzure | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data ExplorerCollaborative team environment | Continuous learning | Flexible work opportunities | Inclusion and diversity cultureMid-level Full TimeCanada, Ontario, Greater Toronto1d ago
-
Data Engineer CAD 73K-91KApache Airflow | Apache Beam | BigQuery | CI/CD | Cloud StorageAnonymous reporting platform | Course Reimbursement Program | Flexible hybrid work environment | Free online doctor visits | Frequent Employee Pulse SurveysMid-level Full TimeOakville, Canada R1d ago
-
Agile | Azure | Azure Blob | Azure Blob Storage | Azure DataEmployee assistance program | Global career opportunities | Health and wellness programs | Insurance benefits | Paid time offEntry-level Full TimeCanada, British Columbia2d ago
-
Mid-level ContractMontréal, Canada2d ago
-
AWS CloudWatch | AWS Glue | AWS HealthLake | AWS S3 | Access ControlSenior-level ContractToronto, Canada2d ago
-
Machine Learning Engineer CAD 125K-154KAWS | Azure | Data Architecture | Databricks | Enterprise DataEmployee and family assistance program | Employee share ownership plan | Health and dental benefits | In-store discount | Learning and development opportunitiesSenior-level Full TimeToronto, ON, M5V 1X6, CAN2d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsHybrid workSenior-level Full TimeToronto, ON, Canada2d ago
-
Sr. Software Developer - ETL (Microsoft D365, SQL, SQL Azure, Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory) - RQ09450 A CAD 141K-212KAPI Management | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract with possible extension | Hybrid work scheduleSenior-level Full TimeToronto, ON, Canada2d ago
-
Access Management | Active Directory | Agile | Ansible | AzureRemote workSenior-level Full TimeEdmonton, AB, Canada R2d ago
-
BERT | Hyperparameter Tuning | Language Processing | Machine Learning | Natural LanguageHybrid workSenior-level Full TimeToronto, ON, Canada2d ago
-
.NET | Azure | Azure CLI | Azure Data Factory | Azure SQLHybrid workSenior-level Full TimeToronto, ON, Canada2d ago
-
AWS | Agile | Business Intelligence | Dashboard Design | Data ModelingContract role | Flexible and dynamic work environment | Flexible work location | Fully remoteMid-level Contract Full TimeCanada R2d ago
-
Analyst, Data Science & AI developper CAD 74K-104KAI Foundry | Agile | App Service | Azure | Azure AIDental insurance | Disability insurance | Employee assistance program | Flexible/hybrid work policies | Health insuranceMid-level Full TimeDorval, Québec, CA, H4S 1Y92d ago
-
Analyst, Data Science & AI CAD 71K-106KAzure | Backtesting | Calibration | Cross-validation | Data GovernanceEmployee assistance program | Flexible and hybrid work policies | Insurance plans | Retirement savings plan | Tele Health ProgramMid-level Full TimeDorval, Québec, CA, H4S 1Y92d ago
-
A/B | A/B Testing | Advertising analytics | Airflow | B testingEquity grants | Flexible remote work | Professional developmentSenior-level Full TimeCanada2d ago
-
Apache Airflow | Apache Flink | Backend Development | Compliance | Data GovernanceAnnual equity refresh opportunities | Collaborative innovation focused environment | Flexible remote work | Health and well-being benefits | New hire equity grantsMid-level Full TimeCanada2d ago
-
Senior Data Engineer (Snowflake) CAD 140K-179KApache Airflow | BigQuery | Compliance | DBT | DagsterExtended health and dental plan | Flexible PTO | Flexible work arrangements | Mentorship | Training budgetSenior-level Full TimeToronto2d ago
-
Senior AI Lead -Snowflake CAD 131K-278KAnthropic API | Autogen | CI/CD | Cortex AI | Cortex AnalystSenior-level Full TimeMontreal, 5 Place Ville Marie, Corp, …2d ago
-
Senior Data Engineer CAD 99K-136KBigQuery | CI/CD | Cloud platform | DBT | Data GovernanceBuy and sell PTO | Digital nomads 4 weeks per year | Flexible dental insurance | Flexible medical insurance | Generous PTOSenior-level Full TimeToronto King Street E Office, Canada2d ago
-
Power BI Product Specialist CAD 74K-129KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | BI GatewayContinuous learning environment | Inclusive work environment | Pension matching | Performance bonus | Profit sharing matchingMid-level Full TimeToronto, ON, CA, M5H 1H12d ago
-
BI Developer, Data & Analytics CAD 74K-111KAgile | BI | BigQuery | Change Management | Cloud platformCareer growth | Dental benefits | Health benefits | Paid time off | Parental leave salary top-upMid-level Full TimeHO0900: Home Office, Canada R2d ago
-
Machine Learning Engineer II CAD 154K-199KC# | C++ | Deep learning | GPU Computing | Generative AICareer development | Health and well-being benefits | Mentoring programs | Paid time off | Reward and recognition programsEntry-level Full Time661 University Avenue, Toronto, Ontario, Canada2d ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R2d ago
-
AWS | CI/CD | Code review | Data Transformation | DatabricksAnnual training bonus | Flexible schedule | Flexible time off | Free telemedicine | Hybrid workSenior-level Full TimeMontréal, Quebec, Canada; Québec, Quebec, Canada2d ago