RQ08100: Software Developer - ETL
Toronto, ON, Canada
A CAD 120K-145K (estimate) Senior-level Full Time
Tasks
- Build Databricks notebooks and jobs
- Conduct end-to-end integration testing
- Design ETL processes
- Develop ETL pipelines
- Develop incremental and full load pipelines
- Document ETL design and troubleshooting steps
- Handle streaming data transformations
- Implement Change Data Capture
- Maintain ETL workflows
- Monitor pipeline performance
- Optimize overall ETL performance
- Perform schema validation and data quality checks
- Perform unit testing
- Prepare production deployment
- Provide go-live support
- Troubleshoot ETL and data issues
Perks/Benefits
Skills/Tech-stack
ACID | Apache Spark | Autoscaling | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Databricks | Blob Storage | Change Data Capture | Data Capture | Data Factory | Data Modeling | Data Quality | Data Validation | Data Versioning | Databricks | Debezium | Delta Lake | Delta Live Tables | Delta Live) | ETL | Medallion Architecture | Oracle | Oracle GoldenGate | PL/SQL | PySpark | Python | SQL | Schema evolution | Stored Procedures | Structured Streaming | T-SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeSenior-level ContractMontreal, Canada11h ago
-
Mid-level Full TimeNew York, Canada11h ago
-
AI SDK | API Integration | Automated testing | Azure Key Vault | Azure MonitorHealth spending account | Maternity and Parental Leave Top-Up | Modern office environment | Social events | Supportive teamwork cultureMid-level Full TimeToronto, ON, CA17h ago
-
AI Engineer Lead, Application Development CAD 99K-141K.NET | AI Document Intelligence | API Management | Azure | Azure AICommunity events | Health spending account | Maternity and Parental Leave Top-Up | Modern office environment | Supportive teamwork cultureSenior-level Full TimeToronto, ON, CA17h ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R20h ago
-
Senior Applied AI Engineer CAD 103K-192KAPI Integration | AWS | AWS Lambda | Agile | AirflowAccident insurance | Health insurance | Life insurance | Retirement savings plan | Tuition reimbursementSenior-level Full TimeFCP, Canada1d ago
-
Databricks Platform Engineer CAD 106K-130KAccess Management | Azure Data | Azure Data Lake | Azure Databricks | Azure DevOpsDPSP matching | Employee share purchase plan | Flexible work arrangements | Group RRSP matching | Share planSenior-level Full TimeToronto, 1000, 700 University Avenue 10th …1d ago
-
Python Developer - NLP, ML, Gen AI CAD 94K-141KApplication development | Data Modeling | Generative AI | Language Processing | Machine LearningSenior-level Full TimeLocation(s): Mississauga, Ontario, Canada1d ago
-
APIs | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeVancouver - 250 Howe Street, Canada1d ago
-
Senior Data Engineer CAD 150K-175KAWS | Amazon Redshift | Apache Airflow | BigQuery | CDCCellphone stipend | Company-Paid Holidays | Dental insurance | Flexible work hours | Health & wellness stipendSenior-level Full TimeRemote - Canada R1d ago
-
Associate Software Engineer – Java (AI First) USD 140K-200KAPI Design | Async Programming | CI/CD | CompletableFuture | ConcurrencyCareer development | Distributed team collaboration | Learning opportunities | Work from anywhereMid-level Full TimeCanada R1d ago
-
Senior Algorithms Developer CAD 150K-206KAlgorithms | C++ | Combinatorial Optimization | Computational Complexity | Data StructuresSenior-level Full TimeBurnaby, Canada1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India; London, England, United …1d ago
-
Data Platform Engineer CAD 90K-113KAWS | Airflow | Automated testing | Bash | BigQueryDocumentation and knowledge sharing culture | On demand incident response | On-call support | Remote-first workSenior-level Full TimeCanada R1d ago
-
Data Platform Engineer CAD 90K-113KAWS | Airflow | BigQuery | CI/CD | Cloud IAMFlexible work approach | On-call support rotation | Remote-first work environmentSenior-level Full TimeCanada R1d ago
-
Staff Back End Engineer (Data Platform) CAD 130K-170KAWS | Apache Spark | C# | Data Modeling | Distributed SystemsDental insurance | Disability insurance | Employee stock ownership plan | Health insurance | Life insuranceSenior-level Full TimeToronto, Canada1d ago
-
Backend Development | Cause analysis | ClickHouse | Cloud Native | Data IntegrityEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, Canada; Remote, US R1d ago
-
Azure Artifacts | Azure Boards | Azure Data | Azure Data Factory | Azure DatabricksMid-level ContractDownsview Central, Canada1d ago
-
Senior-level ContractDowntown Toronto (Ryerson), Canada1d ago
-
Senior Data Engineer, EIM CAD 129K-174KAPIs | Amazon Redshift | Automated testing | Continuous integration | Data MappingAgile environment | Hybrid work option | Remote work optionSenior-level Full TimeCanada - Remote (0002) R1d ago
-
ADF Debugger | Azure Artifacts | Azure Boards | Azure Data | Azure Data FactorySenior-level ContractToronto, Canada1d ago
-
AI Foundry | AI Services | API Gateway | AWS Lambda | AgileSenior-level ContractToronto, Canada1d ago
-
Mid-level Full TimeToronto, ON, M6B 4C4, CA1d ago
-
Senior AI DevEx Engineer USD 169K-220KAI-assisted coding | Application Lifecycle Management | Application lifecycle | Assisted coding | AutomationEquity | Flexible PTO | Medical coverage | Monthly lifestyle stipendSenior-level Full TimeRemote - Canada R1d ago
-
AI Governance | APIs | Access Management | Agentic AI | Artificial Intelligence401k retirement plan | Dental insurance | Flexible work arrangements | Fully remote | Medical insuranceSenior-level Full TimeCanada R1d ago