Software Engineer
Tasks
- Analyze performance bottlenecks
- Build batch data processing pipelines
- Build distributed data-processing pipelines
- Collaborate on target state data platforms
- Design ETL data pipelines
- Develop ETL data pipelines
- Develop SQL transformations
- Develop reusable ETL frameworks
- Develop stored procedures
- Ensure Data Lineage
- Ensure auditability
- Ensure data integrity
- Ensure data reconciliation
- Follow CI/CD practices
- Follow coding standards
- Implement batch orchestration
- Implement data ingestion pipelines
- Implement data quality checks
- Implement data transformation pipelines
- Implement data tuning strategies
- Integrate pipelines with APIs
- Integrate pipelines with messaging
- Maintain data models
- Mentor junior developers
- Modernize legacy ETL workloads
- Optimize ETL performance
- Perform migration testing
- Provide technical design input
- Use version control practices
Perks/Benefits
Skills/Tech-stack
API | Airflow | Apache Spark | CI/CD | Cloud Data | Cloud Data Platforms | DB2 | Data Governance | Data Ingestion | Data Lineage | Data Quality | Data Reconciliation | Data Transformation | Data Warehousing | Data platforms | Git | Kafka | Kafka Streams | Linux | MQ | Oracle | PySpark | SQL | Scala | Spark Streaming | Stored Procedures | Talend | Unix
Education
N/A
Roles
Related jobs
-
Developer, Data Science CAD 85K-112KAirflow | Apache Beam | Apache Spark | BigQuery | CI/CDAccessibility accommodations during hiring | Hybrid workMid-level Full TimeToronto, ON, CA14h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R19h ago
-
Lead Software Engineer - MLOps CAD 90K-140KAPIs | APM | AWS | CI/CD | Cloud NativeCareer growth opportunities | Hybrid work flexibility | Mentorship and training | Well-being focused workplace | Wellness programsSenior-level Full TimeSun Life Waterloo King, Canada1d ago
-
Site Reliability Engineer, Inference Infrastructure USD 165K-267KAmazon Web Services | C plus plus | Cloud platform | Distributed Systems | GPU401k matching | Co working Benefit | Company offsite | Education and learning stipend | Health and dental benefitsMid-level Full TimeToronto1d ago
-
Staff Software Engineer, Inference Infrastructure USD 160K-220KAmazon Web Services | Azure | C++ | Cloud platform | Distributed Systems401k | Annual company offsite | Arts and culture budget | Education and learning stipend | Health and dental benefitsSenior-level Full TimeSan Francisco1d ago
-
Principal Data Engineer USD 180K-220KAWS | Apache Airflow | Artificial Intelligence | CI/CD | Confluence401k | Autonomy | Company paid life insurance | Disability coverage | FSASenior-level Full TimeRemote - US, Canada and Poland R2d ago
-
Machine Learning Test Capability Eng. USD 130K-208KAnomaly Detection | Big Data | Classification | Clustering | Data PipelinesCompetitive compensation | Comprehensive benefits package | Professional growth | State-of-the-art facilityNone Full TimeCanada3d ago
-
Machine Learning Engineer, Operations Technology CAD 135K-155KAPI Development | CI/CD | Data Quality | Databricks | DevOpsDental insurance | Fitness membership discount | Generous vacation | Health insurance | Health spending accountMid-level Full TimeToronto, Ontario, Canada3d ago
-
Senior Analytics Engineer CAD 111K-166KAirflow | CI/CD | DBT | Dimensional Modeling | GitDental insurance | Flexible time off | LinkedIn Learning | Medical insurance | Paid HolidaysSenior-level Full TimeCanada3d ago
-
Alerting | Buildkite | CI/CD | Cause analysis | Cross Database GrantsDental coverage | Employee stock purchase plan | Flexible spending account | Health coverage | Remote workSenior-level Full TimeRemote Canada R3d ago
-
AWS | C# | DynamoDB | Java8 | MySQLHealth and dental benefits | Relocation package | Vacation timeSenior-level Full TimeOntario; Montreal; Quebec City; Quebec; Nova …3d ago
-
Apache Spark | Cloud Computing | Data Engineering | Databricks | ETLMid-level Full TimeMontréal, Canada3d ago
-
Airbyte | Apache Airflow | Apache Iceberg | Cloud platform | DBTContinuous learning environment | Fully remote work environment | Health benefits | Home office setup allowance | Remote work stipendSenior-level Full TimeCanada R3d ago
-
AWS | Artificial Intelligence | BigQuery | Cloud platform | Computer VisionEquity incentives | Flexible time off | Fully remote | Healthcare coverage | Professional developmentSenior-level Full TimeCanada R3d ago
-
API | Data Pipelines | Data Transformation | Data integration | Generative AICarpooling application | E-learning courses | Employee assistance program | Hybrid work policy | On-site cafeteriaEntry-level Full TimeMirabel, Canada4d ago
-
AI/ML Developer, IT CAD 110K-125K.NET | .Net Framework | Access Control | Access Management | Agent workflowsHybrid work schedule | Mentorship and team collaborationMid-level Full TimeVancouver, BC, Canada4d ago
-
Applied AI Backend Engineer CAD 69K-86KAPIs | AWS | Automated testing | Azure | CI/CDEmployee resource groups | Health/dental coverage | Life insurance | Long-term disability | Maternity leaveEntry-level Full TimeOttawa, Canada4d ago
-
Data Engineer - Snowflake, dbtCore/Cloud, AWS CAD 100K-125KAWS | Amazon Aurora | Apache Airflow | DBT | Data CatalogAnnual bonus | Career development opportunities | Corporate wellness programs | Employee diversity programs | Flexible-hybrid workSenior-level Full TimeCanada - Markham ON 10 Aviva …4d ago
-
AI Engineer CAD 135K-170KBigQuery | Cache Augmented Generation | Function Calling | GitOps | Knowledge RetrievalCareer growth | Health insuranceSenior-level Full TimeBrampton, Ontario, Canada4d ago
-
Lead Data Engineer CAD 120K-145K.NET | Airflow | Amazon Web Services | Apache Airflow | C#Collaborative environment | Innovative culture | Professional growthSenior-level Full TimeVancouver, British Columbia, Canada4d ago
-
Data Engineer CAD 61K-113KAWS Glue | Amazon S3 | Apache Spark | Batch Processing | Data MappingAccident insurance | Health insurance | Life insurance | Network-building opportunities | Retirement savings plansMid-level Full TimeSCC, Canada4d ago
-
Gen AI Developer Specialist USD 125K-175KAPI Development | Agentic AI | Alerting | CI/CD | ContainerizationSenior-level Full TimeCanada4d ago
-
Ingénieur data / Data Engineer CAD 74K-121KDB2 | Data Pipelines | ETL | Python | SQLOccasional weekend work for releases and upgradesMid-level Full TimeMontréal, Quebec, Canada4d ago
-
Business Systems Analyst/Data Engineer CAD 118K-152KAcceptance Testing | Agile | Azure | Azure Data | Azure Data FactoryCoaching | Disability insurance | Employee assistance program | Enhanced parental leave | Fitness reimbursementSenior-level Full TimeCanada - Toronto4d ago
-
Data Engineer CAD 93K-134KAirflow | Apache Kafka | Apache Spark | Cloud Computing | Data GovernanceBanking preferred rates | Health and wellness benefits | Paid vacation | Pension matchingSenior-level Full TimeRegina, Saskatchewan, Canada; Regina, Saskatchewan, Canada4d ago