Software Engineer
Tasks
- Analyze performance bottlenecks
- Build batch data processing pipelines
- Build distributed data-processing pipelines
- Collaborate on target state data platforms
- Design ETL data pipelines
- Develop ETL data pipelines
- Develop SQL transformations
- Develop reusable ETL frameworks
- Develop stored procedures
- Ensure Data Lineage
- Ensure auditability
- Ensure data integrity
- Ensure data reconciliation
- Follow CI/CD practices
- Follow coding standards
- Implement batch orchestration
- Implement data ingestion pipelines
- Implement data quality checks
- Implement data transformation pipelines
- Implement data tuning strategies
- Integrate pipelines with APIs
- Integrate pipelines with messaging
- Maintain data models
- Mentor junior developers
- Modernize legacy ETL workloads
- Optimize ETL performance
- Perform migration testing
- Provide technical design input
- Use version control practices
Perks/Benefits
Skills/Tech-stack
API | Airflow | Apache Spark | CI/CD | Cloud Data | Cloud Data Platforms | DB2 | Data Governance | Data Ingestion | Data Lineage | Data Quality | Data Reconciliation | Data Transformation | Data Warehousing | Data platforms | Git | Kafka | Kafka Streams | Linux | MQ | Oracle | PySpark | SQL | Scala | Spark Streaming | Stored Procedures | Talend | Unix
Education
N/A
Roles
Related jobs
-
Software Engineer II - Data Platform CAD 103K-129KAirflow | Artificial Intelligence | BigQuery | DBT | DockerDental coverage | LinkedIn Learning access | Medical coverage | Paid Company Holidays | Paid sick leaveMid-level Full TimeCanada (Remote) R17h ago
-
Senior Machine Learning Operations Engineer USD 166K-208KAlerting | CI/CD | Canary Deployment | Champion Challenger | Drift DetectionSenior-level Full TimeSan Francisco, CA, New York, NY, … R19h ago
-
Data Engineer CAD 64K-114KApache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure EventDisability insurance | Extended health and dental benefits | Paid time off | Perk programs | Recognition programsMid-level Full TimeCambridge, Ontario, Canada; Toronto, Ontario, Canada21h ago
-
Senior Data Engineer CAD 132K-166KAWS Glue | AWS Lambda | Data Governance | Data Observability | Data QualitySenior-level Full TimeCanada (Remote) R22h ago
-
A/B | A/B Testing | AWS | Apache Kafka | B testingDental insurance | Equity | Medical insurance | Remote work environment | Vision insuranceSenior-level Full TimeRemote, USA; Remote, Canada R23h ago
-
Senior Data Engineer, Fixed Term - Toronto CAD 70K-80KAWS | Airflow | Azure | Cloud Computing | DBTBiweekly breakfasts and lunches | Buddy program | Charity volunteering days | Free snacks | Hybrid working policySenior-level TemporaryToronto Canada R1d ago
-
Senior AI Engineer | Canada | Remote CAD 164K-197KAPIs | Anthropic MCP) | BigQuery | CI/CD | CLIsGlobal annual leave policy | Remote workSenior-level Full TimeCanada (Remote) R1d ago
-
.NET | AI Evaluation | AWS | Artificial Intelligence | AzureContinuous learning | Dental insurance | Flexible work arrangements | Health insurance | Inclusive cultureSenior-level Full TimeCanada1d ago
-
Data Platform DevOps Engineer - Senior Consultant CAD 80K-138KAWS | Access Controls | Alerting | Azure | Azure DevOpsDeloitte Days | Development and Innovation Days | Flexible benefit spending account | Flexible work arrangements | Hybrid work arrangementSenior-level Full TimeToronto, ON, CA, M5H 0A91d ago
-
Data Engineer (MS Fabric / Databricks) - Consultant CAD 58K-102KADLS | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible work arrangements | Hybrid work structure | Learning development and innovation days | Mental health support benefits | MentoringMid-level Full TimeToronto, ON, CA, M5H 0A91d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible spending account | Flexible work arrangements | Hybrid work arrangement | Learning days | Mental health support benefitsSenior-level Full TimeToronto, ON, CA, M5H 0A91d ago
-
Principle Data Engineer CAD 115K-125KAirflow | Dagster | Data Governance | Data Modeling | Data PrivacyCareer growth opportunities | Flexible work arrangementsMid-level Full TimeLondon, Ontario1d ago
-
AWS Glue | AWS Lambda | Agentic AI | Amazon Redshift | Amazon Simple Storage ServiceContinuous learning | Flexible hours | Pension | Savings programs | Stock optionsSenior-level Full TimeSun Life Toronto Atria, Canada1d ago
-
Senior Machine Learning Engineer, Personalization CAD 156K-222KA/B | A/B Testing | B testing | CI/CD | DatabricksSenior-level Full TimeRemote - Canada R1d ago
-
Expert, AI & Data Science CAD 64K-106KAWS | Agile | Apache Spark | Azure | DatabricksCareer growth opportunities | Paid trainingSenior-level Full TimeMontreal Est, Quebec, Canada; Montreal1d ago
-
Executive-level Full Time5900 HURONTARIO STREET MISSISSAUGA, Canada1d ago
-
Lead Phyton and Generative AI Engineer- Vice President CAD 120K-170KAIOps | API Development | Agile Development | Application Monitoring | CI/CDSenior-level Full Time5900 HURONTARIO STREET MISSISSAUGA, Canada1d ago
-
Senior AI Software Engineer CAD 132K-188KAWS | Azure | CI/CD | Deep learning | Distributed TrainingEnhanced paid parental leave | Flexible time off | Flexible work hours | Free snacks and drinks | Health, Vision, Dental, Life InsuranceSenior-level Full TimeToronto1d ago
-
Machine Learning Engineer , Amazon Customer Service CAD 114K-191KA/B | A/B Testing | AI Agents | B testing | Data GovernanceDeferred profit-sharing | Dental insurance | Health insurance | Paid time off | Retirement planMid-level Full TimeVancouver, British Columbia, CAN1d ago
-
Senior Data Engineer CAD 132K-160KAmazon Web Services | Apache Airflow | DBT Cloud | DBT Core | DagsterSenior-level Contract Full TimeCanada - Remote R1d ago
-
Data Engineer Senior Manager CAD 94K-145KDashboarding | Data Analysis | Database Administration | ETL | ExcelAccessibility accommodations | Benefits | Community engagement programs | Cross-functional development opportunities | Employee resource groupsSenior-level Full TimeToronto, ON, CA, M5V2T31d ago
-
Data Engineer CAD 120K-145KAPI Integration | AlloyDB | Apache Airflow | Apache Kafka | BigQueryCareer growth | Healthcare benefitsSenior-level Full TimeBrampton, Ontario, Canada1d ago
-
Senior Data Engineer - Palantir Foundry (Hybrid, Canada) CAD 149K-190KAgile | Cloud Engineering | Data Engineering | Data Pipelines | Data QualityAutonomy | Builder culture | Career growth in new market | Hybrid work | Travel opportunitiesSenior-level Full TimeMontreal, Quebec, Canada R1d ago
-
AWS Glue | AWS Lambda | Amazon Redshift | Amazon Web Services | AnsibleContinuous learning | Flexible hours | Pension plans | Savings programs | Stock programsSenior-level Full TimeSun Life Toronto Atria, Canada1d ago
-
AI Engineer USD 165K-240KAPI Design | AWS | Agentic Workflows | Asynchronous processing | BM25401k enrollment | Gym membership stipend | Health coverage | Hybrid work environment | Paid HolidaysSenior-level Full TimeNew York1d ago