Data Integration Engineer
Montreal, Québec, CA, H3B 2E3
R
CAD 139K-192K (estimate) Senior-level Full Time
Tasks
- Build batch and near real time data ingestion
- Build transformation frameworks with Spark
- Create SQL queries for analytics and reporting
- Design and develop data integration pipelines
- Develop and maintain Databricks notebooks and workflows
- Develop data integration solutions with Azure services
- Develop data transformation logic
- Ensure data lineage governance consistency
- Implement data quality validation reconciliation monitoring
- Implement medallion architecture bronze/silver/gold
- Optimize pipeline performance and troubleshoot production issues
- Participate in Agile sprint planning estimation backlog refinement
- Support data cleansing enrichment aggregation
- Support production deployments monitoring and operations
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage | Data Quality | Data Reconciliation | Delta Lake | ELT | ETL | Event Driven | Event-driven architecture | Git | Kafka | Power BI | PySpark | Python | SQL | Synapse Analytics
Education
N/A
Related jobs
-
Data Science & AI CAD 71K-106KApache Spark | Backtesting | Calibration | Cross-validation | Data GovernanceDental insurance | Disability insurance | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeDorval, Québec, CA, H4S 1Y9 R7h ago
-
CUDA | DVC | Distributed Systems | FastAPI | Feature StoreEmployee resource groups | Employer Matched Savings Program | Equity compensation | Flexible sick days | Health benefitsSenior-level Full TimeCanada R9h ago
-
Senior Software Engineer, Datastores (Auth0) CAD 136K-187KAmazon DynamoDB | Amazon Web Services | CI/CD | Go | KubernetesDental insurance | Health insurance | Healthcare spending account | Paid leave | Paid time offSenior-level Full TimeToronto, Ontario, Canada R12h ago
-
Junior Analytics Engineer CAD 50K-65KAirflow | Automated testing | CTE | DBT | Data ModelingFlexible PTO policy | Health benefits | Professional learning and development | Remote-first work environmentEntry-level Full TimeCanada R17h ago
-
Data Science Manager, Risk CAD 90K-130KData Pipelines | Decision Tree | Feature Engineering | Loss forecasting | Machine LearningContinuing education stipend | Generous time off | Health and Wellness Spending Accounts | Hybrid work environment | Medical/Dental/Vision insuranceMid-level Full TimeToronto, Ontario R17h ago
-
Senior AI/ML Software Engineer CAD 150K-180KAPI Security | AWS | Agile | Apache Spark | Data Pipelines401k | Dental insurance | Discretionary time off | Health insurance | Life insuranceSenior-level Full TimeRemote - Canada R18h ago
-
AI/ML Software Engineer CAD 128K-158KAPI Security | AWS | Agile | Apache Spark | Authentication401k | Dental insurance | Discretionary time off | Health insurance | Life insuranceMid-level Full TimeRemote - Canada R18h ago
-
Machine Learning Engineer II (Underwriting ML) CAD 133K-183KAirflow | Backtesting | CatBoost | Classification | DaskDental coverage | Employee stock purchase plan | Flexible spending accounts | Remote work | Subsidized medical coverageMid-level Full TimeRemote Canada R21h ago
-
AI Solutions Engineer CAD 85K-114KAPI Integration | ChatGPT | Claude | CrewAI | Data PipelinesEmployee discounts | Group benefits | Paid time off | RRSP matchMid-level Full TimeHybrid- Toronto, ON R22h ago
-
Senior Machine Learning Engineer CAD 140K-180KA/B | A/B Testing | Apache Spark | B testing | Cloud platformFinancial benefits | Medical benefitsSenior-level Full TimeMovable Ink - Toronto (Remote) R23h ago
-
Applied Intuition | Applied Intuition Simian | C++ | CI/CD | CMakeHybrid work | Medical/Dental/Vision insurance | Personal days | RRSP program | Sick daysMid-level Full TimeMontréal, QC, Canada R23h ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Glue Catalog | AWS LakeCompetitive contract compensation | Flexible work schedule | Fully remote work | Technical autonomySenior-level Contract Full TimeCanada R1d ago
-
AlloyDB | Backup and Restore | Bash | CDC | Cloud BigtableLarge scale transformation projects | Professional growth opportunities | Remote work flexibilitySenior-level Full TimeCanada R1d ago
-
AI Agents | Alerting | C# | Event Driven | Event-driven architectureContinuous learning | Fully remote work | Professional growthMid-level Full TimeCanada R1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Services | Azure SynapseContract opportunity | Fully remote CanadaMid-level Contract Full TimeCanada R1d ago
-
Data Engineer CAD 108K-135KAmazon S3 | Apache Airflow | Apache Hadoop | Apache Hive | Apache SparkChild care benefits | Disability benefits | Family building benefits | Health and dental insurance | Health care savings accountMid-level Full TimeToronto, Canada R1d ago
-
Data Engineer CAD 72K-80KApache Cassandra | Apache HBase | Apache Spark | Apache Zookeeper | Data WarehousingCompany-Paid Holidays | Employee assistance programs | Life and disability insurance | Medical, dental, and vision insurance | Paid time offMid-level Full TimeMississauga, CA R1d ago
-
Azure | Azure Fabric | BigQuery | CI/CD | DBTHybrid work | Medical, dental, vision benefits | Paid time offSenior-level Full TimeMarkham, Ontario, Canada R1d ago
-
Staff Analytics Analyst, Full Stack (Revenue) CAD 153K-213KAI | BI | DBT | Data Documentation | Data GovernanceDental insurance | ESPP (Employee Stock Purchase Plan) | Flexible spending wallets | Health insurance | Remote work flexibilitySenior-level Full TimeRemote Canada R1d ago
-
Senior-level Full TimeToronto, Canada R1d ago
-
API Design | Atomics | Concurrency | Distributed Systems | Generative AIHome office setup | Internet stipend | Learning and development budget | Paid Holidays | Professional membershipsSenior-level Full TimeUnited States or Canada, Remote Opportunity R1d ago
-
Azure | CI/CD | Databricks | Distributed Systems | HCLFlexible work schedule | Four weeks vacation | Health insurance | Hybrid remote work | Life insuranceMid-level Full TimeMontréal, QC, CA R2d ago
-
AI Risk Management Framework | Adversarial Machine Learning | Adversarial Robustness | Adversarial Robustness Toolbox | Adversarial TrainingCareer growth | Flexible work environment | Fully remoteSenior-level Full TimeCanada R2d ago
-
Applied AI Backend Engineer CAD 66K-86KAPIs | AWS | Automated testing | Azure | CI/CDHealth and dental coverage | Life insurance | Long-term disability | Mental health wellness program | Paid parental leaveEntry-level Full TimeOttawa, Canada R2d ago
-
Senior AI Engineer CAD 145K-180KA/B | A/B Testing | AI Search | Agent Orchestration | Audit LoggingSenior-level Full TimeVancouver - Hybrid (3x in office/week) R2d ago