RQ11048 - DataOps/Cloud Data Engineer - Senior
Tasks
- Apply data governance practices information architecture and data modeling standards
- Design develop optimize Azure Data Factory and Databricks pipelines from Oracle to lakehouse
- Design develop optimize Databricks connections to on premises data sources
- Design optimize Medallion Architecture data models
- Design optimize relational data models
- Develop ETL processes with Informatica Azure Data Factory and Databricks
- Develop and maintain data lineage reports
- Develop data pipeline workflow orchestration deployment and automation
- Implement CI CD and data provisioning automation
- Implement data anonymization and masking techniques
- Implement data quality checks and data validation profiling cleansing monitoring
- Integrate and manage Microsoft Entra ID for authentication authorization and RBAC
- Transfer knowledge through one on one sessions emails and document review
- Translate Informatica ETL to Azure Data Factory and Databricks ELT
- Troubleshoot production issues and implement fixes
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Agile | Automation | Azure | Azure Data | Azure Data Factory | CI/CD | Data Cleansing | Data Factory | Data Governance | Data Lakehouse | Data Lineage | Data Provisioning | Data Quality | Data Validation | Data anonymization | Data masking | Data profiling | Databricks | Databricks ELT | Delta Lake | Delta Lake indexing | Entra ID | Informatica | Informatica ETL | Lakehouse | Medallion Architecture | Microsoft Entra | Microsoft Entra ID | Microsoft Fabric | Orchestration | PL/SQL | Parallelism | Python | Role-Based Access | Role-Based Access Control | SDLC | SQL | SSIS | T-SQL | UAT | Unit Testing | Waterfall
Education
N/A
Roles
Cloud Data Engineer | Cloud) | Data Engineer | DataOps Engineer | Engineer
Related jobs
-
AI Systems & ML Engineering Industry Expert CAD 140K-185KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible schedule | Fully remote | Hourly paySenior-level Part TimeToronto, Ontario, CA R7h ago
-
Sourcing Data Analyst, Advanced Analytics CAD 62K-72KData Governance | Data Modeling | Data Quality | Data Reconciliation | Data TransformationComprehensive benefits package | Flexible remote work options | Travel to company offices as requiredMid-level Full TimeToronto, ON, M5G 1Z3, CA12h ago
-
AI Evaluation | AI Observability | ASP.Net Core | AWS | Agentic Architectures401k matching | Continuing education | Flexible PTO | Health and wellness programs | Health, dental, and vision insuranceSenior-level Full TimeCanada R16h ago
-
API Integration | Agentic AI | Amazon Bedrock | Anomaly Detection | Automated testingMid-level Full TimeCanada19h ago
-
Annotation Analysis | Bug tracking | Computer Vision | Data Parsing | Data QualityMid-level Full TimeVancouver1d ago
-
Senior Machine Learning Engineer CAD 150K-210KAPIs | Algorithms | Concurrency | Data Modeling | Data StructuresSenior-level Full TimeToronto, Ontario, Canada R1d ago
-
Staff Full Stack AI Engineer CAD 145K-175K.NET | AI Evaluation | AWS | Agentic Workflows | AutoGPT401k matching | Company lunches | Company outings | Continuing education | Flexible PTOSenior-level Full TimeAtlanta, Charlotte, Denver, New York, Remote … R1d ago
-
Senior Data Engineer CAD 135K-159KAWS | Agile | DBT | Data Governance | Data ModelingHybrid work model | Life leave days | Professional development days | Retirement savings options | Vacation timeSenior-level Full TimeOttawa, ON, Canada R1d ago
-
Senior Software Engineer, Data - Mapping CAD 136K-170KA/B | A/B Testing | AWS | Airflow | Apache IcebergChild care benefits | Disability benefits | Extended health and dental coverage | Family building benefits | Flexible paid time offSenior-level Full TimeToronto, Canada R1d ago
-
Data Engineer CAD 95K-105KAPI 2.0 | Apache Spark | Apache Spark Streaming | Azure Data | Azure Data FactoryMid-level Full TimeToronto, ON, Canada1d ago
-
Senior Analytics Engineer (m/f/d) CAD 130K-170KAWS Glue | Amazon Athena | Amazon S3 | Automation | ComplianceConferences and training budget | Employee and family assistance program | Financial planning with pension matching | Gym discounts | Regular internal training programsSenior-level Full TimeToronto, ON (Canada)1d ago
-
Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryAnnual company retreat | Conference talk sponsorship | Employee leave policies | Home office fund | In person coworking sprintsMid-level Full TimeCanada R1d ago
-
AI/ML Engineer — Agentic AI Systems CAD 160K-240KAPI Integration | Amazon Bedrock | Benchmarking | ClickHouse | Evaluation harnessesMid-level Full TimeToronto, Ontario1d ago
-
AI Agents | API Integration | Access Management | Agent Frameworks | Cost OptimizationCompany offsites | Equity participation | Flexible schedule | Flexible vacation | Fully remoteMid-level Full TimeCanada R1d ago
-
AI Engineer - New Grad CAD 52K-60KAPIs | Agentic AI | Fine Tuning | Language Models | Large Language ModelsDiscount program | Flexible medical spending account | Health benefits | Leadership training | RRSP matchingEntry-level Full TimeGreater Toronto Area, ON, Canada1d ago
-
Advisor, Data engineering CAD 83K-133KAlgorithms | Data Engineering | Data Modeling | Data Pipelines | Data StorageDefined benefit pension plan | Flexible vacation | Group insurance | Health & wellness reimbursement | TelemedicineSenior-level Full TimeComplexe Desjardins Montréal, Canada R1d ago
-
Senior Software Engineer, AI Enablement & Solutions CAD 140K-210KAPIs | AWS | AWS Bedrock | Distributed Systems | MicroservicesEmployee accounts required as applicable | Hybrid work environment | In-office collaborationSenior-level Full TimeToronto, Canada R1d ago
-
Senior Cloud / AI Developer – Train Control , OT CAD 80K-131KAI | APIs | AWS | Access Management | Automated testingPaid trainingSenior-level Full TimeMontreal Est, Quebec, Canada; Montreal1d ago
-
Senior Embedded Build & Release Engineer CAD 84K-114KAsymmetric Encryption | Build systems | CI/CD | Code Signing | Development Life CycleCareer growth support | Employee stock options | Flexible time off | Free Coffee & Tea | Free gymSenior-level Full TimeCanada - Ottawa (Bill Leathem)1d ago
-
Sr. Data Engineer, WW Pricing Data and Insights CAD 135K-226KAWS | AWS Lambda | Amazon EC2 | Amazon EMR | Amazon KinesisDeferred profit-sharing | Dental insurance | Health insurance | Paid time off | Retirement planSenior-level Full TimeVancouver, British Columbia, CAN1d ago
-
Senior AI Engineer / AI Engineer III CAD 156K-234KAmazon Web Services | Autonomous Agents | Cloud Computing | Cloud platform | Deep learningEmployee referral program | Flexible work schedule | Paid time off | Remote work optionsSenior-level Full TimeCanada, BC, Vancouver1d ago
-
Senior-level Full TimeToronto, ON, CA, M9C 5J51d ago
-
SENIOR SYSTEMS INTEGRATOR (Senior BI & Analytics Lead) CAD 105K-160KChange Management | Dashboard Development | Data Modeling | Data Quality | Data WarehousingSenior-level Full TimeToronto, ON, CA, M5V3C61d ago
-
AI Engineer / Data Engineer - Agentic AI CAD 96K-145KAPIs | Artificial Intelligence | Autogen | Cloud services | CrewAISenior-level Full TimeQuebec City, Canada1d ago
-
AWS ETL Data Engineer - REMOTE CAD 86K-133KAWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Apache AirflowDisability insurance | Employee assistance program | Gym discounts | Health and dental coverage | Income protectionSenior-level Full TimeHalifax, NS, CA R1d ago