Senior Data Engineer Backend (Vancouver)
Tasks
- Automate data processing and workflows
- Collaborate with data scientists and analysts to deliver data solutions
- Debug and optimize large scale distributed data processing
- Debug and troubleshoot Spark applications
- Design and build APIs for data integration
- Develop and optimize data pipelines on Databricks
- Implement Spark compute best practices
- Integrate and query data in MongoDB
- Model and optimize MongoDB storage and retrieval
- Optimize MongoDB performance for large scale data
- Optimize workload performance
- Write Python reusable code using object oriented design
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | AWS | Apache Hadoop | Apache Kafka | Apache Spark | Azure | CI/CD | Cloud platform | Data Modeling | Data Warehousing | Databricks | Delta Lake | Distributed Systems | ETL | Git | Google Cloud | Google Cloud Platform | MongoDB | NoSQL | Object-Oriented | Object-oriented programming | Python
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
AI Engineer USD 125K-197KAgentic Architectures | Langchain | Language Models | Large Language Models | Model OrchestrationMid-level Full TimeCanada1d ago
-
Embedded Systems Software Engineer CAD 90K-130KAUTOSAR | Board Support | Board Support Package | C# | Computer VisionSenior-level Full TimeToronto, Canada1d ago
-
Data Engineer CAD 70K-110KAWS | Data Pipeline Development | Data Quality | Data Quality Testing | Data TransformationClimbing wall | Onsite amenities | Onsite gym | Squash court | Steam roomMid-level Full TimeNorth Vancouver, British Columbia1d ago
-
Senior Machine Learning Engineer CAD 113K-153KA/B | A/B Testing | API Design | Azure Machine Learning | B testingRemote workSenior-level Full TimeVancouver, British Columbia, Canada R2d ago
-
Software Engineer, Machine Learning Infrastructure CAD 172K-258KDistributed Systems | Experimentation | High Availability | LLM Applications | Language ModelsEntry-level Full TimeToronto, Canada2d ago
-
AI Developer (LLM & Agentic Systems) CAD 94K-138KAPI Development | Agent Orchestration | Azure | CI/CD | Cloud NativeFlexible work hours | Health and Safety compliant workplaceMid-level Full TimeToronto, ON, Canada2d ago
-
Applied AI Lead - Calgary CAD 120K-145KAI Agents | AWS | AWS Bedrock | Agent Frameworks | Anthropic ClaudeCareer coaching and mentorship | Continuing education reimbursement | Dental | Healthcare benefits | Learning and development platformSenior-level Full TimeCalgary, AB, Canada2d ago
-
Applied AI Lead - Edmonton CAD 120K-170KAI Agents | AWS | AWS Bedrock | Anthropic Claude | Automation workflowsCareer coaching and collaboration | Continuing education reimbursement | Healthcare dental vision life insurance RRSP contributions | International projects collaboration | Learning and development platformSenior-level Full TimeEdmonton, AB, Canada2d ago
-
Analytics Engineer CAD 65K-85KAI integration | ChatGPT | Claude | Core Metrics | DBTComprehensive vacation | Dental benefits | Diverse and inclusive workplace | Group RRSP | Health benefitsMid-level Full TimeToronto, Ontario, Canada2d ago
-
Senior Software Engineer CAD 130K-168KAWS | Algorithms | Apache Airflow | Azure | Caching401k match | Continuing education | Dental insurance | Flexible leave | Health insuranceSenior-level Full TimeToronto, Canada2d ago
-
Data Analyst, Product GBP 95K-124KA/B | A/B Testing | Analytical Functions | Apache Airflow | B testingSenior-level Full TimeUnited Kingdom2d ago
-
Senior Data Engineer CAD 115K-160KAirflow | Anomaly Detection | BigQuery | Data Governance | Data ModelingDonation matching | Employee assistance program | Flexible schedule | Generous referral scheme | Health benefitsSenior-level Full TimeOttawa, Ontario - Remote R2d ago
-
AWS | Azure | C++ | Cloud platform | Data IngestionCompany events | Equity opportunities | Flexible remote work | Flexible time off | Generous leave programsSenior-level Full TimeCanada3d ago
-
Data Engineer - Supply Chain Analytics & Data Enablement CAD 105K-128KAWS Glue | AWS Lambda | Amazon Athena | Amazon QuickSight | Amazon RedshiftEmployee discounts | Flexible work options | On-site perksSenior-level Full TimeMontreal, Quebec, CA, H4N 2B33d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon QuickSight | Amazon RedshiftEmployee discounts | Flexible work options | On-site benefitsMid-level Full TimeMontreal, Québec, CA, H4N 2B33d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote work | Supportive teamMid-level Full TimeWaterloo, Canada3d ago
-
Gen AI Engineer CAD 126K-170KAWS | Amazon Bedrock | CI/CD | CrewAI | DevOpsCareer development opportunitiesSenior-level Full TimeCanada - Remote R3d ago
-
Forward Deployed Engineer (Generative AI) CAD 131K-170KAI Agent Builder | AI Pipelines | Agent Builder | Agent Developer Kit | AlloyDBCareer development | Equal employment opportunity | Individual responsibilitySenior-level Full TimeCanada - Remote R3d ago
-
Lead, AI/Machine Learning Engineer CAD 86K-130KAI Foundry | AI Search | Automated testing | Azure | Azure AICommunity support | Employee connections | Hybrid work 4 days per week | Mentorship and coaching | Wellness programsSenior-level Full TimeHead Office Toronto, Canada3d ago
-
Sr Cloud Data Engineer CAD 92K-120KAutomation | Azure Data | Azure Data Factory | Azure Databricks | Big DataDefined benefit pension plan | Employee share purchase plan | Paid vacation | Wellbeing supportSenior-level Full TimeToronto-81 Bay, 16th Floor, Canada3d ago
-
AI productivity | AI productivity tools | Agile | Atlassian Confluence | Atlassian JiraSenior-level Full TimeMississauga, Ontario, Canada3d ago
-
APIs | Azure Data | Azure Data Factory | Azure Event | Azure Event HubDental insurance | Employee assistance program | Health insurance | Hybrid work schedule | Life insuranceMid-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …3d ago
-
Senior Analyst, Risk Data Scientist CAD 120K-130KArtifact management | CI/CD | Containerization | Data Visualization | DockerCloud first workstyle | Hybrid work | Leaves | Time offSenior-level Full TimeMontreal - 1190 av. des Canadiens-de-Montreal, …3d ago
-
Senior AI Engineer - Tangerine CAD 126K-154KAI Governance | Agentic AI | Amazon Web Services | CI/CD | Cloud ComputingFlexible workspace | Inclusive work environment | Online and in-person courses | Savings plan | Wellbeing supportSenior-level Full TimeToronto, ON, CA3d ago
-
API Integration | Agile | Azure | Data Modeling | Data PipelinesAdditional vendor discounts | Discounted company store products | Hybrid work arrangements | Training and developmentEntry-level ContractNorth York, CA3d ago