Lead Spark Data Engineer
Canada - Remote
R
CAD 108K-199K (estimate) Senior-level Contract Found 12d ago
Tasks
- Architect data solutions on Spark and Flink
- Build Query Validator
- Develop Spark Adapter
- Enforce data governance, security, and quality practices
- Ensure logic parity between Spark and Flink
- Implement IoT Query Language grammar
- Implement relationships logic within core
- Maintain documentation
- Manage Azure and Databricks resources
- Monitor and optimize workloads
- Participate in agile activities
- Transform, clean, and prepare data with SQL, Python, Java
Perks/Benefits
- N/A
Skills/Tech-stack
ANTLR | Abstract syntax trees | Apache Spark | Azure DevOps | CI/CD | Data Governance | Data Modeling | Data Security | Data Warehousing | Databricks | Delta Lake | Flink | GitHub | Java | Python | SQL
Education
N/A
Roles
Language: en |
Views: 0 |
Clicks: 0
Related jobs
-
Principal Machine Learning Engineer CAD 215K-230KA/B | A/B Testing | AI Programming | AI architecture | AI augmentationCareer growth opportunities | On-call rotation | Work from anywhere in CanadaSenior-level Full TimeToronto, ON, Canada R1d ago
-
Senior Software Engineer, AI CAD 123K-165KAI Evaluation | AI research | AWS | Agent Orchestration | CI/CDDental insurance | Disability insurance | Disaster support | Financial planning | Learning & development budgetSenior-level Full TimeRemote - Ontario, Canada R2d ago
-
Senior Software Engineer, AI CAD 123K-165KAI Evaluation | AI research | AWS | Agent Orchestration | CI/CDDental | Disability insurance | Financial planning | Learning budget | Life insuranceSenior-level Full TimeRemote - British Columbia, Canada R2d ago
-
Intermediate Backend Engineer (Canada) CAD 100K-135KAWS | Airflow | Azure | Beam | DagsterDental insurance | Flexible hours | Flexible remote work | Health insurance | Parental leaveMid-level Full TimeRemote - Victoria, British Columbia, Canada R2d ago
-
Senior Analytics Engineer USD 138K-166KAirflow | Automation | DBT | Data Governance | Data ModelingBenefits | EquitySenior-level Full TimeSan Francisco, CA, New York, NY, … R2d ago
-
Staff Machine Learning Engineer CAD 215K-230KA/B | A/B Testing | AI Coding Assistants | AI Tooling | AI architectureCross-team collaboration | Hands-on AI implementation | Senior technical leadership | Strategic influence | Work from anywhereSenior-level Full TimeToronto, ON, Canada R2d ago
-
Senior Machine Learning Engineer USD 144K-204KAWS | Argo Workflows | Azure | Data Pipelines | DevOps401k match | Benefits from day one | Bonus | Dental | EquitySenior-level Full TimeRemote (US/Canada) R2d ago
-
Senior Software Engineer CAD 127K-164KAWS | Automation | Backend Development | BigQuery | CI/CDDental coverage | Equity | Health coverage | Health spending account | Home office reimbursementSenior-level Full TimeCanada, Remote R2d ago
-
Mid-level Full TimeToronto, ON, CA R3d ago
-
Senior Data Engineer USD 180K-200KAWS | Cloud Storage | Data Architecture | Data Lakes | Data ModelingDental | Equity | Flexible PTO | Medical | Remote workSenior-level Full TimeRemote, US or Canada - NYC … R3d ago
-
Senior Software Engineer CAD 127K-164KAPI Development | BigQuery | CI/CD | Cloud Computing | Data PipelinesEquity | Health and dental | Home office reimbursement | Learning resources | Paid time offSenior-level Full TimeCanada, Remote R3d ago
-
AWS | Automation | Cross-Functional Communication | Cross-functional | Data ModelingHealth, dental, vision benefits | Impactful work | Inclusive culture | Industry growth opportunity | Paid time offSenior-level Full TimeCanada R5d ago
-
AI | Computational Algorithms | Generative AI | Machine Learning | NumPyFlexible schedule | Impact on AI development | Part-time | Project experience | RemoteMid-level FreelanceCanada - Remote R5d ago
-
Iceberg Core Engineer, Tech Lead CAD 136K-208KAlgorithms | Big Data | C++ | Cloud Platforms | CollaborationBenefits | Career development | Flexible WFH | PTO | ReimbursementsSenior-level Part TimeCanada-Ontario-Toronto-Remote R5d ago
-
Staff Data Engineer CAD 180K-191KCollaborative communication | Data Architecture | Data Flow | Data Governance | Data ManagementSenior-level Full TimeRemote Canada R6d ago
-
Mid-level Full TimeCanada Remote - Consultant use only R6d ago
-
AI | Analytics data | Analytics data modeling | BigQuery | CommunicationFlexible schedules | Health coverage | Paid vacations | Parental leave | Retirement matchingSenior-level Full TimeCanada R6d ago
-
Senior Software Engineer CAD 189K-225KAWS | Algorithm Development | Application development | C++ | CSSSenior-level Full TimeRemote - Canada R8d ago
-
Principal Software Engineer CAD 140K-193KAWS | Algorithm Development | Application Architecture | C# | C++Global team collaboration | Impactful science innovation | Remote-friendly environmentSenior-level Full TimeRemote - Canada R8d ago
-
Canada- Solution Engineer (Technical Services) CAD 96K-168KAI Foundry | AI integration | App Services | Automation | Azure AIMid-level Full TimeRemote or Mississauga R8d ago
-
Snowflake Developer (Remote friendly) CAD 115K-135KCI/CD | Data Modeling | Data Pipelines | Data integration | ELT401k | Dental | HSA | Life insurance | MedicalSenior-level Full TimeToronto, ON, Canada R9d ago
-
Sr. AI/ML Engineer CAD 145K-209KA/B | A/B Testing | Agentic Architectures | B testing | Bayesian statisticsCloud training | Collaborative culture | Flexible paid time off | Health benefits | High-impact enterprise projectsSenior-level Full TimeRemote, Canada R9d ago
-
Software Engineer CAD 108K-199KC/C++ | CI/CD | Cloud | Configuration Management | ContainerizationCross-environment collaboration | Customer-facing systems | Fast-growing startup | Real-impact working in AIMid-level Full TimeToronto, Ontario, Canada - Remote R9d ago
-
AI Engineer, AI Platform CAD 116K-160KData Security | Embedding Models | Graph Databases | LLM | MLOpsHealth benefits | Learning & development | Retirement plan | Team building | Wellness supportSenior-level Full TimeCanada (Remote); Toronto, Ontario R9d ago
-
Senior Machine Learning Engineer, AI Platform CAD 160K-220KA/B | A/B Testing | B testing | Data Engineering | Experimentation ToolsHealth benefits | Learning and development budget | Retirement plan | Team-building activities | Wellness supportSenior-level Full TimeCanada (Remote); Toronto, Ontario R9d ago