PySpark Big Data Senior Developer - Vice President
5900 HURONTARIO STREET MISSISSAUGA, Canada
CAD 120K-170K Senior-level Full Time
Tasks
- Build event-driven architectures
- Conduct code reviews
- Create dimensional models
- Deploy and manage applications
- Design Big Data solutions
- Develop and optimize data pipelines
- Develop data warehousing solutions
- Implement CI/CD pipelines
- Implement real-time data streaming
- Lead technical discussions
- Mentor junior engineers
- Optimize performance and scalability
- Select distributed storage technologies
- Troubleshoot distributed data processing issues
- Write automated tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS EMR | AWS Glue | Amazon Redshift | Apache HBase | Apache Kafka | Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Databricks | Azure Synapse | Azure Synapse Analytics | BigQuery | Branching | CI/CD | Cassandra | Cloud Dataflow | Cloud Dataproc | Data Factory | Databricks | Databricks SQL | Delta | Delta Lake | Docker | Git | Google Cloud | Google Cloud Dataflow | Google Cloud Dataproc | HDFS | Hadoop | Hadoop YARN | Hive | Iceberg | Kubernetes | MongoDB | ORC | Parquet | PySpark | Python | REST APIs | Redshift | SQL | Snowflake | Spark SQL | Spark Streaming | Synapse Analytics | Version control | YARN
Related jobs
-
Software Engineer II - Data Platform CAD 103K-129KAirflow | Artificial Intelligence | BigQuery | DBT | DockerDental coverage | LinkedIn Learning access | Medical coverage | Paid Company Holidays | Paid sick leaveMid-level Full TimeCanada (Remote) R6h ago
-
Senior Data Engineer, Fixed Term - Toronto CAD 70K-80KAWS | Airflow | Azure | Cloud Computing | DBTBiweekly breakfasts and lunches | Buddy program | Charity volunteering days | Free snacks | Hybrid working policySenior-level TemporaryToronto Canada R12h ago
-
AI Safety | API Development | AWS | Agentic Systems | Amazon Web ServicesSenior-level Full TimeRemote, Canada R16h ago
-
.NET | AI Evaluation | AWS | Artificial Intelligence | AzureContinuous learning | Dental insurance | Flexible work arrangements | Health insurance | Inclusive cultureSenior-level Full TimeCanada18h ago
-
Data Governance | Data Modeling | Data Preparation | Data Quality | ETLFlexible work environment | TeleworkMid-level Full TimeSherbrooke, Canada R21h ago
-
Data Platform DevOps Engineer - Senior Consultant CAD 80K-138KAWS | Access Controls | Alerting | Azure | Azure DevOpsDeloitte Days | Development and Innovation Days | Flexible benefit spending account | Flexible work arrangements | Hybrid work arrangementSenior-level Full TimeToronto, ON, CA, M5H 0A91d ago
-
AI Research Engineer CAD 72K-138KAccelerate | Autogen | Benchmarking | DeepSpeed | DevOpsDeloitte Days | Flexible benefit spending account | Flexible work arrangements | Hybrid work structure | Learning daysMid-level Full TimeToronto, ON, CA, M5H 0A91d ago
-
GenAI & Python Specialist - Operate CAD 72K-125KAPI Development | Agent systems | Claude | Clustering | EmbeddingsFlexible work arrangements | Hybrid work arrangement | Learning days | Paid vacation daysMid-level Full TimeToronto, ON, CA, M5H 0A91d ago
-
Data Engineer (MS Fabric / Databricks) - Consultant CAD 58K-102KADLS | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible work arrangements | Hybrid work structure | Learning development and innovation days | Mental health support benefits | MentoringMid-level Full TimeToronto, ON, CA, M5H 0A91d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible spending account | Flexible work arrangements | Hybrid work arrangement | Learning days | Mental health support benefitsSenior-level Full TimeToronto, ON, CA, M5H 0A91d ago
-
Principle Data Engineer CAD 115K-125KAirflow | Dagster | Data Governance | Data Modeling | Data PrivacyCareer growth opportunities | Flexible work arrangementsMid-level Full TimeLondon, Ontario1d ago
-
AWS Glue | AWS Lambda | Agentic AI | Amazon Redshift | Amazon Simple Storage ServiceContinuous learning | Flexible hours | Pension | Savings programs | Stock optionsSenior-level Full TimeSun Life Toronto Atria, Canada1d ago
-
Senior Machine Learning Engineer, Personalization CAD 156K-222KA/B | A/B Testing | B testing | CI/CD | DatabricksSenior-level Full TimeRemote - Canada R1d ago
-
Expert, AI & Data Science CAD 64K-106KAWS | Agile | Apache Spark | Azure | DatabricksCareer growth opportunities | Paid trainingSenior-level Full TimeMontreal Est, Quebec, Canada; Montreal1d ago
-
Executive-level Full Time5900 HURONTARIO STREET MISSISSAUGA, Canada1d ago
-
Lead Phyton and Generative AI Engineer- Vice President CAD 120K-170KAIOps | API Development | Agile Development | Application Monitoring | CI/CDSenior-level Full Time5900 HURONTARIO STREET MISSISSAUGA, Canada1d ago
-
Senior AI Software Engineer CAD 132K-188KAWS | Azure | CI/CD | Deep learning | Distributed TrainingEnhanced paid parental leave | Flexible time off | Flexible work hours | Free snacks and drinks | Health, Vision, Dental, Life InsuranceSenior-level Full TimeToronto1d ago
-
Inference Optimization Engineer USD 194K-286KASIC | Cloud Computing | Distributed Systems | GPU Programming | Kubernetes401k matching | Flexible paid time off | Health insurance | Remote work | Team meetupsMid-level Full TimeUnited States / Canada1d ago
-
Embedded Software Developer CAD 94K-115KApplication Layer Protocols | Application-layer | C plus plus | C# | FirewallCritical illness insurance | Dental insurance | Disability insurance | Employee assistance program | Health insuranceMid-level Full TimeBurnaby, BC, Canada1d ago
-
AI Engineer USD 165K-240KAPI Design | AWS | Agentic Workflows | Asynchronous processing | BM25401k enrollment | Gym membership stipend | Health coverage | Hybrid work environment | Paid HolidaysSenior-level Full TimeNew York1d ago
-
Co-op Engineer - AI Software Engineering CAD 58K-104KAgent Orchestration | Architectural refactoring | Automated testing | Autonomous Agents | C++Mid-level Full TimeMarkham, Ontario, Canada1d ago
-
Data Architect (BigQuery / GCP) CAD 90K-130KAirflow | Audit Logging | BigQuery | BigQuery ML | CI/CDHybrid work environment | Professional growth | Supportive work environmentSenior-level Full TimeToronto, ON, Canada R1d ago
-
Lead, Finance Analytics & Enablement AI/ML CAD 400K-500KAmplitude | Automation frameworks | Business Intelligence | Cloud platform | Cost OptimizationCo-working access | HSA | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeToronto - Remote R1d ago
-
Amplitude | Data Governance | Data Pipelines | Data Reconciliation | Data WarehousingCo-working space access | Health insurance coverage | Health savings account | Life insurance coverage | Long-term disabilitySenior-level Full TimeMontréal - Remote R1d ago
-
Developer, Data Science CAD 90K-120KAirflow | Apache Beam | Apache Spark | CI/CD | Cloud ComposerHybrid work | Wellbeing supportMid-level Full TimeToronto, ON, CA1d ago