Data Engineer (PySpark)
Tasks
- Analyze complex system and business problems
- Consult with clients and technology teams
- Define operating standards and procedures
- Design data processing pipelines
- Develop and manage distributed data processing jobs
- Develop and test data applications
- Implement data solutions
- Monitor development lifecycle
- Optimize spark performance
- Provide user and operational support
- Recommend programming solutions
- Recommend system and application security measures
Perks/Benefits
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision insurance
- Paid time off
- Retirement savings plan
Skills/Tech-stack
Apache Hadoop | Apache Spark | Cassandra | Data Modeling | Data Security | Dimensional Modeling | HBase | HDFS | MapReduce | MongoDB | NumPy | Pandas | Performance Tuning | PySpark | Python | SQL | Snowflake Schema | Spark GraphX | Spark SQL | Spark Streaming | Star Schema | YARN | Zookeeper
Education
N/A
Roles
Related jobs
-
Data Science & AI CAD 71K-106KApache Spark | Backtesting | Calibration | Cross-validation | Data GovernanceDental insurance | Disability insurance | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeDorval, Québec, CA, H4S 1Y9 R7h ago
-
CUDA | DVC | Distributed Systems | FastAPI | Feature StoreEmployee resource groups | Employer Matched Savings Program | Equity compensation | Flexible sick days | Health benefitsSenior-level Full TimeCanada R10h ago
-
Senior Software Engineer, Datastores (Auth0) CAD 136K-187KAmazon DynamoDB | Amazon Web Services | CI/CD | Go | KubernetesDental insurance | Health insurance | Healthcare spending account | Paid leave | Paid time offSenior-level Full TimeToronto, Ontario, Canada R13h ago
-
Junior Analytics Engineer CAD 50K-65KAirflow | Automated testing | CTE | DBT | Data ModelingFlexible PTO policy | Health benefits | Professional learning and development | Remote-first work environmentEntry-level Full TimeCanada R18h ago
-
Data Science Manager, Risk CAD 90K-130KData Pipelines | Decision Tree | Feature Engineering | Loss forecasting | Machine LearningContinuing education stipend | Generous time off | Health and Wellness Spending Accounts | Hybrid work environment | Medical/Dental/Vision insuranceMid-level Full TimeToronto, Ontario R18h ago
-
Senior AI/ML Software Engineer CAD 150K-180KAPI Security | AWS | Agile | Apache Spark | Data Pipelines401k | Dental insurance | Discretionary time off | Health insurance | Life insuranceSenior-level Full TimeRemote - Canada R19h ago
-
AI/ML Software Engineer CAD 128K-158KAPI Security | AWS | Agile | Apache Spark | Authentication401k | Dental insurance | Discretionary time off | Health insurance | Life insuranceMid-level Full TimeRemote - Canada R19h ago
-
Staff Software Engineer, Product Risk CAD 172K-220KAmazon Web Services | Apache Airflow | Apache Flink | Apache Hive | Apache Hive MetastoreSenior-level Full TimeToronto21h ago
-
Machine Learning Engineer II (Underwriting ML) CAD 133K-183KAirflow | Backtesting | CatBoost | Classification | DaskDental coverage | Employee stock purchase plan | Flexible spending accounts | Remote work | Subsidized medical coverageMid-level Full TimeRemote Canada R22h ago
-
Research Software Engineer (hybrid Montreal) CAD 150K-189KBGP | DNS | Go | HTTP | HTTPSHybrid work environmentSenior-level Full TimeOld Montreal, Canada23h ago
-
AI Solutions Engineer CAD 85K-114KAPI Integration | ChatGPT | Claude | CrewAI | Data PipelinesEmployee discounts | Group benefits | Paid time off | RRSP matchMid-level Full TimeHybrid- Toronto, ON R23h ago
-
Mid-level Full TimeMontréal, Canada23h ago
-
Senior Machine Learning Engineer CAD 140K-180KA/B | A/B Testing | Apache Spark | B testing | Cloud platformFinancial benefits | Medical benefitsSenior-level Full TimeMovable Ink - Toronto (Remote) R1d ago
-
Applied Intuition | Applied Intuition Simian | C++ | CI/CD | CMakeHybrid work | Medical/Dental/Vision insurance | Personal days | RRSP program | Sick daysMid-level Full TimeMontréal, QC, Canada R1d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Glue Catalog | AWS LakeCompetitive contract compensation | Flexible work schedule | Fully remote work | Technical autonomySenior-level Contract Full TimeCanada R1d ago
-
AlloyDB | Backup and Restore | Bash | CDC | Cloud BigtableLarge scale transformation projects | Professional growth opportunities | Remote work flexibilitySenior-level Full TimeCanada R1d ago
-
DBT | Data Governance | Data Lineage | Data Modeling | Data PipelinesProfessional development | Reasonable accommodations during hiring and employment | Remote work flexibility within Canada | Supportive learning culture | Work Eastern Time hoursMid-level Full TimeCanada1d ago
-
AI Agents | Alerting | C# | Event Driven | Event-driven architectureContinuous learning | Fully remote work | Professional growthMid-level Full TimeCanada R1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Services | Azure SynapseContract opportunity | Fully remote CanadaMid-level Contract Full TimeCanada R1d ago
-
Data Engineer CAD 108K-135KAmazon S3 | Apache Airflow | Apache Hadoop | Apache Hive | Apache SparkChild care benefits | Disability benefits | Family building benefits | Health and dental insurance | Health care savings accountMid-level Full TimeToronto, Canada R1d ago
-
GEN AI Specialist CAD 90K-100KAWS SageMaker | Azure AI | CUDA | ChromaDB | ClusteringCompany-Paid Holidays | Disability insurance | Employee assistance program | Health insurance | Life insuranceSenior-level Full TimeMontreal, CA1d ago
-
Data Engineer CAD 72K-80KApache Cassandra | Apache HBase | Apache Spark | Apache Zookeeper | Data WarehousingCompany-Paid Holidays | Employee assistance programs | Life and disability insurance | Medical, dental, and vision insurance | Paid time offMid-level Full TimeMississauga, CA R1d ago
-
Data Engineer (PySpark) CAD 80K-90KApache Zookeeper | Caching | Cassandra | Data Modeling | Data orchestrationCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical, dental, and vision coverage | Paid time offSenior-level Full TimeMississauga, CA1d ago
-
Data Platform Engineer CAD 80K-95KAWS Rekognition | AWS SageMaker | Azure Cognitive | Azure Cognitive Services | Azure DataEducation reimbursement | Employee discounts | Employee recognition programs | Employee resource groups | Health and dental benefitsMid-level Full TimeToronto, ON, CA1d ago
-
Software Engineer or Senior Software Engineer - Data Hub CAD 112K-168KAWS | AWS SageMaker | Amazon EMR | Apache Hive | Apache IcebergSenior-level Full TimeCanada, ON, Toronto1d ago