Sr. Software Engineer (Python + PySpark)
Tasks
- Assess data systems for discrepancies and performance issues
- Build and enhance data processing platforms
- Conduct code reviews and establish coding standards
- Design and maintain cloud-based data pipelines
- Develop data coding best practices
- Document solutions and perform root cause analysis
- Identify risks and implement mitigation plans
- Investigate design and implement solutions
- Provide effort estimations and contribute to project planning
- Translate analytical use cases into reliable data products
- Troubleshoot and optimize data infrastructure and pipelines
- Update and optimize local and metadata models
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
AWS | Apache Flink | Apache Spark | Cause analysis | Docker | Hadoop | Java | Kubernetes | Node.js | OOP | ORC | Parquet | PySpark | Python | Root Cause Analysis | Root cause | Runbooks | Technical design
Education
N/A
Regions
Countries
States
Related jobs
-
Senior Cloud Database Engineer CAD 116K-145KAWS | AWS Step Functions | Aurora | CI/CD | Database performanceDevelopment dollars stipend for professional growth | Flexible vacation time | Health insurance | Parental leave | Remote work supportSenior-level Full TimeToronto, Canada; Vancouver, Canada15h ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon S3Senior-level ContractToronto, Canada19h ago
-
Senior Data Engineer CAD 120K-144KAWS CloudFormation | Amazon Web Services | CI/CD | Data Modeling | DockerCertification programs | Health insurance | Internal mobility | Language courses | MentorshipSenior-level Full TimeOttawa, ON, Canada19h ago
-
Senior Data Engineer CAD 120K-144KAWS | CI/CD | CloudFormation | Data Ingestion | Data ModelingHealth insurance | Internal mobility | Internship opportunities | Language courses | MentorshipSenior-level Full TimeCalgary, AB, Canada19h ago
-
Entry-level ContractWillowdale East (Newtonbrook), Canada20h ago
-
Claude | Copilot | Excel | Microsoft 365 | Microsoft PowerPointMental health support | Volunteer days | Work from home optionEntry-level Full Time InternshipCA Victoria, Canada1d ago
-
Associate Applied AI Engineer – GenAI Systems CAD 69K-115KAPIs | Anomaly Detection | Backtesting | CI/CD | ClassificationHybrid work environment | Inclusion and Diversity support | Well-being supportMid-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …1d ago
-
Senior Analyst - Data Engineering CAD 75K-103KAWS EC2 | AWS S3 | Databricks | Git | JavaHybrid workSenior-level Full TimeToronto-York St, Canada1d ago
-
Data Engineer, Enterprise Data, Insights & Analytics CAD 64K-106KApache Spark | Azure | Azure DevOps | Azure DevOps Repos | Azure SynapseCareer growth opportunities | Continuing education programs | Mental health benefits | Performance incentives | Product DiscountsMid-level Full Time20 Eglinton West, Canada1d ago
-
AWS architecture | Amazon Bedrock | Amazon SageMaker | Data Analysis | DockerSenior-level Full TimeVancouver, British Columbia, CAN1d ago
-
Data Engineer CAD 75K-110KAzure | CI/CD | Data Modeling | Data Monitoring | Data QualityHealth benefits plan | Hybrid work model | Personal days | Training and development opportunities | Vacation timeEntry-level Full TimeToronto, ON, CA1d ago
-
Senior Data Analytics Engineer CAD 120K-145KBI Dashboards | CI/CD | Common table expressions | DBT | Data DocumentationCollaborative team environment | Global company | Remote-friendly work environmentSenior-level Full TimeRemote - Canada R1d ago
-
Senior Data Engineer CAD 120K-144KAWS | Amazon Web Services | CI/CD | CloudFormation | Data ModelingCertification programs | Health insurance | Internal mobility | Language courses | MentorshipSenior-level Full TimeToronto, ON, Canada1d ago
-
Senior Analytics Engineer | Canada | Remote CAD 129K-155KAWS | BigQuery | DBT | Data Cataloging | Data ModelingAnnual leave policy | Global culture | In-person onboarding | Remote workSenior-level Full TimeCanada (Remote) R1d ago
-
Associate AI Engineer CAD 60K-80KAWS | Agile | Docker | ETL | GCPDental insurance | Health insurance | Hybrid work | Learning and development | Vision insuranceMid-level Full TimeToronto, Ontario R1d ago
-
Staff MLOps Engineer | Ingénieur·e MLOps Staff CAD 115K-203KApache Airflow | Automation | CI/CD | Data Drift | Data VersioningTravel for workSenior-level Full TimeMontréal, QC, Canada1d ago
-
C++ | CPU | Deep learning | GPU | Game enginesSenior-level Full TimeMontreal, QC, Canada1d ago
-
API | Distributed Systems | Documentation | JAX | LibraryDental insurance | Health insurance | Hybrid work | Mental health stipend | Professional development stipendSenior-level Full TimeCanada1d ago
-
Access Control | Agile | Azure Data | Azure Data Factory | Azure Data LakeHybrid work | Potential permanent employmentSenior-level ContractToronto, Canada1d ago
-
API Integration | Automation | Data Modeling | Database performance | Database performance tuningCollaborative fast-paced culture | Flexible work location | Fully remote work | High-ownership environmentSenior-level Full TimeCanada R2d ago
-
Embedded Software Engineer CAD 96K-132KARM | Bash | C# | C++ | CVSDental insurance | EAP | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeToronto, ON, Canada2d ago
-
Airflow | Apache Spark | Azure | Azure Event | Azure Event HubsBackground check requirement | Competitive employee benefits | Employee resource groups membership | Flexible work schedules | Hybrid work environmentSenior-level Full TimeMontreal - MRC (Papineau) (36.25), Canada2d ago
-
Agile | Azure | Azure Machine Learning | CI/CD | Computer VisionEmployee Background Check Support | Employee resource groups membership | Flexible work schedule | Hybrid work environment | Mentorship opportunitiesSenior-level Full TimeMontreal - MRC (Papineau) (36.25), Canada2d ago
-
Engineer I - Front End, Data Visualization (Hybrid) CAD 105K-180KAWS | Accessibility | Ag Grid | AmCharts | AngularCompetitive vacation and holidays | Employee networks | Great Place to Work certified | Paid adoption leave | Paid parental leaveSenior-level Full TimeCAN ON Remote, Canada R2d ago
-
Data Engineer II CAD 81K-115KApache Spark | Azure Functions | Azure SQL | Data Lakehouse | DatabricksCareer development | Mentoring | Training and onboardingMid-level Full TimeTD Centre - South - 79 …2d ago