Sr. Software Engineer (Python + PySpark + Java)
Tasks
- Align solutions with stakeholders
- Assess data systems for discrepancies variances and performance
- Conduct code reviews and establish coding standards
- Create technical design documentation
- Deliver projects on time and meet quality expectations
- Design implement and maintain cloud based pipelines
- Develop data coding best practices
- Estimate effort and support project planning
- Evaluate data systems and identify improvement opportunities
- Handle critical production incidents
- Identify area level risks and implement mitigations
- Perform root cause analysis and maintain operational runbooks
- Prepare functional and design specifications
- Propose technical and functional improvements
- Report readiness and quality status and escalate issues
- Translate business drivers into data products
- Troubleshoot and optimize data infrastructure and pipelines
- Update and optimize local and metadata models
Perks/Benefits
- Company-Paid Holidays
- Disability insurance
- Employee assistance program
- Life insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
AWS | Apache Flink | Apache Hadoop | Apache Spark | Cause analysis | Code review | Docker | Hadoop Ecosystem | Java | Kubernetes | OOP | ORC | Parquet | Production Support | PySpark | Python | Root Cause Analysis | Root cause | Stream processing
Education
N/A
Regions
Countries
States
Related jobs
-
Développeur(se) Backend Sénior, Systèmes d’inférence ML / Senior Backend Engineer, ML Inference Systems CAD 135K-187KCI/CD | Docker | GCP | Go | GolangDisability insurance | Employee assistance program | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeMontreal, Canada10h ago
-
Senior ML Engineer USD 152K-228KAmazon SageMaker | Baseten | Batching | CI/CD | Google Vertex401k matching | Dental insurance | Fertility assistance | Flexible time off | Health insuranceSenior-level Full TimeRemote - US & Canada (see … R11h ago
-
AI Software Engineer USD 181K-270KAWS | CI/CD | Docker | Edge Functions | GitHub CopilotComprehensive benefits | Equity | Learning stipend | Remote-first cultureSenior-level Full TimeUnited States or Canada R1d ago
-
AI Architect CAD 120K-140K.Net Core | API Integration | AWS | Autogen | AzureDeferred profit-sharing | Dental insurance | Health insurance | Hybrid work | Paid time offSenior-level Full TimeRemote (Canada) with optional hybrid work … R1d ago
-
Senior AI Engineer, Business Intelligence CAD 92K-130KAPI Development | Apache Spark | Azure | Batch Data Processing | Batch dataDefined benefits pension plan | Employee resource groups membership | Experimentation oriented culture | Flexible work schedules | Hybrid work environmentSenior-level Full TimeToronto (36.25), Canada1d ago
-
Data Engineer USD 80K-105KABAC | Audit Logging | Azure Bicep | Azure Data | Azure Data FactoryHealth and wellness programs | Paid annual leave | Retirement plans | Tuition reimbursement | Work from home optionsMid-level Full TimeHalifax, NS, Canada1d ago
-
Data Engineer I CAD 70K-85KAWS | Azure | CI/CD | Data Ingestion | Data ModelingCareer advancement | Employee stock purchase plan | Health benefits medical dental | Hybrid work option | Long-term disabilityMid-level Full TimeEdmonton, AB, CA, Canada1d ago
-
GenAI Strats - Fixed Income (Hybrid) CAD 129K-170KAPI Development | Automation | Data integration | Docker | Generative AIEmployee support | Health and wellness benefits | Hybrid work environmentSenior-level Full TimeMontreal 700, Canada R1d ago
-
Analytics Engineer CAD 86K-108KAWS | Agile | Azure | DBT | Data AnalysisComprehensive benefits | Growth opportunities | Training programMid-level Full TimeKitchener, Canada1d ago
-
Senior Staff Data Engineer - Platform Data and Analytics CAD 228K-313KAWS | Alerting | Apache Airflow | Apache Spark | Batch ProcessingComprehensive benefits | Equity | Hybrid work flexibility | Remote work up to 4 weeks per yearSenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON R1d ago
-
Data Engineer CAD 73K-122KCloud Computing | Dashboard Development | Data Ingestion | Data Lakes | Data ModelingCultural Holiday Observance Days | December Holiday Shutdown | Dental insurance | Flexible-hybrid work | Gym accessMid-level Full TimeToronto, ON, CAN1d ago
-
AWS | Apache Airflow | Compliance | Dagster | Data GovernanceCompany holiday shutdown | Equity stock options | Health, dental and vision coverage | Meal support | Mental health supportSenior-level Full TimeCanada2d ago
-
AI Agents | AI Governance | Access Control | Azure OpenAI | Azure SecurityCertification support | Collaborative innovation driven culture | Continuous learning opportunities | Employer-paid medical premiums | Exposure to enterprise AI deploymentsMid-level Full TimeCanada R2d ago
-
Data Engineer CAD 117K-141KAWS ECS | AWS Glue | AWS Lambda | Anomaly Detection | Apache SparkAutonomy on projects | Career advancement opportunities | Job stability | Positive impact for customers and communities | Professional growth opportunitiesMid-level Full Time100 New Park Place 500,Vaughan,ON, Canada2d ago
-
AWS | AWS Glue | AWS IAM | AWS Lake Formation | AWS LambdaHybrid workSenior-level Full TimeSt. John's - 18 Hebron Way, …2d ago
-
Mid-level Full TimeAMER - Canada - Ontario - …2d ago
-
Data Engineer CAD 70K-80KAPIs | Airflow | Attribution windows | BigQuery | Campaign ManagerDental insurance | Medical insurance | Paid time off | RRSP matchingMid-level Full TimeToronto - 1 University, Canada2d ago
-
AI/ML Engineer - (Python/RAG) CAD 76K-115KAgentic Frameworks | Algorithms | Anthropic Claude | Context Management | Data StructuresCompany-Paid Holidays | Employee assistance programs | Life and disability insurance | Medical, dental, and vision coverage | Paid time offMid-level Full TimeToronto, CA2d ago
-
Senior Analytics Developer CAD 83K-125KBatch Processing | DBT | Data Cataloging | Data Governance | Data ModelingDisability insurance | Health insurance | Life insurance | Paid Holidays | Paid time offSenior-level Full TimeKanata 307 Legget Dr., Canada2d ago
-
Senior Data Engineer USD 110K-140KAPI Integration | Alerting | Data Governance | Data Modeling | Data QualityCareer development opportunities | Equity program participation | Health benefits | Hybrid flexibility | Paid parental leaveSenior-level Full TimeCambridge, Ontario, Canada2d ago
-
Apache Airflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeDiscounts on company products | Employee assistance program | Employee share ownership plan | Employer sponsored group insurance | Flexible work environmentMid-level Full TimeHead Office - Canadian Division (35), …2d ago
-
Senior-level Full TimeRemote Canada (ON) R2d ago
-
Staff AI Engineer CAD 140K-174KAPI Design | API Gateway | AWS Lambda | AWS Step Functions | Agent OrchestrationSenior-level Full TimeCanada2d ago
-
Staff Engineer, Machine Learning Platform CAD 208K-312KAWS | Agent Orchestration | Agent systems | Amazon Bedrock | Amazon SageMakerCompany bonus | Equity | Health benefits | Retirement plans | Wellness stipendsSenior-level Full TimeToronto2d ago
-
Lead AI Engineer, NLQ & Agentic Systems CAD 179K-302KAI orchestration | Agentic Systems | Data Engineering | LLM Evaluation | Language ModelsSenior-level Full TimeToronto, Ontario, Canada2d ago