Big Data Developer
Tasks
- Collaborate with fraud risk compliance and downstream application teams
- Design realtime and batch fraud analytics data pipelines
- Develop ETL workflows for customer transaction and risk datasets
- Ensure data quality traceability and audit readiness
- Generate alert data and support downstream analytics and investigations
- Monitor and troubleshoot production data pipelines
- Optimize pipeline performance for low latency fraud use cases
- Process streaming transaction data using Apache Spark and Kafka
Perks/Benefits
- Company holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Retirement savings plan
Skills/Tech-stack
Airflow | Amazon Web Services | Apache Spark | Azure | Cassandra | HBase | HDFS | Hadoop | Hive | Java | Kafka | Linux | MongoDB | Oozie | Python | SQL | Scala | Unix | Web Services
Education
N/A
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
Senior Software Engineer, MLOps CAD 175K-220KAgile | Airflow | Batch Processing | DBT | Data PipelinesCharitable donation match | Flexible time off | Medical/Dental/Vision | Paid parental leave | Professional development budgetSenior-level Full TimeRemote - Alberta, Canada R16h ago
-
Analytics Lead, Full Stack CAD 145K-205KAI | Excel | Python | SQL | SigmaDental insurance | ESPP | Flexible spending accounts | Health insurance | Remote workSenior-level Full TimeRemote Canada R18h ago
-
Algorithms | Data Structures | Database systems | Distributed Systems | ESQLDonation matching | Flexible schedule | Health coverage | Parental leave | Vacation timeSenior-level Full TimeCanada R19h ago
-
Algorithms | Concurrency | Continuous integration | Data Structures | Database systemsDonation matching | Employee well-being programs | Flexible schedule | Fully remote | Health coverageSenior-level Full TimeCanada R19h ago
-
Machine Learning Engineer - (Computer Vision) CAD 100K-149KAWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | BiometricsMid-level Full TimeMontreal19h ago
-
Algorithms | Concurrency | Data Structures | Distributed Systems | ESQLDonation matching | Generous vacation days | Health coverage | Parental leave | Remote work flexibilitySenior-level Full TimeCanada R20h ago
-
Algorithms | Concurrency | Data Structures | Elasticsearch | IndexingCompany-matched retirement plan | Donation matching | Flexible schedule | Health coverage | Parental leaveSenior-level Full TimeCanada R20h ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami20h ago
-
Senior Database Reliability Engineer CAD 120K-160KAWS | Apache Iceberg | Blue-Green Deployment | Blue/green | BlueGreen RolloutsSenior-level Full TimeMontreal, Canada22h ago
-
Airflow | Autogen | ClickHouse | CrewAI | DagsterAnnual performance bonus | Equipment support | Flexible working hours | Gifts and rewards | Lunch allowanceSenior-level Full TimeCanada R23h ago
-
Alerting | Amazon Aurora | Amazon Redshift | Batch Processing | CI/CDFully remote work | Ownership of data reliability strategySenior-level Full TimeCanada R1d ago
-
Data Engineer CAD 70K-75KAirflow | Amazon Redshift | Amazon S3 | Apache Kafka | Apache SparkCareer progression | Comprehensive benefits plan | Flexible workplace | Referral bonus opportunity | Successful referral programSenior-level Full TimeMarkham, ON, Canada1d ago
-
Agentic AI | Backend Engineering | Cloud Computing | Deployment | Generative AIAnnual bonus programs | Equity incentives | Health wellness and retirement benefits | Paid leave | Professional development budgetSenior-level Full TimeCanada R1d ago
-
Embedded Software Co-Op CAD 50K-86KC# | C++ | Debugging | Embedded Systems | EthernetContinuous learning opportunities | Lunch and Learn events | Professional networking | Social events for interns | Work-life balanceEntry-level Full TimeCanada, Vancouver1d ago
-
Senior Cloud / AI Developer – Train Control , OT CAD 80K-131KAI Governance | APIs | Access Management | Amazon Web Services | AzurePaid trainingSenior-level Full TimeMontreal Est, Quebec, Canada; Montreal1d ago
-
DataOps & AI Engineer CAD 80K-100KAccess Management | Automation | Azure | Databricks | ETLHealth and wellness programs | Medical plans | Paid annual leave | Retirement plans | Tuition reimbursementMid-level Full TimeHalifax, NS, Canada1d ago
-
AI Scientist & Engineer, Assurance Innovation Lab CAD 110K-160KAI Risk Management Framework | AI Studio | AWS Bedrock | Agent systems | AnthropicMid-level Full TimeToronto - Bay St, Canada1d ago
-
AI Developer CAD 95KAgentic Workflows | Authentication | CI/CD | Docker | FastAPIHybrid work | Inclusive culture | Professional development opportunitiesMid-level Full TimeToronto - Bremner, Canada R1d ago
-
Student, Associate Data Engineer (Fall 2026) CAD 80K-128KAWS Cloud | AWS Glue | AWS Lambda | AWS Step Functions | BitbucketHybrid work | Professional development workshops | Social events | Student awards | Student cultureMid-level Full TimeSun Life Toronto One York, Canada1d ago
-
Senior Machine Learning Engineer CAD 150K-200KAI Search | AWS | AWS Bedrock | Agentic Workflows | AirflowConference budget | Enterprise support | Training budgetSenior-level Full TimeToronto, ON, CA1d ago
-
Agile | Azure | CI/CD | CSS | Data ModelingAgile environment | Flexible location | Hybrid work | Safe environmentSenior-level Full TimeMontreal, Quebec, Canada1d ago
-
Senior Software Engineer - Canada CAD 120K-150KApache Cassandra | Apache Flink | Apache Hadoop | Apache Kafka | Apache SparkAccidental insurance | Canada Life Policy | Dental care | Extended health care | Health insuranceSenior-level Full TimeCalgary, Alberta, Canada - Remote R1d ago
-
GenAI Engineer CAD 135K-170KA/B | A/B Testing | B testing | Cost Optimization | ExperimentationCareer development opportunitiesSenior-level Full TimeCanada - Remote R2d ago
-
Acceptance Testing | Agile | Azure Blob | Azure Blob Storage | Azure DataSenior-level Full TimeToronto, ON, Canada2d ago
-
Acceptance Testing | Agile | Azure Blob | Azure Blob Storage | Azure DataSenior-level Full TimeToronto, ON, Canada2d ago