Big Data Developer
Tasks
- Collaborate with fraud risk compliance and downstream application teams
- Design realtime and batch fraud analytics data pipelines
- Develop ETL workflows for customer transaction and risk datasets
- Ensure data quality traceability and audit readiness
- Generate alert data and support downstream analytics and investigations
- Monitor and troubleshoot production data pipelines
- Optimize pipeline performance for low latency fraud use cases
- Process streaming transaction data using Apache Spark and Kafka
Perks/Benefits
- Company holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Retirement savings plan
Skills/Tech-stack
Airflow | Amazon Web Services | Apache Spark | Azure | Cassandra | HBase | HDFS | Hadoop | Hive | Java | Kafka | Linux | MongoDB | Oozie | Python | SQL | Scala | Unix | Web Services
Education
N/A
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
AWS | Azure | CI/CD | DevOps | Distributed SystemsAccident insurance | Career progression | Collaborative work environment | Continuous learning support | Health insuranceSenior-level Full TimeCanada4h ago
-
Authentication | Automotive Ethernet | Bluetooth | CAN | CAN-FDHybrid work | Medical/Dental/Vision insurance | Personal days | RRSP program | Recreation roomSenior-level Full TimeMontréal, QC, Canada10h ago
-
Senior Software Engineer I — Agentic Analytics USD 168K-177KAirflow | Cost Optimization | DBT | Evaluation Frameworks | Machine LearningAnnual equity refresh grants | Equity grant | Flex First work policy | In-person events | Remote workSenior-level Full TimeCanada - Remote (ON, AB, BC, … R17h ago
-
Senior Data Engineer USD 120K-144KAI tools | AWS | Apache Kafka | Apache Spark | AzureOccasional business travel | Remote workSenior-level Full TimeMarkham19h ago
-
Data Engineer I USD 120K-140KAWS | Apache Kafka | Data Governance | Data Modeling | DatabricksOccasional business trips | Remote workMid-level Full TimeMarkham19h ago
-
AWS | Apache Spark | Data Analysis | Data Architecture | Data GovernanceHybrid work flexibilitySenior-level Full TimeToronto, Ontario20h ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon DynamoDBSenior-level Full TimeVancouver, British Columbia, Canada20h ago
-
AWS EC2 | AWS EMR | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeToronto, Ontario, Canada20h ago
-
Research Engineer - LLM Training & Alignment Systems CAD 127K-225KAutomation | Benchmarking | C# | C++ | Data CurationMid-level Contract Full TimeKingston, Ontario, Canada21h ago
-
Software Engineer, ML Data Infrastructure USD 160K-220KAlgorithms | Cloud platform | Data Pipelines | Data Processing | Data StorageAccess to compute resources | Dental insurance | Health insurance | In-office meals | Learning and mentorshipEntry-level Full TimeToronto1d ago
-
Full Stack AI Engineer / Applied AI Engineer CAD 109K-142KAPI Design | AWS | Agentic Systems | Anthropic | AzureDental | Medical | PTO | Professional development | VisionMid-level Full TimeMontreal1d ago
-
Co-op/Intern Developer, AI Solutions CAD 54K-79KArgo CD | Argo Workflows | Azure | CI/CD | Cloud platformFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Physical and mental well-being programsEntry-level InternshipOttawa, ON, Canada1d ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon DynamoDBSenior-level Full TimeCanada - Remote R1d ago
-
AWS | CI/CD | Dask | Distributed Systems | DynamoDBSenior-level Full TimeCanada - Remote R1d ago
-
AWS | AWS Glue | Amazon EMR | Apache Kafka | CI/CDSenior-level Full TimeCanada - Remote R1d ago
-
Agile | Azure | Data Quality | DataOps | DatabricksHealth benefits | Hybrid work flexibility | Retirement benefits | Work-life balanceSenior-level Full TimeOttawa (centre-ville), ON, CA R1d ago
-
Machine Learning Engineer CAD 80K-93KAWS QuickSight | Algorithms | Artificial Intelligence | C plus plus | Cloud ComputingMid-level Full Time333 MARKET DRIVE,L9T 4Z7,MILTON,CA, Canada1d ago
-
Senior Data Engineer CAD 120K-145KARM Templates | Apache Airflow | Apache Spark | Azure | Azure DataEmployee assistance program | Enhanced parental leave | Family assistance program | Flex Time | Group RRSPSenior-level Full TimeMontreal - 8585 Cote-De-Liesse, QC, Canada1d ago
-
Data Engineer- ETL/Python/Pyspark CAD 65K-142KData Infrastructure | Data Modeling | ETL | PySpark | PythonCompany holidays | Dental insurance | Disability insurance | Employee assistance program | Life insuranceEntry-level Full TimeMississauga, CA1d ago
-
AWS | AWS SageMaker | Azure | Bash | CI/CDHybrid workEntry-level Full Time InternshipCanada Pharma Campus1d ago
-
APIs | Async | Demand forecasting | Economic Order Quantity | GenAI401k RRSP Enrollment | Dental coverage | Healthcare | Paid time off | Remote workSenior-level Full TimeCanada (Remote) R1d ago
-
AI scientist pre-sales CAD 80K-100KArtificial Intelligence | Computer Vision | Data Pipelines | Deep learning | Language ModelsAnnual physical activity allowance | Flexible schedule | Health insurance | Hybrid work | Internet stipendMid-level Full TimeMontréal, Quebec, Canada; Québec, Quebec, Canada1d ago
-
Staff Embedded Software Developer CAD 133K-163KC# | C++ | Git | Golang | LinuxCompany retirement plan match | Critical illness insurance | Dental insurance | Disability insurance | Employee & family assistance planSenior-level Full TimeBurnaby, BC, Canada1d ago
-
AI Software Engineer CAD 85K-120KAPIs | Distributed Systems | Git | Guardrails | HadoopCareer development | Dental insurance | Employee assistance program | Flexible Fridays | Health insuranceMid-level Full TimeOttawa, Canada R1d ago
-
Junior AI Software Engineer CAD 65K-75KGit | Hadoop | Java | JavaScript | LangchainCareer development | Dental benefits | Employee assistance program | Flex Fridays | Health benefitsEntry-level Full TimeOttawa, Canada R1d ago