Big Data Developer
Tasks
- Collaborate with fraud risk compliance and downstream application teams
- Design realtime and batch fraud analytics data pipelines
- Develop ETL workflows for customer transaction and risk datasets
- Ensure data quality traceability and audit readiness
- Generate alert data and support downstream analytics and investigations
- Monitor and troubleshoot production data pipelines
- Optimize pipeline performance for low latency fraud use cases
- Process streaming transaction data using Apache Spark and Kafka
Perks/Benefits
- Company holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Retirement savings plan
Skills/Tech-stack
Airflow | Amazon Web Services | Apache Spark | Azure | Cassandra | HBase | HDFS | Hadoop | Hive | Java | Kafka | Linux | MongoDB | Oozie | Python | SQL | Scala | Unix | Web Services
Education
N/A
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
AWS | Azure | CI/CD | DevOps | Distributed SystemsAccident insurance | Career progression | Collaborative work environment | Continuous learning support | Health insuranceSenior-level Full TimeCanada3h ago
-
Senior Software Engineer I — Agentic Analytics USD 168K-177KAirflow | Cost Optimization | DBT | Evaluation Frameworks | Machine LearningAnnual equity refresh grants | Equity grant | Flex First work policy | In-person events | Remote workSenior-level Full TimeCanada - Remote (ON, AB, BC, … R15h ago
-
AWS | Apache Spark | Data Analysis | Data Architecture | Data GovernanceHybrid work flexibilitySenior-level Full TimeToronto, Ontario18h ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon DynamoDBSenior-level Full TimeVancouver, British Columbia, Canada19h ago
-
AWS EC2 | AWS EMR | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeToronto, Ontario, Canada19h ago
-
Research Engineer - LLM Training & Alignment Systems CAD 127K-225KAutomation | Benchmarking | C# | C++ | Data CurationMid-level Contract Full TimeKingston, Ontario, Canada20h ago
-
Software Engineer, ML Data Infrastructure USD 160K-220KAlgorithms | Cloud platform | Data Pipelines | Data Processing | Data StorageAccess to compute resources | Dental insurance | Health insurance | In-office meals | Learning and mentorshipEntry-level Full TimeToronto1d ago
-
Full Stack AI Engineer / Applied AI Engineer CAD 109K-142KAPI Design | AWS | Agentic Systems | Anthropic | AzureDental | Medical | PTO | Professional development | VisionMid-level Full TimeMontreal1d ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon DynamoDBSenior-level Full TimeCanada - Remote R1d ago
-
AWS | CI/CD | Dask | Distributed Systems | DynamoDBSenior-level Full TimeCanada - Remote R1d ago
-
AWS | AWS Glue | Amazon EMR | Apache Kafka | CI/CDSenior-level Full TimeCanada - Remote R1d ago
-
Agile | Azure | Data Quality | DataOps | DatabricksHealth benefits | Hybrid work flexibility | Retirement benefits | Work-life balanceSenior-level Full TimeOttawa (centre-ville), ON, CA R1d ago
-
Machine Learning Engineer CAD 80K-93KAWS QuickSight | Algorithms | Artificial Intelligence | C plus plus | Cloud ComputingMid-level Full Time333 MARKET DRIVE,L9T 4Z7,MILTON,CA, Canada1d ago
-
Senior Data Engineer CAD 120K-145KARM Templates | Apache Airflow | Apache Spark | Azure | Azure DataEmployee assistance program | Enhanced parental leave | Family assistance program | Flex Time | Group RRSPSenior-level Full TimeMontreal - 8585 Cote-De-Liesse, QC, Canada1d ago
-
Data Engineer- ETL/Python/Pyspark CAD 65K-142KData Infrastructure | Data Modeling | ETL | PySpark | PythonCompany holidays | Dental insurance | Disability insurance | Employee assistance program | Life insuranceEntry-level Full TimeMississauga, CA1d ago
-
APIs | Async | Demand forecasting | Economic Order Quantity | GenAI401k RRSP Enrollment | Dental coverage | Healthcare | Paid time off | Remote workSenior-level Full TimeCanada (Remote) R1d ago
-
AI scientist pre-sales CAD 80K-100KArtificial Intelligence | Computer Vision | Data Pipelines | Deep learning | Language ModelsAnnual physical activity allowance | Flexible schedule | Health insurance | Hybrid work | Internet stipendMid-level Full TimeMontréal, Quebec, Canada; Québec, Quebec, Canada1d ago
-
Staff Embedded Software Developer CAD 133K-163KC# | C++ | Git | Golang | LinuxCompany retirement plan match | Critical illness insurance | Dental insurance | Disability insurance | Employee & family assistance planSenior-level Full TimeBurnaby, BC, Canada1d ago
-
AI Software Engineer CAD 85K-120KAPIs | Distributed Systems | Git | Guardrails | HadoopCareer development | Dental insurance | Employee assistance program | Flexible Fridays | Health insuranceMid-level Full TimeOttawa, Canada R1d ago
-
Junior AI Software Engineer CAD 65K-75KGit | Hadoop | Java | JavaScript | LangchainCareer development | Dental benefits | Employee assistance program | Flex Fridays | Health benefitsEntry-level Full TimeOttawa, Canada R1d ago
-
Senior kdb+ Engineer CAD 118K-145KAI Tooling | AWS | Azure | Capital Markets | Electronic TradingFlexible working hours | Healthcare and wellbeing | Hybrid work | Increased holiday allowance | Leadership developmentSenior-level Full TimeToronto, ON, Canada1d ago
-
Senior DevOps - Data Platform Infrastructure CAD 120K-145KAlerting | CDC | CI/CD | Cost Management | DatabricksHybrid work | On-call rotationSenior-level Full TimeMontreal (Province of Quebec, Canada)1d ago
-
Application Resilience | Automated testing | Azure Data | Azure Data Factory | Azure Data LakeSenior-level ContractQuebec City, Canada1d ago
-
API Development | Cloud Storage | Cloud infrastructure | Containerization | Data FormatsAsynchronous collaboration | Career growth | Conference stipend | Hardware stipend | Professional learning stipendSenior-level Full TimeCanada R1d ago
-
Forward Deployed AI Engineer - Vancouver CAD 130K-180KAPIs | Analytics | Conversational AI | Dashboards | Docker20 days vacation | Competitive healthcare plan | Employee share options plan | Fertility and family forming programmes | Learning and development allowanceMid-level Full TimeVancouver1d ago