Ab Initio Developer (Big Data & Hadoop)
Tasks
- Analyze business requirements
- Build and maintain data pipelines for data lake
- Collaborate with architects, data engineers, and stakeholders
- Create project estimates
- Design develop test and support ETL solutions
- Develop reusable modular components
- Ensure application quality performance scalability
- Mentor junior developers
- Participate in agile scrum ceremonies
- Perform code reviews
- Perform performance tuning for ETL and big data
- Translate requirements to functional specifications
- Troubleshoot production issues
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
Ab Initio | Apache Hadoop | CI/CD | Data Lake | Data Modeling | Data Quality | Data pipeline | DevOps | ETL | Git | HBase | Hive | Java | Kafka | NoSQL | Oozie | Performance Tuning | Python | SQL | Scala | Shell Scripting | Spark | Sqoop | Zookeeper
Education
Related jobs
-
AI Agents | APIs | Cloud infrastructure | Governance | Language ModelsAccess to modern tools and innovation focused environment | Flexible remote work options | Holidays | Medical, dental, and vision coverage | Paid parental leaveSenior-level Full TimeCanada2h ago
-
Lead Machine Learning Engineer CAD 156K-251KAWS | Azure | CI/CD | Cloud Computing | Cloud platformAutonomy | Career development support | Learning and development programs | Mentorship and coachingSenior-level Full TimeToronto, Canada R9h ago
-
Principal AI Engineer CAD 214K-344KCI/CD | Container Orchestration | Docker | Fine Tuning | Information RetrievalInteractive career development tools | Learning and development programs | MentorshipSenior-level Full TimeToronto, Canada11h ago
-
Senior Machine Learning Engineer (Fraud) CAD 153K-213KAirflow | Apache Spark | Batch Processing | CatBoost | DaskDental coverage | Employee Stock Purchase Plan (ESPP) | Flexible spending wallets | Health coverage | Remote work optionSenior-level Full TimeRemote Canada R17h ago
-
AI Foundry | Agent systems | Anthropic Claude | Azure AI | Azure AI FoundryCaregiver leave | Continuous development support program | Employee assistance program | Flexible paid time off | Parental leaveMid-level Full TimeMississauga R17h ago
-
AWS SageMaker | Azure Machine Learning | CI/CD | Computer Vision | DockerBilingual work environmentMid-level Full TimeMontréal, Canada19h ago
-
Data Analysis | Data Automation | Excel | Experiment design | Financial ModelingDental coverage | Employee stock purchase plan | Flexible spending allowances | Healthcare coverage | Paid HolidaysSenior-level Full TimeCanada R1d ago
-
Data Engineering Consultant CAD 95K-109KAmazon Web Services | Apache Airflow | Apache Spark | Cloud platform | DatabricksCare days | Dental care | Extended health benefits | Health savings account | Paid vacation daysMid-level Full TimeToronto1d ago
-
Machine Learning Engineer (Platform) USD 156K-211KAWS | CPU Optimization | Data Processing | Data throughput | Distributed TrainingRemote workSenior-level Full TimeRemote-US R1d ago
-
Senior-level Full TimeToronto R1d ago
-
Angular | Automation Testing | CI/CD | Deep learning | DevOpsHybrid work scheduleSenior-level Full TimeMONTREAL, Canada1d ago
-
Senior Data Engineer CAD 90K-110KCost Optimization | Data Ingestion | Data Modeling | Data Transformation | Data pipelineAdditional paid time off option | Annual bonus eligibility | Career development opportunities | Corporate wellness programs | Employee driven diversity programsSenior-level Full TimeCanada - Markham ON 10 Aviva …1d ago
-
Mid-level Full TimeMississauga, CA1d ago
-
Senior Software Engineer (Data Engineering) CAD 140K-210KAWS | Apache Avro | Apache Flink | Apache Iceberg | Apache KafkaFlexible work schedule | Hybrid work model | On-call supportSenior-level Full TimeCanada, BC, Vancouver1d ago
-
Senior Software Engineer, MLOps CAD 175K-220KAgile | Airflow | Batch Processing | DBT | Data PipelinesCharitable donation match | Flexible time off | Medical/Dental/Vision | Paid parental leave | Professional development budgetSenior-level Full TimeRemote - Alberta, Canada R1d ago
-
Analytics Lead, Full Stack CAD 145K-205KAI | Excel | Python | SQL | SigmaDental insurance | ESPP | Flexible spending accounts | Health insurance | Remote workSenior-level Full TimeRemote Canada R1d ago
-
Machine Learning Engineer USD 156K-281KAirflow | Apache Spark | Data Drift | Data drift monitoring | Delta LakeSenior-level Full TimeMiami, FL; Toronto, Canada; Seattle, WA1d ago
-
Algorithms | Data Structures | Database systems | Distributed Systems | ESQLDonation matching | Flexible schedule | Health coverage | Parental leave | Vacation timeSenior-level Full TimeCanada R1d ago
-
Algorithms | Concurrency | Continuous integration | Data Structures | Database systemsDonation matching | Employee well-being programs | Flexible schedule | Fully remote | Health coverageSenior-level Full TimeCanada R1d ago
-
Machine Learning Engineer - (Computer Vision) CAD 100K-149KAWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | BiometricsMid-level Full TimeMontreal1d ago
-
Algorithms | Concurrency | Data Structures | Distributed Systems | ESQLDonation matching | Generous vacation days | Health coverage | Parental leave | Remote work flexibilitySenior-level Full TimeCanada R1d ago
-
Algorithms | Concurrency | Data Structures | Elasticsearch | IndexingCompany-matched retirement plan | Donation matching | Flexible schedule | Health coverage | Parental leaveSenior-level Full TimeCanada R1d ago
-
AI Solutions Engineer CAD 90K-110KAI Agents | API Integration | Alerting | Cause analysis | Content ManagementDental insurance | Employee discounts | Medical insurance | Paid time off | RRSP matchMid-level Full TimeHybrid- Toronto, ON R1d ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami1d ago
-
Data Engineer CAD 82K-123KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeToronto, ON, CA1d ago