Senior Data Engineer (Databricks/AWS)
Tasks
- Architect build deploy data integration pipelines connecting Salesforce Life Sciences Cloud to Databricks
- Build proactive monitoring and alerting
- Collaborate with stakeholders during US East Coast hours
- Execute CRM migration pipeline modifications from Veeva CRM to Salesforce Life Sciences Cloud
- Implement data validation testing and verification rules
- Manage Delta tables and optimize Databricks clusters
- Orchestrate workflow DAGs using Apache Airflow
- Use AWS S3 for data lake storage
- Write dbt transformation models and documentation
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Amazon S3 | Apache Airflow | Apache Spark | CI/CD | DBT | Databricks | Delta Lake | PySpark | Python | SDLC | SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Senior-level ContractDowntown Toronto (Richmond / Adelaide / … R8h ago
-
Agent Orchestration | Artificial Intelligence | BERT | C# | C++Entry-level Apprenticeship Full TimeRemote, Canada R11h ago
-
Principal Java Data Engineer BRL 30KAWS | Alerting | Apache Hudi | Apache Spark | Apache TrinoCaregiver leave | Continuous development support program | Employee assistance program | Flexible paid time off | Parental leaveSenior-level Full TimeMississauga R1d ago
-
Senior Machine Learning Engineer USD 151K-191KAWS | Accuracy | Anomaly Detection | Azure | ClassificationDental insurance | Equity | Flexible PTO | Health insurance | Mental health supportSenior-level Full TimeRemote (US/Canada) R1d ago
-
Senior Manager, GTM Sales Engineer & AI solutions CAD 136K-218KAPI Development | API Integration | Access Control | Agentic Workflows | AgileSenior-level Full TimeToronto, Ontario, Canada R1d ago
-
AI Systems & ML Engineering Industry Expert CAD 140K-185KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible schedule | Fully remote | Hourly paySenior-level Part TimeToronto, Ontario, CA R1d ago
-
Senior CRM & AI Solutions Developer (Power Platform) CAD 130K-165KAI Builder | AI Services | Azure AI | Azure AI Services | Azure DevOpsDental insurance | Disability insurance | Employee stock purchase plan | Generous vacation policy | Life insuranceSenior-level Full TimeToronto R1d ago
-
AI Evaluation | AI Observability | ASP.Net Core | AWS | Agentic Architectures401k matching | Continuing education | Flexible PTO | Health and wellness programs | Health, dental, and vision insuranceSenior-level Full TimeCanada R1d ago
-
Azure | CI/CD | Databricks | Infrastructure as Code | LLMDental insurance | Health insurance | Paid time off | Pension plan | Remote work one day per weekSenior-level Full Time TemporaryCA Vancouver, Canada R1d ago
-
Mid-level Full TimeCAN - Richmond, Canada R1d ago
-
Mid-level Full TimeCanada - Remote R1d ago
-
Senior Machine Learning Engineer CAD 150K-210KAPIs | Algorithms | Concurrency | Data Modeling | Data StructuresSenior-level Full TimeToronto, Ontario, Canada R2d ago
-
Staff Full Stack AI Engineer CAD 145K-175K.NET | AI Evaluation | AWS | Agentic Workflows | AutoGPT401k matching | Company lunches | Company outings | Continuing education | Flexible PTOSenior-level Full TimeAtlanta, Charlotte, Denver, New York, Remote … R2d ago
-
Senior Data Engineer CAD 135K-159KAWS | Agile | DBT | Data Governance | Data ModelingHybrid work model | Life leave days | Professional development days | Retirement savings options | Vacation timeSenior-level Full TimeOttawa, ON, Canada R2d ago
-
Senior Software Engineer, Data - Mapping CAD 136K-170KA/B | A/B Testing | AWS | Airflow | Apache IcebergChild care benefits | Disability benefits | Extended health and dental coverage | Family building benefits | Flexible paid time offSenior-level Full TimeToronto, Canada R2d ago
-
Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryAnnual company retreat | Conference talk sponsorship | Employee leave policies | Home office fund | In person coworking sprintsMid-level Full TimeCanada R2d ago
-
AI Agents | API Integration | Access Management | Agent Frameworks | Cost OptimizationCompany offsites | Equity participation | Flexible schedule | Flexible vacation | Fully remoteMid-level Full TimeCanada R2d ago
-
Advisor, Data engineering CAD 83K-133KAlgorithms | Data Engineering | Data Modeling | Data Pipelines | Data StorageDefined benefit pension plan | Flexible vacation | Group insurance | Health & wellness reimbursement | TelemedicineSenior-level Full TimeComplexe Desjardins Montréal, Canada R2d ago
-
Senior Software Engineer, AI Enablement & Solutions CAD 140K-210KAPIs | AWS | AWS Bedrock | Distributed Systems | MicroservicesEmployee accounts required as applicable | Hybrid work environment | In-office collaborationSenior-level Full TimeToronto, Canada R2d ago
-
AWS ETL Data Engineer - REMOTE CAD 86K-133KAWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Apache AirflowDisability insurance | Employee assistance program | Gym discounts | Health and dental coverage | Income protectionSenior-level Full TimeHalifax, NS, CA R2d ago
-
Data Engineer (Databricks) CAD 80K-90KAlgorithms | Apache Spark | CI/CD | Data Modeling | Data Structures401k | Dental insurance | Educational events | Health insurance | Networking eventsSenior-level Full TimeToronto, Ontario, Canada - Remote R2d ago
-
Lead Databricks Consultant CAD 114K-164KAWS | Access Control | Apache Spark | Azure | Batch Processing401k retirement plan | Dental insurance | Employee assistance program | Medical insurance | Paid HolidaysSenior-level Full TimeCAN, ON, Work-at-Home, Canada R2d ago
-
Senior Machine Learning Engineer CAD 120K-160KAPI Design | Agentic Workflows | Automated testing | C# | Cloud infrastructureCareer development and mentoring programs | Community Volunteering and Philanthropy Programs | Employee peer recognition programs | Flexible time off | Health insuranceSenior-level Full TimeRemote, Canada R2d ago
-
Staff Data Engineer CAD 131K-164KAWS | Azure | CI | CI/CD | Cloud platform401k | Dental insurance | Discretionary time off | Equity participation | Health insuranceSenior-level Full TimeRemote - Canada R3d ago
-
Senior-level Full TimeRemote, Canada; Computer/Software; Canada, Canada; Remote, … R3d ago