Senior Data Engineer (Databricks/AWS)
Tasks
- Architect build deploy data integration pipelines connecting Salesforce Life Sciences Cloud to Databricks
- Build proactive monitoring and alerting
- Collaborate with stakeholders during US East Coast hours
- Execute CRM migration pipeline modifications from Veeva CRM to Salesforce Life Sciences Cloud
- Implement data validation testing and verification rules
- Manage Delta tables and optimize Databricks clusters
- Orchestrate workflow DAGs using Apache Airflow
- Use AWS S3 for data lake storage
- Write dbt transformation models and documentation
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Amazon S3 | Apache Airflow | Apache Spark | CI/CD | DBT | Databricks | Delta Lake | PySpark | Python | SDLC | SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Gen AI Engineer CAD 126K-170KAWS | Amazon Bedrock | CI/CD | CrewAI | DevOpsCareer development opportunitiesSenior-level Full TimeCanada - Remote R1d ago
-
Forward Deployed Engineer (Generative AI) CAD 131K-170KAI Agent Builder | AI Pipelines | Agent Builder | Agent Developer Kit | AlloyDBCareer development | Equal employment opportunity | Individual responsibilitySenior-level Full TimeCanada - Remote R1d ago
-
Applied AI Lead USD 140K-180KAPI Integration | Agents | Artificial Intelligence | Assistants | Context engineeringEquity package | Health coverage | Remote-first workplace | Unlimited PTOSenior-level Full TimeRemote - United States or Canada R1d ago
-
Azure | CI/CD | DBT | Data Ingestion | Data ModelingSenior-level Full TimeMontreal, Quebec, Canada R1d ago
-
Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | BigQueryCollaborative environment | Continuous learning opportunities | Flexible work environment | Fully remote | Professional growthMid-level Full TimeCanada R1d ago
-
API Design | Artificial Intelligence | Channels | Concurrency | Distributed SystemsFour-day work week | Fully remote | Professional growth opportunities | Supportive culture | Uncapped holiday allowanceSenior-level Full TimeCanada R2d ago
-
AWS | Azure | C# | Cloud Computing | Data ScienceEntry-level Full Time InternshipCAN - Remote, Canada R2d ago
-
GCP Data Engineer CAD 64K-104KApache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache PrestoMid-level Full TimeRemote, Ontario R2d ago
-
Senior Cloud Data Infrastructure Engineer CAD 140K-202KAWS | Amazon EC2 | Apache Kafka | Apache Spark | As-a-ServiceFlexible time off | Flexible work environment | Global gatherings | Healthcare employer contribution | Home office setupSenior-level Full TimeCanada (Remote) R2d ago
-
Senior AI Developer CAD 141K-170KAWS | Agile | Azure | CI/CD | CachingFlexible hours | Paid sabbatical | Parental program | Training | Wellness and productivity spending accountSenior-level Full TimeMontreal (EN) R3d ago
-
AI Architect (T & I) (Telework/Hybrid) CAD 110K-130KA2A | AI Agent | AI agent architectures | AWS | AccelerateHybrid work | TeleworkSenior-level Full TimeMontreal - MRC (Papineau) (36.25), Canada R3d ago
-
Lead Machine Learning Engineer CAD 156K-251KAWS | Azure | CI/CD | Cloud Computing | Cloud platformAutonomy | Career development support | Learning and development programs | Mentorship and coachingSenior-level Full TimeToronto, Canada R3d ago
-
Senior Machine Learning Engineer (Fraud) CAD 153K-213KAirflow | Apache Spark | Batch Processing | CatBoost | DaskDental coverage | Employee Stock Purchase Plan (ESPP) | Flexible spending wallets | Health coverage | Remote work optionSenior-level Full TimeRemote Canada R3d ago
-
AI Foundry | Agent systems | Anthropic Claude | Azure AI | Azure AI FoundryCaregiver leave | Continuous development support program | Employee assistance program | Flexible paid time off | Parental leaveMid-level Full TimeMississauga R3d ago
-
Machine Learning Engineer (Platform) USD 156K-211KAWS | CPU Optimization | Data Processing | Data throughput | Distributed TrainingRemote workSenior-level Full TimeRemote-US R4d ago
-
Senior-level Full TimeToronto R4d ago
-
AI Engineer, Marketing AI Automation CAD 67K-90KCloud Computing | Full Stack | Full-Stack Development | Git | JavaScriptSenior-level Full TimeCAD Remote – ON, Canada R4d ago
-
Senior Software Engineer, MLOps CAD 175K-220KAgile | Airflow | Batch Processing | DBT | Data PipelinesCharitable donation match | Flexible time off | Medical/Dental/Vision | Paid parental leave | Professional development budgetSenior-level Full TimeRemote - Alberta, Canada R4d ago
-
Senior Staff Machine Learning Platform Engineer CAD 248K-341KAWS | Airflow | Amazon S3 | Apache Iceberg | Apache KafkaHybrid work schedule | Remote work flexibilitySenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON R4d ago
-
AI Solutions Engineer CAD 90K-110KAI Agents | API Integration | Alerting | Cause analysis | Content ManagementDental insurance | Employee discounts | Medical insurance | Paid time off | RRSP matchMid-level Full TimeHybrid- Toronto, ON R4d ago
-
Airflow | Autogen | ClickHouse | CrewAI | DagsterAnnual performance bonus | Equipment support | Flexible working hours | Gifts and rewards | Lunch allowanceSenior-level Full TimeCanada R4d ago
-
Alerting | Amazon Aurora | Amazon Redshift | Batch Processing | CI/CDFully remote work | Ownership of data reliability strategySenior-level Full TimeCanada R4d ago
-
Agentic AI | Backend Engineering | Cloud Computing | Deployment | Generative AIAnnual bonus programs | Equity incentives | Health wellness and retirement benefits | Paid leave | Professional development budgetSenior-level Full TimeCanada R5d ago
-
AI/ML Technical Practice Lead CAD 131K-170KAWS Agentic AI | AWS CloudFormation | AWS ECS | AWS Fargate | AWS IAMContinuous learning culture | Professional development | Remote work | Training sessions | Travel opportunitiesSenior-level Full TimeCanada - Remote R5d ago
-
AI Data Engineer CAD 120K-154KAWS | Amazon Redshift | CI/CD | Data Governance | Data ModelingCritical illness insurance | Extended Healthcare Plan | Flexible hours | Group Life AD D | Group RRSPSenior-level Full TimeToronto, Ontario, Canada - Remote R5d ago