Sr. Databricks Data Engineer, Onsite AVP
Tasks
- Build and test end to end ingestion pipelines
- Collaborate on proofs-of-concept
- Design and develop data pipelines using Databricks
- Develop and deploy scalable ETL pipelines
- Manage software development lifecycle activities
- Optimize and tune Databricks job performance
- Perform data issue troubleshooting
- Perform root cause analysis and impact analysis
Perks/Benefits
Skills/Tech-stack
API | AWS | Azure | Batch Processing | Data Ingestion | Data Lakehouse | Databricks SQL | ETL | Event Driven | Event-driven architecture | Microservices | PySpark | Query Optimization | Resource Management | Scala | Streaming Data
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
Senior Platform Analytics Engineer CAD 156K-214KAWS | Apache Airflow | Apache Spark | Big Data | DBTBenefits | Equity | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON20h ago
-
Senior-level Full TimeMontreal21h ago
-
Apache Spark | Azure | Azure Data | Azure Data Factory | Data FactoryMid-level Full TimeToronto, ON, Canada1d ago
-
Senior Backend Software Developer, Platform & Services CAD 123K-161KAPI Design | AWS | ClickHouse | Data pipeline | Database DesignDental insurance | Flexible work hours | Health insurance | Open PTO policy | Parental leave top-upSenior-level Full TimeCanada (Remote) R1d ago
-
Senior Data Engineer CAD 132K-208KAccess Management | Cassandra | Data Governance | Data Modeling | Data QualitySenior-level Full TimeRemote - Toronto, Ontario, Canada R1d ago
-
Senior AI Business Process Engineer CAD 120K-170KAPI Design | Agile | BPMN 2.0 | Backlog Management | Camunda 8Career development opportunitiesSenior-level Full TimeOntario, Canada - Remote R1d ago
-
Senior Snowflake Data Engineer, AVP CAD 91K-140KAPI | Airflow | Apache Airflow | Azure | Azure DevOpsDevelopment programs | Educational support | Employee networks | Flexible work options | Insurance plansSenior-level Full TimeToronto, Ontario, Canada1d ago
-
Software Developer (API & Data Engine Integration) CAD 270K-270KAWS | Azure | CI/CD | Cloud Storage | Data IngestionContract position | Fully remoteSenior-level ContractToronto, ON, Canada R1d ago
-
Data Engineer CAD 100KAPI | AWS Lambda | Amazon S3 | Amazon SageMaker | Amazon Web ServicesFlexible vacation and sick days | Health and wellness benefits | Paid time off | Professional development paid training | Team events and activitiesSenior-level Full TimeToronto, Canada2d ago
-
Applied AI Engineer CAD 115K-145KAI orchestration | API Development | AWS | AWS Bedrock | Anthropic Claude401k match | Annual professional development budget | Charitable donation match | Commuter benefits | Flexible time offMid-level Full TimeRemote - Ontario, Canada R2d ago
-
Intermediate Data Engineer CAD 70K-130KBackend Development | Cloud Firestore | Express.js | Firebase Authentication | Node.jsSenior-level Full TimeRichmond Hill, Greater Toronto Area, Ontario, …2d ago
-
Senior Data Engineer CAD 113K-139KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeCare days | Defined benefit pension | Extra statutory holidays | Flexible work arrangement | Generous vacationSenior-level Full TimeVancouver, British Columbia, Canada3d ago
-
Senior-level Full TimeCanada3d ago
-
AWS | Agile | Azure | Cloud Computing | Data Governance100 percent remote | Career growth | Continuous learning | Innovation culture | International projectsSenior-level Full TimeCanada R4d ago
-
AWS | CI/CD | Containerization | Geopandas | KubernetesSenior-level Full TimeVancouver4d ago
-
Mid-level Full TimeToronto4d ago
-
Lead AI Engineer CAD 170K-255KAI Agents | Asynchronous programming | Background Jobs | Change detection | Data integrationCompany paid cell phone plan | Dental coverage | Employee assistance program | Flexible work options | Healthcare coverageSenior-level Full TimeToronto, ON, Canada4d ago
-
AWS | Big Data | Data Quality | Databricks | Deep learningSenior-level Full TimeMontreal, Canada4d ago
-
Data Engineer Specialist CAD 75K-113KAgile | Airflow | Apache Hive | Apache Spark | AvroCommunity engagement programs | Employee resource groups | Remote-friendly work environment | Tuition assistance | Upskilling opportunitiesMid-level Full TimeToronto, ON, CA, M1L4S24d ago
-
Principal Software Developer - AI Integration CAD 155K-180KAPI Design | AWS | Azure | CI/CD | CSSHybrid work environment | Training and development programsSenior-level Full TimeOttawa, Ontario, Canada (Hybrid) R4d ago
-
Analytics Lead, Metrics CAD 102K-127KDashboarding | Data Governance | Data Modeling | Data Pipelines | Data QualityChild care benefits | Dental insurance | Disability benefits | Family building benefits | Flexible paid time offSenior-level Full TimeToronto, Canada4d ago
-
Senior Data Platform Engineer CAD 101K-124KAWS | Alation | Amazon Kinesis | Apache Airflow | Apache FlinkSenior-level Full TimeMontreal, Canada5d ago
-
Software Engineer Co-Op - AI/ML CAD 50K-53KAWS | CI/CD | Flyte | Git | GitHub ActionsFitness reimbursement | Hybrid work | Wellness reimbursementEntry-level Full TimeOttawa Office5d ago
-
Senior Software Developer, Data Infrastructure CAD 107K-157KAPI Development | AWS | Airflow | Automation | Big DataSenior-level Full TimeAMER - Canada - Ontario - …5d ago
-
Applied AI Engineer – GenAI Systems CAD 94K-144KAPIs | Agent Orchestration | Anomaly Detection | Backtesting | CI/CDDental insurance | Disability insurance | Employee assistance program | Health insurance | Life insuranceSenior-level Full TimeCAN, Ontario, Toronto, 200 Bloor Street …5d ago