Staff Software Engineer - Lakehouse
Tasks
- Build internal storage services
- Build metadata services
- Enhance Spark stability/usability/performance
- Ensure minimal downtime
- Extend Apache Iceberg capabilities
- Maintain monitoring logging alerting
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
AQE | Apache Hadoop | Apache Iceberg | Apache Parquet | Apache Spark | Catalyst Optimizer | Delta Lake | Distributed Systems | Execution Engine | HBase | HDFS | Java | Linux | Networking | Scala | Shell Scripting | Tungsten Execution Engine | YARN
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeCanada6h ago
-
Agile | C++ | Cloud infrastructure | Data Processing | DebuggingSenior-level Full TimeWaterloo, ON, Canada10h ago
-
Airflow | Apache Kafka | Apache Spark | Azure | Azure EventCompetitive benefits | Employee resource groups | Flexible work schedule | Hybrid work environment | Mentorship opportunitiesSenior-level Full TimeMontreal - MRC (Papineau) (36.25), Canada21h ago
-
Applied AI Backend Software Developer CAD 76K-105KAPI | AWS | Azure | CI/CD | DockerCritical illness insurance | Employee resource groups | Health and dental coverage | Life insurance | Long-term disabilityNone Full TimeOttawa, Canada21h ago
-
Applied AI Full Stack Engineer MacOS CAD 105K-130KAgile | C++ | CI/CD | Design Patterns | DevOps14 Annual Holidays | Critical illness insurance | Employee resource groups | Health and dental coverage | Life insuranceMid-level Full TimeOttawa, Canada21h ago
-
Artificial Intelligence | Automation | C Sharp | C plus plus | ChatGPTCareer development program | Employee share purchase plan | Generous vacation policy | Hybrid work environment | Maternity/parental top-upEntry-level InternshipToronto1d ago
-
Data Engineer CAD 108K-135KAWS | Ansible | Apache Airflow | Apache Spark | ChefChild care benefits | Disability benefits | Family building benefits | Flexible paid time off | Health and dental coverageMid-level Full TimeToronto, Canada R1d ago
-
Senior Software Developer, Data Platform Infrastructure CAD 120K-158KAlerting | Apache Spark | CDC | CI/CD | DatabricksSenior-level Full TimeMontreal (Province of Quebec, Canada)1d ago
-
Senior Data Engineer - (Python/Spark/SQL) CAD 130K-144KApache Airflow | Apache Hive | Apache Spark | Apache Zeppelin | Cloud ComputingHybrid work environment | Remote work days per weekSenior-level Full TimeToronto, ON, Canada1d ago
-
Data Integration Engineer CAD 62K-113KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeHybrid work | Pension matching | Performance bonus | Profit sharing | Vacation benefitsMid-level Full TimeToronto, ON, CA, M5H1H11d ago
-
Senior AI Engineer CAD 126K-164KAI orchestration | API Development | Agent Based Workflows | Agent-based | Azure OpenAICareer development | Mentoring programs | Online learning platform | Skill development | Training and onboardingSenior-level Full TimeTD Centre - TD Tower - …1d ago
-
Data Engineer CAD 90K-130KAWS Glue | Azure Purview | CI/CD | Data Governance | Data ModelingFlexible dress code | Hybrid work modelMid-level Full Time5th Avenue Place, Canada1d ago
-
Software Engineer CAD 94K-176KAccess Control | Alation | Apache Spark | Atlan | AzureAccessibility and workplace accommodations | Community engagement programs | Employee resource groups | Flexible vacation | Free tea and coffeeSenior-level Full TimeToronto, ON, CA, M5H 1H11d ago
-
Senior Software Engineer CAD 92K-171KAccess Control | Alation | Apache Spark | Atlan | AzureBenefits package | Community engagement programs | Employee resource groups | Employee tea and coffee | Flexible vacationSenior-level Full TimeToronto, ON, CA, M5H 1H11d ago
-
Bash | Black box testing | Black-box | Box testing | Coverage.pyFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeCanada - Remote R1d ago
-
Sr. Firmware Engineer - Embedded Systems CAD 80K-100KARM | Bare Metal | Bitbucket | C# | C++Annual bonus plan | Company paid benefits | Group pension plan | Social events | Training opportunitiesSenior-level Full TimeMississauga, Ontario, Canada2d ago
-
Software Engineer, Perception and Prediction Evaluation USD 155K-213KAWS | Amazon Batch | Amazon ECS | Amazon S3 | Apache AirflowCatered meals | Daily Drinks | Equity awards | Flexible hours | Health and wellness benefitsMid-level Full TimeRemote US & Canada R2d ago
-
Sr. Data Engineer - CANADA (Remote) CAD 140K-160KAWS | Alerting | Apache Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeCanada R3d ago
-
Data Engineer CAD 85K-128KAgile | Azure Data | Azure Data Factory | Azure DevOps | Azure SynapseAwards and recognition program | Discounted monthly rent | Discretionary bonus program | Employee referral program | Employee savings programSenior-level Full TimeCalgary, Alberta, Canada4d ago
-
Biomedical Algorithms Engineer (Hybrid) CAD 76K-121KApplied Mathematics | Biosignal Processing | Calculus | Cardiac electrophysiology | Computational GeometryAdoptive leave top up | Career progression | Fertility treatment coverage | Maternity leave top-up | Medical, dental coverageSenior-level Full TimeBurnaby, BC, V5J 0B6, CAN R4d ago
-
Data Engineering Developer CAD 105K-131KAPI | Apache Spark | Azure Data | Azure Data Factory | Azure EventEmployee assistance program | Flexible work schedule | Hybrid work schedule | Retirement savings plan | Tailored trainingSenior-level Full TimeLongueuil, Quebec, Canada4d ago
-
Deep learning | Distributed Systems | Distributed Training | Experiment design | GPU ComputingAccess to high-performance computing | Collaborative environment | Global distributed work environment | High autonomy | Professional growthSenior-level Full TimeCanada4d ago
-
Senior Data Engineer CAD 130K-144KApache Airflow | Apache Hive | Apache Spark | Apache Zeppelin | Batch ProcessingSenior-level Full TimeToronto, ON, Canada4d ago
-
Computer Vision | Data Processing | Data debugging | Distributed Computing | JavaSenior-level Full TimeWaterloo, ON, Canada4d ago
-
Senior Machine Learning Engineer CAD 170K-250KC# | C++ | Data-intensive | Data-intensive software | Deep learningBanking benefits and discounts | Career development | Health and well-being benefits | Mentoring programs | Paid time offSenior-level Full Time661 University Avenue, Toronto, Ontario, Canada4d ago