Staff Software Engineer - Lakehouse
Tasks
- Build internal storage services
- Build metadata services
- Enhance Spark stability/usability/performance
- Ensure minimal downtime
- Extend Apache Iceberg capabilities
- Maintain monitoring logging alerting
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
AQE | Apache Hadoop | Apache Iceberg | Apache Parquet | Apache Spark | Catalyst Optimizer | Delta Lake | Distributed Systems | Execution Engine | HBase | HDFS | Java | Linux | Networking | Scala | Shell Scripting | Tungsten Execution Engine | YARN
Education
N/A
Roles
Related jobs
-
Staff Software Developer, ML Infrastructure, Core Infra CAD 216K-221KCloud platform | Conversational AI | Data Processing | Data Storage | Data StructuresSenior-level Full TimeWaterloo, ON, Canada11h ago
-
API Development | AWS | AWS Lambda | AWS Step Functions | Amazon ECSSenior-level Full TimeAMER - Canada - Ontario - …22h ago
-
Senior Platform Analytics Engineer CAD 156K-214KAWS | Apache Airflow | Apache Spark | Big Data | DBTBenefits | Equity | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeKitchener-Waterloo, ON; Toronto, ON1d ago
-
Senior-level Full TimeMontreal1d ago
-
Senior-level Full TimeMontreal1d ago
-
Embedded Software Developer (Optical Control) CAD 71K-113KC# | C++ | Control Systems | Control loops | DWDMMid-level Full TimeKanata, ON1d ago
-
Availability Testing | C++ | Connection Management | Data Movement | Distributed SystemsBackup child and elder care | Dental insurance | Fertility assistance | Flexible paid time off | Health insuranceSenior-level Full TimeToronto1d ago
-
Apache Spark | Azure | Azure Data | Azure Data Factory | Data FactoryMid-level Full TimeToronto, ON, Canada1d ago
-
Senior Backend Software Developer, Platform & Services CAD 123K-161KAPI Design | AWS | ClickHouse | Data pipeline | Database DesignDental insurance | Flexible work hours | Health insurance | Open PTO policy | Parental leave top-upSenior-level Full TimeCanada (Remote) R1d ago
-
Senior Data Engineer CAD 132K-208KAccess Management | Cassandra | Data Governance | Data Modeling | Data QualitySenior-level Full TimeRemote - Toronto, Ontario, Canada R1d ago
-
Sr. Databricks Data Engineer, Onsite AVP CAD 91K-140KAPI | AWS | Azure | Batch Processing | Data IngestionEmployee networks | Flexible work/life support | Medical insurance | Paid volunteer days | Savings plansSenior-level Full TimeToronto, Ontario, Canada1d ago
-
Senior-level Full TimeMontreal 111, Canada1d ago
-
Data Engineer CAD 100KAPI | AWS Lambda | Amazon S3 | Amazon SageMaker | Amazon Web ServicesFlexible vacation and sick days | Health and wellness benefits | Paid time off | Professional development paid training | Team events and activitiesSenior-level Full TimeToronto, Canada2d ago
-
Applied AI Engineer CAD 115K-145KAI orchestration | API Development | AWS | AWS Bedrock | Anthropic Claude401k match | Annual professional development budget | Charitable donation match | Commuter benefits | Flexible time offMid-level Full TimeRemote - Ontario, Canada R2d ago
-
Senior Data Engineer CAD 113K-139KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeCare days | Defined benefit pension | Extra statutory holidays | Flexible work arrangement | Generous vacationSenior-level Full TimeVancouver, British Columbia, Canada3d ago
-
Mid-level Full TimeToronto4d ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPAsynchronous work culture | Handsoff management | Remote work | Supportive teamMid-level Full TimeMontreal, Canada4d ago
-
Data Engineer Specialist CAD 75K-113KAgile | Airflow | Apache Hive | Apache Spark | AvroCommunity engagement programs | Employee resource groups | Remote-friendly work environment | Tuition assistance | Upskilling opportunitiesMid-level Full TimeToronto, ON, CA, M1L4S24d ago
-
Principal Software Developer - AI Integration CAD 155K-180KAPI Design | AWS | Azure | CI/CD | CSSHybrid work environment | Training and development programsSenior-level Full TimeOttawa, Ontario, Canada (Hybrid) R4d ago
-
Senior Data Platform Engineer CAD 101K-124KAWS | Alation | Amazon Kinesis | Apache Airflow | Apache FlinkSenior-level Full TimeMontreal, Canada5d ago
-
Generative AI Developer CAD 115K-138KAPI Integration | CI/CD | Context Management | DevOps | DockerSenior-level Full TimeGatineau, Canada5d ago
-
Software Engineer Co-Op - AI/ML CAD 50K-53KAWS | CI/CD | Flyte | Git | GitHub ActionsFitness reimbursement | Hybrid work | Wellness reimbursementEntry-level Full TimeOttawa Office5d ago
-
Algorithms | C++ | Concurrency | Data Structures | Distributed SystemsFlexible work schedule | Health coverage | Parental leave | Vacation days | Volunteer timeMid-level Full TimeCanada5d ago
-
Algorithms | Concurrency | Consensus Algorithms | Data Structures | Distributed SystemsCompany-matched retirement plan | Flexible schedule | Health coverage | Parental leave | Vacation daysSenior-level Full TimeCanada5d ago
-
Senior Solutions Engineer (Canada) CAD 120K-140KAPI Integration | Apache Spark | Cloud Operations | Data Pipelines | Data ValidationDental insurance | Flexible hours | Flexible-hybrid work | Health insurance | Parental leaveSenior-level Full TimeRemote - Calgary, Alberta, Canada R5d ago