Senior Data Engineer

Description

About AllCloud

AllCloud is a global professional services company that provides organizations with cloud enablement and transformation tools. As an AWS Premier Consulting Partner and audited MSP, a Salesforce Platinum Partner, and a Snowflake Premier Partner, AllCloud helps clients connect their front and back offices by building a new operating model to harness the benefits of cloud technology, data, and analytics.

Job Summary

AllCloud is looking for a savvy Senior Data Engineer to join our growing team of data experts. The hire will be responsible for migrating to the cloud, optimizing our customer's databases and data flows, and enriching our operational and functional data flows.

The ideal candidate is fearless of data in any form or scale and is experienced with cloud services to ingest, stream, store, and manipulate data. The Senior Data Engineer will support new systems designs and migrate existing ones, working closely with solutions architects, project managers, and data scientists. The candidate must be self-directed, a fast learner, and comfortable supporting the data needs of multiple teams, systems, and products. The right candidate will be excited by the prospect of optimizing or re-designing our customers’ data architecture to support their next generation of products and data initiatives.

Summary of Key Responsibilities

• Design, Build, and Operate the infrastructure required for optimal data extraction, transformation, and loading from a wide variety of data sources using SQL, cloud migration tools, and ‘big data’ technologies.
• Optimize the ingestion, storage, processing, and retrieval of various data types, from near real-time events and IoT to unstructured data such as images, audio, video, documents, and others.
• Design, Build, and Operate large, complex data lakes that meet functional / non-functional business requirements.
• Work with customers and internal stakeholders, including the Executive, Product, Data, Software Development, and Design teams, to assist with data-related technical issues and support their data infrastructure and business needs.

Requirements

• 5+ years of experience in a Data Engineer role in a cloud-native ecosystem.
• Bachelor (Graduate preferred) degree in Computer Science, Mathematics, Informatics, Information Systems, or another quantitative field. 
• Working experience with the following technologies/tools:
• In-depth knowledge of AWS services for scalable and secure cloud-based solutions.
• Programming skills in Python, including data manipulation and script automation.
• Familiarity with Terraform for infrastructure as code to manage cloud services and resource
• Advanced SQL
• Experience building and optimizing data pipelines, architectures, and data sets.
• Experience supporting and working with external customers in a dynamic environment.
• Possesses excellent communication and presentation skills.
• Team player that can train as well as learn from others.

Nice to Have Skills:

• One or more AWS Certification(s) (SA Associate, Data Analytics Specialty, etc.)
• Apache Spark development experience
• Hands-on Snowflake Experience
• GitFlow Branch Methodology Experience
• Technical Documentation of Solutions

Why work for us? 

Our team inspires progress in each other and in our customers through our relentless pursuit of excellence; you will work with leaders who promote learning and personal development. We offer competitive salaries, bonus incentives, benefits, flexible hours, and mentoring. Apply now to become part of the team. 

AllCloud is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, provincial, or local law.