Manager, Data Engineer
Brookfield Place, Canada
Brookfield Asset Management
We are a leading global investment firm, investing on behalf of institutions and individuals around the world.Location
Brookfield Place - 181 Bay StreetTechnology Services
Technology Services (TS) is responsible for delivering all enterprise infrastructure, applications and related end user technology services across all Brookfield business groups, comprised of approximately 6,500 users.
Brookfield Culture
Brookfield has a unique and dynamic culture. We seek team members who have a long-term focus and whose values align with our Attributes of a Brookfield Leader: Entrepreneurial, Collaborative and Disciplined. Brookfield is committed to the development of our people through challenging work assignments and exposure to diverse businesses.
Job Description
What You Will Do:
- Design and implement scalable data models and architectures within cloud data platforms like Databricks or Snowflake to support analytics and business intelligence initiatives.
- Design and implement ETL/ELT processes between various sources into Snowflake and/or Databricks platforms, ensuring high performance and reliability.
- Implement data validation and cleansing processes to ensure data accuracy and integrity.
- Migrate existing data infrastructure to Snowflake, ensuring optimal performance and scalability.
- Assess risks associated with data pipelines and identify potential issues proactively to minimize business impact.
- Identify opportunities using data-driven approach and lead data engineering projects that deliver value to the business.
- Identify areas for optimization within existing data workflows and processes, and devise plan to execute improvements for operational efficiency
- Work closely with business stakeholders to understand requirements and formulate data-driven solutions that address business needs.
- Work with end users or data scientists to develop automated workflows for key reporting processes, and develop governance and controls for underlying data and processes
- Communicate data engineering processes, architecture and technical solutions to business stakeholders and management
- Collaborate with cross-functional teams to ensure alignment between data engineering initiatives and broader technological and business objectives.
- Optimizing database schemas and performance for reading and writing of data and upstream processing in the reporting system
- Working with business end users on maintaining systems to enable ad-hoc or periodic analytics and cashflow runs in production
- Provide technical guidance and support to junior data engineers and business power users.
Qualifications and Skills
- A Bachelor's degree in Computer Science, Information Management, Data Analytics or related discipline.
- 5+ years of hands-on experience in data engineering and optimization with significant exposure to data platforms such as Snowflake, Databricks and/or other data platforms.
- Hands-on experience with data orchestration and workflow management using tools such as Workato or other similar platforms.
- Proven expertise in ETL/ELT, data modeling, data warehousing, data Lakehouse concepts with extensive experience with SQL and Python programming.
- Using best practice data frameworks like Data Centric Development Frameworks or Medalion Architecture when onboarding data, ensuring structures and efficient data integrations processes.
- Strong understanding of RESTful APIs and experience in integrations of various data sources and services.
- Familiarity or experience in source code management and continuous integration practice using Azure DevOps.
- Strong analytical skills, including conceptual, requirements interpretation, solution creation and problem-solving abilities
- Ability to assess and manage risks within data workflows and implement effective mitigation strategies.
- Strong communication skills, with the ability to collaborate effectively with cross-functional teams
- Relevant certification in Snowflake and or Databricks is a plus.
- Familiarity with data governance frameworks and ensuring compliance with data protection regulations
- Familiarity with integrating learning models into data pipelines and understanding their infrastructure requirements
- Familiarity or experience with Investment management business domain, specifically in terms of data modelling across Public and Private asset classes (nice to have)
Brookfield is committed to maintaining a Positive Work Environment that is safe and respectful; our shared success depends on it. Accordingly, we do not tolerate workplace discrimination, violence or harassment.
Brookfield is committed to creating an accessible and inclusive organization. We are committed to providing barrier-free and accessible employment practices in compliance with the Accessibility for Ontarians with Disabilities Act. Should you require a Human Rights Code-protected accommodation through any stage of the recruitment process, please make them known when contacted and we will work with you to meet your needs.* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: APIs Architecture Azure Business Intelligence Computer Science Data Analytics Databricks Data governance Data pipelines Data Warehousing DevOps ELT Engineering ETL Pipelines Python Snowflake SQL
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.