Sr. Manager, Global Data Engineering
Nonstore B152 Charlotte NC, United States
Circle K
Circle K is a convenience store and gas station chain offering a wide variety of products for people on the go. Visit us today!As the Sr. Manager, Global Data Engineering, your primary responsibility will be to manage a team of Data Engineers and Managers, including Development and Production Support functions. You will provide leadership in guiding the Global Data Engineering team (onshore and offshore), fostering collaboration with cross-functional teams, and spearheading initiatives geared towards fortifying our data infrastructure, CI/CD pipelines, and analytics capabilities.
This role will report to the Head of Global Data Engineering and BI and will have six to eight direct reports.
Responsibilities:
You will also be for the following:
- Providing Global Data Engineering and BI team’s leadership for large initiatives, both directly and indirectly through a team of technical leads
- Identifying process improvement opportunities, leading the efforts to improve those processes and implement the change across the team
- Ensuring that the Data Engineering team has standards in place for their work and for the work of third-party vendors and that all parties adhere to those standards
- Growing and developing your team members and optimizing your team’s performance via strong people management skills
- Collaborating with business stakeholders to scope and prioritize data engineering initiatives
- Executing the required performance management requirements for your direct reports (employees) including but not limited to setting annual objects / KRAs, mid-year and year-end progress reviews, growth conversations, and succession planning
You will also be responsible for ensuring your team members (employees and contractors):
- Apply advanced knowledge of Data Engineering principles, methodologies and techniques to design and implement data loading and aggregation frameworks across broad areas of the organization.
- Gather and process raw, structured, semi-structured and unstructured data using batch and real-time data processing frameworks.
- Implement and optimize data solutions in enterprise data warehouses and big data repositories, focusing primarily on movement to the cloud.
- Drive new and enhanced capabilities to Enterprise Data Platform partners to meet the needs of product / engineering / business.
- Leverage strong Python, Spark, SQL programming skills to construct robust pipelines for efficient data processing and analysis.
- Implement CI/CD pipelines for automating build, test, and deployment processes to accelerate the delivery of data solutions.
- Drive continuous improvement initiatives to enhance performance, reliability, and scalability of our data infrastructure.
- Collaborate with data scientists, analysts, and other stakeholders to understand business requirements and translate them into technical solutions.
- Implement best practices for data governance, security, and compliance to ensure the integrity and confidentiality of our data assets.
Qualifications:
- 10+ years of experience in a data engineering role, with expertise in designing and building data pipelines, ETL processes, and data warehouses
- 5+ years of experience working as a Manager
- Excellent interpersonal and communication skills: able to work across business lines at senior levels to influence and effect change to achieve common goals
- Ability to effectively drive people, process, and technology change in a dynamic and complex operating environment
- Demonstrated ability to work as part of a global team, including understanding how to navigate cultural differences in workstyles and communications
- Strong, results-driven personality with a high level of enthusiasm, energy and confidence
- Strong proficiency in SQL, specifically being able to handle window functions like rank, average, standard deviation
- Python and PySpark programming languages
- Strong experience with the Azure cloud platform
- Experience working in a retail environment
- Extensive experience working with Databricks and Azure Data Factory for data lake and data warehouse solutions
- Experience in implementing CI/CD pipelines for automating build, test, and deployment processes
- Hands-on experience with big data technologies (such as Hadoop, Spark, Kafka)
Plusses:
- Prior experience on working with offshore team (India, Europe, etc.)
- Relevant certifications (e.g., Azure, Databricks, Snowflake) would be a plus
- Experience working with Snowflake and/or Microsoft Fabric
Circle K is an Equal Opportunity Employer.
The Company complies with the Americans with Disabilities Act (the ADA) and all state and local disability laws. Applicants with disabilities may be entitled to a reasonable accommodation under the terms of the ADA and certain state or local laws as long as it does not impose an undue hardship on the Company. Please inform the Company’s Human Resources Representative if you need assistance completing any forms or to otherwise participate in the application process.
Click below to review information about our company's use of the federal E-Verify program to check work eligibility:
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Azure Big Data CI/CD Databricks Data governance Data pipelines Data warehouse Engineering ETL Hadoop Kafka Pipelines PySpark Python Security Snowflake Spark SQL Unstructured data
Perks/benefits: Startup environment
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.