Manager, Data Operations

The Manager - Global DataOps & DevOps will play a crucial role in designing, implementing, and maintaining automation and support processes for Enterprise Data Lake built on Azure. In addition to ensuring the scalability, resilience, and efficiency of data engineering pipelines, production workflows, and the data platform, this role will also lead the definition and continuous improvement of global support processes. The manager will partner closely with Data Engineering leads, Platform Owners, Architects, Cloud Engineering Teams, and external vendors to drive automation, support data engineering pipelines, and governance, enabling high-quality deliverables and operational excellence.

Responsibilities:

• Develop a comprehensive global support framework for data engineering pipelines and production systems.
• Define the strategic vision for DevOps practices, CI/CD pipelines, and production support automation within Enterprise Data Lake.
• Provide leadership and mentorship to a global team of engineers, fostering a culture of innovation and operational excellence.

• Design and implement Terraform-based automation for provisioning Azure resources, ensuring adherence to best practices and governance.
• Lead efforts to optimize DevOps practices, including CI/CD pipeline management for data engineering workflows.
• Oversee data pipelines monitoring setup, incident management, and operational reporting to ensure uptime and reliability.

• Establish and enforce platform governance policies, including tagging, cost management, and security protocols.
• Partner with Cloud Engineering team to align networking, access management, and landing zone best practices.

• Collaborate with Data Engineering, Cloud Architecture, and implementation partners to ensure smooth development and deployment processes.
• Act as the primary point of contact for production support escalations, ensuring timely resolutions and stakeholder communication.

• Drive a proactive approach to DataOps by implementing automated alerting, anomaly detection, and self-healing mechanisms.
• Lead a 24/7 production support team globally to ensure seamless operations and quick resolution of platform issues.

• Conduct regular reviews of operational processes, identifying areas for optimization and automation.
• Implement DevSecOps practices to enhance data engineering pipeline security and compliance.
• Ensure seamless production support for Enterprise Data Lake by implementing robust monitoring, escalation frameworks, and 24/7 operational readiness.
• Introduce feedback loops to capture lessons learned from incidents and ensure iterative enhancements to support processes.
• Foster collaboration across teams, including Data Engineering, DevOps, Cloud Infrastructure, and Business Operations, to ensure support strategies align with organizational goals.

Qualifications

• Bachelor’s or Master’s Degree in Computer Science, Engineering, or a related field; equivalent experience and certifications will be considered.
• 8+ years of experience in DevOps, production support, or platform engineering roles, preferably in data engineering environments.
• 5+ years of experience managing technical teams in agile environments.
• Proven expertise in Azure DevOps, Terraform, and CI/CD pipeline tools.
• Advanced knowledge of Azure services (ADLS, Synapse, Data Factory, SQL, etc.) and networking (VNETs, private endpoints).
• Strong proficiency in SQL, Python and Spark programming languages.
• Strong experience with cloud platforms such as AWS, Azure, or GCP is a must.
• Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, and distributed computing frameworks.
• Experience with monitoring tools like Azure Monitor, Log Analytics, or Datadog.
• Strong understanding of IaaC (Infrastructure as Code) using Terraform or Bicep.
• Knowledge of DevSecOps practices and security protocols for cloud environments.
• Hands-on experience with GitHub, including integrating CI/CD pipelines.
• Familiarity with incident management frameworks like ITIL.
• Excellent communication and stakeholder management skills.

#LI-CQ1

Circle K is an Equal Opportunity Employer.
The Company complies with the Americans with Disabilities Act (the ADA) and all state and local disability laws.  Applicants with disabilities may be entitled to a reasonable accommodation under the terms of the ADA and certain state or local laws as long as it does not impose an undue hardship on the Company. Please inform the Company’s Human Resources Representative if you need assistance completing any forms or to otherwise participate in the application process.

Click below to review information about our company's use of the federal E-Verify program to check work eligibility:

In English

In Spanish