Senior DataOps Engineer
Bangalore, India
Calix
Calix is a leading provider of cloud and software platforms, systems, and services for internet service providers. Partner with Calix and grow your business.Calix is undergoing a growth transformation, and we are looking for the best and brightest engineers for our Data Engineering team. Our team is facilitating Calix’s transformation into a more data centric enterprise with our business operational leaders. We partner with our operational teams to identify the key points of decision. We create decision support tools that enable optimal data driven selection of business actions and we build out & maintain these decision support tools on a modern data technology stack using DataOps processes. We are building out the data foundations for the next phase of our growth journey. This is a great opportunity to join a rapidly scaling enterprise with a lot of opportunity for personal growth.
The Data Engineering team is seeking a Senior DataOps Engineer who will be an extraordinary addition to our growing team. You will build and maintain our cloud-based enterprise data platform. Key areas that you will own include data platform infrastructure, data pipelines, data warehousing, security and governance protocols, data integrity processes, and data QA best practices. You will build automation systems and tools to configure, monitor, and orchestrate data infrastructure and data pipelines.
The ideal candidate will have outstanding communication skills, proven data infrastructure design and implementation capabilities, strong business acumen, and an innate drive to deliver results. He/she will be a self-starter, comfortable with ambiguity and will enjoy working in a fast-paced dynamic environment.
Responsibilities:
- Partner with data engineering, and business teams to set KPIs, SLAs, and SLIs for the quality and availability of data.
- Validate the data pipeline executions to ensure that they are completed within the SLA’s.
- Troubleshoot issues related to data pipelines, data integrations, bug fixes, performance bottlenecks.
- Work with multiple cross functional teams like Data Engineering, Business Analytics, IT and Vendor Support to resolve any incidents / problems.
- Continuously monitor and alert for any anomalies in the data.
- Implement role-based security, including AD integration, security policies, and auditing across the data platform environment.
- Test data to make sure it matches business logic and meets basic operational thresholds.
- Work with Data Scientists to support the AI / ML model development environments and operationalization of the models.
- Closely monitor and optimize the data platform infrastructure cost.
- On-call support for P1 issues on weekends / holidays on rotation basis.
- A desire to work in a collaborative, intellectually curious environment.
Required Qualifications:
- 5+ years of relevant DataOps, DevOps or related enterprise data team experience.
- 2+ years of overall data engineering and data infrastructure experience.
- Experience with Cloud Data Warehouses like Snowflake, Amazon Redshift, Google Big Query or Azure Synapse.
- Experience with pipeline orchestration tools (Fivetran, Stitch, Airflow, etc.).
- Coding proficiency in at least one modern programming language (Python, Java, Scala, etc.).
- Strong SQL expertise.
- Experience with Infrastructure as Code (IaC) tools like Terraform, Ansible, Chef, Puppet or AWS Cloud Formation.
- Experience with containerization and container orchestration technologies, like Docker or Kubernetes.
- Experience with version control systems (GitHub, BitBucket, GitLab).
- Experience with cloud deployment automation and configuration management.
- Experience with networking, monitoring, and logging for cloud services.
Desired Qualifications:
- Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines.
- Experience with dbt SQL development environment.
- Experience developing and deploying machine learning models in a production environment.
- Experience with Oracle ERP and Oracle Data Cloud tools.
- Experience with Power BI and/or SFDC Einstein/Tableau.
Education:
- Bachelor’s degree or equivalent experience in Computer Science, Engineering, Management Information Systems (MIS), or related field.
Location:
Bangalore
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Ansible AWS Azure BigQuery Bitbucket Business Analytics Computer Science DataOps Data pipelines Data QA Data Warehousing dbt DevOps Docker ELT Engineering ETL FiveTran GitHub GitLab Java KPIs Kubernetes Machine Learning ML models Oracle Pipelines Power BI Puppet Python Redshift Scala Security Snowflake SQL Tableau Terraform
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.