Associate Principal, Data Analytics Engineering
Chicago - 125 S Franklin
Full Time Mid-level / Intermediate USD 136K - 174K
Name of Employer:
The Options Clearing Corporation
Job Title:
Associate Principal, Data Analytics Engineering
Location:
125 S. Franklin Street, Suite 1200, Chicago, IL 60606
Duties:
Design and deliver scalable and resilient hybrid and Cloud-based applications and data solutions that support critical financial market clearing and risk activities. Drive the strategy of transforming the enterprise into a data-driven organization. Lead through innovative strategic thinking in building data solutions. Craft and build cloud-based applications and data systems that will serve as the backbone for the enterprise data management and analytics capabilities. Develop stream ETL applications to ingest data from multiple Kafka topics, including trading engine and market data topics in Google Protobuf format, to various data storage systems such as data lake based on AWS S3 storage. Apply Docker to containerize all applications into Docker image and set up quick local test environments using Docker Compose, and build and maintain continuous integration pipelines using Jenkins to automate the Docker images build process. Deploy containerized applications using Helm and Kubernetes to achieve high availability, fault tolerance and auto scalable functionality, and build Kubernetes pods log and health status monitoring stacks based on AWS EC2 Linux instances. Design and implement streaming applications using Flink to aggregate and store financial market data, write SQLs to analyze data in various databases, and utilize Git to review code and maintain version control. Work closely with internal and external business and technology partners. Take on unique technical challenges associated with handling large datasets and managing streaming data in public cloud and hybrid environments. Build large and complex data pipelines and integrate data coming from diverse sources in different formats. Implement continuous integration/continuous delivery pipelines, and be a part of API-first design principle implementation. Up to 40% telecommuting permitted. *This position qualifies for The Options Clearing Corporation’s Employee Referral Program.*
Education & Experience Required:
Master’s degree in CS, computer systems engineering, mathematics or related and two (2) years of experience as a software developer, software development intern or related.
Special Skills Required:
Must have work experience with each of the following: 1) Develop stream ETL applications to ingest data from multiple Kafka topics, including trading engine and market data topics in Google Protobuf format, to various data storage systems such as data lake based on AWS S3 storage; 2) Apply Docker to containerize all applications into Docker image and set up quick local test environments using Docker Compose, and build and maintain continuous integration pipelines using Jenkins to automate the Docker images build process; 3) Deploy containerized applications using Helm and Kubernetes to achieve high availability, fault tolerance and auto scalable functionality, and build Kubernetes pods log and health status monitoring stacks based on AWS EC2 Linux instances; 4) Design and implement streaming applications using Flink to aggregate and store financial market data, write SQLs to analyze data in various databases, and utilize Git to review code and maintain version control. Up to 40% telecommuting permitted.
Salary:
$136,700 - $174,100
Apply:
Apply online at www.theocc.com. No calls. EOE.
Step 1
When you find a position you're interested in, click the 'Apply' button. Please complete the application and attach your resume.
Step 2
You will receive an email notification to confirm that we've received your application.
Step 3
If you are called in for an interview, a representative from OCC will contact you to set up a date, time, and location.
For more information about OCC, please click here.
OCC is an Equal Opportunity Employer
Tags: APIs AWS Data Analytics Data management Data pipelines Docker EC2 Engineering ETL Flink Git Helm Jenkins Kafka Kubernetes Linux Mathematics Pipelines Streaming
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.