Associate Principal, Data Analytics Engineering

Chicago - 125 S Franklin

Apply now Apply later

Name of Employer:    
The Options Clearing Corporation 


Job Title:    

Associate Principal, Data Analytics Engineering


Location:    
125 S. Franklin Street, Suite 1200, Chicago, IL 60606


Duties:    

Design and deliver scalable and resilient hybrid and Cloud-based applications and data solutions that support critical financial market clearing and risk activities. Drive the strategy of transforming the enterprise into a data-driven organization. Lead through innovative strategic thinking in building data solutions. Craft and build cloud-based applications and data systems that will serve as the backbone for the enterprise data management and analytics capabilities. Develop stream ETL applications to ingest data from multiple Kafka topics, including trading engine and market data topics in Google Protobuf format, to various data storage systems such as data lake based on AWS S3 storage. Apply Docker to containerize all applications into Docker image and set up quick local test environments using Docker Compose, and build and maintain continuous integration pipelines using Jenkins to automate the Docker images build process. Deploy containerized applications using Helm and Kubernetes to achieve high availability, fault tolerance and auto scalable functionality, and build Kubernetes pods log and health status monitoring stacks based on AWS EC2 Linux instances. Design and implement streaming applications using Flink to aggregate and store financial market data, write SQLs to analyze data in various databases, and utilize Git to review code and maintain version control. Work closely with internal and external business and technology partners. Take on unique technical challenges associated with handling large datasets and managing streaming data in public cloud and hybrid environments. Build large and complex data pipelines and integrate data coming from diverse sources in different formats. Implement continuous integration/continuous delivery pipelines, and be a part of API-first design principle implementation. Up to 40% telecommuting permitted. *This position qualifies for The Options Clearing Corporation’s Employee Referral Program.*


Education & Experience Required:    

Master’s degree in CS, computer systems engineering, mathematics or related and two (2) years of experience as a software developer, software development intern or related.


Special Skills Required:    

Must have work experience with each of the following: 1) Develop stream ETL applications to ingest data from multiple Kafka topics, including trading engine and market data topics in Google Protobuf format, to various data storage systems such as data lake based on AWS S3 storage; 2) Apply Docker to containerize all applications into Docker image and set up quick local test environments using Docker Compose, and build and maintain continuous integration pipelines using Jenkins to automate the Docker images build process; 3) Deploy containerized applications using Helm and Kubernetes to achieve high availability, fault tolerance and auto scalable functionality, and build Kubernetes pods log and health status monitoring stacks based on AWS EC2 Linux instances; 4) Design and implement streaming applications using Flink to aggregate and store financial market data, write SQLs to analyze data in various databases, and utilize Git to review code and maintain version control. Up to 40% telecommuting permitted.


Salary:    

$136,700 - $174,100


Apply:    
Apply online at www.theocc.com. No calls. EOE.

Step 1
When you find a position you're interested in, click the 'Apply' button. Please complete the application and attach your resume.  

Step 2
You will receive an email notification to confirm that we've received your application.

Step 3
If you are called in for an interview, a representative from OCC will contact you to set up a date, time, and location. 

For more information about OCC, please click here.

OCC is an Equal Opportunity Employer

Apply now Apply later
Job stats:  0  0  0

Tags: APIs AWS Data Analytics Data management Data pipelines Docker EC2 Engineering ETL Flink Git Helm Jenkins Kafka Kubernetes Linux Mathematics Pipelines Streaming

Region: North America
Country: United States

More jobs like this