Big Data Engineer Senior Manager

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. 

Job Description

Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer, and more useful for everyone. At the heart of that mission are the people that work here—the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real-world problems and put your talents towards transforming transportation. That’s because at Arity, we believe work and life shouldn’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don’t just want you to see yourself here. We want you to be yourself here. Arity is committed to supporting an inclusive and diverse environment where you can thrive and learn from others.

Architect – Real-Time Traffic Engineering Team

The Engineering Team
Our Real-Time Traffic Engineering Team is at the forefront of innovation in high-throughput, low-latency computing on cloud platforms. Our engineers are passionate about building solutions that enable real-time decision-making at scale, creating state-of-the-art, highly available, and low-downtime systems. They tackle complex challenges across telematics, enterprise engineering, and high-scale platform development, pushing the boundaries of cloud-native architecture and distributed systems. Within an Agile, collaborative environment, our engineers own projects from conception through deployment, operating with a focus on trust, transparency, and reliability. If designing and architecting cutting-edge real-time traffic solutions excites you, we’d love to meet you.

Job Profile Summary
The Architect on our Real-Time Traffic Engineering Team is a technical leader responsible for designing and implementing scalable architecture solutions for real-time, high-performance systems. Working alongside a team of skilled architects, you’ll address high-throughput, low-latency computing challenges, enabling resilient, high-performance systems. In this role, you’ll collaborate with cross-functional teams, ensuring alignment with business objectives and delivering strategic improvements to support real-time scalability and uptime demands.

The Role
As a Technical Architect in our Real-Time Traffic Engineering Team, you thrive on transforming ideas into real, scalable solutions—be it through design, code, or architectural frameworks. You will work in close collaboration with other architects, bringing deep expertise in high-throughput computing and cloud-native systems, readily addressing the unique challenges of high-scale, low-latency infrastructure. Your ability to navigate tool selection, trade-offs, and implementation will be key to our success.

Key Responsibilities

• Collaborate on Complex Systems Architecture: Work with fellow architects to lead analysis, design, and development of high-throughput, low-latency solutions, crafting architectures across multiple logical and physical dimensions. Present comprehensive documentation and support team implementation efforts.

• Enhance Existing Architectures: Continuously identify and optimize architectural components, ensuring scalability, resilience, and performance within real-time computing systems.

• Develop and Leverage Patterns: Contribute to creating and promoting reusable architectural patterns, practices, and reference architectures that align with our organization’s blueprint.

• Consult and Advise: Act as a strategic consultant on real-time traffic engineering architecture, providing insights on how business drivers and emerging technologies can align with enterprise objectives.

• Champion Effective Designs: Promote best practices in architectural design, enhancing efficiency and reliability across our solutions.

• Stakeholder Engagement: Partner with director and AVP-level stakeholders in technical and business areas to deliver high-impact solutions aligned with strategic goals.

• Drive Standardization and Innovation: Influence prioritization for enterprise benefits and risk reduction, encouraging adoption of best practices in design and architecture.

• Knowledge Sharing and Mentorship: Share findings and architectural insights with the team and stakeholders, helping define and guide best practices.

• Collaborative Development: Work closely with technical and non-technical team members to deliver highly available, scalable solutions while ensuring efficiency and low latency.

Required Technologies and Skills

• Database Technologies: Extensive experience with SQL and NoSQL databases.

• Programming Languages: Proficiency in Java/JVM, Golang, Python, and Bash scripting.

• Version Control: Experience with GitLab and GitHub.

• Containerization and Infrastructure: Expertise with Docker for containerized applications.

• Infrastructure as Code: Experience with Terraform, CloudWatch, and cloud infrastructure automation.

• Cloud Platforms: Proficiency in Amazon Web Services (AWS) or Google Cloud Platform (GCP), including serverless offerings such as Lambda, EKS, EventBridge, and SQS, or equivalent services from other cloud providers.

• High-Throughput, Low-Latency Computing: Proven ability to design and implement solutions optimized for real-time, high-performance, and low-latency requirements.

• Highly Available Systems: Expertise in designing systems with low downtime and built-in fault tolerance.

Skills

Amazon Web Services (AWS), Big Data, Building Architecture, Cloud Infrastructure, Data Analysis, Scalable Architectures, Software Project Planning, Strategic Management

Compensation

Compensation offered for this role is $134,400.00 - 217,350.00 annually and is based on experience and qualifications.

The candidate(s) offered this position will be required to submit to a background investigation.

Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.  

You’ll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we’ve proven that Allstate empowers everyone to lead, drive change and give back where they work and live. 

Good Hands. Greater Together.

Allstate generally does not sponsor individuals for employment-based visas for this position.

Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.

For jobs in San Francisco, please click “here” for information regarding the San Francisco Fair Chance Ordinance.
For jobs in Los Angeles, please click “here” for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.

To view the “EEO is the Law” poster click “here”. This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs

To view the FMLA poster, click “here”. This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.

It is the Company’s policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee’s ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.