Senior Software Engineer - Pyspark - Enterprise Architecture

Senior Software Engineer - Pyspark - Enterprise Architecture-25013512

Description

 

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career.

Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express.


Joining Amex Tech means discovering and shaping your contribution to something big. Here, you can work alongside talented tech teams and build a unique career with the Powerful Backing of American Express. With a range of opportunities to work with the latest technologies, and commitment through open source, our mission is to power your success. Because Amex Tech is powered by our technology, our culture, and our colleagues. 


The Chief Technology Officer Organization's vision is to set the standard for technical excellence, talent, strategy, and standards across Technology. It also seeks to cultivate and foster technical innovation, amplify the technical heartbeat of the organization, and deliver great experiences to all American Express colleagues. 

About Enterprise Architecture:  

Enterprise Architecture is an organization within the Chief Technology Office at American Express and it is a key enabler of the company’s technology strategy. The four pillars of Enterprise Architecture include: 

• Architecture as Code: this pillar owns and operates foundational technologies that are leveraged by engineering teams across the enterprise. 
• Architecture as Design: this pillar includes the solution and technical design for transformation programs and business critical projects which need architectural guidance and support. 
• Governance: this pillar is responsible for defining technical standards and developing innovative tools that automate controls to ensure compliance. 
• Colleague Enablement: this pillar is focused on colleague development, recognition, training, and enterprise outreach.  

What you will be working on: 

  We are looking for a Senior Engineer to join our Enterprise Architecture team. In this role you will be designing and implementing highly scalable real-time systems following the best practices and using the cutting-edge technology. This role is best suited for experienced engineers with broad skillset who are open, curious and willing to learn. 

Key Responsibilities: 

• Design and implement solutions to provision and process data in distributed relational and non-relational databases across private and public cloud environments. 
• Collaborate effectively with technology and product teams to develop and enhance Arena toolsets. 
• Analyze complex data dependencies between data sources and use cases by working closely with multiple platform teams, business stakeholders, and product managers. 
• Partner with product teams to understand business data requirements, identify data needs and sources, and create robust data architectures. 
• Design, develop, troubleshoot, evaluate, modify, deploy, and document all data components, including data architecture, logical and physical data models, database objects, and database administration, to meet application and business needs. 
• Document data requirements and data stories while maintaining data models to ensure seamless integration into existing data architectures. 
• Collaborate with developers on day-to-day activities, including design reviews, coding, and SDLC tasks. 
• Act as the key owner and driver of several large-scale hybrid projects, managing all technical aspects of software development with a focus on cloud platform enablement. 
• Drive innovation within the team by challenging the status quo, introducing improvements, and taking calculated risks. 
• Enhance team productivity by analyzing workflows and contributing to tools and processes that enable faster and more effective results. 
• Mentor and guide team members, fostering their growth and success within the team. 

Qualifications:  

What you will Bring: 

• Bachelor’s degree in Computer science, Computer Engineering, or a related field, or equivalent experience. 
• 4+ years of progressive experience showcasing strong architecture, programming, and engineering skills. 
• Expertise in data processing capabilities across both private and public cloud environments, including GCP and AWS. 
• Proven experience in developing and optimizing data pipelines and processing large datasets using tools like AWS Glue, Data Fusion, and Spark. 
• Proficiency in optimizing Spark applications for performance, scalability, and reliability. 
• Hands-on experience with Continuous Integration, Continuous Delivery (CI/CD), and DevOps systems as part of application development. 
• Strong commitment to code quality through participation in code reviews, adherence to coding standards, and best practices. 
• Proficiency in programming languages such as Python and Scala. 
• Demonstrated ability to lead, collaborate, and partner effectively across cross-functional engineering teams. 
• Expertise in implementing data quality checks, governance policies, and security measures aligned with enterprise technology standards. 
• Hands-on experience with large-scale distributed NoSQL databases such as Elasticsearch, Cassandra, and Couchbase. 
• Knowledge and experience with containerized environments, including Kubernetes and Docker. 
• A passion for innovation, with an appetite for experimenting with new technologies and building rapid Proof of Concepts (POCs). 

Minimum Qualifications

 

Salary Range: $110,000.00 to $190,000.00 annually + bonus + benefits

The above represents the expected salary range for this job requisition. Ultimately, in determining your pay, we’ll consider your location, experience, and other job-related factors.

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

• Competitive base salaries 
• Bonus incentives 
• 6% Company Match on retirement savings plan 
• Free financial coaching and financial well-being support 
• Comprehensive medical, dental, vision, life insurance, and disability benefits 
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need 
• 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy 
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location) 
• Free and confidential counseling support through our Healthy Minds program 
• Career development and training opportunities

For a full list of Team Amex benefits, visit our Colleague Benefits Site.

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law. American Express will consider for employment all qualified applicants, including those with arrest or conviction records, in accordance with the requirements of applicable state and local laws, including, but not limited to, the California Fair Chance Act, the Los Angeles County Fair Chance Ordinance for Employers, and the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance. For positions covered by federal and/or state banking regulations, American Express will comply with such regulations as it relates to the consideration of applicants with criminal convictions.

We back our colleagues with the support they need to thrive, professionally and personally. That's why we have Amex Flex, our enterprise working model that provides greater flexibility to colleagues while ensuring we preserve the important aspects of our unique in-person culture. Depending on role and business needs, colleagues will either work onsite, in a hybrid model (combination of in-office and virtual days) or fully virtually.

US Job Seekers - Click to view the “Know Your Rights” poster. If the link does not work, you may access the poster by copying and pasting the following URL in a new browser window: https://www.eeoc.gov/poster

Employment eligibility to work with American Express in the United States is required as the company will not pursue visa sponsorship for these positions.

Job

 Technology

Primary Location

 US-New York-New York

Organization

 A6382 - CTO Organization

Schedule

 Full-timeJob Band 35Work Location Options Hybrid

Job Posting

 Jul 28, 2025, 5:15:55 PM - Aug 5, 2025, 3:59:00 AM

Recruiter

 Alan A Esparza

Hiring Manager

 Jaspal Singh Virk