Software Engineer III - Data Infrastructure
Sunnyvale / San Francisco
Full Time Senior-level / Expert USD 180K - 210K
Lead Bank
Lead Bank is a community-minded, independent commercial bank with a national client base recognized for its imaginative approach to community banking.Simply put, Lead offers the essential attributes that every fintech seeks in a partner bank. First, unparalleled technical expertise from a distinguished team of developers with an extensive understanding of the banking and payments systems. Second, oversight expertise, automated compliance systems, and bespoke program management to navigate the ever-shifting regulatory landscape. Finally, a commitment to transparency and operational rigor to ensure everyone’s money does what it’s supposed to do.
Role Description:We are seeking a skilled Data Infrastructure Engineer to join our data engineering team in the banking sector, where accuracy and reliability are paramount. You will design, build, and maintain high-quality data pipelines that feed our Snowflake data warehouse, integrating diverse sources such as RDS, DynamoDB, and S3. You will ensure our data infrastructure meets the rigorous standards required for financial operations. This role demands a meticulous approach to pipeline quality and expertise in distributed systems.
Key Responsibilities:
- Design, develop, and maintain highly reliable data pipelines to ingest, transform, and load data into Snowflake with an uncompromising focus on accuracy and quality.
- Leverage AWS services (e.g., RDS, DMS, S3, Data Firehose, Kinesis, Lambda, DynamoDB) to build scalable and fault-tolerant data workflows.
- Maintain infrastructure as code using AWS CDK to maintain data infrastructure
- Utilize open-source distributed data processing frameworks (e.g., Hadoop, Spark) to handle large-scale data transformations and batch processing.
- Manage schema evolution and database migrations with tools like SchemaChange or Flyway.
- Write and maintain code in programming languages (Java, Go, or Python)
- Monitor, troubleshoot, and optimize pipelines to ensure maximum uptime, performance, and data integrity, critical for banking operations.
- Collaborate with data engineers, analysts, and other cross-functional teams.
- Document pipeline designs, processes, and quality assurance measures to maintain transparency and auditability.
Required Skills and Qualifications:
- 5-7 years of experience in data engineering, with a proven track record of building and maintaining high-quality data pipelines.
- Expertise with AWS services, including RDS (Aurora), AWS DMS, S3, Data Firehose, Kinesis, Lambda, DynamoDB, or other equivalent services.
- Hands-on experience with AWS CDK for infrastructure as code or equivalent
- Experience with distributed data processing. example (mapreduce/hadoop/spark).
- Proficiency in one of the programming languages (Java, Go, or Python)
- Knowledge of data modeling (e.g., star schemas, dimensional modeling, data mesh).
- Attention to detail and a commitment to maintaining the highest standards of data accuracy and pipeline quality.
- Ability to troubleshoot complex issues and implement robust, reliable solutions
- Strong communication skills to work with cross-functional teams.
Preferred Qualifications:
- Experience in the banking or financial services industry, with an understanding of compliance and data accuracy requirements.
- Experience with Snowflake database.
- Exposure to CI/CD pipelines for deploying data infrastructure in a controlled, auditable manner.
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
What we offer:
- At Lead, we design our benefits to support company culture and principles, to foster an efficient and inspiring work environment, and to create the conditions for our team to give their best in both work and life
- Competitive compensation, including opportunities for equity grants, based on experience, geographic location, and role
- Medical, Dental, Vision, Life, 401k Matching, and other wellness benefits, including FSA, HSA and HRA
- Paid parental leave
- Flexible vacation policy, including PTO and paid holidays
- A fun and challenging team environment in a dynamic industry with ample opportunities for career growth
*Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
*Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
*Our compensation reflects the cost of labor across several US geographic markets. Pay is based on a number of factors and may vary depending on geographical market location, job-related knowledge, skills, and experience. These ranges may be modified in the future.
Zone 1: $180,000 - $210,000 (SF/Bay Area)
#LI #engineering #softwareengineerjobs #hybrid
Tags: AWS Banking CI/CD Computer Science Data pipelines Data warehouse Distributed Systems DynamoDB Engineering FinTech Firehose Hadoop Java Kinesis Lambda Open Source Pipelines Python Snowflake Spark
Perks/benefits: Competitive pay Equity / stock options Flex vacation Health care Medical leave Parental leave Startup environment Wellness
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.