Senior Data Engineer - AWS
Reston Town Center, United States
Fannie Mae
We facilitate equitable and sustainable access to homeownership and quality, affordable rental housing across America.At Fannie Mae, the inspiring work we do helps make a home a possibility for millions of homeowners and renters. Every day offers compelling opportunities to impact the future of the housing industry while being part of a collaborative team thriving in an energizing environment. Here, you will grow your career and help create access to affordable housing finance.
Job Description
As a valued colleague on our team, you will contribute to developing data infrastructure and pipelines to capture, integrate, organize, and centralize data while testing and ensuring the data is readily accessible and in a usable state, including quality assurance.
THE IMPACT YOU WILL MAKE
The Senior Data Engineer - AWS will offer you the flexibility to make each day your own, while working alongside people who care so that you can deliver on the following responsibilities:
Identify customer needs and intended use of requested data in the development of database requirements and support the planning and engineering of enterprise databases.
Maintain comprehensive knowledge of database technologies, complex coding languages, and computer system skills.
Support the integration of data into readily available formats while maintaining existing structures and govern their use according to business requirements.
Analyze new data sources and monitor the performance, scalability, and security of data.
Create an initial analysis and deliver the user interface (UI) to the customer to enable further analysis.
Qualifications
THE EXPERIENCE YOU BRING TO THE TEAM
Minimum Required Experiences:
2+ years with Big Data Hadoop cluster (HDFS, Yarn, Hive, MapReduce frameworks), Spark, AWS EMR
2+ years of recent experience with building and deploying applications in AWS (S3, Hive, Glue, AWS Batch, Dynamo DB, Redshift, AWS EMR, Cloudwatch, RDS, Lambda, SNS, SWS etc.)
2+ years of Python, SQL, SparkSQL, PySpark
Excellent problem-solving skills and strong verbal & written communication skills
Ability to work independently as well as part of an agile team (Scrum / Kanban)
Desired Experiences:
Bachelor degree or equivalent
Knowledge of Spark streaming technologies
Experience in working with agile development teams
Familiarity with Hadoop / Spark information architecture, Data Modeling, Machine Learning (ML)
Skills
Skilled in cloud technologies and cloud computing
Programming including coding, debugging, and using relevant programming languages
Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
Tools
Skilled in AWS Analytics such as Athena, EMR, or Glue
Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
Skilled in SQL
Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
Skilled in Python object-oriented programming
Qualifications
Education:
Bachelor's Level Degree (Required)The future is what you make it to be. Discover compelling opportunities at Fanniemae.com/careers.
For most roles, employees are encouraged to work onsite on a regular basis at their designated office location. In-office work cadence is determined by your manager. Proximity within a reasonable commute to your designated office location is preferred unless the job is noted as open to remote.
Fannie Mae is an equal opportunity employer and considers qualified applicants for employment without regard to race, color, religion, sex, national origin, disability, age, sexual orientation, gender identity/gender expression, marital or parental status, or any other protected factor. Fannie Mae is committed to providing reasonable accommodations to qualified individuals with disabilities who are employees or applicants for employment, unless to do so would cause undue hardship to the company. If you need assistance using our online system and/or you need a reasonable accommodation related to the hiring/application process, please complete this form.
The hiring range for this role is set forth below. Final salaries will generally vary within that range based on factors that include but are not limited to, skill set, depth of experience, certifications, and other relevant qualifications. This position is eligible to participate in a Fannie Mae incentive program (subject to the terms of the program). As part of our comprehensive benefits package, Fannie Mae offers a broad range of Health, Life, Voluntary Lifestyle, and other benefits and perks that enhance an employee's physical, mental, emotional, and financial well-being. See more here.
Requisition compensation:
121000to
158000* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Athena AWS Big Data Data Mining EC2 ECS Engineering Finance Hadoop HDFS Informatica Kanban Lambda Machine Learning MongoDB MySQL OOP Oracle Pipelines PySpark Python Redshift Scrum Security Spark SQL Streaming Testing
Perks/benefits: Career development Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.