Senior Data Engineer

What you'll do...

Position: Senior Data Engineer

Job Location: 640 W. California Avenue, Sunnyvale, CA 94086

Duties: Build real time, large volume streaming data pipelines with fault tolerant and resilient systems leveraging Spark. Build robust applications using Spark and Python. Leverage understanding of star/dimensional model Kimball Data Model (physical and logical). Analyze processes and procedures and identify and suggest improvements and innovations for query performance improvements. Work closely with the business teams and stakeholders to support retail store operations with data. Build audits to monitor operations, investigate data anomalies, and execute root cause analysis. Build data blocks to support faster analytics and data mappings. Develop data flows, maintain databases, and work with users for reporting requests and cube development. Map source system data to data warehouse models and maintain data conformity rules across data marts. Adapt and enhance data processing pipelines to accommodate changes in source systems, performance requirements, and data accuracy issues. Optimize data orchestrations and job scheduling to produce real-time data analytics. This position does not supervise employees.

Minimum education and experience required: Master’s degree or equivalent in Computer Science, Engineering (Any), or related field and 2 years of experience in large scale enterprise software development environment; OR Bachelor’s degree or equivalent in Computer Science, Engineering (Any), or related field and 5 years of experience in large scale enterprise software development environment.

Skills required: Experience architecting big data applications that can be deployed on multi-cloud platforms, including Azure and Google Cloud Platform. Experience architecting ETL workflows for real-time data processing at scale. Experience authoring scripts to perform various automation activities, including emailing data and reports to end users and scheduling jobs. Experience extracting transactional data from Oracle databases and Microsoft databases for processing and ingesting data into MPP systems. Experience with Hadoop and Data Lakes for Business Intelligence reporting purposes. Experience designing data processing pipelines using Apache Spark and optimizing for performance. Experience designing data models for real-world use cases following Star Schema and Snowflake Schema. Experience using Object Oriented Programming in Python for file/HTML processing. Experience acquiring data from large disparate data sources, including REST APIs, SQL databases, and NoSQL databases. Experience with CI/CD tools, including Git, Looper, and Jenkins. Experience with workflow orchestration tools, including Airflow. Employer will accept any amount of experience with the required skills.

Salary Range: $174,518/year to $234,000/year. Additional compensation includes annual or quarterly performance incentives.   Additional compensation for certain positions may also include: Regional Pay Zone (RPZ) (based on location) and Stock equity incentives.

Benefits: At Walmart, we offer competitive pay as well as performance-based incentive awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty and voting. Other benefits include short-term and long-term disability, education assistance with 100% company paid college degrees, company discounts, military service pay, adoption expense reimbursement, and more.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. For information about benefits and eligibility, see One.Walmart.com.

Wal-Mart is an Equal Opportunity Employer.