Data Engineer 3

Valorem Reply is an award-winning digital transformation firm focused on delivering data-driven enterprise, IT modernization, customer experience, product transformation and digital workplace. Through the expertise of their people and power of Microsoft technologies, they provide hyper-scale and agile delivery of unique digital business services, strategic business models and design-led user experiences. Their innovative strategies and solutions securely and rapidly transform the way their clients do business.   
As a Data Engineer 3, you will develop, enhance, and sustain innovative data engineering solutions to improve the customer’s data experience. In this role, you will also review designs and participate in meaningful collaboration sessions on how to help customers leverage their data assets to solve complex problems and inform their business decisions. This role requires a deep understanding of data, effective communication skills, and the ability to work independently while collaborating across teams.  

Responsibilities

• Implement new data engineering features in a highly collaborative work environment alongside product managers and fellow engineers across multiple disciplines
• Help drive the design and implementation of ETL workflows across multiple disparate systems and data sources and help provide clarity across the customer’s data
• Collaborate closely with business partners and internal customers
• Own end-to-end operations of resilient and observable ETL workflows
• Share technical solutions and product ideas through team planning, design review, and technical discussions
• Design, build and operate large-scale distributed data processing systems, data lakes, lake shore apps
• Take the initiative on projects and help improve processes, documentation and the overall design by adopting data engineering best practices
• Designing and working with large swaths of disparate vendor data sets, document stores, and tabular data

Minimum Requirements

• 5 years of experience with common data engineering languages like Python (primary language), SQL, and PySpark
• 5 years of experience with orchestrating pipelines on Airflow
• 5 years of proven experience in building and deploying complex ETL pipelines on-prem, hybrid, and cloud environments
• 5 years of experience building within AWS in a production environment (ex. MWAA, Glue/EMR (Spark), S3, ECS/EKS, IAM, Lambda, etc.)
• 5 years of experience with core statistical principles, industry-standard data modeling, data security and classification methodologies
• 5 years of experience in Agile software development, test-driven development, unit testing, code reviews and design documentation
• 5 years of experience in object-oriented or functional design skills with understanding of common design patterns

Preferred Qualifications

• Experience in Financial Industry
• Experience with other modern programming languages like Java, C++, and C#
• Databricks and /or Dreamio Lakehouse platform experience
• Experience with DevOps and CI/CD pipelines including working with Terraform or any IaC platform 
• Ability to own all stages of the development process: design, testing, implementation, operational support
• Experience documenting complex data processing workflows and operational guides

About Reply
Reply specializes in the design and implementation of solutions based on new communication channels and digital media. Reply is a network of highly specialized companies supporting global industrial groups operating in the telecom and media, industry and services, banking, insurance and public administration sectors in the definition and development of business models enabled for the new paradigms of AI, cloud computing, digital media and the Internet of Things. Reply services include Consulting, System Integration and Digital Services.
The base compensation range for this full-time position is between $120,000 - $150,000 plus benefits. Compensation decisions are supported through market data, where regional variances may exist based on cost of labor. We also take into consideration prior experience, relevant skills, education and/or training, certifications and, as applicable, other required qualifications. If you have questions regarding compensation, the talent acquisition team can provide relevant details during the interview process.
Reply is an equal opportunity employer. We are committed to provide equal opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. If you need assistance and reasonable accommodation due to a disability during the application or the recruiting process, email us at jobusa@reply.com. Visit our website at www.reply.com to learn more about our open roles.