Senior Data Engineer

About Prove 

As the world moves to a mobile-first economy, businesses need to modernize how they acquire, engage with and enable consumers. Prove’s phone-centric identity tokenization and passive cryptographic authentication solutions reduce friction, enhance security and privacy across all digital channels, and accelerate revenues while reducing operating expenses and fraud losses. Over 1,000 enterprise customers use Prove’s platform to process 20 billion customer requests annually across industries, including banking, lending, healthcare, gaming, crypto, e-commerce, marketplaces, and payments. For the latest updates from Prove, follow us on LinkedIn.

Prove is driving the future of digital identity. We are looking for Provers who know how to make an impact. We’re talking self-starting professionals who thrive in a fast-paced environment, process information quickly, and make intelligent decisions. The work is challenging and requires not only smart but natural curiosity and tenacity. Teamwork is also important to us – we work together and play together.   

Prove has big plans, and we’re excited about the future. If this sounds like the place for you – come join our team! 

Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our data team. The ideal candidate will have extensive experience with data engineering tools and technologies, including a strong background in Data Orchestration, Data Pipelines, Medallion architecture, and Data Governance. This is a unique opportunity to work on a core initiative, building and architecting a unique data asset store. 

Responsibilities

• Design, develop, and maintain robust and scalable data pipelines using a combination of batch and streaming technologies. 
• Implement/Implement Apache Airflow to orchestrate and automate complex data workflows and ensure timely delivery of data. 
• Optimize and tune data pipelines to improve performance and reliability.
• Design and implement data solutions following the Medallion (Bronze, Silver, Gold) architecture to provide organized, enriched, and high-quality data layers. 
• Ensure the smooth transition of data from raw to processed and curated stages while maintaining data quality standards.
• Establish and enforce data governance practices, ensuring data integrity, compliance, and best practices.
• Implementing Data Lineage, Metadata controls in collaboration with compliance requirements. 
• Collaborate with business stakeholders to define data quality metrics and implement monitoring mechanisms. Maintain documentation of data lineage, data models, and transformation processes.
• Work closely with data analysts, data scientists, and business stakeholders to understand data requirements and ensure data solutions meet business needs. 
• Guide and mentor junior data engineers and other team members, promoting a culture of best practices and collaboration within and without the organization. 

 

Experience and Qualifications:

 

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or related field. 
• 5+ years of experience in Data Engineering. 
• Proven experience with Apache Airflow for orchestrating and automating data workflows. 
• Hands-on experience with Medallion architecture and implementing data pipelines across multiple layers. 
• Experience working with cloud data platforms (e.g., AWS, Azure, GCP). 
• Solid experience with SQL, NoSQL and database technologies. 
• Strong programming skills in Python or general purpose programming languages.
• Experience with distributed data processing tools (e.g., Spark, Databricks, DBT). 
• Knowledge of data modeling, ETL/ELT processes, and data warehousing. Understanding of data governance principles, data cataloging, and data quality management. 
• Excellent problem-solving and analytical skills. 
• Strong communication and collaboration skills. 
• Ability to work in a fast-paced, agile environment.

Nice to Have:

• Experience with data visualization tools (e.g., Tableau, Power BI, Looker). 
• Familiarity with CI/CD practices for Data Engineering.
• Familiarity with Snowflake. 
• Experience with Terraform and AWS Manage Data Services, DynamoDB and MWAA. 

Privacy & Data Protection

When you are applying for a job at Prove, we collect and use your personal information in the job application process. To understand more about how Prove uses your personal information, please see our Recruitment Privacy Policy on our website.

Benefits & Perks for FTE Provers:

• Competitive salaries & Bonus Plan (for eligible roles) and Equity Plan
• Modern Health for financial, mental, and physical wellness
• 401(k) Retirement Plan & Match (US Offices) and Local Country Pension (International Offices)
• Unlimited Vacation and Flexible hours
• Comprehensive medical benefits for you and your family ❤️
• Emotional & Physical Wellness – Access to wellness services (EAP & Prove Well-Being Reimbursement)
• Bottomless snacks & beverages for certain office locations
• Daily GrubHub stipend for lunch if coming into the office (US Offices)
• A great place to work and connect with other talented Provers like yourself!

Don’t meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. At Prove we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.   This position description should not be considered the final description of the position. It should be assumed that we would, to some extent, structure responsibilities in accordance with the successful candidate’s capabilities and changing business conditions.   Prove is an equal opportunity employer committed to providing equal employment opportunity for all people regardless of race, color, religion, gender or sexual orientation, age, marital status, national origin, citizenship status, disability, veteran status or other personal characteristics.