Azure Data Quality Engineer

Description

About Our Team

Our employees thrive in a culture that's fast-paced and ego-free, where innovation and collaboration are encouraged at every turn. We are an organization that provides federal agencies instant access to experienced and talented professionals who understand their unique challenges and know the most efficient ways to address them. We are continually investing in resources and talent, so we stay prepared with specialized teams in place who are experts in creating tailored technologies. Our solutions empower Federal organizations to grow, modernize, and succeed in a rapidly evolving landscape.

We value all voices and want to attract talent from all backgrounds. We're on the lookout for individuals who are passionate about technology and thrive in environments where problem-solving is approached with creativity and enthusiasm. If you're someone who enjoys continuously expanding your skill set while tackling real-world business problems, you'll feel right at home with us. Veterans and military spouses are especially encouraged to bring your unique and valuable experience to our team.

About the Role:

Join our dynamic team as an Azure Data Quality Engineer, where you’ll play a critical role in ensuring the accuracy, consistency, and reliability of data within our cloud environment. You will design and implement robust data validation processes, automate quality checks, and develop monitoring solutions to detect anomalies across structured and unstructured datasets. Collaborating closely with data engineers and analysts, you will create scalable frameworks for data governance and integrity, ensuring compliance with organizational standards. By joining our organization, you'll be part of the team gathering valuable insights into Veterans' experiences, making a real impact in improving their interactions with VA services!

Key Responsibilities:

• Design and implement data validation and quality assurance processes for cloud-based environments.
• Automate data quality checks and develop monitoring solutions to detect data anomalies.
• Collaborate with data engineers and analysts to ensure data governance and compliance.
• Analyze and profile structured and unstructured datasets for accuracy and consistency.
• Build and maintain automated testing frameworks to proactively catch data issues.
• Utilize Azure data engineering and ELT tools, including Azure Synapse and Databricks.
• Create and execute comprehensive test plans using tools such as JIRA’s X-RAY.
• Implement and execute test automation using CoTS tooling like Collibra's Data Quality, Microsoft’s Profisee, or custom scripts in Python or Scala.

Basic Qualifications:

• 3+ years of experience working in a cloud-based environment.
• Experience in analyzing and profiling data.
• Proficiency in querying and working with data using SQL and Python.
• Experience in building automated testing frameworks for data quality assurance.
• Hands-on experience with Azure tools for data engineering and ELT, including Azure Synapse and Databricks.
• Strong knowledge of best testing practices and patterns in cloud environments.
• Ability to work independently within a mid-sized team and rapidly develop test plans using JIRA's X-RAY.
• Proficiency in implementing automated test plans using Collibra's Data Quality, Microsoft Profisee, or script-based testing with Python or Scala.
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements.
• Bachelor’s degree or 4+ years of relevant experience in lieu of a degree.

Preferred Qualifications:

• Familiarity with JIRA and Confluence for project tracking and documentation.
• Ability to integrate testing protocols with monitoring applications such as Dynatrace, Splunk, or Log Analytics.
• Bachelor’s degree in Computer Science or a related field.
• Azure Data Engineer Certification.
• a

TAG: INDMJC

TAG: #LI-I4DM

Requirements

Benefits