Data Engineer QA

DTN is a global leader providing insights and analytics to our customers to feed, fuel, and protect the world.  We help people make critical business decisions that impact the agriculture, oil and gas, trading, and weather industries.

It’s a difference you’ve likely felt without even knowing it. From the food on your plate to the gas in your car to the last flight you took, chances are a DTN customer made it possible. And that’s just for starters. That’s why we say, “When our customers prosper, we all win.”

Job Description:

We are seeking a detail-oriented and skilled Data Engineer QA (T1) to join our growing data team. In this role, you will be responsible for ensuring the quality, integrity, and reliability of our data engineering processes and outputs. You will work closely with data engineers, analysts, and other stakeholders to develop and implement quality assurance strategies for our data pipelines and systems.

Key Responsibilities:

• Design, develop, and execute test plans for ETL processes, data pipelines, and data warehousing solutions

• Perform thorough testing of data transformations, integrations, and migrations
• Perform data lineage audits and ensuring applied updates reflect incoming data sources
• Develop and maintain automated test suites for continuous integration and deployment
• Conduct performance testing and optimization of data workflows
• Collaborate with data engineers to troubleshoot and resolve data quality issues
• Implement data validation checks and monitoring systems
• Participate in code reviews and provide constructive feedback
• Document testing procedures, results, and best practices
• Stay current with industry trends and emerging technologies in data quality assurance

Required Qualifications:

• Bachelor's degree in Computer Science, Information Systems, or a related field
• 2+ years of experience in data engineering, quality assurance, or a related role
• Strong proficiency in SQL and Python programming
• Experience with big data technologies such as Hadoop and Spark
• Familiarity with cloud platforms (AWS, Azure, or GCP)
• Experience with Docker and Kubernetes
• Knowledge of data modeling and ETL processes
• Experience with version control systems (e.g., Git)
• Proficiency in Linux/Unix command-line operations

Preferred Skills and Experience:

• Experience with data quality tools such as Great Expectations
• Familiarity with workflow management tools like Apache Airflow and Argo Workflows
• Experience with data transformation tools like dbt, PySpark, Jupyter, and SQL
• Familiarity with CI/CD pipelines and practices
• Experience with test automation frameworks (e.g., pytest)
• Knowledge of data privacy and security best practices
• Experience with Palantir Foundry

Soft Skills:

• Excellent attention to detail and analytical skills
• Strong problem-solving abilities
• Effective communication skills, both written and verbal
• Ability to work collaboratively in a team environment
• Good time management and prioritization skills
• Adaptability and willingness to learn new technologies

The targeted hiring base pay range for this position is between $56,250 and $75,000. DTN is a pay for performance organization, which means there is the opportunity to advance your compensation with performance over time. The actual base pay offered for this position will be dependent upon many factors, including but not limited to: prior work experience, training/education, transferable skills, business needs, internal equity and applicable laws. The targeted hiring base pay range is subject to change and may be modified in the future. This role may also be eligible for market competitive variable pay and benefits. 

#LI-REMOTE
#LI- JW1

Why DTN?

OUR VISION: To be the independent, trusted source of insights to our customers who feed, protect, and fuel the world. 

OUR MISSION: Empower our customers with intelligent and actionable insights that exceed their expectations and enable their success on a daily basis. 

OUR VALUES: Customer-Focused, Forward-Thinking, People-Centric, Solution-Oriented

We have great benefits at DTN – apply today to find out more! 

At DTN, we are an equal opportunity employer. Come join us as we help feed, fuel, and protect the world!

** DTN is an Equal Opportunity Employer Minorities/Women/Veterans/Disabled