Data Engineer II
Dallas, TX
PDI Technologies
PDI Technologies helps fuel and convenience businesses increase productivity, profitability, loyalty, and security by Connecting Convenience.
At PDI Technologies, we empower some of the world's leading convenience retail and petroleum brands with cutting-edge technology solutions that drive growth and operational efficiency.
By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make more informed decisions, and engage faster with customers through loyalty programs, shopper insights, and unmatched real-time market intelligence via mobile applications, such as GasBuddy. We’re a global team committed to excellence, collaboration, and driving real impact. Explore our opportunities and become part of a company that values diversity, integrity, and growth.
Role Overview
PDI is seeking a talented and motivated Full Time Data Engineer II to join our elite agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies.
The ideal candidate will have hands-on experience in coding data pipelines, administering databases, and working with business users to understand and meet their data requirements. This role involves maintaining high performance and security of our data systems, performing quality assurance, and supporting the company’s data infrastructure, primarily using AWS, Snowflake and DBT.
By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make more informed decisions, and engage faster with customers through loyalty programs, shopper insights, and unmatched real-time market intelligence via mobile applications, such as GasBuddy. We’re a global team committed to excellence, collaboration, and driving real impact. Explore our opportunities and become part of a company that values diversity, integrity, and growth.
Role Overview
PDI is seeking a talented and motivated Full Time Data Engineer II to join our elite agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies.
The ideal candidate will have hands-on experience in coding data pipelines, administering databases, and working with business users to understand and meet their data requirements. This role involves maintaining high performance and security of our data systems, performing quality assurance, and supporting the company’s data infrastructure, primarily using AWS, Snowflake and DBT.
Key Responsibilities
- Develop and optimize data pipelines and ETL processes
- Implement data integration solutions
- Collaborate with data analysts and data scientists to support their data needs
- Maintain and enhance data systems to ensure high performance and reliability
- Perform data validation and quality assurance
- Document data workflows and processes
- Participate in agile teams to provide technical expertise and feedback
- Adhere to project development and deployment processes
- Ensure compliance with industry standards and best practices
- Maintain data security and integrity
- Provide on-call support as needed
- Estimate effort and resources for new data projects
- Work with stakeholders to understand data requirements and deliver solutions
- Monitor and optimize data storage and processing capabilities
- Troubleshoot and resolve data issues
Qualifications
- Proficient in SQL and relational databases
- Strong programming skills in Python or another language
- Experience with data warehousing solutions like Snowflake
- Proficiency in DBT (Data Build Tool)
- Cloud experience, such as AWS, GCP or Azure
- Good understanding of ETL processes and data integration
- Strong analytical and problem-solving abilities
Preferred Qualifications
- Certifications such as Snowflake SnowPro Core Certification, dbt Certification, AWS Certified Data Analytics are a plus
- Bachelor’s degree in Computer Science, Information Technology, or a related field
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Category:
Engineering Jobs
Tags: Agile AWS Azure Big Data Computer Science Data Analytics Data pipelines Data Warehousing dbt ETL GCP Pipelines Python RDBMS Security Snowflake SQL
Perks/benefits: Career development Competitive pay Startup environment
Region:
North America
Country:
United States
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Engineer II jobsBI Developer jobsData Scientist II jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsPrincipal Data Engineer jobsData Manager jobsSenior AI Engineer jobsJunior Data Analyst jobsData Science Manager jobsBusiness Data Analyst jobsResearch Scientist jobsData Science Intern jobsPrincipal Software Engineer jobsData Specialist jobsLead Data Analyst jobsSoftware Engineer II jobsSr. Data Scientist jobsData Analyst Intern jobsBI Analyst jobsSoftware Engineer, Machine Learning jobsData Analyst II jobsData Engineer III jobsDevOps Engineer jobsJunior Data Engineer jobs
Snowflake jobsEconomics jobsLinux jobsOpen Source jobsData Warehousing jobsNoSQL jobsAirflow jobsGoogle Cloud jobsHadoop jobsComputer Vision jobsKafka jobsRDBMS jobsMLOps jobsBanking jobsKPIs jobsJavaScript jobsClassification jobsScikit-learn jobsPhysics jobsData warehouse jobsScala jobsOracle jobsStreaming jobsLooker jobsTerraform jobs
GitHub jobsPostgreSQL jobsScrum jobsR&D jobsSAS jobsPySpark jobsBigQuery jobsPandas jobsData Mining jobsCX jobsJira jobsdbt jobsDistributed Systems jobsRobotics jobsIndustrial jobsUnstructured data jobsRedshift jobsMicroservices jobsReact jobsData strategy jobsPharma jobsE-commerce jobsELT jobsJenkins jobsNumPy jobs