Data Engineer III
Chennai
PDI Technologies
PDI Technologies helps fuel and convenience businesses increase productivity, profitability, loyalty, and security by Connecting Convenience.
At PDI Technologies, we empower some of the world's leading convenience retail and petroleum brands with cutting-edge technology solutions that drive growth and operational efficiency.
By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make more informed decisions, and engage faster with customers through loyalty programs, shopper insights, and unmatched real-time market intelligence via mobile applications, such as GasBuddy. We’re a global team committed to excellence, collaboration, and driving real impact. Explore our opportunities and become part of a company that values diversity, integrity, and growth.
Role Overview:PDI is seeking a talented and motivated Full Time Data Engineer III to join our elite agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies. The ideal candidate will have hands-on experience in coding data pipelines, administering databases, and working with business users to understand and meet their data requirements. This role involves maintaining high performance and security of our data systems, performing quality assurance, and supporting the company’s data infrastructure, primarily using AWS, Snowflake and DBT.
By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make more informed decisions, and engage faster with customers through loyalty programs, shopper insights, and unmatched real-time market intelligence via mobile applications, such as GasBuddy. We’re a global team committed to excellence, collaboration, and driving real impact. Explore our opportunities and become part of a company that values diversity, integrity, and growth.
Role Overview:PDI is seeking a talented and motivated Full Time Data Engineer III to join our elite agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies. The ideal candidate will have hands-on experience in coding data pipelines, administering databases, and working with business users to understand and meet their data requirements. This role involves maintaining high performance and security of our data systems, performing quality assurance, and supporting the company’s data infrastructure, primarily using AWS, Snowflake and DBT.
Key Responsibilities:
- Design and manage complex data architectures.
- Lead the development and optimization of data pipelines and ETL processes.
- Mentor junior engineers and provide technical guidance.
- Collaborate with cross-functional teams to understand and meet data requirements.
- Ensure the reliability and performance of data systems.
- Conduct data validation and quality assurance.
- Document data workflows and technical specifications.
- Participate in agile development processes.
- Implement industry standards and best practices.
- Maintain data security and compliance.
- Provide on-call support as required.
- Estimate and plan data engineering projects.
- Develop strategies for data storage, processing, and archiving.
- Troubleshoot and resolve complex data issues.
Qualifications:
- Advanced SQL skills and proficiency in multiple programming languages.
- Extensive experience with data warehousing, specifically Snowflake.
- Proficiency in DBT (Data Build Tool).
- Extensive experience in Cloud, such as AWS, GCP or Azure
- Strong problem-solving and project management skills.
- Excellent communication and leadership abilities.
- Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
Preferred Qualifications:
- Certifications such as Snowflake SnowPro Core Certification, dbt Certification, AWS Certified Data Analytics are a plus.
Behavioral Competencies:
- Cultivates Innovation
- Decision Quality
- Manages Complexity
- Drives Results
- Business Insight
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
3
0
0
Category:
Engineering Jobs
Tags: Agile Architecture AWS Azure Big Data Computer Science Data Analytics Data pipelines Data Warehousing dbt Engineering ETL GCP Pipelines Security Snowflake SQL
Perks/benefits: Career development Competitive pay Startup environment
Region:
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Scientist II jobsData Engineer II jobsSr. Data Engineer jobsStaff Data Scientist jobsPrincipal Data Engineer jobsPrincipal Software Engineer jobsStaff Machine Learning Engineer jobsData Science Manager jobsBusiness Intelligence Analyst jobsData Manager jobsData Science Intern jobsSoftware Engineer II jobsDevOps Engineer jobsJunior Data Analyst jobsData Analyst Intern jobsData Specialist jobsSr. Data Scientist jobsBusiness Data Analyst jobsStaff Software Engineer jobsLead Data Analyst jobsAI/ML Engineer jobsSenior Backend Engineer jobsData Governance Analyst jobsResearch Scientist jobsData Engineer III jobs
NLP jobsAirflow jobsOpen Source jobsTerraform jobsMLOps jobsLinux jobsKPIs jobsEconomics jobsKafka jobsNoSQL jobsJavaScript jobsData Warehousing jobsComputer Vision jobsGoogle Cloud jobsPostgreSQL jobsRDBMS jobsGitHub jobsScikit-learn jobsPhysics jobsBanking jobsStreaming jobsData warehouse jobsR&D jobsScala jobsHadoop jobs
dbt jobsPandas jobsBigQuery jobsClassification jobsLooker jobsOracle jobsReact jobsScrum jobsDistributed Systems jobsCX jobsPySpark jobsRAG jobsMicroservices jobsPrompt engineering jobsELT jobsRedshift jobsIndustrial jobsJira jobsRobotics jobsGPT jobsTypeScript jobsOpenAI jobsSAS jobsLangChain jobsNumPy jobs