Data Engineer III
Chennai
PDI Technologies
At PDI Technologies, we empower some of the world's leading convenience retail and petroleum brands with cutting-edge technology solutions that drive growth and operational efficiency. By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make more informed decisions, and engage faster with customers through loyalty programs, shopper insights, and unmatched real-time market intelligence via mobile applications, such as GasBuddy. We’re a global team committed to excellence, collaboration, and driving real impact. Explore our opportunities and become part of a company that values diversity, integrity, and growth.
Role Overview:
PDI is seeking a talented and motivated Full Time Data Engineer III to join our elite agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies.
The ideal candidate will have hands-on experience in coding data pipelines, administering databases, and working with business users to understand and meet their data requirements. This role involves maintaining high performance and security of our data systems, performing quality assurance, and supporting the company’s data infrastructure, primarily using AWS, Snowflake and DBT.
Role Overview:
PDI is seeking a talented and motivated Full Time Data Engineer III to join our elite agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies.
The ideal candidate will have hands-on experience in coding data pipelines, administering databases, and working with business users to understand and meet their data requirements. This role involves maintaining high performance and security of our data systems, performing quality assurance, and supporting the company’s data infrastructure, primarily using AWS, Snowflake and DBT.
Key Responsibilities:
- Design and manage complex data architectures.
- Lead the development and optimization of data pipelines and ETL processes.
- Mentor junior engineers and provide technical guidance.
- Collaborate with cross-functional teams to understand and meet data requirements.
- Ensure the reliability and performance of data systems.
- Conduct data validation and quality assurance.
- Document data workflows and technical specifications.
- Participate in agile development processes.
- Implement industry standards and best practices.
- Maintain data security and compliance.
- Provide on-call support as required.
- Estimate and plan data engineering projects.
- Develop strategies for data storage, processing, and archiving.
- Troubleshoot and resolve complex data issues.
Qualifications:
- Advanced SQL skills and proficiency in multiple programming languages.
- Extensive experience with data warehousing, specifically Snowflake.
- Proficiency in DBT (Data Build Tool).
- Extensive experience in Cloud, such as AWS, GCP or Azure
- Strong problem-solving and project management skills.
- Excellent communication and leadership abilities.
- Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
Preferred Qualifications:
- Certifications such as Snowflake SnowPro Core Certification, dbt Certification, AWS Certified Data Analytics are a plus.
Behavioral Competencies:
- Ensures Accountability
- Manages Complexity
- Communicates Effectively
- Balances Stakeholders
- Collaborates Effectively
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Category:
Engineering Jobs
Tags: Agile Architecture AWS Azure Big Data Computer Science Data Analytics Data pipelines Data Warehousing dbt Engineering ETL GCP Pipelines Security Snowflake SQL
Perks/benefits: Career development Competitive pay Startup environment
Region:
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Business Intelligence Developer jobsPrincipal Data Engineer jobsData Scientist II jobsBI Developer jobsStaff Data Scientist jobsData Manager jobsJunior Data Analyst jobsResearch Scientist jobsData Science Manager jobsLead Data Analyst jobsBusiness Data Analyst jobsSenior AI Engineer jobsData Engineer III jobsData Specialist jobsData Science Intern jobsSr. Data Scientist jobsData Analyst Intern jobsData Analyst II jobsSoftware Engineer II jobsPrincipal Software Engineer jobsSoftware Engineer, Machine Learning jobsAzure Data Engineer jobsBI Analyst jobsJunior Data Engineer jobsSenior Data Scientist, Performance Marketing jobs
Snowflake jobsLinux jobsEconomics jobsOpen Source jobsHadoop jobsJavaScript jobsBanking jobsComputer Vision jobsGoogle Cloud jobsKafka jobsRDBMS jobsPhysics jobsData Warehousing jobsNoSQL jobsAirflow jobsR&D jobsMLOps jobsKPIs jobsScala jobsOracle jobsData warehouse jobsStreaming jobsClassification jobsGitHub jobsPostgreSQL jobs
Scikit-learn jobsSAS jobsCX jobsTerraform jobsData Mining jobsScrum jobsPandas jobsPySpark jobsDistributed Systems jobsRobotics jobsIndustrial jobsBigQuery jobsJira jobsLooker jobsUnstructured data jobsJenkins jobsE-commerce jobsRedshift jobsReact jobsMicroservices jobsdbt jobsData strategy jobsPharma jobsMySQL jobsNumPy jobs