Lead Data Engineer
Hyderabad, Andhra Pradesh, India; Pune, Maharashtra, India; India; India
Apexon
Apexon is a Digital Technology Services & Platform Solutions Company that provide solutions in the areas of Experience, Digital Engineering, Data & Analytics, AI, and cloudAs a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data warehouse platform and reporting processes.
Responsibilities
· Design, develop & implement ETL processes on Pyspark, Azure Cloud using Databricks and Azure Synapse
· Advanced SQL knowledge, capable to write optimized queries for faster data work flows.
· Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.
· Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies and best practices
Requirements
· Bachelor's Degree or master’s degree in Computer Science.
· 10+ years of hands-on software engineering experience.
· Proven work experience in Spark , Python ,SQL , Any RDBMS.
· Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS
· Strong database fundamentals including SQL, performance and schema design.
· Understanding of CI/CD framework is an added advantage.
· Ability to interpret/write custom shell scripts. Python scripting is a plus.
· Experience with any cloud is desired (Azure platform and Synapse/ AWS).
· Experience with Git / Azure DevOps
- To be able to work in a fast-paced agile development environment.
If this role sounds like you, we invite you to apply. Our recruiting team will be in touch shortly with qualified candidates regarding next steps.
Disclaimer: If you feel that this is a good match for your skillsets, please submit a current word version of your resume along with a cover letter describing your skills, experience and salary expectations. We are an Equal Opportunity Employer (EOE). You can read our job applicant privacy policy here.* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture AWS Azure CI/CD Computer Science Databricks Data pipelines Data warehouse DevOps ELT Engineering ETL Git Pipelines Privacy PySpark Python RDBMS Spark SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.