Senior Data Engineer- Tech Lead (immediate role)
India - Remote
Applications have closed
Zealogics
Digital transformation and Engineering services company working with Fortune 500 customers across Industries for a Sustainable Tomorrow.
Responsibilities
- Able to participate in business discussions and assist gathering data requirements. Good analytical and problem-solving skills to help address data challenges by leading a team
- Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and performance tuning. Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the data. Hands on experience with PySQL/Pyspark etc.
- Hands on Experience in creating and managing data pipelines using Azure Data Factory. Understanding of data integration, transformation, and workflow orchestration in Azure environments.
- Knowledge of data engineering workflows and best practices in Databricks. Able to understand existing templates and patterns for development. Hands on experience with Unity Catalog and Databricks workflow.
- Proficiency in using Git for version control and collaboration in data projects. Ability to work effectively in a team environment, especially in agile or collaborative settings.
- Clear and effective communication skills to articulate findings and recommendations for other team members. Ability to document processes, workflows, and data analysis results effectively.
- Willingness to learn new tools, technologies, and techniques as the field of data analytics evolves. Being adaptable to changing project requirements and priorities.
- 9+ years of overall experience with more than 5 years of expertise in Azure technologies
- Ability to envision/lead E2E solution and solve technical issue during offshore.
- Azure Databricks, Data Lakehouse architectures, and Azure Data Factory.
- Expertise in optimizing data workflows and predictive modeling.
- Designing and implementing data pipelines using Databricks, Spark,
- Expertise in batch and streaming data solutions, automating workflows with CI/CD tools like Jenkins and Azure DevOps, and ensuring data governance with Delta Lake
- Spark, PySpark, Delta Lake, Azure DevOps, Python.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
1
0
0
Categories:
Engineering Jobs
Leadership Jobs
Tags: Agile Architecture Azure CI/CD Data analysis Data Analytics Databricks Data governance Data pipelines DevOps Engineering Git Jenkins Pipelines Predictive modeling PySpark Python Spark SQL Streaming
Regions:
Remote/Anywhere
Asia/Pacific
Country:
India
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Sr. Data Engineer jobsBusiness Intelligence Developer jobsPrincipal Data Engineer jobsBI Developer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsPrincipal Software Engineer jobsJunior Data Analyst jobsData Science Intern jobsDevOps Engineer jobsData Science Manager jobsSoftware Engineer II jobsData Manager jobsLead Data Analyst jobsData Analyst Intern jobsStaff Software Engineer jobsAccount Executive jobsBusiness Data Analyst jobsAI/ML Engineer jobsSr. Data Scientist jobsData Specialist jobsData Governance Analyst jobsSenior Backend Engineer jobsData Engineer III jobsBusiness Intelligence Analyst jobs
Consulting jobsMLOps jobsAirflow jobsOpen Source jobsEconomics jobsLinux jobsKPIs jobsKafka jobsTerraform jobsGitHub jobsJavaScript jobsRDBMS jobsPostgreSQL jobsData Warehousing jobsClassification jobsNoSQL jobsStreaming jobsScikit-learn jobsBanking jobsComputer Vision jobsPrompt engineering jobsRAG jobsPhysics jobsGoogle Cloud jobsOracle jobs
Pandas jobsdbt jobsHadoop jobsScala jobsBigQuery jobsGPT jobsR&D jobsData warehouse jobsReact jobsLangChain jobsScrum jobsDistributed Systems jobsPySpark jobsLooker jobsMicroservices jobsIndustrial jobsELT jobsCX jobsSAS jobsJira jobsOpenAI jobsRedshift jobsModel training jobsRobotics jobsTypeScript jobs