Lead Data Engineer (Azure)
Diamond Bar, California, United States
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
Tiger Analytics
An Advanced Analytics and AI consulting services company. Trusted Data sciences, Data engineering partner for Fortune 1000 firms.Simplify data. Explore moreTiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce.
We are expanding our Data Engineering practice and looking for Azure Data Engineers to join our growing team of analytics experts. The right candidate will have strong analytical skills and the ability to combine data from different sources and will strive for efficiency by aligning data systems with business goals.
Requirements
Below are the specifics.
- Data Engineering Lead – 9+ years’ experience leading DE engagements
- Strong program management experience, managing complex data engineering initiatives – stakeholder management, risk management, offshore coordination with 6-10 members DE team.
- Strong in communication; both at executive as well as execution level
- Primary Skill- Azure, Databricks, SQL, Python
- Secondary Skill- On Prem to Cloud Migration
- Proficiency in Python programming.
- Proficiency in SQL queries
- Experience building data pipelines using Azure stack
- 2+ years of experience using Apache spark
- Good working experience on Delta Lake and ETL processing
- Prior experience of working in a Unix environment
- Experience in harmonizing raw data into a consumer-friendly format using Azure Databricks
- Experience extracting/querying/joining large data sets at scale
- Experience building data ingestion pipelines using Azure Data Factory to ingest structured and unstructured data
- Experience in data wrangling, advanced analytic modeling is preferred
- Strong communication and organizational skills
Benefits
This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Azure Databricks Data pipelines Engineering ETL Pipelines Python Spark SQL Unstructured data
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.