Azure Databricks - Technical Lead-Data Engg
INDIA - NOIDA- BIRLASOFT OFFICE, IN
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Build CI CD pipelines for data workloads using Azure DevOps
- Build reusable PySpark frameworks for ingestion transformation and validation
- Design and maintain batch and near real time data pipelines
- Design and monitor ETL ELT pipelines with Azure Data Factory
- Develop and optimize T SQL queries stored procedures and schemas
- Ensure secure data access with Key Vault managed identities and service principals
- Follow data security RBAC and governance standards
- Implement medallion architecture
- Implement operational logging monitoring and data quality checks
- Tune query performance and refine data models
- Use Git for version control pull requests and code reviews
Perks/Benefits
- N/A
Skills/Tech-stack
Analytical modeling | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Key Vault | Azure SQL | Azure SQL Database | CI/CD | Data Factory | Data Modeling | Delta Lake | Dimensional Modeling | ELT | ETL | Git | Key Vault | Managed Identities | Medallion Architecture | PySpark | RBAC | SQL | SQL Database | Service principals | T-SQL | VNet
Education
N/A
Related jobs
-
Data Bricks Engineer INR 1500K-2400KDatabricks | Databricks SQL | Delta Lake | JSON-RPC | MLflowWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India2h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India3h ago
-
Senior AI Engineer INR 3000K-5000KAPI deployment | Adversarial Testing | Auto Retraining | Azure ML | CI/CDSenior-level Full TimeBangalore8h ago
-
Azure Data | Azure Data Factory | CI/CD | Data Factory | Data ReconciliationSenior-level Full TimeBangalore, India9h ago
-
BI Developer (Power BI + Tableau) INR 1400K-2500KDAX | Data Modeling | Data Quality | Data Visualization | Data WarehousingMid-level Full TimeGurugram, Haryana, India9h ago
-
Senior Talend Developer / Lead Data Engineer INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full Timebengaluru, India10h ago
-
Solutions Architect INR 2400K-3500KADLS | AWS | Airflow | Azure | CassandraBootcamp training | Broadband reimbursement | Continuous learning opportunities | Medical insurance | Paid certificationsSenior-level Full TimeIndia - Remote R10h ago
-
Sr. SW Engineer, Machine Learning INR 2475K-3465KA/B | A/B Testing | Agent systems | B testing | CI/CDFinancial wellness support | Hybrid work | Mental health support | Time offSenior-level Full TimeBengaluru, India10h ago
-
Sr GIS Data Engineer -Python l AI ML l SQL INR 1800K-2500KArcGIS | Batch Processing | Data Pipelines | Data Quality | FMESenior-level Full TimeMumbai, MH, India10h ago
-
Mid-level Full TimeIT Centre Bengaluru GDTC, India14h ago
-
Senior Data Engineer INR 1500K-2500KAccess Control | Azure | Azure Data | Azure Data Factory | Azure SQLSenior-level Full TimeHyderabad, IN, 500 00814h ago
-
Java Technical Lead- Career INR 2000K-3000KAWS | Airflow | Apache Beam | Atlassian | AzureHealthcare package | Hybrid work | Learning platform with guided career tracks | Paid time offSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India14h ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | Azure SQLSenior-level Full TimeGurugram 10 C, India14h ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | C#Senior-level Full TimeGurugram 10 C, India14h ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | C#Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India14h ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | C#Flexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeGurugram 10 C, India14h ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAI/ML | Azure Data | Azure Data Factory | Azure Databricks | Azure SQLSenior-level Full TimeBengaluru Millenia, India14h ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SQL DatabaseFlexibility programmes | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India14h ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAI/ML | AI/ML data | AI/ML data preparation | Azure Data | Azure Data FactorySenior-level Full TimeBengaluru Millenia, India14h ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SQL DatabaseEqual employment opportunities | Flexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India14h ago
-
Mid-level Full TimeHyderabad, Telangana, India14h ago
-
EY - GDS Consulting - AIA -Generative AI - Senior INR 1960K-3300KAWS CloudFormation | Amazon Web Services | Apache Spark | Azure | Azure DevOpsCoaching and Mentorship | Continuous learning | Diverse and inclusive culture | Tools and flexibilitySenior-level Full TimeKolkata, WB, IN, 70009114h ago
-
Senior-level Full TimeBangalore, India14h ago
-
Senior-level Full TimeIndia - Bangalore - 5th floor, …14h ago
-
Senior-level Full TimeIndia - Bangalore - Export Promotion …14h ago