Technical Lead-Data Engg
INDIA - NOIDA- BIRLASOFT OFFICE, IN
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Architect data warehouse and lakehouse solutions
- Build and optimize ELT/ETL pipelines
- Define technical standards and reusable frameworks
- Design and implement PySpark transformations on Azure Databricks
- Ensure data security reliability and cost optimization
- Implement data ingestion frameworks for multiple sources
- Integrate Databricks with CI/CD pipelines
- Lead data engineering solution design
- Manage Databricks job pipelines notebooks and clusters
- Orchestrate reliable data workflows in Azure Data Factory
- Provide technical leadership across delivery lifecycle
- Tune clusters and optimize performance
- Use Delta Lake features for enterprise datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Analytical Functions | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Synapse | CI/CD | Data Factory | Data Lake Storage | Data Partitioning | Delta Lake | Dimensional Modeling | ELT | ETL | Event Hubs | PySpark | SQL | Scrum | Stored Procedures
Education
N/A
Related jobs
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India7h ago
-
Senior Data Engineer - Delivery INR 3000K-3900KAnalytics services | App Service | Azure Analytics | Azure Analytics Services | Azure AppSenior-level Full TimePune, MH, India7h ago
-
AVP - QA Automation Engineer - IB Tech & CRM/ Analytics INR 3000K-4000KAWS | AWS Lambda | AWS RDS | Amazon Redshift | Amazon S3Executive-level Full TimePune, India8h ago
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Senior-level Full TimeMumbai, India10h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R11h ago
-
Applied AI ML Associate Senior INR 1200K-2500KAI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India11h ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN11h ago
-
DE&A - Core - Cloud Data Engineering - AWS Data Engineering INR 3000K-4000KAWS | AWS Data | AWS Data Governance | AWS EC2 | Data GovernanceSenior-level Full TimePune, Maharashtra, India12h ago
-
Senior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India13h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R13h ago
-
Manager Data Integration INR 2520K-4064KApache Airflow | BigQuery | Bigtable | Celigo | Cloud ComposerSenior-level Full TimeBengaluru, KA, India14h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN18h ago
-
Senior-level Full TimeBangalore, KA, IN18h ago
-
Senior Data Engineer INR 3200K-4200KAWS | Airflow | Apache Spark | CI/CD | Cloud ComputingCompany-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India18h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R18h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R18h ago
-
Software Development Senior Analyst INR 2000K-4500KAPI Gateway | AWS CloudFormation | AWS Lambda | Agile | Amazon BedrockSenior-level Full TimeChennai, TN, IN18h ago
-
Director, Senior Engineering (.Net FS + AI/ML) INR 2771K-3500K.NET | API Gateway | AWS | AWS CDK | Amazon BedrockContinuing education program | Continuous learning resources | Family-friendly perks | Financial wellness programs | Generous time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India18h ago
-
Senior Data Scientist / AI Engineer INR 3700K-5000KAdapters | Agentic AI | BERT | CI/CD | Command LineSenior-level Full TimeBangalore,IND, India18h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India18h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India18h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India18h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India18h ago