Technical Lead-Data Engg
INDIA - NOIDA- BIRLASOFT OFFICE, IN
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Architect data warehouse and lakehouse solutions
- Build and optimize ELT/ETL pipelines
- Define technical standards and reusable frameworks
- Design and implement PySpark transformations on Azure Databricks
- Ensure data security reliability and cost optimization
- Implement data ingestion frameworks for multiple sources
- Integrate Databricks with CI/CD pipelines
- Lead data engineering solution design
- Manage Databricks job pipelines notebooks and clusters
- Orchestrate reliable data workflows in Azure Data Factory
- Provide technical leadership across delivery lifecycle
- Tune clusters and optimize performance
- Use Delta Lake features for enterprise datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Analytical Functions | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Synapse | CI/CD | Data Factory | Data Lake Storage | Data Partitioning | Delta Lake | Dimensional Modeling | ELT | ETL | Event Hubs | PySpark | SQL | Scrum | Stored Procedures
Education
N/A
Related jobs
-
Senior-level Full TimeBengaluru, KA, India7h ago
-
CDP Specialist (Treasure Data) INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | Big Data | CassandraMid-level Full TimeIN-KA-Bangalore9h ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India10h ago
-
AI Software Engineer INR 1500K-2500KAPI Development | AWS | Access Control | Agentic patterns | AuditabilityCompany bonus/profit share | Flexible work arrangements | Long service awards | Medical benefits | Mobile Phone ReimbursementMid-level Full TimeChennai, India10h ago
-
Senior Data Engineer - Delivery INR 3000K-3900KAnalytics services | App Service | Azure Analytics | Azure Analytics Services | Azure AppSenior-level Full TimePune, MH, India11h ago
-
Team Member - IP, CE Data & Conv Core INR 2000K-2500KGenerative AI | HTML | Jira | Power BI | PythonSenior-level Full TimeNavi Mumbai, Maharashtra, India11h ago
-
AVP - QA Automation Engineer - IB Tech & CRM/ Analytics INR 3000K-4000KAWS | AWS Lambda | AWS RDS | Amazon Redshift | Amazon S3Executive-level Full TimePune, India12h ago
-
Product Engineering Specialist INR 2500K-5000KAI Foundry | AI Governance | AI Solution | AI Solution Architecture | AI platformsSenior-level Full TimePune, Maharashtra, India12h ago
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Senior-level Full TimeMumbai, India13h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R14h ago
-
Applied AI ML Associate Senior INR 1200K-2500KAI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India14h ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN15h ago
-
DE&A - Core - Cloud Data Engineering - AWS Data Engineering INR 3000K-4000KAWS | AWS Data | AWS Data Governance | AWS EC2 | Data GovernanceSenior-level Full TimePune, Maharashtra, India15h ago
-
Senior-level Full TimeBengaluru, Karnataka, India15h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India16h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R17h ago
-
Manager Data Integration INR 2520K-4064KApache Airflow | BigQuery | Bigtable | Celigo | Cloud ComposerSenior-level Full TimeBengaluru, KA, India18h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN22h ago
-
Senior-level Full TimeBangalore, KA, IN22h ago
-
Senior Data Engineer INR 3200K-4200KAWS | Airflow | Apache Spark | CI/CD | Cloud ComputingCompany-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India22h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R22h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R22h ago
-
Software Development Senior Analyst INR 2000K-4500KAPI Gateway | AWS CloudFormation | AWS Lambda | Agile | Amazon BedrockSenior-level Full TimeChennai, TN, IN22h ago
-
Director, Senior Engineering (.Net FS + AI/ML) INR 2771K-3500K.NET | API Gateway | AWS | AWS CDK | Amazon BedrockContinuing education program | Continuous learning resources | Family-friendly perks | Financial wellness programs | Generous time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India22h ago