Technical Lead-Data Engg
INDIA - NOIDA- BIRLASOFT OFFICE, IN
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Architect data warehouse and lakehouse solutions
- Build and optimize ELT/ETL pipelines
- Define technical standards and reusable frameworks
- Design and implement PySpark transformations on Azure Databricks
- Ensure data security reliability and cost optimization
- Implement data ingestion frameworks for multiple sources
- Integrate Databricks with CI/CD pipelines
- Lead data engineering solution design
- Manage Databricks job pipelines notebooks and clusters
- Orchestrate reliable data workflows in Azure Data Factory
- Provide technical leadership across delivery lifecycle
- Tune clusters and optimize performance
- Use Delta Lake features for enterprise datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Analytical Functions | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Synapse | CI/CD | Data Factory | Data Lake Storage | Data Partitioning | Delta Lake | Dimensional Modeling | ELT | ETL | Event Hubs | PySpark | SQL | Scrum | Stored Procedures
Education
N/A
Related jobs
-
Senior ML Engineer INR 3000K-4000KAzure | Azure DevOps | Change Management | Classification | ClusteringAnnual leave | Employee assistance programme | Employee wellbeing platform Unmind | Flexible working | Learning and development opportunitiesSenior-level Full TimeChennai, IN5h ago
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India10h ago
-
Senior-level Full TimeHyderabad India - Block B10h ago
-
Staff Database Platform Engineer INR 2500K-4200KAWS IAM | AWS RDS | Amazon EC2 | Amazon S3 | AnsibleSenior-level Full TimeIN - India - Bangalore10h ago
-
Spclst , Data Engineering INR 1163K-2558KAWS EMR | AWS Glue | AWS IAM | AWS Lake | AWS Lake FormationMid-level Full TimeIND - Telangana - Hyderabad (Hitec …13h ago
-
AI Developer INR 346K-360KAWS | Agile | Amazon EventBridge | CI/CD | Cloud ComputingMedical benefits | Paid time off | Wellbeing benefits | Work-life balanceEntry-level Full TimeHyderabad, India20h ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R20h ago
-
Senior Data Scientist - AI Engineering INR 3264K-5000KAWS | AWS Bedrock | Agentic AI | Anthropic Claude | Automated RegressionCareer growth | Company-sponsored certifications | Innovation time | Mentorship | SnacksSenior-level Full TimeHyderabad, TS, India20h ago
-
Manager: Embedded Electronics & PCBA Design CoE INR 2500K-4000KANSYS | Agile | CAM Editing | CAM Validation | CAM350Senior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101320h ago
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …21h ago
-
Senior Analytics Engineer INR 3600K-5000KAI Agents | AI Evaluation | AI Foundry | API Development | Agent OrchestrationSenior-level Full TimeIndia21h ago
-
Data Engineer INR 302K-480KAgile | Apache Airflow | Cloud Composer | Cloud Storage | Cloud platformEntry-level Full TimeIN-MH-Pune21h ago
-
Senior-level Full TimeIN-TN-Chennai21h ago
-
Senior Machine Learning Engineer INR 3584K-4800KAWS | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Development programs | Learning and development programs | Remote work flexibility | Work from office or client siteSenior-level Full TimeBangalore, India R21h ago
-
Senior Data Management Professional – Process Automation & Data Operations, Company Financials Data , Pune INR 2800K-4000KCI/CD | Cause analysis | Data Governance | Data Monitoring | Data ObservabilityPlatinum customer supportSenior-level Full TimePune21h ago
-
Assistant Manager INR 1500K-2500KData Governance | Data Lakes | Data Pipelines | Data Quality | Data SecurityMid-level Full TimeMaharashtra, India22h ago
-
Software Engineer (AI/ML) INR 500KAttention Mechanisms | Distributed Computing | Domain Adaptation | Embeddings | Entity recognitionEmployee assistance program | Group term life insurance | Learning and development opportunities | Maternity leave | Medical insuranceMid-level Full TimeBengaluru, Onsite22h ago
-
Staff Software Engineer - India INR 4000K-5000KAPI Development | AWS | Agentic AI | Azure | Cloud infrastructureCareer growth | High visibility and impact | Open Source contributionSenior-level Full TimeBengaluru R22h ago
-
CDP,Snowflake,SQL,Java, API, AWS - (6-9 Yrs) - CHN INR 2000K-3000KAPI Integration | AWS | Audience Management | Customer Data | Customer Data PlatformSenior-level Full TimeIndia22h ago
-
Senior Software Engineer - Platform INR 3500K-5000KAWS | Apache Kafka | Azure | CI/CD | Cloud platformSenior-level Full TimeIndia (Bengaluru)22h ago
-
Senior QA Engineer INR 2500K-5000KAI-assisted testing | API Testing | Authentication | CI/CD | Case designSenior-level Full TimeBengaluru23h ago
-
Data Engineer ((SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Factory | Databricks | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India23h ago
-
API Integration | AWS | Anomaly Detection | Azure | Data LineageSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Data Governance | Data Modeling | Data Quality | Data ResiliencyDiversity inclusion and respectMid-level Full TimeHyderabad, Telangana, India23h ago
-
Lead - Agentic AI Engineer INR 2500K-5000KAgent Development Kit | Anomaly Detection | CI/CD | Cloud Computing | Data PreprocessingSenior-level Full TimeChennai, Tamil Nadu, India1d ago