Lead Software Engineer - Data Engineering
Chennai, Tamil Nadu, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Architect scalable secure data platforms
- Build ETL and ELT pipelines
- Build and maintain data lakes and data warehouses
- Communicate technical concepts to non-technical audiences
- Create data pipelines with Snowflake and dbt
- Deploy services using CI/CD
- Design near real time streaming architectures
- Develop manufacturing analytics predictive maintenance and supply chain analytics
- Enable ML model operationalization with data pipelines
- Establish data quality lineage and schema evolution
- Implement data governance and metadata management
- Lead and mentor data engineering team
- Leverage Azure and AWS for data ingestion and transformation
- Optimize storage retrieval and processing for performance
- Partner with stakeholders to gather requirements
- Support real time analytics and edge ai
Perks/Benefits
Skills/Tech-stack
AWS | AWS CloudFormation | Apache Kafka | Apache Spark | Azure | Azure CloudFormation | Azure Data | Azure Data Factory | Azure DevOps | Big Data | CI/CD | DBT | Data Factory | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Quality | Data Visualization | Data Warehousing | ELT | ETL | Jenkins | Looker | MLOps | Machine Learning | Metadata Management | NoSQL | Power BI | Real Time | Real-time Data | SQL | Schema evolution | Snowflake | Streaming Architecture | Tableau
Education
Related jobs
-
Founder’s office - AI Enablement INR 2000K-5000KAPI Integration | Artificial Intelligence | Change Management | Enterprise Architecture | Machine LearningMid-level Full TimeBengaluru, Karnataka, India2d ago
-
Agile | Confluence | Data Engineering | Data Ingestion | DevOpsContinuous professional development | Flexible working | Inclusive and diverse environmentMid-level Full TimePune, Maharashtra, India R2d ago
-
Sub Value Stream Technology Delivery Lead/Sr. Associate Director, Data and Analytics INR 1400K-2100KAgile | CI/CD | Cloud Native | Cloud platform | ComplianceMid-level Full TimePune, Maharashtra, India R2d ago
-
Team Leader - Data Management INR 1500K-2700KCRP | Cause analysis | Cloudera | Data Governance | Data ManagementSenior-level Full TimePondicherry, Puducherry, IND, 6051112d ago
-
Lead Data Engineer with AI experience INR 2000K-4500KAWS | Access Control | Attribute-Based Access Control | Attribute-based access | Audit LoggingSenior-level Full TimeIndia3d ago
-
Generative AI / Associate Director, Software Engineering INR 1400K-1800KActive Directory | Agile | Alerting | Ansible | Apache KafkaMid-level Full TimePune, Maharashtra, India R3d ago
-
BI Lead (Power BI / Tableau) INR 1500K-3500KCI/CD | DAX | Data Governance | Data Modeling | Power BISenior-level Full TimeGurugram, Haryana, India3d ago
-
Amazon Web Services | Batch ETL | Big Data | Data Architecture | Data GovernanceSenior-level Full TimeMumbai, Mahārāshtra, India3d ago
-
Senior Talend Developer / Lead Data Engineer INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full Timebengaluru, India3d ago
-
Lead Data Scientist INR 2500K-4000KApache Hadoop | Apache Spark | Association Rules | Bayesian Networks | ClassificationCollaborative and inclusive work culture | Continuous learning and skill development | Flexible working arrangementsSenior-level Full TimeMumbai, India3d ago
-
Java Technical Lead- Career INR 2000K-3000KAWS | Airflow | Apache Beam | Atlassian | AzureHealthcare package | Hybrid work | Learning platform with guided career tracks | Paid time offSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India3d ago
-
Manager Data and AI Engineering INR 1500K-3000KAgile | Artificial Intelligence | BI | Business Analysis | Cloud DataMid-level Full TimeBangalore, India3d ago
-
Senior-level Full TimeIN022 Hyderabad, India3d ago
-
Data Engineering/Enablement Associate INR 800K-1263KApplication Integration | Application Programming | Application Programming Interface | Application Programming Interface (API) | AutomationMid-level Full TimePune, India3d ago
-
Lead Consultant - Data Engineering INR 3000K-4000KAPIs | AWS | Accessibility | Artificial Intelligence | BigQuerySenior-level Full TimeIndia - Chennai3d ago
-
Lead Product AI Data Engineer & Architect INR 2000K-4000KAWS | Apache Airflow | Cloud platform | DBT | Data WarehousingEqual employment opportunity | Full-time employment | Hybrid working environmentSenior-level Full TimeR131-Bangalore, India3d ago
-
Cloud & Data Platform Architect INR 2000K-4000KAWS | Alerting | Audit controls | Automated testing | AzureFlexible benefits packageSenior-level Full TimeGH Office: Hyderabad, India3d ago
-
Software Engineering Manager - HIH - Evernorth INR 1000K-1500KAlerting | CI/CD | Cause analysis | Collibra | Data GovernanceMid-level Full TimeHIH - Hyderabad, India3d ago
-
Lead/Senior Software Engineer – User Foundations Platform INR 2000K-4725KAWS | CI/CD | Data Structures | Data Structures and Algorithms | GCPSenior-level Full TimeIND - Bangalore - Ecoworld 6B …3d ago
-
Senior-level Full TimeIND Pune, India3d ago
-
Lead Consultant - Data Engineering INR 3000K-4000KAPI Integration | AWS | Artificial Intelligence | BigQuery | CI/CDSenior-level Full TimeIndia - Chennai3d ago
-
Senior Data Science Lead (Gen AI/ Agentic AI) - Vice President INR 2000K-4800KAgentic AI | Agile | Apache Hive | Big Data | ComplianceSenior-level Full TimeAMRUTHAHALLI, NH 7,INTERNATION, India3d ago
-
Senior-level Full TimePune, India3d ago
-
Applied AI/ML Lead INR 3000K-5000KApache Hive | Apache Spark | Data Analysis | Data Wrangling | KerasSenior-level Full TimeBengaluru, Karnataka, India3d ago
-
Senior-level Full TimePune, Maharashtra, India3d ago