Lead Software Engineer - Data Engineering
Chennai, Tamil Nadu, India
INR 2000K-2400K (estimate) Senior-level Full Time
Tasks
- Architect scalable secure data platforms
- Build Data Lakes and Data Warehouses
- Build Snowflake data pipelines
- Communicate technical concepts to non-technical audiences
- Deploy with CI/CD tools
- Design scalable data architectures for analytics
- Design streaming data movement
- Drive Agile practices and delivery
- Ensure platform scalability, security, and operational readiness
- Establish data governance and metadata management
- Implement data modeling etl elt
- Implement data quality frameworks
- Integrate gen ai capabilities into pipelines
- Lead and mentor data engineers
- Manage schema evolution strategies
- Operationalize ml models with data pipelines
- Optimize data storage, retrieval, and processing
- Partner with stakeholders to deliver data solutions
- Support real time analytics and edge ai
- Track data lineage
- Use azure and aws for ingestion transformation analytics
Perks/Benefits
Skills/Tech-stack
AWS | AWS CloudFormation | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOps | Big Data | CI/CD | DBT | Data Engineering | Data Factory | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Quality | Data Visualization | Data Warehousing | Distributed Systems | ELT | ETL | Edge AI | Jenkins | Kafka | Looker | MLOps | Machine Learning | Metadata Management | NoSQL | Power BI | Real Time | Real-time analytics | SQL | Schema evolution | Snowflake | Streaming Data | Tableau
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN2h ago
-
GCP Data Engineer Lead INR 1500K-2500KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeHyderabad, TS, India4h ago
-
Principal AI Engineer INR 2000K-4500KAPI Integration | AWS Bedrock | Agent Orchestration | CI/CD | Deep learningSenior-level Full TimeBangalore, KA, IN10h ago
-
Lead AI Software Engineer INR 2000K-4500KAI Agents | AWS | Azure | CI/CD | Cloud platformCareer growth | Career growth in technology domain | Continuous learningSenior-level Full TimePune City, India20h ago
-
Senior-level Full TimeIndia23h ago
-
Data Integration Lead INR 1500K-2500KCICD | Control-M | IBM InfoSphere | IBM Infosphere DataStage | InfoSphere-DataStageClient facing communication | Production support experienceSenior-level Full TimeIndia23h ago
-
Amaze - Cloud Data Architect INR 1200K-2000KApache Airflow | Azure | Integration Services | Java | Power BISenior-level Full TimeIndia23h ago
-
CLOUD AMAZE - DW Lead (Practice) INR 1500K-2500KAzure | Azure Databricks | Cloud Computing | Data Architecture | Data EngineeringSenior-level Full TimeIndia1d ago
-
Senior-level Full TimeIndia1d ago
-
Agile | Data Governance | Data Visualization | Excel | JiraCareer growth opportunities | Dynamic flexible work culture | Fully remote work within India | Inclusive environment | Opportunity to lead and grow analytics teamSenior-level Full TimeIndia R1d ago
-
JAVA Data Engineering/Associate Director Software Engineering INR 1400K-2200KApache Beam | Apache Flink | Apache Kafka | Apache Spark | Data PipelinesCareer growth | Continuous professional development | Flexible working | Inclusive work environmentMid-level Full TimePune, Maharashtra, India R1d ago
-
Lead Data Scientist INR 3000K-4000KAWS | Azure | Classification | Clustering | Experiment designFlexibility | Health benefitsSenior-level Full TimePune City,India R1d ago
-
Mid-level Full TimeHyderabad, Telangana, India1d ago
-
Agile | Excel | Jira | Looker | Power BICareer development | Evening shift scheduling | Fully remote work | Inclusive workplace | Upskilling opportunitiesSenior-level Full TimeIndia R1d ago
-
API | AWS | Anthropic | Authentication | CI/CDCareer growth opportunities | Certification sponsorship | Education sponsorship | Flexible leave policies | Health insuranceSenior-level Full TimeIndia1d ago
-
Lead Data Scientist-Digital Banking Kotak 811-Regional Sales INR 3000K-4000KCI/CD | Data Analysis | Deep learning | Experiment design | Exploratory Data AnalysisSenior-level Full TimeBangalore, Karnataka, India1d ago
-
AWS | Always On | Backup and Recovery | Compliance | Database ArchitectureCareer development | Follow the sun support environment | Global multicultural work environment | Mentoring opportunities | Remote workSenior-level Full TimeIndia1d ago
-
AWS Data Specialist - R01558578 INR 2000K-2750KAWS | AWS CloudFormation | AWS CodePipeline | AWS Glue | AWS LambdaSenior-level Full TimePune, Maharashtra, India1d ago
-
Lead Data Architect INR 1500K-2500KAWS | Agile | Amazon Redshift | Apache Spark | BigQueryRelocationSenior-level Full TimeIND - Bangalore, India1d ago
-
IN_Manager_Data Analyst_Digital Integration_Advisory_Kolkata INR 1400K-2300KAlation | Azure Data | Azure Data Services | Azure Purview | CollibraFlexible working | Inclusive benefits programs | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India1d ago
-
Director Data Engineering INR 3000K-6000KAPI Management | APIs | Azure API | Azure API Management | Azure DataExecutive-level Full TimeBangalore, India1d ago
-
Experienced Lead engineer in Storage/Networking domain INR 1500K-2772KAccess Control | Algorithms | BGP | Cloud Architecture | Data StructuresHealth and wellbeing benefits | Hybrid work | Inclusive workplace | Professional developmentSenior-level Full TimeBengaluru, Karnātaka, India1d ago
-
Lead Data Science Consultant INR 1880K-2436KAWS | Agile | Azure | Cloud Computing | Credit RiskEqual opportunity workplace | Onsite 3 days per weekSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
Lead Software Engineer - Full Stack Developer and Gen AI INR 2500K-3465KAngular | Azure DevOps | C# | CI/CD | ContainerizationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Experienced Lead engineer in Storage/Networking domain INR 1500K-2772KAlgorithms | BGP | Cloud Architecture | Data Structures | DevOpsHealth and wellbeing | Professional developmentSenior-level Full TimeBengaluru, Karnātaka, India1d ago