Lead Software Engineer - Data Engineering
Chennai, Tamil Nadu, India
INR 2000K-2400K (estimate) Senior-level Full Time
Tasks
- Architect scalable secure data platforms
- Build Data Lakes and Data Warehouses
- Build Snowflake data pipelines
- Communicate technical concepts to non-technical audiences
- Deploy with CI/CD tools
- Design scalable data architectures for analytics
- Design streaming data movement
- Drive Agile practices and delivery
- Ensure platform scalability, security, and operational readiness
- Establish data governance and metadata management
- Implement data modeling etl elt
- Implement data quality frameworks
- Integrate gen ai capabilities into pipelines
- Lead and mentor data engineers
- Manage schema evolution strategies
- Operationalize ml models with data pipelines
- Optimize data storage, retrieval, and processing
- Partner with stakeholders to deliver data solutions
- Support real time analytics and edge ai
- Track data lineage
- Use azure and aws for ingestion transformation analytics
Perks/Benefits
Skills/Tech-stack
AWS | AWS CloudFormation | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOps | Big Data | CI/CD | DBT | Data Engineering | Data Factory | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Quality | Data Visualization | Data Warehousing | Distributed Systems | ELT | ETL | Edge AI | Jenkins | Kafka | Looker | MLOps | Machine Learning | Metadata Management | NoSQL | Power BI | Real Time | Real-time analytics | SQL | Schema evolution | Snowflake | Streaming Data | Tableau
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Science INR 2000K-3300KAgentic AI | Apache Airflow | CrewAI | Data Architecture | Data PipelinesSenior-level Full TimeIN-MH-Pune15h ago
-
Software Engineer Manager II, Embedded Systems/Firmware, Silicon INR 2800K-4500KC++ | Compiler optimization | Embedded operating systems | Graphics Processing | Graphics Processing UnitsSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
DevOps Engineer INR 1500K-2500KAgile | Amazon Web Services | BI dashboarding | CI/CD | Cloud platformInternational collaboration | Occasional travel to EuropeMid-level Full TimePune, MH, India16h ago
-
Specialist - Data Engineering-Data Engineering INR 180K-200KAWS | Apache Kafka | Apache Spark | Data Modeling | Data QualityEntry-level Full TimeMumbai, Maharashtra, India17h ago
-
Director of Software Engineering - Python, Gen AI INR 1500K-6000KA/B | A/B Testing | AWS | Agentic Workflows | AnthropicExecutive-level Full TimeBengaluru, Karnataka, India19h ago
-
Data Analytics & Data Engineering Vice President INR 2000K-5800KAccess Control | Agile | Alteryx | Cloud Computing | ConfluenceExecutive-level Full TimeIndia22h ago
-
Lead Software Engineer INR 3000K-4500KAWS | CI/CD | DevOps | Docker | EMRCareer development opportunities | Comprehensive benefits | Continuous learning | Flexible working hours | Work-life balanceSenior-level Full TimeMumbai, India23h ago
-
Product & Program Lead - Analytics & Insights INR 3000K-4000KA/B | A/B Testing | APIs | Advanced Analytics | Analytics governanceSenior-level Full TimePune, IN1d ago
-
AWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseHybrid scheduleSenior-level Full TimeIND - Pune, Kalyani Nagar, India R1d ago
-
Lead Analytics Consultant INR 1100K-2200KAlteryx | Binomial trees | Calypso | Capital Markets | Commodities derivativesSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Lead Consultant- AI Engineering INR 2000K-3465KAPIs | CI/CD | Calculus | Computer Vision | ContainerizationSenior-level Full TimeIndia - Chennai1d ago
-
Lead Analyst - Credit Data Solutions (Data Governance) INR 1890K-2700KBusiness Intelligence | Dashboards | Data Governance | Data Lineage | Data MappingSenior-level Full TimeIND - KA - Bangalore - …1d ago
-
Lead Accountant (Power Bi & Excel) INR 1687K-3220KAccount Reconciliation | Accounting | Automation | Cash reconciliation | Data analyticsSenior-level Full TimeBengaluru, India1d ago
-
Software Engineering Manager INR 1327K-1670KAutomated testing | C# | Cloud Native | Cloud-native development | Data EngineeringMid-level Full TimePune, India1d ago
-
Custom Software Engineer INR 1300K-2000KCloud Architecture | Data Modeling | Data Querying | Data Warehousing | ETLMid-level Full TimeBengaluru, BDC6F, India1d ago
-
Team Lead/Senior Specialist - AI INR 2500K-4800KAutogen | CI/CD | Cloud Platforms | Cost Optimization | CrewAISenior-level Full TimeIndia - Remote R1d ago
-
GRC Data Analyst Manager INR 945K-1500KAlerting | Automation | Cause analysis | Data Modeling | Data MonitoringMid-level Full TimeINDJZ03 - Pune - Weikfield IT …1d ago
-
Associate Director–Data Lake Operations INR 1500K-2700KADaM | AWS | Apache Spark | Big Data | CDISCMid-level Full TimeHyderabad, India1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
AI-powered analytics | Business Intelligence | Change Management | Cloud Data | Cloud Data PlatformsFlexible remote friendly work arrangements | High-visibility leadership role | Inclusive collaborative cultureSenior-level Full TimeIndia1d ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPIs | Agentic AI | Agile | Azure | BERTMid-level Full TimeBangalore, Karnataka, India1d ago
-
Generative AI Lead INR 2475K-3465KAPIs | Chatbots | Cloud infrastructure | Conversational AI | Data LakesHybrid work | Reward and recognition | Volunteering opportunities | Wellness program | Work-life balanceSenior-level Full TimeHyderabad, India1d ago
-
Assistant Manager-GDC INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeHyderabad, Telangana, India1d ago
-
AWS | Airflow | Azure | CI/CD | DBTSenior-level Full TimeBengaluru, KA, India1d ago
-
API Management | Azure Data | Azure Data Factory | Cloud Computing | Data FactoryInclusive collaborative global work environment | Remote friendly work arrangementsExecutive-level Full TimeIndia1d ago