Lead Software Engineer- Data Engineer
Chennai, Tamil Nadu, India
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Architect AWS data platforms
- Build and optimize Snowflake pipelines
- Collaborate with product managers SMEs and stakeholders
- Define CI/CD standards
- Design data ingestion frameworks
- Drive agile execution
- Drive automation continuous improvement
- Enable ingestion from databases APIs files streaming
- Enforce modular design code quality testing version control
- Ensure scalability resiliency operational readiness
- Establish engineering best practices
- Implement CI/CD pipelines
- Implement data modeling governance metadata management
- Lead and mentor data engineering team
- Leverage AWS services for end to end pipelines
- Operationalize ML models and analytics workflows
- Promote reusable ingestion transformation frameworks
- Translate business needs into data solutions
Perks/Benefits
Skills/Tech-stack
AWS | AWS CloudFormation | Agile | Azure DevOps | CI/CD | CuDF | CuGraph | CuML | Data Ingestion | Design Patterns | Distributed Systems | ELT | EMR | ETL | Git | GitHub | Glue | Graph Databases | Jenkins | Kafka | Lambda | Milvus | NVIDIA Rapids | Neo4j | Neptune | OpenSearch | Python | Redshift | S3 | SQL | Snowflake | Spark | Spark Streaming | Streaming Data | Testing | Vector Databases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Technical Solutions Engineer INR 500K-700KAPI Integration | Agentic AI | Automation Anywhere | Excel | Incident ManagementEntry-level Full TimeHyderabad, India5h ago
-
Data Engineer - Databricks & Microsoft FabricData Engineer - Databricks & Microsoft Fabric INR 1500K-2800KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeChennai, IN, 6000326h ago
-
Lead Data Engineer INR 1500K-2700KApache Kafka | Apache Spark | Automated testing | CI/CD | Data ModelingSenior-level Full TimeBengaluru, KA, India7h ago
-
ASR | AWS | Audio Processing | Cloud platform | ContainerizationFlexible working hours | Fully remote | Mentorship | Professional growthSenior-level Full TimeIndia R7h ago
-
Software Engineer - Data Engineering INR 1500K-2541KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite 5 days per week | Relocation assistance | Visa sponsorshipMid-level Full TimeChennai, Tamil Nadu, India11h ago
-
Software Engineer - Data Engineering INR 1500K-2500KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite work | Relocation assistanceMid-level Full TimeChennai, Tamil Nadu, India11h ago
-
Senior-level Full TimeBangalore, KA, IN11h ago
-
Lead Software Engineer (AWS, Snowflake & ML Backend) INR 3000K-4500KAWS | AWS Lambda | AWS Step Functions | Access Control | Amazon ECSOnsite work 5 days per week | Relocation supportSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
Senior Software Engineer - Data Engineering INR 1500K-2500KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite work 5 days per week | Relocation assistanceSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
Mid-level Full TimeIndia - Remote R11h ago
-
Senior-level Full TimeBengaluru, Karnataka, India11h ago
-
GenAI LLM Python/Senior Associate Director, Software Engineering INR 2000K-4000KAPI Development | AWS | Agent systems | Agentic Workflows | AzureFlexible working | Professional developmentMid-level Full TimePune, Maharashtra, India R19h ago
-
EAI Software Engineer INR 1800K-3500KAPI Gateway | Agile | Argo CD | CI/CD | Cloud FunctionsCollaborative team | Inclusive culture | On-site work 4 days a weekMid-level Full TimeHyderabad, India20h ago
-
Staff Engineer, Data Engineering INR 1500K-2500KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBengaluru, KA, India21h ago
-
Backend Engineer (Cloud & AI Integration) INR 1500K-3000KAPI Integration | AWS | Cloud Native | Documentation | GitMid-level Full TimeBengaluru, KA, India21h ago
-
Lead - Data Engineering INR 3000K-4000KData Governance | Data Modeling | Data Quality | Data Visualization | Data WarehousingSenior-level Full TimeBengaluru, Karnataka, India, India21h ago
-
AWS | AWS Lambda | AWS S3 | Amazon EMR | Apache AirflowCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningSenior-level Full TimePune, MH, India22h ago
-
Senior Data Engineering - GCP Lead INR 2500K-4000KAPIs | Airflow | Artificial Intelligence | BigQuery | Business IntelligenceSenior-level Full TimeIndia - Bengaluru22h ago
-
Mid-level Full TimeIN-TN-Chennai22h ago
-
Streamlit & Databricks API INR 1500K-2500KAgile | CI/CD | Databricks | Databricks Apps | Databricks NotebooksSenior-level Full TimeIN-TN-Chennai22h ago
-
Data Engineer with GCP INR 1500K-2500KBatch Processing | BigQuery | Cloud Storage | Cloud platform | Data GovernanceSenior-level Full TimeIN-AP-Hyderabad R22h ago
-
Senior Data Engineering - PSM-Libra INR 1500K-3000KAgile | Anaconda | Ansible | Apache Hive | Apache SparkSenior-level Full TimeIndia - Bengaluru22h ago
-
Agentic AI | Alerting | Anomaly Detection | Apache Airflow | Artifact RegistryMid-level Full TimePune, Maharashtra, India R23h ago
-
Data Engineer INR 1000K-1700KAWS Athena | Airflow | Amazon Web Services | Big Data | CI/CDEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimePune, MH, India23h ago
-
Agentic AI Data Engineer INR 2000K-5000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon BedrockSenior-level Full TimePune, Maharashtra, India23h ago