Lead Data Engineer
Tasks
- Analyze datasets for requirements
- Build data ETL tooling
- Create data pipeline architecture
- Design data processing automation
- Enhance data pipeline implementations
- Improve data quality, security, and performance
- Maintain data pipelines
- Optimize data delivery performance
- Provide lifecycle support to operations
- Review design documents and code
- Test and deploy data applications
Perks/Benefits
- Competitive total compensation
- Flexible remote work
- Inclusive collaborative culture
- Remote work options
Skills/Tech-stack
AWS | Apache Flink | Apache Spark | Big Data | Data Engineering | Data Pipelines | ETL | Hadoop | Java | KSQL | Kafka | Message queuing | MySQL | NoSQL | PostgreSQL | Python | Relational databases | SQL | Scala | Spark Streaming | Stream processing
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Lead - Data Platform Engineering INR 2000K-2156KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeHyderabad, India11h ago
-
CI/CD | Cloud Platforms | Data Architectures | Data Engineering | Data ModelingHybrid work | Immediate join | VIRTUAL interviewMid-level ContractBangalore North, India13h ago
-
NLP Engineer (Remote) INR 2000K-3000KAsynchronous programming | BERT | Batch Processing | Data Preprocessing | ETLMid-level Full TimeGurgaon, India R13h ago
-
Senior-level Full TimeHyderabad, India14h ago
-
Software Engineer (2024 / 25, GenAI must) INR 1100K-1500KAgile | CI/CD | Deep learning | Full SDLC | Generative AIHybrid work | MentorshipMid-level Full TimeBengaluru, INDIA, India15h ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R15h ago
-
Lead BI Engineer (GenAI) INR 2500K-3380KAI Agents | Azure SQL | DAX | Data Modeling | Data WarehousingCareer growth | Certification support | Growth chats | Idea tanks | MentorshipSenior-level Full TimeHyderabad, TS, India15h ago
-
Lead - Data Platform Engineering INR 2040K-2400KAlerting | Automation | Bash | CPU | Concurrency ControlSenior-level Full TimeChennai, India16h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India16h ago
-
Senior AI & Automation Engineer (6+ years Generative AI, Agentic AI, LLMs, Python, APIs, MCP) INR 2500K-5000KAgentic AI | Agile | Conversational AI | LLM | LLMOpsSenior-level Full TimeBengaluru, KA, India17h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India17h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India17h ago
-
Gen AI - Consultant INR 2500K-4500KAWS SageMaker | Apache Airflow | Azure Machine Learning | CI/CD | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India18h ago
-
Gen AI - Consultant INR 2500K-4500KAPI Design | AWS SageMaker | Apache Airflow | Apache Spark | Azure MLAccess to AI research labs and cloud platforms | Certification access | Mentoring opportunities | Work on global clientsSenior-level Full TimeBangalore, Karnataka, India18h ago
-
Software Engineer III-( Java, AWS & Pyspark ) INR 2000K-2200KAWS | AWS Athena | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeMumbai, Maharashtra, India18h ago
-
Software Engineer I - Data Infrastructure INR 1200K-1500KAlgorithms | C++ | Data Structures | Database Proxy | Database replicationInclusive culture | Professional developmentMid-level Full TimeBangalore, India19h ago
-
Senior-level Full TimeBengaluru, Karnataka, India19h ago
-
Assistant Vice President INR 240K-420KData Analysis | Data Science | Machine Learning | Model Deployment | PythonExecutive-level Full TimeIndia19h ago
-
Senior Data Engineer INR 2500K-2829KAWS | Apache Airflow | Apache Iceberg | Apache Spark | AzureEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India20h ago
-
Data Engineering INR 2520K-3356KAWS | AWS CloudFormation | Amazon Redshift | Amazon S3 | Backup and RecoveryCode reviews | Continuous improvement | Mentoring and coaching | Onboarding support | Technical assessments participationSenior-level Full TimeIndia20h ago
-
Apache Airflow & AWS (S3/EMR/Bedrock) Data Platform Administrator / Operations Engineer INR 2535K-4200KAWS | AWS IAM | AWS KMS | Access Logging | Amazon Bedrock24x7 production supportSenior-level Full TimePune, Maharashtra, India21h ago
-
Lead Software Engineer - Python AWS Developer INR 2200K-3500KAPI Versioning | AWS SDK | AWS SDK for Python | AWS Secrets | AWS Secrets ManagerCareer growth | Collaborative team environment | Community of practice involvement | Mentorship | Technology adoption opportunitiesSenior-level Full TimeMumbai, Maharashtra, India21h ago
-
Azure Lead Data Engineer INR 2000K-2000KAzure Cloud | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeChennai, Tamil Nadu, India21h ago
-
Senior-level Full TimeHyderabad, Telangana, India21h ago
-
Apprentice Software Engineer INR 302K-540KAWS | Azure | BigQuery | Cloud Computing | Data ComplianceContinuous improvement initiatives | Mentoring | Shift handovers | Structured learning sessionsEntry-level Apprenticeship Full TimeChennai, Tamil Nadu, India21h ago