Lead Data Engineer
IN - HYDERABAD SKYVIEW, India
INR 2520K-3356K (estimate) Senior-level Full Time
Tasks
- Align pipelines with strategic initiatives
- Build data acquisition pipelines
- Build data transformation pipelines
- Collaborate with data integration teams
- Design distributed data processing jobs
- Develop clean modular testable data processing code
- Implement data workflow orchestration
- Maintain feed systems
- Maintain production data services
- Optimize data pipelines for performance and scalability
Perks/Benefits
Skills/Tech-stack
API Design | Agile | Big Data | CI/CD | Cloud Computing | Containerization | Data Lake | Data Modeling | Data Processing | Data Warehousing | Data orchestration | DevOps | Distributed data | Distributed data processing | ETL | Functional Programming | GitHub | Grafana | NoSQL Databases | Object-Oriented | Object-oriented programming | Object-oriented scripting | Observability | REST API | Relational databases | Workflow Management
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Mid-level Full TimePune, Maharashtra, India3h ago
-
Data Science & AI Specialist INR 2000K-3000KAI ethics | Algorithm Design | Artificial Intelligence | Business Analysis | Cloud ComputingMid-level Full TimeKolkata, IN, 7001565h ago
-
Mid-level Full TimePune, Maharashtra, India6h ago
-
Data Science AI Engineer, Advisor INR 950K-1400KAs-a-Service | C# | Cloud technologies | Database methodologies | Development LifecycleHybrid work environment | Work-life balanceMid-level Full TimeBangalore, KA, IN, 5601007h ago
-
AWS | AWS Glue | Advanced SQL | Airflow | Amazon EMRMid-level Full TimeHyderabad, Telangana, India7h ago
-
GenAI Engineer - Database INR 2520K-3880KData Governance | Data Lineage | Embeddings | Entity Resolution | Graph DatabasesEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India8h ago
-
Principal I, Data Engineering INR 2000K-2040KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | CI/CDSenior-level Full TimeBangalore, KA, India10h ago
-
Sr Quality Engineer (SD/HD map, Spatial Data Engineering) INR 1800K-2400KAPI | AWS | Anomaly Detection | ArcGIS | ClassificationCross-team collaboration | Inclusive work environment | Mentorship | Professional developmentSenior-level Full TimeMumbai, India10h ago
-
Web Analytics Specialist INR 2520K-3900KAdobe Analytics | Adobe Experience | Adobe Experience Platform | Adobe Launch | Analytics governanceSenior-level Full TimeNoida, India R14h ago
-
Mid-level Full TimePune, MH, IN, 41105714h ago
-
Senior Computer Scientist 1 INR 2000K-4725KCI/CD | Cloud Platforms | Distributed tracing | Docker | Integration TestingSenior-level Full TimeNoida, India R14h ago
-
Senior DevOps Engineer (Universal Robots, India) INR 3000K-4000KAgile | Bash | DNS | Docker | ElasticsearchEmployee development | Health insurance | On-site collaboration | Skill-buildingSenior-level Full TimeBangalore, IN14h ago
-
Java Developer INR 1300K-2000KAWS | Agile | Azure | CI/CD | CSSHealthcare benefits | Hybrid work setting | Online learning platform | Paid time offMid-level Full TimeIND-Trivandrum-Equifax Analytics-PTEC, India14h ago
-
IN_Senior Associate_Python_Data and Analytics_Advisory_Hyderabad INR 2400K-3500KAWS | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India14h ago
-
Archiving Squad Data Engineer-Senior INR 2520K-3500KAWS | Amazon S3 | Appian | Azure Blob | Azure Blob StorageSenior-level Full TimeNoida, UP, IN, 20130114h ago
-
Archiving Squad Data Engineer-Staff INR 2520K-3880KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130114h ago
-
Archiving Squad Data Engineer-Senior INR 2500K-3500KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130114h ago
-
Archiving Squad Data Engineer INR 1500K-1700KAWS S3 | Application retirement | Azure Blob | Azure Blob Storage | Blob StorageMid-level Full TimeNoida, UP, IN, 20130114h ago
-
Software Engineer - Entry INR 1294K-1700KAWS | Agile | Azure | CI/CD | Cloud ComputingHealthcare | Hybrid work | Paid time offMid-level Full TimeIND-Pune-Equifax Analytics-PTEC, India14h ago
-
AI Lead Engineer INR 2500K-4000KData Pipelines | Generative AI | LLM | Machine Learning | Model OptimizationSenior-level Full TimeDGS India - Mumbai - Thane …14h ago
-
Lead Data Scientist-Vice President INR 2040K-3356KAWS Redshift | Amazon Athena | Amazon EMR | Amazon S3 | Apache KafkaSenior-level Full TimeTRIL INFO PARK, NEVILLE TOWER, India14h ago
-
Apache Spark | Artificial Intelligence | Cloudera | Consulting | Data AnalysisExecutive-level Full TimeRAMANUJAN IT CITY SEZ TARAMANI CHENNAI, …14h ago
-
Gen AI Python Developer – Assistant Vice President INR 1500K-6000KCI/CD | Database Design | Django | FastAPI | FlaskExecutive-level Full TimeIT BUILDING, RAMANUJAN IT SEZ,, India14h ago
-
Application Production Support Engineer Generative AI INR 2000K-3200KCI/CD | Cause analysis | Configuration Management | ECS | ELKContinuous learning | Flexibility with work schedule | Hybrid work options | MentorshipSenior-level Full TimeTOWER B, EON FREE ZONE II, …14h ago
-
Senior-level Full TimeINBLR02 - Bangalore - Milesstone Buildcon, …14h ago