Lead Data Engineer
111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 Twr-4, India
INR 2000K-2500K (estimate) Senior-level Full Time
Tasks
- Analyze business operational and technical challenges
- Build data pipelines
- Collaborate with colleagues and managers
- Conduct code reviews focused on testability and code coverage
- Develop data models
- Lead data engineering initiatives
- Lead teams to meet data engineering deliverables
- Maintain analytics environment
- Maintain data warehouse
- Maintain highly available data pipelines
- Oversee data integration
- Resolve data engineering issues
- Work in Agile environment using Scrum or Kanban
- Write data integration and analysis scripts
Perks/Benefits
- N/A
Skills/Tech-stack
Ab Initio | Agile | Apache Spark | CI/CD | Data Warehouse | Distributed Systems | ETL | GCP | H2O | HBase | Hadoop | Hive | Infrastructure as Code | Kafka | Kanban | LLM | Machine Learning | MongoDB | NLP | Neo4j | Oracle | PL/SQL | Parallel processing | Python | SQL | Scala | Scrum | Shell Scripting | Spark Architecture | Spark DataFrames | Spark Datasets | Spark SQL | Spark-core | Statistical Analysis | Unix | Vertex AI | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Analytics AI Specialist INR 15K-20KClassification | Clustering | Data Visualization | Data cleaning | Machine LearningFast-paced startup environment | Growth opportunities | High ownershipEntry-level Full TimeGurugram, HR, IN8h ago
-
Senior-level Full TimePune, Maharashtra, India11h ago
-
Agentic Data Delivery Lead INR 2000K-4500KAWS | Access Control | Agent systems | Apache Hadoop | Apache SparkSenior-level Full TimePune, Maharashtra, India12h ago
-
Mid-level Full TimeBengaluru, Karnataka, India14h ago
-
Snowflake Lead - Manager INR 1500K-2500KAirflow | Anthropic Claude | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India14h ago
-
Senior-level Full TimeIndia15h ago
-
Senior Data Developer INR 2000K-2800K21 CFR | 21 CFR Part 11 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeGurugram, HR, IN, 12200216h ago
-
Senior Data Engineer INR 3000K-4000KAWS Lambda | Amazon Web Services | Apache Spark | Aurora PostgreSQL | Batch ProcessingBike to work | Educational assistance | Employee assistance programme | Employee discount | Fitness classesSenior-level Full TimeMumbai, MH, India17h ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4500KAPI Development | AWS | Autogen | Azure | Azure OpenAISenior-level Full TimeBangalore, Karnataka, India17h ago
-
Data Governance Engineer - Senior INR 1500K-2500KAgile | Amazon Web Services | Apache Hadoop | Apache Kafka | AzureSenior-level Full TimePune, Maharashtra, India17h ago
-
Senior-level Full TimeBengaluru, India19h ago
-
Senior Software Engineer - Data Platform INR 3000K-4000KAWS | Algorithms | Apache Airflow | Apache Flink | Apache HadoopDisability insurance | Financial wellness support | Health care benefits | Hybrid work | Life insuranceSenior-level Full TimeBengaluru, India22h ago
-
Senior-level Full TimeBangalore, KA, IN23h ago
-
POD Engineers (Int) INR 700K-1000KADLS | AWS | AWS Data | AWS Data Migration | AWS Data Migration ServicesTravel opportunitiesMid-level Full Timetbd, AN, IN23h ago
-
Senior Data Engineer I INR 3000K-4000KAWS Lambda | AWS S3 | AWS Step Functions | CI/CD | Control-MComprehensive benefits package | Development opportunities | Flexible working | Wellbeing supportSenior-level Full TimeFIL Bengaluru Office, India23h ago
-
Data Engineer - II INR 2000K-3000KAWS S3 | CI/CD | ControlM | Data Modeling | Data QualityDevelopment opportunities | Flexible working hours | Wellbeing supportSenior-level Full TimeFIL Bengaluru Office, India23h ago
-
Archiving Squad Data Engineer-Senior INR 3000K-4000KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130123h ago
-
Python Engineer - AI/ML INR 3500K-5000KAPI Integration | Artificial Intelligence | Chroma | Data Engineering | Data IngestionEntry-level Full TimePLOT NO-1, S.NO. 77, India23h ago
-
A/B | A/B Testing | AWS | Azure | B testingSenior-level Full TimeBengaluru Millenia, India23h ago
-
Lead Data & AI Scientist INR 2500K-5000KAsyncio | Cloud platform | Debugging | Ensemble Methods | ForecastingFlexible working | Hybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India23h ago
-
IN-Senior Associate_ Snowflake Senior Data Engineer _Data and Analytics_Advisory_Bangalore INR 1500K-2500KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | CI/CDSenior-level Full TimeBengaluru Millenia, India23h ago
-
Lead Analyst Retail Analytics - CBI RGM INR 3000K-4000KDashboarding | Data Modeling | Data Visualization | Distribution analysis | ExcelHybrid workSenior-level Full TimeIN025 Embassy Manyata Business Park, India23h ago
-
Associate Data Engineer INR 1500K-2000KAWS Redshift | Agile | BigQuery | ETL | GCPFlexible work arrangement | Inclusion and diversity focusMid-level Full TimeBangalore (Ulsoor)IN, India23h ago
-
Lead Data Scientist INR 1500K-3500KArtificial Intelligence | Change Management | Coaching | Data Analysis | Data ManagementFlexible working options | Hybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India23h ago
-
Application Production Support Engineer - Generative AI Tools- Assistant Vice President INR 1500K-6000KAWS | Azure | Bash | Change Management | Datadog24 7 on call rotation coverageExecutive-level Full TimeTOWER B, EON FREE ZONE II, …23h ago