Lead Data Engineer
111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 Twr-4, India
INR 2040K-2400K (estimate) Senior-level Full Time
Tasks
- Design develop ETL ELT pipelines
- Develop SQL queries stored procedures views
- Document data flows and transformations
- Ensure data quality, integrity, and consistency
- Lead data engineering initiatives
- Migrate SAS to Python and PySpark
- Monitor, troubleshoot, and optimize data workflows
- Participate in code reviews
- Process data with PySpark
- Write optimized Python scripts
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon EMR | Azure HDInsight | BigQuery | Data Warehousing | Databricks | Dremio | ELT | ETL | GCP | PySpark | Python | SAS | SQL | Starburst
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AES - DE - Generative AI Application Developers INR 3000K-4200KAWS | Asyncio | Azure | Azure AD | CI/CDSenior-level Full TimeIndia4h ago
-
Principal Lead - Data Engineer - 3132 INR 2000K-3500KAPIs | Agile | Apache Airflow | DBT | Data PipelinesFlexible working hours | Global exposure | Professional development | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India5h ago
-
Senior Staff Software Engineer (AI/ML) INR 3000K-4000KA/B | A/B Testing | Access Control | Airflow | Audit LoggingSenior-level Full TimeHyderabad, India5h ago
-
Mid-level Full TimeHyderabad, TS, India5h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India6h ago
-
Staff GenAI Engineer INR 2000K-4763KAWS | Agentic Workflows | Azure | CI/CD | Distributed SystemsCollaborative team environment | Leadership development program | Training sessionsSenior-level Full TimeMumbai, MH, India6h ago
-
Sr Data Engineering Manager INR 1500K-2400KAzure Data | Azure Data Factory | Azure Service | Azure Service Bus | CI/CDSenior-level Full TimeHyderabad, TS, India7h ago
-
Data Engineering Manager INR 1500K-2000KAzure Data | Azure Data Factory | Azure Service | Azure Service Bus | CI/CDMid-level Full TimeHyderabad, TS, India8h ago
-
Sr. Digital Solution Engineer - Data & Analytics INR 2520K-3380KAzure | Azure Data | Azure Data Factory | Azure SQL | Azure SynapseSenior-level Full TimeBengaluru, KA, IN; Mumbai, MH, IN8h ago
-
Software Engineer – IB Tech & CRM/Analytics INR 3000K-4000KAWS EKS | Amazon Redshift | Amazon Web Services | CI/CD | DockerSenior-level Full TimePune, India8h ago
-
Associate Consultant- Data Support INR 1500K-2500KAlteryx | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCustomer support focus | High attention to detail | Mentorship | Rotation shift workMid-level Full TimeBangalore, Karnataka, India9h ago
-
Sr. Snowflake Data Engineer - Risk Technology INR 3000K-4200KClustering keys | Cost Optimization | Data Quality | ELT | ETLSenior-level Full TimePune, India9h ago
-
Entry-level Full TimeIndia9h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAPI Integration | Autogen | Cloud Computing | CrewAI | FastAPIMid-level Full TimePune, Maharashtra, India10h ago
-
Azure Data Engineer - Associate Consultant INR 1500K-2000KAgile | Apache Hive | Apache Spark | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior-level Full TimePune, Maharashtra, India10h ago
-
Mid-level Full TimeGurugram, Haryana, India11h ago
-
Sr. Software Engineer (AI/ML) (PhD / Postdoc) INR 1500K-2400KCausal Inference | Deep learning | Generative AI | Language Processing | Machine LearningAccess to large clinical dataset | Collaboration with healthcare partners | Conference publication support | Research freedomSenior-level Full TimeHyderabad, India11h ago
-
AI/ML Engineer - AWS INR 1800K-2700KAWS | AWS Lambda | AWS Step Functions | AWS Textract | Amazon CloudWatchMid-level Full TimeTelangana, Hyderabad, India11h ago
-
Mid-level Full TimeGurugram, Haryana, India11h ago
-
AI | AWS | Agile | Ansible | AutosysSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Associate Process Manager INR 800K-1500KBigQueryML | CRM | Cloud platform | Customer Segmentation | Data QualityAPAC shift scheduleMid-level Full TimeMumbai, Maharashtra, India12h ago
-
Senior-level Full TimeMumbai, Maharashtra, India12h ago
-
Senior Data Engineer INR 3000K-4000KAzure Data | Azure Data Factory | Azure DevOps | Azure SQL | Azure SQL DatabaseAgile delivery | Code reviews | Cross-functional collaboration | Mentoring | Pair programmingSenior-level Full TimeChennai, Tamil Nadu, India13h ago
-
Business Intelligence Engineer, Last Mile Analytics INR 1800K-2400KAmazon QuickSight | Data Analysis | Data Interpretation | Data Visualization | NoSQLMid-level Full TimeHyderabad, Telangana, IND17h ago