Principal Engineer - Data Engineering
Hyderabad, India
INR 1500K-5800K (estimate) Executive-level Full Time
Tasks
- Build distributed processing using Apache Spark
- Define data platform technical vision
- Define metadata management and data cataloging
- Design batch data processing pipelines
- Design real time streaming ingestion
- Develop semantic data models and curated data products
- Drive data platform cost optimization FinOps
- Establish data governance quality and lineage
- Implement change data capture systems
- Implement observability and telemetry
- Mentor Staff and Senior engineers
- Optimize warehouse and lakehouse architectures
- Own multi year data architecture roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Spark | Change Data Capture | Cloud Architecture | Data Capture | Data Catalog | Data Governance | Data Ingestion | Data Modeling | Data Quality | Data virtualization | Database Schema | Database Schema Design | Databricks | Delta Lake | Distributed Systems | Feature Stores | FinOps | Kafka | Kinesis | Lakehouse | Lineage tracing | Machine Learning | Metadata Management | Observability | PubSub | Real Time | Real-time Streaming | Schema Design | Security Compliance | Semantic layer | Snowflake | System Architecture
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Principal | Principal Engineer | Staff Data Engineer
Related jobs
-
Data Engineer INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeIN-KA-Bangalore3h ago
-
Sr. Data Engineer INR 1500K-2500KACID | Amazon Redshift | Amazon S3 | Apache Kafka | Azure DataWork from office 5 days per weekSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
AI/ML Developer INR 1500K-2500KAzure | Cloud Computing | Cloud platform | Data Preprocessing | Deep learningMid-level Full Timebangalore, India5h ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4500KAWS | Autogen | Azure | Azure OpenAI | ClaudeSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Senior Azure Data Engineer INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePune, Maharashtra, India7h ago
-
Mid-level Full TimeBengaluru, India7h ago
-
Senior-level Full TimeBengaluru, India7h ago
-
Data Engineer II INR 1500K-2500KAWS | Apache Airflow | Astronomer | BigQuery | CI/CDCareer growth | Holistic well-being support | Learning opportunitiesSenior-level Full TimeBengaluru, KA, India8h ago
-
Staff - Software Engineering INR 2515K-3500KAWS | AWS Glue | AWS Lambda | Amazon Kinesis | Amazon SNSCareer growth and development | Flexible workSenior-level Full TimePune8h ago
-
Staff Software Engineer (Python) INR 3000K-5000KAPIs | Alerting | Amazon Web Services | Authentication | Cloud platformCollaborative team environment | Diverse projects | Global consulting environment | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India9h ago
-
Senior Software Engineer INR 2500K-3465KAPIs | Amazon Web Services | CI/CD | Cloud platform | Distributed SystemsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India10h ago
-
AI Engineer II INR 1685K-3000KAWS | Apache Hive | Apache Spark | Cloud platform | Continuous DeliveryCareer development and training | Counseling support | Dental insurance | Disability benefits | Flexible working modelMid-level Full TimeGurugram, HR, India10h ago
-
(Services) Data Engineer INR 1500K-2400KAPI Integration | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad11h ago
-
FinOps Engineer INR 1500K-3500KAWS | Amazon QuickSight | Amazon Redshift | Azure | Cloud billingCross-functional collaboration | Hybrid work | Mandatory office days 3 per weekSenior-level Full TimeBangalore11h ago
-
Principal Solutions Architect - Data Engineering INR 3000K-3880KADLS | AWS | Agile | Airflow | Apache FlinkBonuses for approved content | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceSenior-level Full TimeIndia - Remote R11h ago
-
Senior Data Engineer (SSIS/SSRS) INR 2000K-2500KData Modeling | Data Pipelines | Data Warehousing | Data integration | ETLSenior-level Full TimeIN KA Bengaluru, India15h ago
-
Data Test Engineer (ETL Testing) INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCross-functional team collaboration | Hybrid work | Remote workMid-level Full TimeNCR Region, DL, IN15h ago
-
DBT/Snowflake Engineer INR 1200K-2000KAzure DevOps | CI/CD | DBT | Data Modeling | Dimensional ModelingSenior-level Full TimeBangalore, KA, IN15h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
Agile methodology | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
DBT/Snowflake Engineer INR 1200K-2000KAzure DevOps | CI/CD | DBT | Data Warehousing | Dimensional ModelingSenior-level Full TimeBangalore, KA, IN15h ago
-
Airframe Data Scientist - Robust AI/ML INR 2000K-3500KAWS | Computer Aided Design | Computer Vision | Data extraction | Deep learningSenior-level Full TimeBangalore (Airbus), India R15h ago
-
Archiving Squad Data Engineer-Senior INR 3000K-4000KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130115h ago
-
Lead Software Engineer - Full Stack Developer and Gen AI INR 2755K-3500KAPI Integration | Agent Orchestration | Angular | Asynchronous programming | Azure DevOpsSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India15h ago
-
A/B | A/B Testing | AWS Glue | AWS Lambda | AWS Model RegistrySenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …15h ago