Principal Engineer - Data Engineering
Hyderabad, India
INR 1500K-5800K (estimate) Executive-level Full Time
Tasks
- Build distributed processing using Apache Spark
- Define data platform technical vision
- Define metadata management and data cataloging
- Design batch data processing pipelines
- Design real time streaming ingestion
- Develop semantic data models and curated data products
- Drive data platform cost optimization FinOps
- Establish data governance quality and lineage
- Implement change data capture systems
- Implement observability and telemetry
- Mentor Staff and Senior engineers
- Optimize warehouse and lakehouse architectures
- Own multi year data architecture roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Spark | Change Data Capture | Cloud Architecture | Data Capture | Data Catalog | Data Governance | Data Ingestion | Data Modeling | Data Quality | Data virtualization | Database Schema | Database Schema Design | Databricks | Delta Lake | Distributed Systems | Feature Stores | FinOps | Kafka | Kinesis | Lakehouse | Lineage tracing | Machine Learning | Metadata Management | Observability | PubSub | Real Time | Real-time Streaming | Schema Design | Security Compliance | Semantic layer | Snowflake | System Architecture
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Principal | Principal Engineer | Staff Data Engineer
Related jobs
-
Mid-level Full TimeBengaluru, India6h ago
-
Senior-level Full TimeBengaluru, India6h ago
-
Staff - Software Engineering INR 2515K-3500KAWS | AWS Glue | AWS Lambda | Amazon Kinesis | Amazon SNSCareer growth and development | Flexible workSenior-level Full TimePune6h ago
-
Staff Software Engineer (Python) INR 3000K-5000KAPIs | Alerting | Amazon Web Services | Authentication | Cloud platformCollaborative team environment | Diverse projects | Global consulting environment | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India8h ago
-
Senior Software Engineer INR 2500K-3465KAPIs | Amazon Web Services | CI/CD | Cloud platform | Distributed SystemsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India8h ago
-
(Services) Data Engineer INR 1500K-2400KAPI Integration | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad9h ago
-
FinOps Engineer INR 1500K-3500KAWS | Amazon QuickSight | Amazon Redshift | Azure | Cloud billingCross-functional collaboration | Hybrid work | Mandatory office days 3 per weekSenior-level Full TimeBangalore9h ago
-
Principal Solutions Architect - Data Engineering INR 3000K-3880KADLS | AWS | Agile | Airflow | Apache FlinkBonuses for approved content | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceSenior-level Full TimeIndia - Remote R10h ago
-
Senior Data Engineer (SSIS/SSRS) INR 2000K-2500KData Modeling | Data Pipelines | Data Warehousing | Data integration | ETLSenior-level Full TimeIN KA Bengaluru, India14h ago
-
Data Test Engineer (ETL Testing) INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCross-functional team collaboration | Hybrid work | Remote workMid-level Full TimeNCR Region, DL, IN14h ago
-
DBT/Snowflake Engineer INR 1200K-2000KAzure DevOps | CI/CD | DBT | Data Modeling | Dimensional ModelingSenior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Agile methodology | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India14h ago
-
DBT/Snowflake Engineer INR 1200K-2000KAzure DevOps | CI/CD | DBT | Data Warehousing | Dimensional ModelingSenior-level Full TimeBangalore, KA, IN14h ago
-
Airframe Data Scientist - Robust AI/ML INR 2000K-3500KAWS | Computer Aided Design | Computer Vision | Data extraction | Deep learningSenior-level Full TimeBangalore (Airbus), India R14h ago
-
Archiving Squad Data Engineer-Senior INR 3000K-4000KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130114h ago
-
Lead Software Engineer - Full Stack Developer and Gen AI INR 2755K-3500KAPI Integration | Agent Orchestration | Angular | Asynchronous programming | Azure DevOpsSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India14h ago
-
A/B | A/B Testing | AWS Glue | AWS Lambda | AWS Model RegistrySenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …14h ago
-
A/B | A/B Testing | AUC-ROC | AWS Lambda | AWS S3Career growth opportunities | Flexible career development | MentorshipSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …14h ago
-
Principal Machine Learning Engineer INR 3264K-5000KAPIs | Computer Vision | Data Pipelines | Deep learning | Distributed SystemsChallenging ML problems | Fast track growth opportunitiesSenior-level Full TimeBangalore - Embassy Tech Village, India14h ago
-
AWS | CI/CD | Databricks | Delta Lake | Feature StoreMid-level Full TimeHyderabad - Phoenix Equinox Tower 2, …14h ago
-
A/B | A/B Testing | AUC-ROC | Amazon Web Services | B testingCareer development | Collaborative work environment | Flexible growth opportunities | MentoringSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …14h ago
-
Machine Learning Engineer, Specialist INR 2500K-4800KAWS Glue | AWS Lambda | Amazon S3 | Amazon SageMaker | CI/CDFinancial wellness programs | Hybrid work model | Personal wellness resources | Physical wellness benefits | Wellness supportSenior-level Full TimeHyderabad, India14h ago
-
Senior Software Engineer with Python & Gen AI experience INR 2000K-2829KAWS | Agile Scrum | Azure | CI/CD | DevOpsEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India18h ago
-
Software Engineer - Infra + Data INR 2200K-3465KAWS Glue | Alerting | Amazon EKS | Apache Iceberg | Apache KafkaEntry-level Full TimeBangalore23h ago