Principal Engineer - Data Engineering
INR 1500K-5800K (estimate) Executive-level Full Time
Tasks
- Build distributed processing using Apache Spark
- Define data platform technical vision
- Define metadata management and data cataloging
- Design batch data processing pipelines
- Design real time streaming ingestion
- Develop semantic data models and curated data products
- Drive data platform cost optimization FinOps
- Establish data governance quality and lineage
- Implement change data capture systems
- Implement observability and telemetry
- Mentor Staff and Senior engineers
- Optimize warehouse and lakehouse architectures
- Own multi year data architecture roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Iceberg | Apache Spark | Change Data Capture | Cloud Architecture | Data Capture | Data Catalog | Data Governance | Data Ingestion | Data Modeling | Data Quality | Data virtualization | Database Schema | Database Schema Design | Databricks | Delta Lake | Distributed Systems | Feature Stores | FinOps | Kafka | Kinesis | Lakehouse | Lineage tracing | Machine Learning | Metadata Management | Observability | PubSub | Real Time | Real-time Streaming | Schema Design | Security Compliance | Semantic layer | Snowflake | System Architecture
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Principal | Principal Engineer | Staff Data Engineer
Related jobs
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R5h ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN6h ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R6h ago
-
Senior-level Full TimeBengaluru, Karnataka, India6h ago
-
Dir, Machine Learning Engrg Mgmt INR 3242K-4200KAlgorithms | Code optimization | Design Patterns | Java | Machine LearningFlexible work options | In-office work options | Remote work optionsSenior-level Full TimeHyderabad, India7h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India7h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R8h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN13h ago
-
Senior-level Full TimeBangalore, KA, IN13h ago
-
AI Research IC Leadership role INR 2500K-5000KAgentic AI | Artificial Intelligence | Language Models | Large Language Models | Machine LearningAcademic collaborations | Career growth | Conference participation | Flexible R and D environment | Hybrid workSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Data Engineer INR 3200K-4200KAWS | Airflow | Apache Spark | CI/CD | Cloud ComputingCompany-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India13h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R13h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R13h ago
-
Software Development Senior Analyst INR 2000K-4500KAPI Gateway | AWS CloudFormation | AWS Lambda | Agile | Amazon BedrockSenior-level Full TimeChennai, TN, IN13h ago
-
Senior Staff Engineer (AI Solution Design) INR 4000K-5500KAlerting | Artificial Intelligence | Data Architecture | Data Lakes | Data PipelinesSenior-level Full TimeMumbai, India1d ago
-
Senior-level Full TimeMumbai, MH, India1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Senior-level Full TimePune, India1d ago
-
AI Engineer INR 2000K-4500KAI Foundry | AI Services | API Development | Azure AI | Azure AI FoundryMid-level Full TimeBangalore, IN1d ago
-
Senior Data Engineer - Consulting INR 2500K-4000KAJAX | AWS ECS | Agile | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, Telangana1d ago
-
Data Engineer - Delivery INR 1500K-2000KAmazon Web Services | Azure Blob | Azure Blob Storage | Blob Storage | Data ManagementCollaborative team | Professional growth | Training completionMid-level Full TimeHyderabad, Telangana1d ago
-
Senior-level Full TimeBengaluru, KA, IN1d ago
-
Sr SDE (Java + AI) INR 3000K-5000KAI orchestration | AWS | Alerting | Automated testing | AzureDesign review leadership | MentorshipSenior-level Full TimePune City, India2d ago
-
Silicon Embedded Software Engineer INR 1800K-3870KARM | C# | C++ | Device Drivers | Embedded SystemsMid-level Full TimeBengaluru, Karnataka, India2d ago
-
Data Scientist - GenAi-AgenticAi INR 2500K-5000KAI orchestration | AWS | Agentic AI | Crew AI | Data MiningSenior-level Full TimeIndia2d ago