Principal Engineer – Data Platform
Tasks
- Align data architecture with business goals
- Architect data platform strategy
- Articulate design tradeoffs and constraints
- Build data ingestion frameworks
- Define data modeling and schema evolution standards
- Design open table formats
- Design pipeline reliability and testing
- Develop streaming pipelines
- Enable self serve data platform
- Ensure data freshness accuracy availability
- Establish data lineage and data observability
- Implement data serving layers
- Lead lakehouse architecture
- Lead performance tuning
- Maintain production grade reliability
- Mentor engineers and elevate technical rigor
- Optimize large-scale data handling
- Own data ingestion data modeling streaming and data quality
- Own end to end data flows from ingestion to serving
- Plan capacity and cost efficiency
- Set partitioning and compaction best practices
Perks/Benefits
- Continuous learning
- Culture first work environment
- High-trust work environment
- Unlimited vacation policy
Skills/Tech-stack
AWS | Access Control | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Batch Processing | CloudFormation | Compaction | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Partitioning | Data Quality | Distributed Systems | Docker | Failure recovery | Go | Kubernetes | Lakehouse | Multi-tenancy | Observability | Pipeline monitoring | Python | S3 | Schema evolution | Snapshotting | Streaming | System design | Terraform | TypeScript
Education
N/A
Related jobs
-
Data Management AI Lead INR 2500K-3380KAWS | Agent Orchestration | Agent systems | Azure | Cloud DataSenior-level Full TimeBangalore, Karnataka, IN1h ago
-
Senior-level Full TimeBengaluru, INDIA, India2h ago
-
Lead Data Engineer - Tieto Tech Consulting (m/f/d) INR 2400K-2800KAzure | Azure Data | Azure Data Factory | CI/CD | Data FactoryContinuous learning | Flexible hybrid work model | Open culture | Professional growth | Work-life balanceSenior-level Full TimeBangalore, India3h ago
-
Entry-level Full TimeBangalore4h ago
-
Sr Data Engineer INR 3200K-4600KAWS | Apache Airflow | Apache Spark | Data Modeling | Google CloudCommuter benefits | Disability coverage | Financial wellness support | Healthcare | Life insuranceSenior-level Full TimeBengaluru, India4h ago
-
Senior-level Full Timebengaluru, India4h ago
-
AI Engineer - Full-Stack & Applied UI INR 2500K-4500KABAC | AI SDK | JavaScript | LLM | MCPCollaborative team environment | Flexible work arrangementsSenior-level Full TimeBangalore5h ago
-
Senior-level Full TimeHyderabad, India5h ago
-
Mid-level Full TimeHyderabad, Telangana, India; Open to Remote … R16h ago
-
Lead - Data Platform Engineering INR 2000K-2156KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeHyderabad, India17h ago
-
Data Engineer INR 1500K-2300KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkOffice based 5 days per weekMid-level Full TimeGurgaon, India17h ago
-
Senior Analytics Engineer I INR 2535K-3500KAirflow | Amazon S3 | CI/CD | Cloud Storage | Command LineHybrid work modelSenior-level Full TimeGurugram18h ago
-
CI/CD | Cloud Platforms | Data Architectures | Data Engineering | Data ModelingHybrid work | Immediate join | VIRTUAL interviewMid-level ContractBangalore North, India19h ago
-
NLP Engineer (Remote) INR 2000K-3000KAsynchronous programming | BERT | Batch Processing | Data Preprocessing | ETLMid-level Full TimeGurgaon, India R19h ago
-
Senior-level Full TimeHyderabad, India19h ago
-
Software Engineer (2024 / 25, GenAI must) INR 1100K-1500KAgile | CI/CD | Deep learning | Full SDLC | Generative AIHybrid work | MentorshipMid-level Full TimeBengaluru, INDIA, India21h ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R21h ago
-
Lead BI Engineer (GenAI) INR 2500K-3380KAI Agents | Azure SQL | DAX | Data Modeling | Data WarehousingCareer growth | Certification support | Growth chats | Idea tanks | MentorshipSenior-level Full TimeHyderabad, TS, India21h ago
-
Lead - Data Platform Engineering INR 2040K-2400KAlerting | Automation | Bash | CPU | Concurrency ControlSenior-level Full TimeChennai, India22h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India22h ago
-
Access Control | Ansible | Backup Management | Cisco UCS | ContainerizationSenior-level Full TimeBengaluru, KA, India23h ago
-
Applied AI Solution Engineer INR 1340K-1680KAWS Bedrock | Agent Orchestration | Azure AI | Data Engineering | Enterprise IntegrationCompany equity (RSUs) | Comprehensive benefits | Counseling | Generous PTO | Gym subsidiesMid-level Full TimeBangalore, India23h ago
-
Senior AI & Automation Engineer (6+ years Generative AI, Agentic AI, LLMs, Python, APIs, MCP) INR 2500K-5000KAgentic AI | Agile | Conversational AI | LLM | LLMOpsSenior-level Full TimeBengaluru, KA, India23h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India23h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India23h ago