Principal Engineer – Data Platform
Tasks
- Align data architecture with business goals
- Architect data platform strategy
- Articulate design tradeoffs and constraints
- Build data ingestion frameworks
- Define data modeling and schema evolution standards
- Design open table formats
- Design pipeline reliability and testing
- Develop streaming pipelines
- Enable self serve data platform
- Ensure data freshness accuracy availability
- Establish data lineage and data observability
- Implement data serving layers
- Lead lakehouse architecture
- Lead performance tuning
- Maintain production grade reliability
- Mentor engineers and elevate technical rigor
- Optimize large-scale data handling
- Own data ingestion data modeling streaming and data quality
- Own end to end data flows from ingestion to serving
- Plan capacity and cost efficiency
- Set partitioning and compaction best practices
Perks/Benefits
- Continuous learning
- Culture first work environment
- High-trust work environment
- Unlimited vacation policy
Skills/Tech-stack
AWS | Access Control | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Batch Processing | CloudFormation | Compaction | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Partitioning | Data Quality | Distributed Systems | Docker | Failure recovery | Go | Kubernetes | Lakehouse | Multi-tenancy | Observability | Pipeline monitoring | Python | S3 | Schema evolution | Snapshotting | Streaming | System design | Terraform | TypeScript
Education
N/A
Related jobs
-
Mid-level Full TimeHyderabad, Telangana, India; Open to Remote … R15h ago
-
Lead - Data Platform Engineering INR 2000K-2156KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeHyderabad, India15h ago
-
Data Engineer INR 1500K-2300KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkOffice based 5 days per weekMid-level Full TimeGurgaon, India16h ago
-
Senior Analytics Engineer I INR 2535K-3500KAirflow | Amazon S3 | CI/CD | Cloud Storage | Command LineHybrid work modelSenior-level Full TimeGurugram16h ago
-
CI/CD | Cloud Platforms | Data Architectures | Data Engineering | Data ModelingHybrid work | Immediate join | VIRTUAL interviewMid-level ContractBangalore North, India18h ago
-
NLP Engineer (Remote) INR 2000K-3000KAsynchronous programming | BERT | Batch Processing | Data Preprocessing | ETLMid-level Full TimeGurgaon, India R18h ago
-
Senior-level Full TimeHyderabad, India18h ago
-
Software Engineer (2024 / 25, GenAI must) INR 1100K-1500KAgile | CI/CD | Deep learning | Full SDLC | Generative AIHybrid work | MentorshipMid-level Full TimeBengaluru, INDIA, India19h ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R19h ago
-
Lead BI Engineer (GenAI) INR 2500K-3380KAI Agents | Azure SQL | DAX | Data Modeling | Data WarehousingCareer growth | Certification support | Growth chats | Idea tanks | MentorshipSenior-level Full TimeHyderabad, TS, India19h ago
-
Lead - Data Platform Engineering INR 2040K-2400KAlerting | Automation | Bash | CPU | Concurrency ControlSenior-level Full TimeChennai, India20h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India21h ago
-
Access Control | Ansible | Backup Management | Cisco UCS | ContainerizationSenior-level Full TimeBengaluru, KA, India21h ago
-
Senior AI & Automation Engineer (6+ years Generative AI, Agentic AI, LLMs, Python, APIs, MCP) INR 2500K-5000KAgentic AI | Agile | Conversational AI | LLM | LLMOpsSenior-level Full TimeBengaluru, KA, India22h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India22h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India22h ago
-
Gen AI - Consultant INR 2500K-4500KAWS SageMaker | Apache Airflow | Azure Machine Learning | CI/CD | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India22h ago
-
Gen AI - Consultant INR 2500K-4500KAPI Design | AWS SageMaker | Apache Airflow | Apache Spark | Azure MLAccess to AI research labs and cloud platforms | Certification access | Mentoring opportunities | Work on global clientsSenior-level Full TimeBangalore, Karnataka, India22h ago
-
Software Engineer III-( Java, AWS & Pyspark ) INR 2000K-2200KAWS | AWS Athena | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeMumbai, Maharashtra, India22h ago
-
Software Engineer I - Data Infrastructure INR 1200K-1500KAlgorithms | C++ | Data Structures | Database Proxy | Database replicationInclusive culture | Professional developmentMid-level Full TimeBangalore, India23h ago
-
Senior-level Full TimeBengaluru, Karnataka, India23h ago
-
Assistant Vice President INR 240K-420KData Analysis | Data Science | Machine Learning | Model Deployment | PythonExecutive-level Full TimeIndia1d ago
-
Senior Data Engineer INR 2500K-2829KAWS | Apache Airflow | Apache Iceberg | Apache Spark | AzureEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India1d ago
-
Data & AI DevSecOps Specialist INR 2298K-2675KAccess Control | CI/CD | Cloud platform | Data Classification | Data PrivacySenior-level Full TimeBengaluru, IN, 5601031d ago
-
Data Engineering INR 2520K-3356KAWS | AWS CloudFormation | Amazon Redshift | Amazon S3 | Backup and RecoveryCode reviews | Continuous improvement | Mentoring and coaching | Onboarding support | Technical assessments participationSenior-level Full TimeIndia1d ago