Principal Engineer - Open Source Data Platform (ODP)
Tasks
- Architect across bare metal and virtualized environments
- Conduct research and development initiatives
- Define technical strategy and architecture
- Deploy on Kubernetes and multi cloud
- Drive alignment across engineering product and operations
- Drive open source contributions
- Establish architectural principles and patterns
- Establish engineering best practices
- Improve reliability and failure analysis
- Influence open source project roadmaps
- Lead complex architectural initiatives
- Lead resolution of complex technical problems
- Mentor staff engineers and senior engineers
- Optimize performance and scalability
- Provide technical due diligence for initiatives
- Represent company in open source community
- Run technical discussions with customers and partners
- Translate business strategy into technical execution
- Translate customer requirements into platform capabilities
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Hadoop | Apache Hive | Apache Hudi | Apache Kafka | Apache Spark | Cloud Native | Cloud Native Architecture | Consensus Protocols | Data mesh | Data replication | Delta Lake | Distributed Computing | Distributed Transactions | Failure mode analysis | Flink | Hadoop | Hive | Iceberg | Java | Kafka | Kubernetes | Lakehouse | Multi-cloud | Partitioning | Performance optimization | Python | Resource Management | Scala | Spark | Trino
Education
Related jobs
-
ETL Migration Engineer - Data Integration - Lead Consultant INR 1650K-2600KAPI | AWS | AWS Glue | Amazon EKS | Apache AirflowSenior-level Full TimeChennai, IN, 6000322h ago
-
Data Engineer INR 3000K-3500KAlerting | Amazon Redshift | Apache Spark | Argo Workflows | AzureAgile working options | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon3h ago
-
IT Analyst INR 950K-1250KAzure | Azure ML | Azure OpenAI | Cognitive Services | EmbeddingsContinuing education program | Continuous learning | Family-friendly perks | Flexible time off | Health care coverageMid-level Full TimeIN - NOIDA CANDOR TECHSPACE SECTOR …8h ago
-
Cloud Computing | Computer Vision | Data Pipelines | Data Quality | Data Quality EvaluationAccidental insurance | Hybrid work options | Life insurance | Medical insurance | Paid parental leaveSenior-level Full TimeBangalore, India (Hybrid) R14h ago
-
Senior Machine Learning Engineer - AI-Assisted Data Annotation INR 2400K-3500KConfidence scoring | Few-Shot Learning | Few-shot | Fine Tuning | Human-in-the-loopAccidental insurance | Flexible hours | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R14h ago
-
Benchmarking | Deep learning | Distributed Training | Efficient Deep Learning | Experiment trackingAccidental insurance | Flexible hours | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeBangalore, India (Hybrid) R14h ago
-
Staff Engineer – Data/AI Platform Engineering INR 3000K-5000KAzure | Batch Processing | Data Catalog | Data Governance | Data IngestionAccidental insurance | Flexible hours | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R14h ago
-
Cloud Platforms | Computer Vision | Data Quality | Fine Tuning | Language ModelsAccidental insurance | Flexible hours | Hybrid work options | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R14h ago
-
Consultant - Data Warehouse -238 INR 2520K-4000KBusiness Intelligence | Cloud Platforms | Data Governance | Data Modeling | Data VisualizationEmployee engagement initiatives | Training and mentorshipMid-level Full TimeBengaluru, Karnataka19h ago
-
Python Robot QA INR 1524K-2541KAgile | Azure DevOps | Backup and Recovery | Case management | Continuous integrationHybrid workSenior-level Full TimeIN-AP-Hyderabad19h ago
-
Senior-level Full TimeIN-KA-Bangalore19h ago
-
Agentic AI Engineer INR 1000K-1500KAPIs | Agentic AI | Automation | Automation Anywhere | Cloud ComputingEnhanced medical benefits | Family well-being benefits | Paid time off | Wellbeing benefits | Work-life balance benefitsMid-level Full TimeHyderabad, India19h ago
-
Senior-level Full Timebengaluru, India19h ago
-
ML and GenAI INR 1000K-1000KAPIs | Algorithms | Data Structures | Event Driven | Event-driven architectureMid-level Full TimeGurgaon, Haryana, India20h ago
-
RAG + Agentic AI Engineer (India) (Remote) INR 2500K-3500KAccess Control | Agent Orchestration | Asynchronous programming | Auditability | BM25Growth opportunities | Ownership and autonomy | Remote workMid-level Full TimeMaharashtra, Pune, India R20h ago
-
Staff Engineer, Data Engineering INR 2400K-3100KAPIs | Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, India20h ago
-
Manager- Data Aggregation-304 INR 1200K-2500KAirflow | Amazon Redshift | Data Deidentification | Data Governance | Data ManagementMid-level Full TimeBengaluru, Karnataka20h ago
-
DevOps Lead INR 3000K-5000KAmazon Web Services | Azure DevOps | CI/CD | Cloud Security | CloudFormationCareer growth opportunities | Flexible work environment | Hybrid work environmentSenior-level Full TimeKARNATAKA, Bengaluru, India20h ago
-
Mid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN21h ago
-
Sr. Staff Engineer (Java Fullstack or Python, AI) INR 2475K-3500KAWS | Angular | Anthropic | Azure OpenAI | Bias MitigationFamily well-being benefits | Health benefits | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India21h ago
-
Senior Generative AI Engineer (India) (Remote) INR 2000K-4800KAI orchestration | AI/ML stack | API Development | API Gateway | AWS AIAgile environment | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R21h ago
-
Data Engineer INR 1000K-2100KApache Airflow | Apache Spark | Azure | CI/CD | DatabricksEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India22h ago
-
Mid-level Full TimeMaharashtra, Pune, India22h ago
-
AI Data Scientist INR 1800K-3000KAgent systems | Agentic Systems | Calculus | Data Preprocessing | Diffusion ModelsMid-level Full TimeChennai, Tamil Nadu, India22h ago
-
Senior Software Engineer (Microsoft .NET/Azure cloud) INR 2829K-4000K.NET | API Management | APIM | Angular | App ServicesHealth insurance | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India22h ago