Lead Data Platform Engineer (OpenSearch)
Tasks
- Automate deployment processes
- Build end to end streaming architecture
- Design RDBMS query performance improvements
- Design high-availability data pipelines
- Implement sharding and lifecycle management
- Lead database and data pipeline releases
- Model data for efficient querying
- Optimize OpenSearch index design
- Partition tables in RDBMS
- Troubleshoot real time data pipelines
- Tune SQL queries
- Version database schema
Perks/Benefits
Skills/Tech-stack
AWS | Amazon MSK | Ansible | Database Schema | Database Schema Versioning | Elasticsearch | Flyway | IaC | Index Lifecycle Management | Index lifecycle | Indexing | Infrastructure as Code | Kafka | Lifecycle Management | Logstash | MySQL | OpenSearch | Performance Tuning | PostgreSQL | RDBMS | RDS Performance Tuning | SQL | Schema versioning | Sharding | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Java Fullstack Engineer with GenAI & React INR 1500K-2500KAgile Development | Azure | Design Patterns | Docker | Extreme programmingEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India4h ago
-
Software Engineer INR 1500K-2100KAWS | Agile | Bash | CI/CD | CloudWatchFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time off | Work-life balance benefitsMid-level Full TimeHyderabad, India R6h ago
-
Staff Engineer - Data Path INR 1500K-3000KC# | C++ | Cache Management | Concurrency | Data transferSenior-level Full TimePune Office7h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R10h ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R12h ago
-
AI Orchestration / Platform Engineer INR 2500K-4680KAlerting | Authentication | Authorization | CI/CD | CachingSenior-level Full TimeNoida/Gurgaon, HR, IN R12h ago
-
Tech S And T-Cloud AI Platform Engineer-ISR-Senior-GDSF02 INR 3000K-5000KAI Pipelines | ARM Templates | AWS | AWS CloudFormation | Amazon BedrockSenior-level Full TimeNoida, UP, IN, 20130112h ago
-
Sr Analytics Engineer INR 2400K-3000KAPI Integration | AWS | Amazon Redshift | Data Analysis | Data GovernanceRelocation assistanceSenior-level Full TimeBengaluru, India12h ago
-
Senior Data Engineer, Director INR 1500K-3000KAWS EMR | Amazon Athena | Amazon DynamoDB | Amazon Kinesis | Amazon QuickSightSenior-level Full TimeGurugram, India12h ago
-
Analyst/Consultant - Data Engineer - Azure (INDM) INR 1500K-2000KApache Cassandra | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimePune, Maharashtra, India1d ago
-
Senior Software Engineer (App-Framework) INR 2475K-3465KClass Loading | Concurrency | Distributed Systems | Garbage Collection | Input OutputSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer (Data Platform) INR 2000K-3000KAirflow | CI/CD | DBT | Data Governance | Data QualitySenior-level Full TimeBengaluru, India1d ago
-
Staff Software Engineer - Fullstack INR 2475K-3500KAccessibility | Dashboarding | Data Pipelines | Data Visualization | Distributed SystemsSenior-level Full TimeBengaluru, India1d ago
-
Anonymization | Artificial Intelligence | Data Deidentification | Data Drift | Data Drift DetectionMid-level Full TimeNew Delhi, DL, India1d ago
-
Senior-level Full TimeIND-KA-Bengaluru, India1d ago
-
Senior-level Full TimeHyderabad, India2d ago
-
Senior ML Engineer INR 3000K-4000KAzure | Azure DevOps | Change Management | Classification | ClusteringAnnual leave | Employee assistance programme | Employee wellbeing platform Unmind | Flexible working | Learning and development opportunitiesSenior-level Full TimeChennai, IN2d ago
-
Principal Software Engineer INR 3264K-5876KAWS | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingSenior-level Full TimeHyderabad, TG, India R2d ago
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India2d ago
-
AI Model Training | AI model | Bash | Cloud platform | Data IngestionAsynchronous culture | Entrepreneurial team | Flexible management approach | Remote-friendlyMid-level Full TimeBangalore, India2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Entrepreneurial team | Friendly work environment | Opportunity for large impactMid-level Full TimeNoida, India2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudEntrepreneurial team | Flexible, async culture | Mission driven product impact | Supportive hands off managementMid-level Full TimeMumbai, India2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Entrepreneurial environment | Friendly laid-back atmosphere | Hands-off managementMid-level Full TimeAhmedabad, India2d ago
-
Staff Database Platform Engineer INR 2500K-4200KAWS IAM | AWS RDS | Amazon EC2 | Amazon S3 | AnsibleSenior-level Full TimeIN - India - Bangalore2d ago
-
Staff Machine Learning Engineer INR 3600K-5000KA/B | A/B Testing | AWS | Agentic Workflows | AzureHybrid work | Onsite collaborationSenior-level Full TimeIndia - Pune - Office R2d ago