OpenSearch Engineer / AWS & Data Pipelines
Tasks
- Build PostgreSQL to OpenSearch synchronization pipelines
- Build operational runbooks and alerting
- Build reconciliation to repair missing or stale documents
- Design indices and mappings
- Implement retries idempotency and deduplication
- Implement snapshot restore backup and disaster recovery
- Investigate slow queries and indexing bottlenecks
- Monitor ingestion lag and data freshness
- Optimize OpenSearch queries and indexing
- Own AWS OpenSearch service in production
- Perform production incident response and root cause analysis
- Plan OpenSearch upgrades and migrations
- Secure access with IAM and least privilege
Perks/Benefits
Skills/Tech-stack
AWS CloudWatch | AWS DMS | AWS Lambda | AWS OpenSearch | AWS OpenSearch Service | Aggregations | Amazon ECS | Amazon EKS | Amazon S3 | Amazon SQS | Bulk Indexing | Data Reconciliation | Dead Letter | Dead-letter queues | Disaster Recovery | Elasticsearch | IAM | Idempotency | Index Mapping | Index shard design | Indexing | OpenSearch | OpenSearch Ingestion | OpenSearch Service | PostgreSQL | Query-DSL | Retries | Snapshot Restore
Education
N/A
Roles
Related jobs
-
Senior Data Engineer USD 150K-200KAPIs | Amazon QuickSight | Amazon Web Services | Backup | CI/CDBusiness English classes | Continuous learning support | Defined career path | Every other Friday off | Explore programSenior-level Full TimeLatAm, North Macedonia, Portugal, Serbia R8d ago
-
Senior Data Engineer EUR 55K-76KAlerting | Amazon Kinesis | Amazon S3 | Anomaly Detection | Apache AirflowSenior-level Full TimeOffsite Serbia R17d ago
-
Senior Data Platform Engineer (Python) CAD 110K-160KAWS | Amazon Redshift | Amazon S3 | Apache Airflow | Apache IcebergHybrid work | Mentoring and code review culture | On-call supportSenior-level Full TimeOffsite Serbia R17d ago