Senior Data Engineer

Tasks

• Automate database replication using CDC
• Build CI CD pipelines for data testing and validation
• Build centralized datasets for analytics and reporting
• Create data validation frameworks and automate data quality checks
• Design and implement real time event driven data pipelines
• Design data pipeline observability with metrics and alerts
• Design dimensional analytics ready data models
• Develop and maintain batch data ingestion pipelines
• Establish anomaly detection and outlier monitoring
• Implement data security, governance, and RBAC
• Lead scalable data platform architecture
• Maintain technical documentation for data lineage and ETL ELT processes
• Manage on premise infrastructure for data workloads
• Mentor junior data engineers and share engineering best practices
• Own OLAP and OLTP database development and maintenance

Perks/Benefits

• Equity policies
• Growth culture
• Learning opportunities
• Mentorship

Skills/Tech-stack

APIs | Airbyte | Apache Airflow | Apache Kafka | Backups | Bash | CDC | CI/CD | ClickHouse | DBT | Debezium | Dimensional Modeling | Disaster Recovery | Docker | Docker in production | Encryption | Git | Grafana | Great Expectations | In production | Kafka Connect | MySQL | OLAP | OLTP | PostgreSQL | Prometheus | Python | RBAC | SQL | Shell | Spark | Webhooks