Senior Data Engineer
Tasks
- Architect batch and real time data pipelines
- Build ingestion frameworks with data quality and lineage
- Conduct root cause analysis and mentor engineers
- Create runbooks and architecture documentation
- Design and optimize dimensional data models
- Establish data engineering best practices for pipelines
- Implement ETL and ELT pipelines
- Monitor troubleshoot production data pipelines
- Perform performance and cost optimization for workloads
- Set up CI CD for data pipelines
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | AWS SQS | Airflow | Avro | CI/CD | Caching | Cluster tuning | Clustering | DBT | Data Lineage | Data Modeling | Data Quality | Data orchestration | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Event Driven | Event-driven architecture | GitLab | IAM | Indexing | JSON | Kafka | ORC | Parquet | Partitioning | Profiling | PySpark | Python | Query Optimization | SQL | Schema evolution | Semi-structured | Semi-structured Data | Snowflake | Snowflake Schema | SparkSQL | Star Schema | Streaming Architectures | Structured data | Terraform | Z-ordering
Roles
Related jobs
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Hands-off management | Remote/distributed workMid-level Full TimeKathmandu, Nepal4d ago
-
Senior Data Engineer USD 139K-247KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS SQSEquity | Health coverage | Paid time offSenior-level Full TimeNepal25d ago
-
Senior Data Engineer - Nepal USD 30K-40KAWS Glue | AWS Lambda | AWS S3 | Airflow | AlertingNight shiftSenior-level Full TimeKathmandu, Bagmati, Nepal (Hybrid) R28d ago
-
Site Reliability Engineer USD 150K-190KAWS | Alerting | CI/CD | Cause analysis | Data PipelinesEquity | Growth-focused environment | Health coverage | Paid leaveMid-level Full TimeNepal1mo ago
-
Data Engineer USD 112K-149KCI/CD | Cloud services | Data Warehousing | Databricks | ETLEquity | Growth opportunities | Health coverageMid-level Full TimeNepal1mo ago
-
Senior Data QA Engineer USD 120K-155KAPI Testing | AWS | Athena | Automation frameworks | Big DataEquity | Growth environment | Health coverageSenior-level Full TimeNepal1mo ago