Senior Data Engineer
Tasks
- Architect batch and real time data pipelines
- Build ingestion frameworks with data quality and lineage
- Conduct root cause analysis and mentor engineers
- Create runbooks and architecture documentation
- Design and optimize dimensional data models
- Establish data engineering best practices for pipelines
- Implement ETL and ELT pipelines
- Monitor troubleshoot production data pipelines
- Perform performance and cost optimization for workloads
- Set up CI CD for data pipelines
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | AWS SQS | Airflow | Avro | CI/CD | Caching | Cluster tuning | Clustering | DBT | Data Lineage | Data Modeling | Data Quality | Data orchestration | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Event Driven | Event-driven architecture | GitLab | IAM | Indexing | JSON | Kafka | ORC | Parquet | Partitioning | Profiling | PySpark | Python | Query Optimization | SQL | Schema evolution | Semi-structured | Semi-structured Data | Snowflake | Snowflake Schema | SparkSQL | Star Schema | Streaming Architectures | Structured data | Terraform | Z-ordering
Roles
Related jobs
-
Senior Data Engineer USD 139K-247KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS SQSEquity | Health coverage | Paid time offSenior-level Full TimeNepal4d ago
-
Senior Data Engineer - Nepal USD 30K-40KAWS Glue | AWS Lambda | AWS S3 | Airflow | AlertingNight shiftSenior-level Full TimeKathmandu, Bagmati, Nepal (Hybrid) R8d ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Processing | DockerAsynchronous culture | Diverse and inclusive workplace | Friendly and laid-back atmosphere | Opportunity to make impactMid-level Full TimeKathmandu, Nepal15d ago
-
Site Reliability Engineer USD 150K-190KAWS | Alerting | CI/CD | Cause analysis | Data PipelinesEquity | Growth-focused environment | Health coverage | Paid leaveMid-level Full TimeNepal16d ago
-
Data Engineer USD 112K-149KCI/CD | Cloud services | Data Warehousing | Databricks | ETLEquity | Growth opportunities | Health coverageMid-level Full TimeNepal26d ago
-
Senior Data QA Engineer USD 120K-155KAPI Testing | AWS | Athena | Automation frameworks | Big DataEquity | Growth environment | Health coverageSenior-level Full TimeNepal1mo ago
-
Sr. Databricks Azure Data Engineer USD 139K-225KApache Spark | Apache Spark internals | Azure AD | Azure DevOps | CI/CDSenior-level ContractKathmandu1mo ago