Data Engineer
Tasks
- Apply data security best practices and HIPAA SOC 2 compliance
- Automate secure data operations and governance workflows
- Build and maintain batch and real-time pipelines
- Create technical documentation and runbooks
- Design and develop data pipelines
- Develop data models and schemas for analytical workloads
- Implement CI CD workflows for data pipelines
- Implement fault tolerant multi account AWS data architectures
- Integrate ingestion frameworks with Databricks Snowflake AWS and vendor APIs
- Perform performance profiling and compute optimization
- Support code reviews and knowledge sharing
- Translate business requirements into technical specifications and data flows
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS SQS | Airflow | Amazon Redshift | Auditing | Avro | BigQuery | CI/CD | Clustering | DBT | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Encryption | HIPAA | JSON | Kafka | Logging | ORC | Observability | Orchestration | Parquet | Partitioning | PySpark | Python | RBAC | SOC 2 | SQL | Schema evolution | Snowflake | Snowflake Schema | Spark SQL | Star Schema | Terraform | Tokenization
Roles
Related jobs
-
Senior Data Engineer USD 152K-247KAWS Glue | AWS Lambda | AWS S3 | AWS SQS | AirflowEquity | Health coverage | Leave benefits | Onsite work arrangement | Professional growth environmentSenior-level Full TimeNepal3d ago
-
Senior Data Engineer USD 139K-247KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS SQSEquity | Health coverage | Paid time offSenior-level Full TimeNepal4d ago
-
Senior Data Engineer - Nepal USD 30K-40KAWS Glue | AWS Lambda | AWS S3 | Airflow | AlertingNight shiftSenior-level Full TimeKathmandu, Bagmati, Nepal (Hybrid) R8d ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Processing | DockerAsynchronous culture | Diverse and inclusive workplace | Friendly and laid-back atmosphere | Opportunity to make impactMid-level Full TimeKathmandu, Nepal15d ago
-
Site Reliability Engineer USD 150K-190KAWS | Alerting | CI/CD | Cause analysis | Data PipelinesEquity | Growth-focused environment | Health coverage | Paid leaveMid-level Full TimeNepal16d ago
-
Data Engineer USD 112K-149KCI/CD | Cloud services | Data Warehousing | Databricks | ETLEquity | Growth opportunities | Health coverageMid-level Full TimeNepal27d ago
-
Senior Data QA Engineer USD 120K-155KAPI Testing | AWS | Athena | Automation frameworks | Big DataEquity | Growth environment | Health coverageSenior-level Full TimeNepal1mo ago
-
Sr. Databricks Azure Data Engineer USD 139K-225KApache Spark | Apache Spark internals | Azure AD | Azure DevOps | CI/CDSenior-level ContractKathmandu1mo ago