Sr. Databricks Azure Data Engineer
Kathmandu
USD 139K-225K (estimate) Senior-level Contract Found 12d ago
Tasks
- Build CI/CD automated testing for data pipelines
- Design data solutions on Spark and Flink
- Develop Python SDK for Jupyter Notebooks
- Document solutions and workflows
- Enforce data governance and security practices
- Implement data quality rules
- Maintain CI/CD workflows
- Manage and optimize Azure and Databricks resources
- Monitor and optimize pipelines
- Participate in agile activities
- Transform and prepare data using SQL, Python, Java
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Apache Spark internals | Azure AD | Azure DevOps | CI/CD | Compliance | Data Design | Data Modeling | Data Warehousing | Databricks | Dataframes | Deequ | Delta Lake | Encryption | GitHub | Great Expectations | JUnit | PySpark | Pytest | Python | Spark internals
Education
Roles
Regions
Countries
States
Language: en |
Views: 1 |
Clicks: 0
Related jobs
-
Software Engineer II - Data QA USD 91K-130KAWS | Agile | Automation | Data Analysis | Data ValidationEquity | Growth environment | Health coverageMid-level Full TimeNepal3d ago
-
Senior Data Engineer USD 152K-204KAPIs | AWS | Airbyte | Batch Data Processing | Batch dataLife insurance | Medical cover | Office snacks | Professional growth | Remote workSenior-level Full TimeKathmandu, Bagmati Province, Nepal6d ago
-
Data Engineer USD 120K-177KAWS | Airflow | Avro | BigQuery | CachingEquity | Growth environment | Health coverageMid-level Full TimeNepal12d ago
-
Senior-level Full TimeNepal13d ago