Data Engineer Senior
Tasks
- Build and optimize Spark processing jobs
- Collaborate with Agile scrum teams
- Create and validate Power BI reports
- Develop and maintain data lake pipelines
- Enable analytical consumption layers
- Ensure data quality and versioning
- Ingest data from transactional systems
- Maintain Git version control
- Manage Hive queries and modeling
- Transform and model data
- Use Azure DevOps for backlog and task management
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hive | Apache Hudi | Apache Iceberg | Apache Spark | Apache Zeppelin | Azure Boards | Azure DevOps | Cloudera Data Platform | Columnar Storage | Data Governance | Data Lake | Data Lake Architecture | Data Lineage | Data Partitioning | Data Quality | Data compactation | Data platform | Databricks | Databricks Certification | Delta Lake | File optimization | Git | GitHub | HQL | Hadoop | Kanban | Lakehouse | Parquet | Performance Tuning | Power BI | PySpark | Python | SQL Server | Schema evolution | Scrum | Spark file optimization | T-SQL | Table formats
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior Machine Learning USD 160K-179KAzure Synapse | Azure Synapse Analytics | Data Processing | Data Visualization | Feature EngineeringSenior-level Full TimeBolivia17d ago
-
Senior Data Engineer USD 110K-165KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeBolivia17d ago
-
Senior-level Full TimeBolivia28d ago
-
Senior Software Development Engineer in Test USD 101K-147KAutomation Testing | BI | DBT | Data Pipelines | Data QualitySenior-level Full TimeBolivia1mo ago
-
Senior Data Engineer Databricks USD 152K-213KAWS | Data Governance | Data Modeling | Data Pipelines | Data ProcessingSenior-level Full TimeBolivia1mo ago