BIBA Practice - Big Data Architect
Tasks
- Analyze source data dependencies and data flow
- Build CI CD pipelines and DevOps workflows
- Ensure data quality and integrity
- Ensure data security and privacy compliance
- Implement ETL pipelines
- Manage code lineage
- Perform data transformations
- Troubleshoot Snowpark and PySpark workflows
- Troubleshoot big data processing issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | CI/CD | Data Quality | Data Security | Data Warehousing | DevOps | ETL | PySpark | Python | SQL | Snowflake | Snowpark
Education
N/A
Roles
Related jobs
-
Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | CI/CDSenior-level Full TimeNew Zealand2d ago
-
Data Architect NZD 131K-160KAPIs | Amazon Web Services | Analytical Data | Analytical data stores | AzureHybrid workingSenior-level Full TimeKelburn, Wellington, New Zealand6d ago
-
Sr. Solutions Engineer NZD 135K-170KApache Spark | Big Data | Big data analytics | Cloud Computing | Data ArchitectureSenior-level Full TimeAuckland, New Zealand12d ago
-
Data Architect NZD 155K-175KABAC | Audit trails | Cloud Data | Data Architecture | Data LineageCareer development programmes | Childcare discounts | Discounted car parking | Discounts on services | Flexible work hoursSenior-level Full TimeAuckland, Auckland, New Zealand13d ago
-
AI Architect NZD 140K-170KAI Agentic | AI Data | AI data modeling | AI managed services | AI managed services (BedrockChill-out spaces | Flexi hours | Inclusive environment | Professional development | Remote WorkingSenior-level Full TimeAuckland, Auckland, New Zealand1mo ago