Big Data Lead
Tasks
- Analyze data flow
- Build ETL pipelines
- Collaborate with DevOps
- Document code lineage
- Ensure data quality and integrity
- Ensure data security compliance
- Implement CI/CD pipelines
- Transform data
- Troubleshoot PySpark workflows
- Troubleshoot Snowpark applications
Perks/Benefits
- N/A
Skills/Tech-stack
CI/CD | Data Warehousing | DevOps | ETL | Hadoop | Hive | Kafka | PySpark | Python | SAS | SQL | Snowflake | Snowpark | Spark
Education
N/A
Roles
Big Data Engineer | Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Related jobs
-
Senior Data Engineer NZD 127K-145KAgile | Batch Processing | Control-M | DevOps | ITILOn-call rosterSenior-level Full TimeWellington, NZ23h ago
-
Software Engineer II - Data Engineering NZD 87K-115KAgile | Backend Services | CI/CD | Containerization | Data LakeMid-level Full TimeAuckland, NZ5d ago
-
AWS | Computer Vision | Data Ingestion | Data Processing | Data labelingFlexible scheduling | Fully remote | Inclusive international team culture | Paid training | Professional development supportMid-level Full TimeNew Zealand R5d ago
-
Data Engineer NZD 112K-131KAWS | Airflow | Avro | Azure | CI/CDAdditional paid leave | Banking benefits | Insurance discounts | Internal mobility | Professional developmentEntry-level Full TimeWestpac on Takutai Square, New Zealand6d ago
-
Intermediate Data Engineer NZD 105K-120KAPI Integration | Abinitio | Airflow | Apache Spark | CI/CDDiscounts on selected products and services | Flexible working arrangements | Wellbeing services accessMid-level Full TimeAuckland or Wellington, NZ7d ago
-
Senior Data Engineer, 12-Month Fixed Term Contract NZD 127K-138KAPI | Ab Initio | Airflow | Automation | CI/CDAccess to additional support for recruitment adjustments | Discounts on selected products and services | Flexible working arrangements | Wellbeing services accessSenior-level Contract TemporaryAuckland or Wellington, NZ7d ago
-
Junior AI Integration Engineer NZD 92K-114KAWS | Agentic Workflows | CI/CD | Context engineering | DBTCareer growth | Employee recognition | Global opportunities | Health benefitsEntry-level Full TimeNew Zealand, Auckland8d ago
-
Automation | Data Engineering | Data Governance | Data Visualization | Employee ExperienceBonus | Career growth | Equity opportunities | Flexible work arrangements | Healthcare and wellness benefitsExecutive-level Full TimeNew Zealand8d ago
-
Data & Analytics Practice Lead NZD 83K-95KBudget Management | Cloud Data | Cloud Data Platforms | Data Delivery | Data EngineeringChill-out spaces | Flexi hours | Inclusive culture | Professional development courses | Remote WorkingSenior-level Full TimeAuckland, Auckland, New Zealand14d ago
-
Data Engineer - Senior Analyst / Manager NZD 112K-132KAccess Controls | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeAnnual summer shutdown | Coaching | Employee assistance program | Flexible working | Health insuranceSenior-level Full TimeWellington - PwC Centre, Level 4, …14d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Ingestion | Data ProcessingAsynchronous culture | Entrepreneurial team | Remote/distributed teamMid-level Full TimeAuckland, New Zealand17d ago
-
Practice Lead - Data & Analytics NZD 108K-144KAccess Management | Azure | CI/CD | Code Quality | DBTDiscounts on products | Fuel discounts | Onsite cafe | Onsite carpark | Professional development opportunitiesSenior-level Full TimeAuckland, Auckland, New Zealand18d ago
-
Mid-level Full TimeAuckland or Wellington, NZ19d ago
-
Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DB | Azure DataHybrid work | Relocation package | Visa sponsorshipMid-level Full TimeWellington, New Zealand20d ago
-
Staff Machine Learning Engineer - Auckland NZD 157K-197KAzure | Bias Evaluation | CI/CD | Cloud platform | Computer VisionExpert Sessions Paid | Flexible work hours | Health care plan | Parental leave | Personal growthSenior-level Full TimeAuckland, Auckland, New Zealand21d ago
-
Data Engineers NZD 130K-150KAWS | Apache Spark | Azure DevOps | Data Modeling | DatabricksEAP services | Employee discounts | Free lunch or dinner | Health insurance | Illness or injury income protectionSenior-level Full TimeAuckland, NZ26d ago
-
Data Engineer NZD 88K-104KAgile | Automation | DBT | Data Modeling | Data QualityContinuous improvement culture | Diversity & Inclusion focus | Flexible working | Well-being focusMid-level Full TimeCentral Auckland, NZ, 101026d ago
-
Senior Solution Engineer NZD 145K-170KAWS | Analytics | Artificial Intelligence | As-a-Service | AzureSenior-level Full TimeNZ-Auckland-MSO27d ago
-
Senior-level Full TimeChristchurch, Canterbury Region, New Zealand27d ago
-
Senior Developer / Tech Lead - AI LAB NZD 135K-153KAI Foundry | AI Search | AKS | AWS Bedrock | Agent FrameworksChill-out spaces | Flexi hours | Professional development courses | Remote Working | Social eventsSenior-level Full TimeAuckland, Auckland, New Zealand30d ago
-
API Development | Agent Orchestration | Agentic Systems | Anthropic | Cloud ComputingFlex leave | Flexible work arrangements | Paid parental leave | Wellness incentiveSenior-level Full TimeAuckland, NZ, 10101mo ago
-
Data Engineer NZD 105K-115KChange Data Capture | Change Data Capture (CDC) | Data Modeling | Data Pipelines | Data QualityChallenging and supportive work environment | Competitive remuneration | Free car parking | On site subsidised cafeteria | Professional development opportunitiesMid-level Full TimeAuckland, New Zealand1mo ago
-
Lead Data Engineer NZD 103K-125KAnalysis Services | Business Intelligence | CDC | Data Modeling | Data QualityDevelopment opportunities | Free car parking | On-site work environment | Subsidised cafeteria | Work-life balanceSenior-level Full TimeAuckland, New Zealand1mo ago
-
Sr. Solutions Engineer NZD 135K-170KApache Spark | Big Data | Big data analytics | Cloud Computing | Data ArchitectureSenior-level Full TimeAuckland, New Zealand1mo ago
-
Data/Analytics Engineer NZD 90K-120KBI tools | Data Enrichment | Data Governance | Data Modeling | Data QualityMid-level Full TimeNew Zealand - Christchurch1mo ago