Data Engineer (Azure Databricks) Consultant/Senior Consultant
Sydney, International House, 3 Sussex St, Australia
AUD 70K-120K (estimate) Senior-level Full Time
Tasks
- Build data transformation workflows
- Design scalable data ingestion pipelines
- Develop Databricks notebooks with PySpark
- Document data pipelines and workflows
- Ensure data security, governance, and compliance
- Implement data quality checks and monitoring
- Integrate structured, semi-structured, and unstructured data
- Optimize Spark jobs for performance and cost
- Participate in code reviews and design discussions
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Synapse | Blob Storage | CI/CD | Data Factory | Data Governance | Data Lake | Data Lake Architecture | Data Modeling | Data Quality | Data Security | Data Warehousing | Delta Lake | ELT | ETL | Git | NoSQL | PySpark | Python | SQL | Scala | Terraform
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior Applied AI Engineer AUD 119K-161KAgent Orchestration | Agent systems | Bias Testing | Context engineering | Evaluation datasetsCoaching | Equity | Extended end of year break | Home workspace setup budget | Inclusive parental leaveSenior-level Full TimeMelbourne7h ago
-
Principal Consultant - Data Engineering AUD 160K-190KAnalysis Services | App Insights | Azure | Azure Data | Azure Data FactoryCareer pathways | Diversity and equal opportunity | Flexibility | Inclusion | Ongoing learningSenior-level Full TimeAustralia23h ago
-
Adtech | Distributed Systems | Docker | Embeddings | JavaAccess to technical leadership | Collaborative engineering culture | Exposure to cutting edge generative AI | High autonomy and flexibility | High ownership and real world production impactEntry-level Full TimeAustralia R1d ago
-
Cyber Security Data Engineer AUD 135K-165KArtificial Intelligence | Automation | Compliance reporting | Control assessments | Control mappingEmployee discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteering opportunitiesMid-level Full TimeSydney, NSW, Australia1d ago
-
Agile | Apex | CI/CD | Change Data Capture | CopadoFlexible working | Hybrid working options | Wellbeing supportSenior-level Full TimeSydney Office, Australia1d ago
-
Data Engineer-Medicare Mental Health Check In AUD 96K-119KAutomated testing | Azure | Azure Data | Azure Data Factory | CI/CDCompetitive salary packaging benefits | Hybrid working | Inclusive and supportive culture | Professional development and learning opportunitiesMid-level Full TimeVIC Group Office - Melbourne, Australia1d ago
-
AI Engineer - Melbourne AUD 92K-125KAPI Development | AWS | Automated testing | CI/CD | Cloud platformMid-level Full TimeMelbourne - 727 Collins, Australia R1d ago
-
Mid-level Full TimeSydney - Barangaroo, Australia R1d ago
-
Azure Databricks | Azure Synapse | CI/CD | DAX | Data LakeSenior-level Full TimePerth, Exchange Tower, Australia1d ago
-
AI Software Engineer AUD 111K-161KASP.NET Web | ASP.NET Web API | AWS ECS | AWS Lambda | AWS S3Additional time off | Flexible and hybrid working | Gym membership | Learning opportunities | Social eventsMid-level Full TimeSydney, New South Wales, Australia2d ago
-
Mid-level Full TimeHong Kong, Hong Kong; Sydney, Australia3d ago
-
Reporting & Data Engineers AUD 150K-180KAgile | Azure | CI/CD | Data Modeling | Data WarehousingClient office access | Hybrid workMid-level Full TimeMelbourne, Victoria 3000, Australia3d ago
-
Graduate Consultant - Data & Analytics (Open) AUD 80K-87KAzure Data | Azure Data Factory | BigQuery | DBT | Data FactoryCareer development | Client exposure | Learning opportunities | Team-based environmentEntry-level Full TimeSydney, New South Wales 2000, Australia3d ago
-
Data Engineer AUD 125K-128KAI Agents | AWS | Automation | Azure | Data GovernanceCharity volunteering opportunities | EAP support | Financial planning support | Flexible work options | Generous leaveMid-level Full TimeNorwest, New South Wales 2153, Australia4d ago
-
Data Engineer AUD 110K-140KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Birthday day off | End-of-trip facilities | Flexible working | Paid parental leaveMid-level Full TimeSydney4d ago
-
Senior Software Engineer AUD 140K-143KAPI Design | Agile | Automated testing | CI/CD | Distributed SystemsFlexible working hours | Job share | Office connection at least half time per month | Part-time arrangementsSenior-level Full TimeEveleigh, NSW - 1 Locomotive Street, …4d ago
-
Data Engineering Lead AUD 120K-125KAWS | Azure | CI/CD | Cloud Computing | Data ArchitectureCareer development opportunities | Discounted healthcare memberships | Employee counselling support | Employee discounts | Flexible leave optionsSenior-level Full TimeHead Office Sydney, Australia4d ago
-
Principal AI Engineer AUD 130K-180KAPI Development | Agentic Workflows | Backend Services | CI/CD | ClassificationCareer growth | Flexible working environment | Remote-friendly cultureSenior-level Full TimeSydney4d ago
-
Senior Data & Analytics Engineer, Strategic Finance AUD 150K-222KDBT | Data Modeling | Data Pipelines | Data Quality | Dimensional ModelingEmployee stock options | Health insurance coverage | Hybrid work | Paid time off | Parental leaveSenior-level Full TimeMelbourne, VIC, Sydney, NSW R4d ago
-
Data Engineer - 12 month FTC AUD 100K-134KAWS S3 | Agile | Amazon Redshift | Amazon Web Services | Apache AirflowAdditional leave | Corporate partner discounts | Flexible-hybrid work | Free NBN plan | Free mobile planEntry-level Contract Full Time TemporaryBarangaroo, NSW, AU4d ago
-
Azure AI Developer Consultant AUD 70K-100K.NET | API Management | App Service | Azure API | Azure API ManagementFlexible work schedule | Onsite customer visits when required | Work from home optionSenior-level Full TimeMelbourne, VIC, AU4d ago
-
Senior Analytics Engineer - Security Insights AUD 118K-130KAlerting | Batch Processing | Cost Optimization | DBT | Data GovernanceEquity packages | Flexible leave | Parental leave | Wellbeing allowanceSenior-level Full TimeSydney, Australia R5d ago
-
Entry-level Full TimeMelbourne, Australia5d ago
-
Analytics Engineer - Personalisation AUD 110K-140KDBT | Data Modeling | Data Pipelines | Data Warehousing | ELTEquity packages | Flexible leave options | Flexible remote work | Inclusive parental leave | Wellbeing allowanceMid-level Full TimeSydney, Australia R5d ago
-
AWS Glue | AWS Step Functions | Amazon EMR | Amazon Kinesis | Amazon RedshiftFlexible working | Hybrid work | Job-sharing | Part-time arrangementsSenior-level Contract Full Time TemporarySydney, NSW - CBP North, 1 … R5d ago