Data Engineer
VIC - Melbourne - 655 Collins St, Australia
AUD 115K-120K (estimate) Mid-level Full Time
Tasks
- Build and maintain data pipelines
- Build data transformation workflows
- Design data pipelines
- Develop delta tables for reporting
- Document solutions and runbooks
- Implement data security
- Implement incremental loads
- Implement merges
- Manage Fabric capacity
- Monitor data quality
- Monitor pipeline performance
- Optimize datasets for Power BI
- Support CI/CD practices
- Validate data
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | BI semantic models | CI/CD | Data Factory | Data Pipeline Monitoring | Data Quality | Data Security | Data pipeline | Databricks | Delta Lake | Delta Tables | Direct Lake | Git | Microsoft Fabric | Pipeline monitoring | Power BI | Power BI Semantic Models | Python | RLS | Semantic models | Spark SQL | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior AI Software Engineer - 12 month fixed term AUD 100K-120KAPI Integration | AWS Lambda | Amazon Web Services | CI/CD | Database MigrationHybrid work | Loyalty leave | Paid parental leave | Wellbeing programs | Wellness initiativesSenior-level Full Time TemporarySydney, NSW, Australia22h ago
-
Solution Designer / Lead Data Engineer (Google Cloud) AUD 130K-158KAPI Integration | Airflow | Apache Beam | BigQuery | CDCAI Driven Learning Platform | Career development training | Discounted health insurance | Paid parental leave | Performance recognition and rewardsSenior-level Full TimeSydney, NSW, Australia23h ago
-
Data Integration Developer AUD 113K-125KAzure Data | Azure Data Factory | CI/CD | Continuous Delivery | Continuous integration24 7 operating environment | Flexible work options | On-call supportMid-level Full TimeMacquarie Park, NSW, AU, 21131d ago
-
Applied AI Specialist AUD 152K-180KAPIs | Anomaly Detection | Cloud Architecture | Computer Vision | Data GovernanceContinued career development access | Employee resource groups | Flexible WFH policy | Generous PTO policy | Paid volunteer timeSenior-level Full TimeAustralia-New South Wales-Sydney1d ago
-
Lead Data Engineer AUD 135K-140KAI Tooling | Access Control | Analytics Platforms | Automation | Cloud DataAccess to employee share plan | Additional support leave | Challenger Day extra day off | Discretionary bonus scheme | Extra superannuation contributionsSenior-level Full TimeNSW - 5 Martin Place, Australia1d ago
-
Senior Data Engineer AUD 102K-114KAPI Development | AWS | AWS CDK | Apache Airflow | Apache KafkaCommunity grants | Community support programs | Flexible leave options | Flexible parental leave | HackdaysSenior-level Full TimeRichmond, Melbourne VIC, Australia1d ago
-
AI Engineer AUD 60K-60KAgile | Azure | C# | Cloud platform | Generative AIAnnual festive gifts | Career development support | Discounted food and drinks | Employee benefits program | Free OnePass membershipSenior-level Full TimeSupport Office VIC, Australia1d ago
-
GCP Data Engineer (Google) AUD 122K-134KApacheAirflow | ApacheBeam | AppEngine | Bash | BigQueryCareerDevelopmentTrainingPrograms | DiscountedHealthInsurance | DiscountsOnProductsAndServices | PaidParentalLeave | PerformanceRecognitionMid-level Full TimeBrisbane, QLD, Australia1d ago
-
GCP Data Engineer (Google) AUD 122K-134KApache Airflow | Apache Beam | Bash | BigQuery | CI/CDCareer Development Programs | Discounted health insurance | Discounts on products and services | Employee well-being initiatives | Paid parental leaveMid-level Full TimeMelbourne, VIC, Australia1d ago
-
GCP Data Engineer (Google) AUD 122K-134KApache Airflow | Apache Beam | Apache Kafka | App Engine | Automated testingCareer development training programs | Discounted health insurance | Discounts on products and services | Paid parental leave | Well-being initiativesMid-level Full TimeSydney, NSW, Australia1d ago
-
Anomaly Detection | Data Analysis | Data Science | Machine Learning | Model InterpretabilityFlexible working arrangements | Hybrid work arrangement | Research infrastructure accessSenior-level Full Time TemporaryCampus, Clayton campus1d ago
-
Lead Data engineer AUD 122K-155KARM Templates | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataRemote team collaborationSenior-level Full TimeMelbourne, Victoria, Australia1d ago
-
Senior Analyst, Data & Analytics AUD 60K-78KBusiness Intelligence | DBT | Data Governance | Data Modeling | Data PipelinesEmployee discount travel | Hybrid work model | Staff travel programSenior-level Full TimeMelbourne, Victoria, Australia R1d ago
-
AI Engineer AUD 146K-157KAWS | Azure | Google Cloud | Langchain | Language ModelsContinuous learning | Flexible working | Inclusive cultureSenior-level Full TimeDOCKLANDS, VIC, AU, 30082d ago
-
Manager, AI & Advanced Analytics AUD 125K-127KAWS | Cloud Computing | Data Engineering | GCP | MLOpsMid-level Full TimeAPAC, AU, Victoria, Melbourne, CSL Limited …2d ago
-
Chapter Lead, Data Science (Operations) AUD 131K-143KAgentic Systems | CI/CD | Containerization | Data Architecture | Data PipelinesCareer development | Flexible workplace | Inclusion and respect cultureSenior-level Full TimeEveleigh, NSW - 5-7 Central Ave, …2d ago
-
DBT | Data Modeling | Data Pipelines | Data Quality | Data TestingSenior-level Contract Full Time TemporarySydney, NSW - CBP North, 1 …2d ago
-
API Integration | Azure AI | Database Integration | GPU Computing | Hugging FaceCollaboration with international team | Comprehensive benefits package | Inclusive workplace culture | Professional growth opportunities | Remote work flexibilitySenior-level Full TimeAustralia2d ago
-
AWS | Azure | GCP | Git | Language ModelsAutonomy | Continuous learning | Flexible work environment | Fully remote work | Professional growthMid-level Full TimeAustralia R2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly laid back environment | Impactful product work | Remote-friendly teamMid-level Full TimeBrisbane, Australia2d ago
-
Data Analysis | Machine Learning | Model Evaluation | Model Serving | NumPyEquity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia R3d ago
-
AWS | Agent-based | Agent-based modeling | Alteryx | AzureCoaching and Mentorship | On-the-job training | Work onsite with clientsEntry-level Full TimeSydney - Eora Nation, Australia3d ago
-
Snr Specialist Cyber Insights &Analytics AUD 113K-125KAzure Data | Azure Data Factory | Azure SQL | DAX | Data FactoryHybrid workMid-level Full TimeMacquarie Park, NSW, AU, 21133d ago
-
Mid-level Full TimeMelbourne CBD, Victoria 3000, Australia3d ago
-
Senior AI Engineer, AI Accelerator AUD 132K-147KAI Operationalisation | AI platforms | Agent Design | Amazon Web Services | Artificial IntelligenceCareer development opportunities | Convenient city location | Discounts on partner products | Free OnePass membership | Hybrid workingSenior-level Full TimeMelbourne, VIC, AU3d ago