Data Engineer, AI and Data, Technology Consulting
Tasks
- Build scalable data pipelines
- Coordinate junior team members
- Create pipeline documentation and diagrams
- Design data pipeline solutions
- Develop data ingestion and validation workflows
- Implement data transformations and modeling
- Translate business requirements into technical specifications
Perks/Benefits
Skills/Tech-stack
Airflow | Azure Data | Azure Data Factory | Code review | DBT | Data Factory | Data Modeling | Data pipeline | Data pipeline orchestration | Databricks | Deployment | Pipeline Orchestration | PySpark | SQL | Snowflake | Spark | Testing
Education
N/A
Roles
Related jobs
-
Associate Data Scientist AUD 100K-120KAirflow | Amazon Redshift | Continuous Deployment | Data Enrichment | Data ModelingCoaching | Equity | Extended end of year break | Five social impact days | Home workspace setup allowanceMid-level Full TimeSydney3d ago
-
Senior Data Engineer (Databricks/Azure) - Hybrid, QLD AUD 150K-165KApache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure SQLAdditional paid leave for certifications and exams | Digital library access | Employee assistance program | Equipment incentive | Gym and wellbeing programSenior-level Full TimeQueensland, Australia R3d ago
-
Data Engineer - 12 month FTC AUD 100K-140KAWS | Agentic AI | Amazon Redshift | Amazon S3 | Apache AirflowAdditional leave | Corporate partner discounts | Free NBN plan | Free mobile plan | Hybrid workEntry-level Contract Full Time TemporaryBarangaroo, NSW, AU3d ago
-
Agile | Analytical Skills | Apache Kafka | Apache NiFi | Data MigrationHybrid work | Mentoring coaching and training | Professional development | Work from home flexible arrangementsSenior-level Full TimeCanberra, Australian Capital Territory, Australia R4d ago
-
GCP Data Engineer AUD 100K-150KAutomated testing | BigQuery | CI/CD | Cloud Composer | Cloud platformCareer development and learning opportunitiesMid-level Full TimeMELBOURNE, VIC, AU, 30084d ago
-
Data Engineer AUD 66K-76KAPIs | Agile | Azure Data | Azure Data Factory | Data FactoryCultural leave | Discounted childcare | Discounted health care | Employee wellbeing program access | First Nations supportMid-level Full TimeMURARRIE, BRISBANE, QLD, AU, 41724d ago
-
Consultant - Data Engineer AUD 150K-170KCI/CD | DBT | Data Lineage | Data Warehousing | Dimensional Modeling360° feedback | Innovation days | Mentorship support | Paid certifications | Professional development pathwaysSenior-level Full TimeSydney, New South Wales, Australia4d ago
-
Senior AI Engineer AUD 120K-150KC plus plus | C# | CI/CD | Cloud Computing | Data GovernanceCareer development | Collaborative culture | Flexible working | Learning opportunitiesSenior-level Full TimeCannon Hill, QLD, AU, 41704d ago
-
Engineer, Machine Learning Systems (AI Products) AUD 180K-200KAWS | Apache Airflow | Apache Spark | Dask | Data orchestrationAccess to modern office spaces | Collaborative boost days | Hybrid work model | Mentoring and coaching cultureSenior-level Full TimeAU: Sydney (45 Clarence St)5d ago
-
Data Engineer AUD 89K-111KAirflow | Azure Data | Azure Data Factory | Code Repository | Code reviewCareer development | Flex leave | Flexible work arrangements | Paid parental leave | Wellness incentivesEntry-level Full TimeMelbourne, VIC, AU, 30005d ago
-
Databricks Platform Engineer AUD 90K-112KAWS | Access Control | Access Management | Apache Spark | AutomationCareer development | Comprehensive benefits package | Flex leave | Flexible work arrangements | Paid parental leaveSenior-level Full TimeMelbourne, VIC, AU, 30005d ago
-
Data Engineer AUD 94K-130KAWS CDK | AWS Glue | Apache Airflow | Apache Flink | Apache IcebergExtra annual leave days | Leadership development programs | LinkedIn Learning | Perkbox discountsMid-level Full TimePyrmont, New South Wales, Australia5d ago
-
Senior Quantitative Data Engineer - 2-year fixed-term AUD 122K-127KAWS | Agile methodology | Algorithmic trading | Apache Spark | AzureFlexible interview adjustments | Flexible working | Hybrid workingSenior-level Full Time TemporarySydney Office, Australia5d ago
-
Data Engineer AUD 94K-130KAWS CDK | AWS Glue | Amazon Web Services | Apache Airflow | Apache FlinkExtra annual leave days | Leadership development programs | LinkedIn Learning | Perkbox discountsMid-level Full TimeSydney, Australia5d ago
-
Access Management | Amazon Web Services | Apache Spark | Automation | AzureCareer development | Comprehensive benefits package | Flex leave | Flexible work arrangements | Paid parental leaveSenior-level Full TimeMelbourne, VIC, AU, 30005d ago
-
Lead Databricks Engineer AUD 70K-80KAWS | AWS Glue | Airflow | Amazon Redshift | Amazon S3AI Driven Learning Platform | Career development training programs | Discounted health insurance | Discounts on products and services | Paid parental leaveSenior-level Full TimeAdelaide, SA, Australia5d ago
-
Test Lead - Data AUD 90K-125KAlteryx | Data Governance | Data Quality | Data Validation | Data profilingSenior-level Full TimeAustralia6d ago
-
Senior Engineer - ML Systems (AI Products) AUD 175K-200KAWS | Apache Airflow | Apache Spark | Dask | Data orchestrationHybrid work model | Mentorship | On call ownershipSenior-level Full TimeAU: Sydney (45 Clarence St)6d ago
-
Staff AI & Data Engineer AUD 150K-200KAgentic AI | Anthropic | Apache Kafka | Azure | Azure EventFlexible working environment | Health and safety support | Inclusive workplaceSenior-level Full TimeAirTrunk HQ - North Sydney6d ago
-
Senior Data Engineer — Platform & Architecture AUD 139K-146KCI/CD | Clustering | Cost Optimization | Data Governance | Data ModelingEAP support | Fitness passport | Salary packagingSenior-level Full TimeBrisbane, Queensland 4000, Australia6d ago
-
Senior Data Engineer — Integration & Pipelines AUD 118K-120KAPI pagination | Anomaly Detection | CI/CD | Data Governance | Data QualityEAP support | Fitness passport | Salary packagingSenior-level Full TimeBowen Hills, Queensland 4006, Australia6d ago
-
Senior Machine Learning Engineer AUD 131K-148K3D Perception | Airflow | C++ | Computer Vision | Continuous MonitoringEquity grants | Health insurance | Recovery BenefitsSenior-level Full TimeSydney, New South Wales, Australia6d ago
-
Staff Software Engineer - Machine Learning AUD 121K-125KAWS | Airflow | BigQuery | CI/CD | Data DriftCommunity grants | Flexible leave | Hackdays | Hybrid work | Matched payroll givingSenior-level Full TimeRichmond, Melbourne VIC, Australia6d ago
-
GCP Data Engineer - Data Modelling AUD 70K-160KApache Airflow | BigQuery | Cloud platform | Composer | Data ModelingCareer development | Learning opportunitiesMid-level Full TimeMELBOURNE, VIC, AU, 30086d ago
-
Analytics Platforms | Apache Airflow | BigQuery | Cloud platform | DBTAnnual off-site events | Co-working space allowance | Equity participation | Flexible asynchronous schedule | Fully remoteSenior-level Full TimeAustralia R6d ago