Data Engineering Tech Lead - Databricks, Azure Data Factory, DBT & Python
Tasks
- Build data integrations using APIs
- Collaborate with data modelers analysts DBAs and DevOps teams
- Conduct code reviews
- Develop data transformation with Python
- Develop scalable data pipelines
- Document processes workflows and system architecture
- Lead project delivery pods
- Maintain data pipelines
- Mentor junior team members
- Monitor workflow performance
- Optimize workflows for performance and cost
- Transform raw data with dbt
Perks/Benefits
- Flexible working options
- Hybrid work
- Market-leading parental leave
- Mentoring
- Paid volunteering days
- Retail discounts
- Return to work support package
- Training
- Wellbeing leave
Skills/Tech-stack
API Integration | Azure Data | Azure Data Factory | Azure DevOps | Azure Fabric | Cloud Data | Cloud Data Storage | DBT | Data Architecture | Data Factory | Data Pipelines | Data Storage | Data Transformation | Databricks | GitHub | Python | SQL | Version control
Regions
Countries
States
Cities
Related jobs
-
Data pipeline | Debugging | Distributed Systems | Inference Optimization | KubernetesFlexible leave options | Inclusive parental leave | Remote within Australia | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R1d ago
-
Data Engineer AUD 110K-140KAWS Redshift | Azure | Data Analysis | Data Modeling | Data OptimizationAccommodation discount | Car hire discount | Discounted air travel | Discounted lounge membership | Discounts on retail and technologyMid-level Full TimeBrisbane, Melbourne, Sydney1d ago
-
Staff Data Engineer (AWS, Big Data) AUD 140K-150KAWS | Athena | CI/CD | CloudFormation | Data ModelingFlexible start/finish times | Flexible work arrangements | Job share | Part-time optionsSenior-level Full TimeSydney, NSW - CBP North, 1 …2d ago
-
Senior Presales Engineer, Unstructured Data Solutions AUD 129K-155KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeChatswood, Australia2d ago
-
Bash | Coverage py | Dagger | Docker | GcovFlexible schedule | Freelance project-based collaboration | Fully remote | Project based AI opportunities | Supportive global communitySenior-level Full TimeAustralia - Remote R2d ago
-
Senior Data Engineer AUD 125K-142KApache Kafka | Apache Spark | Cloud | DBT | Data Lakes4-day work week option | Conference attendance | Flexible work hours | Professional development support | TrainingSenior-level Full TimeMelbourne2d ago
-
Data Engineer AUD 151K-185KAPI Integration | AWS Glue | Airflow | BigQuery | CI/CDCommunity volunteering | Company and team events | Hackathons | Health and wellness program | Learning and developmentSenior-level Full TimeSouth Melbourne, Victoria2d ago
-
Senior Data Engineer AUD 80K-95KAcceptance Testing | Amazon Web Services | Apache Airflow | Apache Spark | Automation TestingPaid training | Professional development | Supportive workplace cultureSenior-level Full TimeNorth Sydney, NSW, AU4d ago
-
Mid-level Full TimeSydney4d ago
-
AI Engineer - Applied AI AUD 111K-150KAgent architecture | Artificial Intelligence | Data orchestration | Data pipeline | ElevenLabsCoaching and professional development budgets | Employee share options | Employee wellbeing breaks | Medical insurance | Mental wellbeing supportMid-level Full TimeMelbourne4d ago
-
Senior Software Engineer, Robotics Task Planning AUD 170K-190KAutonomous Systems | Behavior planning | C++ | Data Pipelines | Machine Learning401k contributions | Dental insurance | Health insurance | Unlimited vacation | Vision insuranceSenior-level Full TimeCharlestown, MA4d ago
-
Software Engineer, Quantum Sensing AUD 70K-80KAlgorithm Development | C# | C++ | Continuous integration | Data FusionCompetitive benefits | Equity potential | FlexibilityMid-level Full TimeSydney4d ago
-
Data Engineer AUD 90K-150KAWS | Agile | Alerting | CI/CD | Code reviewEmployee discounts | Flexible working | Frequent events | Health and wellbeing programs | Income protection insuranceMid-level Full TimeCremorne, Victoria, Australia4d ago
-
Junior Machine Learning Engineer AUD 60K-65KAWS | Azure | CI/CD | Databricks | DockerFlexible schedule | Hybrid work | Retailer discounts | Wellbeing benefitsEntry-level Full TimeMelbourne, Victoria, Australia5d ago
-
TL Data and Analytics Legacy AUD 89K-110KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeAdditional leave days | Career development via internal mobility | Flexible working arrangements | Health and wellbeing initiatives | Supportive and inclusive managersMid-level Full TimeMelbourne: 509 St Kilda Rd, Australia5d ago
-
Data Governance & Quality Platform Lead AUD 125K-135KAperture | Business glossary | DAMA-DMBOK | Data Architecture | Data CatalogCommunity initiatives | Continuous learning opportunities | Diversity and inclusion focus | Employee wellbeing support | Fitness incentivesSenior-level Full TimeWest Perth - Wellington Street, Australia5d ago
-
Staff Data Engineer AUD 129K-143KAWS | AWS architecture | Agile | AppDynamics | Auto ScalingFlexible work location | Flexible working hours | Job flexibility | Job share | Part-time optionsSenior-level Full TimePerth, WA - 300 Murray Street …5d ago
-
Principal Data Engineer AUD 149K-170KAWS | Agile | Change Management | Cloud Native | Data LakeFlexible start and finish times | Flexible work arrangements | Hybrid work options | Job share optionsSenior-level Full TimeSydney, NSW - CBP North, 1 …5d ago
-
Enterprise Data Engineer USD 92K-120KAzure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics401k match | Dependent Care Match | Employee referrals | Flexible work schedules | Health insuranceMid-level Full TimeAtwell5d ago
-
Data Analytics & BI Lead AUD 150K-170KAnalysis Services | Artificial Intelligence | Azure | Dashboards | Data GovernanceInclusive workplaceSenior-level Full TimeCremorne, VIC, 3121, AU5d ago
-
Amazon Redshift | DBT | Data Architecture | Data Modeling | Data QualityFully remote | Global team collaboration | Healthcare coverage | Home office equipment allowance | Learning and development budgetSenior-level Full TimeAustralia R5d ago
-
Lead Data Analyst - Marketing AUD 110K-145KA/B | A/B Testing | AWS | Azure | B testingBirthday work anniversary vouchers | Company events | Daily catered breakfast | Employee assistance program | Free coffee, tea, smoothiesSenior-level Full TimeMelbourne, Australia5d ago
-
Senior Applied AI Engineer AUD 137K-181KAgentic Workflows | Applied AI | Automated testing | CI/CD | ClaudeBike storage | Equity stock options | Free snacks and drinks | Lockers | ShowersSenior-level Full TimeMelbourne, Australia6d ago
-
Principal / Lead Azure AI Developer Consultant AUD 85K-95K.NET | API Management | App Service | Azure API | Azure API ManagementFlexible work environment | Present on customer site when required | Split work between home and officeSenior-level Full TimeSydney, NSW, AU6d ago
-
Azure AI Developer Consultant AUD 85K-95K.NET | API Management | App Service | Automated testing | Azure APIFlexible work environment | On site customer presence when required | Remote work option | Split time between home and officeSenior-level Full TimeBrisbane, QLD, AU6d ago