Senior Data Engineer (Microsoft Fabric, PySpark, SQL)
Eveleigh, NSW - 1 Locomotive Street, Australia
AUD 140K-142K (estimate) Senior-level Full Time
Tasks
- Apply automated testing and CI/CD
- Build data warehouse in Microsoft Fabric
- Collaborate in Agile delivery
- Design analytics data models
- Develop data ingestion pipelines
- Handle Errors and Monitoring
- Implement data quality checks
- Implement medallion architecture
- Ingest data from APIs and web services
- Ingest data from relational databases
- Manage source control and documentation
- Perform reconciliation controls
- Transform data with PySpark
- Write SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | Agile | Automated testing | CI/CD | Continuous Delivery | Continuous integration | Data Ingestion | Data Lineage | Data Modeling | Data Quality | Data Reconciliation | Data Transformation | Dynamic SQL | Error Handling | Facts Dimensions | Medallion Architecture | Metadata Management | Microsoft Fabric | Monitoring | PySpark | Relational databases | SQL | Source Control | T-SQL | Web Services
Education
N/A
Roles
Related jobs
-
AI Solutions & Delivery Specialist AUD 72K-95KAWS | Agentic AI | Artificial Intelligence | Azure | Bias AssessmentEmployee network groups | Qantas Group staff travel discountMid-level Full TimeMelbourne, Victoria, Australia21h ago
-
Senior Backend Engineer - Experiments Team AUD 120K-140KA/B | A/B Testing | B testing | Data Modeling | Data WarehousingEquity packages | Flexible leave options | Flexible remote work | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeSydney, Australia R1d ago
-
Data Engineer AUD 105K-125KAccess Control | Anomaly Detection | Apache Spark | Audit Logging | Data ContractsAdditional paid leave | Employee discounts | Flexible working arrangements | Free counseling services | Gym accessMid-level Full TimeSydney, Australia R1d ago
-
Data Engineer AUD 125K-137KBatch Processing | CDC | Change Data Capture | Cloud Data | Cloud Data PlatformsMid-level Full Time TemporaryBentley, Australia; Bentley, WA, Australia; Bentley …1d ago
-
Senior Data Engineer AUD 140K-150KAirflow | ClickHouse | Cloud | Data pipeline | ELTCareer growth opportunities | Gym benefits | Healthcare coverage | Hybrid work | Remote workSenior-level Full TimeSydney, New South Wales, Australia R1d ago
-
Data & AI Engineer II USD 133K-166KAPIs | Azure | CI/CD | Dash | Databricks401k match | Employee stock purchase plan | Gym reimbursement | Health and welfare benefits | Paid leave for living donor programMid-level Full TimeBrisbane, CA3d ago
-
Azure AI Developer Consultant AUD 130K-165K.NET | API Management | App Service | Azure API | Azure API ManagementFlexible work hours | On-site customer visits | Work from homeMid-level Full TimeSydney, NSW, AU3d ago
-
Senior Databricks Consulting Engineer AUD 170K-200KAWS | Apache Spark | Cloud Architecture | Cloud platform | Data GovernanceContinuous learning and certification support | Remote friendly working environmentSenior-level Full TimeSydney, New South Wales, Australia3d ago
-
Senior Analytics Engineer AUD 140K-170KAutomation | BigQuery | Business Intelligence | DBT | Data GovernanceSenior-level Full TimeAU - HQ - NSW3d ago
-
AI Solutions & Delivery Lead AUD 121K-136KAWS | Agentic AI | Azure | Bias Assessment | Cloud platformEmployee network groups | Supportive inclusive culture | Travel discountSenior-level Full TimeMelbourne, Victoria, Australia3d ago
-
Customer Analytics & Insights Lead - Hawthorn East AUD 118K-127KA/B | A/B Testing | AI tools | B testing | Cohort AnalysisDiscounts | Fitness classes | Flexible working options | Free parking | Gym facilitySenior-level Full TimeHawthorn East Melbourne, VIC, AU, 3123 R4d ago
-
Senior Data Engineer AUD 160K-180KAI functions | AWS | Apache Airflow | Azure | Cortex AICareer growth opportunities | Flexible working hours | Health and Wellbeing Programmes | Hybrid work model | Learning and development programsSenior-level Full TimePerth, Australia4d ago
-
Access Control | Anomaly Detection | CI/CD | Classification | Deep learningCompetitive salary | Exposure to LLM RAG MLOps LLMOps Kubernetes | Hands on AI ML GenAI projects | Remote working model | Scalable secure governed observable engineering environmentSenior-level Full TimeAustralia4d ago
-
Lead Data Scientist - AI Technical Solutions AUD 142K-170KAI Pipelines | AWS | Apache Airflow | Artificial Intelligence | AzureContinuous learning | Flexible work arrangements | Remote WorkingSenior-level Full TimeSydney, Melbourne R4d ago
-
Mid-level Full TimeSydney, Australia5d ago
-
Senior AI Engineer (AI Innovation Office) AUD 143K-154KAPI | Agents | CI/CD | Cloud services | ComplianceEmployee discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteering opportunitiesSenior-level Full TimeSydney, NSW, Australia5d ago
-
Senior Data Engineer AUD 125K-140KConfiguration Management | Continuous Deployment | Data Modeling | Data Pipelines | Data integrationLearning opportunities | Social communities and networksSenior-level Full TimeAU: Melbourne - Docklands, Australia5d ago
-
AI Engineer x 2 (AI Innovation Office) AUD 120K-143KAPI Development | Artificial Intelligence | Automated testing | CI/CD | Cloud ComputingEmployee discounts | Flexible work arrangements | Learning and development | Leave options | Mortgage discountsMid-level Full TimeSydney, NSW, Australia5d ago
-
Senior Data Engineer AUD 146K-155KAnomaly Detection | CI/CD | DBT | Data Modeling | Data pipelineCareer growth opportunities | Employee discounts | Flexible working arrangements | Health and wellbeing servicesSenior-level Full TimeMelbourne, AU6d ago
-
Databricks Engineer AUD 100K-140KAPIs | AWS | Azure | CI/CD | Data ModelingCareer breaks | Career development program | Family Inclusive Workplace certification | Flexible work arrangements | Local and international career opportunitiesMid-level Full TimeSydney, International House, 3 Sussex St, …6d ago
-
Senior Data Engineer AUD 129K-138KApache Spark | Artificial Intelligence | Azure Data | Azure Data Factory | Azure DevOpsEmployee assistance program | Fitness passport | Flexible work options | Meals and Entertainment Salary Packaging | Professional development and learning opportunitiesSenior-level Full TimeAnglicare Hub Macquarie Park, Australia6d ago
-
Senior AI Engineer AUD 141K-152KAPI Design | Agentic AI | Azure | Bicep | CI/CDCorporate partner discounts | Employee discounts | Flexible work environment | Hybrid working | RACV club membership discountsSenior-level Full Time485 Bourke Street Melbourne6d ago
-
Software Engineer - Machine Learning AUD 90K-111KAWS | Agile | Azure | C# | CI/CDCommunity Café volunteering | Community grants | Flexible leave | Flexible parental leave | HackdaysMid-level Full TimeSydney, NSW, Australia6d ago
-
Data and AI Engineer AUD 122K-125KAPI Integration | Automation | Azure Data | Azure Data Factory | Azure SynapseCareer growth opportunities | Continuous improvement culture | Exposure to diverse technologies | Supportive workplaceSenior-level Full TimeBrisbane, Queensland, Australia6d ago
-
Data & AI Engineer AUD 100K-150KAPI Integration | Automation | Data Architecture | Data Governance | Data PipelinesMid-level Full TimeSydney, New South Wales 2000, Australia6d ago