Data Engineer
Tasks
- Build data pipelines in Palantir Foundry
- Create ontology objects links and actions
- Develop PySpark transformations
- Investigate pipeline failures
- Maintain engineering documentation
- Mentor junior engineers
- Perform code reviews
- Support Workshop applications and tooling
Perks/Benefits
- N/A
Skills/Tech-stack
DBT | Data Quality | Data quality monitoring | Dimensional Modelling | Git | Great Expectations | Jupyter Notebooks | Kafka | Ontology | Palantir Foundry | Pipeline Builder | PySpark | Quality monitoring | SQL | Workshop
Education
N/A
Roles
Regions
Countries
Related jobs
-
API Integration | Alerting | Code review | Data Quality | Data VaultSenior-level Full TimeCanberra, ACT, AU4h ago
-
Mid-level Full TimeBrisbane, QLD, Australia14h ago
-
Senior-level Full TimeMelbourne, Australia1d ago
-
Data Engineer AUD 72K-80KAWS | AWS DataZone | AWS Glue | Amazon Athena | Amazon QuickSightBackground checks during onboarding | Flexible working options | Hybrid working | Workplace diversity and inclusion initiativesSenior-level Full TimeSydney Office, Australia1d ago
-
Staff Data Engineer AUD 90K-110KAWS | Apache Spark | Azure | Cloud Data | Cloud Data PlatformsAdditional leave purchase | Flexible working | Paid leave | Paid partner leave | Paid performance bonus planSenior-level Full TimeCremorne, Victoria, Australia1d ago
-
Senior Data Engineer AUD 148KAPI Integration | API Security | Ansible | Application Security | Azure DataAdditional leave loading | Career development opportunities | Flexible workingSenior-level Full TimeSydney, NSW1d ago
-
Deep learning | Generative AI | Langchain | Language Models | Large Language ModelsEnglish CV required | Flexible hours during active phases | Part time freelance projects | Project based workMid-level FreelanceAustralia - Remote R2d ago
-
Freelance Machine Learning Engineer AUD 110KLLM | Langchain | MLOps | NumPy | PandasProject based workMid-level FreelanceAustralia - Remote R2d ago
-
Data Engineer (DataX) AUD 110K-140KApache Spark | Azure | Azure DevOps | Azure Synapse | Azure Synapse AnalyticsEmployee banking discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteer opportunitiesMid-level Full TimeSydney, NSW, Australia4d ago
-
Staff Analytics Engineer AUD 150K-170KAnomaly Detection | CI/CD | DBT | Data Quality | Data TestingEmployee assistance program | Fitness Passport membership | Flexible work | Hybrid work | Mental health supportSenior-level Full TimeSydney, New South Wales 2000, Australia R4d ago
-
TL Data and Analytics Legacy AUD 89K-100KAgile | Azure Data | Azure Data Factory | Azure Data Lake | CI/CDAdditional leave days | Career development through internal mobility | Flexible working arrangements | Health and wellbeing initiatives | Supportive and inclusive managersMid-level Full TimeMelbourne: 509 St Kilda Rd, Australia4d ago
-
Senior Data Engineer AUD 118K-127KAWS | AWS CloudFormation | AWS Database | AWS Database Migration Service | AWS GlueFlexible working | Hybrid working options | Part-time optionsSenior-level Full TimeSydney Office, Australia4d ago
-
Data Analysis | Data Ingestion | Data cleaning | Deep learning | Exploratory Data AnalysisProject based workMid-level FreelanceAustralia - Remote R4d ago
-
Senior Manufacturing Engineer, Test Analytics AUD 120K-150KLean Manufacturing | Microsoft Excel | Microsoft Power | Microsoft Power BI | Power BIFlexible work environment | Health benefits | Paid leaveSenior-level Full TimeSydney, New South Wales, Australia5d ago
-
Senior Data Engineer AUD 120K-130KA/B | A/B Testing | AWS | Amplitude | B testingAnnual leave | Catered lunch | Equity | Flexible leave policy | Hybrid workSenior-level Full TimeMelbourne, Victoria5d ago
-
Analytics Engineer AUD 80K-108KCI/CD | DBT | Data Lineage | Data Modeling | Data QualityAnniversary leave | Cyclist end of trip facilities | Employee share option plan | Hybrid working | Pantry snacks and drinksMid-level Full TimeSydney, NSW5d ago
-
Specialist Data Engineer AUD 80K-110KAPI Integration | Agile | Airflow | Apache Hadoop | Apache KafkaExtended leave entitlements | Flexible working options | Paid parental leave | Parent roomsMid-level Full TimeAustralia5d ago
-
Director - Data Platform Engineering AUD 60K-200KAirflow | Amazon Web Services | Apache Kafka | Apache Spark | CI/CDExecutive-level Full TimeSydney, New South Wales, Australia5d ago
-
Senior Data Engineer – Data & AI Practice AUD 70K-80KApache Airflow | Apache Kafka | CI/CD | DBT | Data GovernanceFlexibility | Health and wellbeing programs | Learning program | Novated leasing options | Purchased leaveSenior-level Full TimeMelbourne, Australia5d ago
-
Data Engineer – Data & AI Practice AUD 80K-120KAWS | Apache Airflow | Azure | CI/CD | DBTFlexible work arrangements | Health and wellbeing program | Learning & development program | Novated leasing options | Paid leaveMid-level Full TimeMelbourne, Australia5d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Additional paid leave | Corporate partner discounts | Hybrid work | Learning platform access | Mobile PlanSenior-level Full TimeBarangaroo, NSW, AU6d ago
-
Senior Machine Learning / ML Engineer AUD 170K-190KAirflow | Amazon EMR | Apache Spark | Dask | Data orchestrationEngineering standards | Hybrid work model | MentoringSenior-level Full TimeAU: Melbourne: (260 Burwood Rd)6d ago
-
Sr. Forward Deployed Engineer AUD 145K-185KAnthropic | Apache Spark | Artificial Intelligence | Backend Development | Cloud ComputingSenior-level Full TimeMelbourne, Australia; Sydney, Australia6d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project-based workSenior-level Full TimeAustralia - Remote R6d ago
-
Staff Data Engineer AUD 125K-138KAWS | Apache Spark | Cloud Computing | Cloud platform | Data ModelingEmissions reduction focus net zero by FY2050 | Flexible working | Paid leave | Parental leave | Personal Flexi DaysSenior-level Full TimeCremorne, Victoria, Australia7d ago