Principal Data Platform Engineer
Sydney, New South Wales, Australia
AUD 150K-185K (estimate) Senior-level Full Time
Tasks
- Build batch and real-time pipelines
- Build greenfield data platforms
- Consult clients on data solutions
- Design cloud-native data platforms
- Design data contracts
- Design data mesh
- Design data products
- Develop streaming and event driven pipelines
- Ensure security and compliance
- Implement data governance
- Improve data quality
- Improve observability
- Improve operational excellence
- Improve testing
- Lead end to end architecture
- Make ingestion storage processing access decisions
- Mentor engineers
- Optimize data access patterns
- Optimize data storage formats
- Orchestrate workflows with Airflow
- Orchestrate workflows with Dataflow
- Process and transform large datasets
- Review designs and code
- Set engineering standards and best practices
- Translate business needs into engineering decisions
Perks/Benefits
Skills/Tech-stack
AWS | Airflow | Amazon Kinesis | Apache Spark | ArgoCD | Avro | BigQuery | CI/CD | Cassandra | Cloud platform | DBT | Data Contracts | Data Products | Data mesh | Databricks | Delta Lake | Flink | GitHub Actions | Google Cloud | Google Cloud Platform | Great Expectations | Infrastructure as Code | Kafka | Kinesis | MongoDB | ORC | Parquet | PostgreSQL | PubSub | Pulumi | Python | SQL | Snowflake | Soda | Terraform | “as-code”
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior Data Engineer - Automation & AI AUD 118K-127KAccess Control | Agentic Systems | Auditability | Batch Processing | ChunkingEmployee assistance program | Employee wellbeing platform | Extra days leave | Flexibility support | Hybrid work modelSenior-level Full TimeAustralia R1d ago
-
Senior Data & Power BI Developer AUD 122K-140KAzure Data | Azure Data Factory | Azure SQL | DAX | Data FactoryCareer progression | Company vehicle | Laptop | Phone | Supportive cultureSenior-level Full TimeMeadowbrook, Queensland 4131, Australia1d ago
-
Data & Analytics Specialist AUD 160K-190KAPI Testing | Agile | Azure | Azure Monitor | Continuous DeliveryCoffee and snacks | Flexible working conditions | Modern office amenities | Social events | Team-building activitiesMid-level Full TimePerth, Western Australia 6000, Australia1d ago
-
Data Engineer AUD 65K-67KAWS Redshift | Apache Spark | Automation | CI/CD | DBTDiscounts | Fitness passport | Flexible working | Paid parental leave | Professional developmentMid-level Full TimeHead Office- Melbourne, Australia1d ago
-
Senior Data Engineer, Business Intelligence AUD 118K-134KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | DashboardsDiscounted private health | EAP | Fitness passport | Flexible work arrangements | Generous leave optionsSenior-level Full TimeAustralia, UniSC Sunshine Coast, Australia, UniSC …1d ago
-
Revenue Systems Engineer AUD 36K-42KAPI Development | Alerting | Amazon Redshift | Automation | Data ModelingSenior-level Full TimeMelbourne, Australia1d ago
-
Analytics and Intel Reporting Lead AUD 137K-146KDashboard Development | Data Visualization | Data analytics | Power BI | PythonEmployee discounts | Flexible work arrangements | Learning and development opportunities | Leave options | Volunteer opportunitiesSenior-level Full TimeParramatta, NSW, Australia1d ago
-
Embedded Software Engineer GBP 30K-34KBluetooth | C# | C++ | CI/CD | Continuous DeploymentAnnual leave | Community and charity initiatives | Company pension scheme | Cycle to work | Private healthcareMid-level Full TimeMelbourn, United Kingdom2d ago
-
API Design | Channels | Distributed Systems | Docker | GoFour-day work week | Fully remote work | Professional growth | Uncapped holiday allowanceSenior-level Full TimeAustralia R2d ago
-
Entry-level Full TimeSydney, NSW, Australia2d ago
-
Lead Data Engineer / Architect | GCP, BigQuery & DBT AUD 70K-120KAirflow | Analytics engineering | BigQuery | CI/CD | Cloud StorageCoaching | Financial coaching | Flexible work arrangement | Nutrition coaching | Paid parental leaveSenior-level Full TimeSydney, NSW, AU2d ago
-
Senior Manufacturing Test Engineer, Robotics USD 135K-160KBring-up | Cause analysis | Data Pipelines | Data dashboards | End of Line401k plan | Commuter benefits | Company-Paid Holidays | Dental insurance | Health insuranceSenior-level Full TimeBrisbane, CA2d ago
-
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3Collaborative team culture | Continuous learning | Flexible work environment | High ownership | Professional growthSenior-level Full TimeAustralia3d ago
-
Software Engineer - Machine Learning Frameworks AUD 120K-185KC++ | CUDA | Code generation | Compute Orchestration | MLIRMid-level Full TimeSydney, Australia3d ago
-
Graduate Data Engineer AUD 90K-93KData Governance | Data Pipelines | Data Quality | Data Security | GitHubBusiness rotations | Career pathways | Employee recognition training | Internal mobility | Learning and developmentEntry-level Contract Full Time2 Market Street, Sydney NSW 20003d ago
-
Technical Services Engineer AUD 80K-110KAWS | Active Directory | Application Performance Analysis | Application performance | AuthenticationMid-level Full TimeSydney3d ago
-
Chief Data Engineer AUD 163K-220KApache Airflow | Cloud Architecture | Code review | DBT | Data GovernanceExecutive-level Full TimeSydney, New South Wales 2000, Australia3d ago
-
Senior Machine Learning Engineer AUD 148K-210KAccess Control | Agent systems | CI/CD | Capabilities Based Access Control | Error RecoveryHealth and wellness benefits | Hybrid work schedule | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R3d ago
-
Staff Machine Learning Engineer AUD 140K-185KAWS | Amazon ECS | Amazon ElastiCache | Amazon S3 | Audit LoggingSenior-level Full TimeAustralia - Melbourne - Hybrid R3d ago
-
Senior Machine Learning Engineer AUD 148K-210KACID | Distributed Systems | Durable Execution | Event Sourcing | Fault ToleranceHybrid work | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R3d ago
-
AI Engineer (Intern) - Fixed Term Part Time AUD 65K-68KData Analysis | Deep learning | Machine Learning | PyTorch | PythonEmployee assistance program | Employee discount platform | Paid volunteer leave | Parental leave support | Private health insurance discountsEntry-level Internship Part Time TemporaryAUS GPC AUS 01 Group Support …3d ago
-
Senior Machine Learning Engineer AUD 145K-186KAI Risk Management Framework | Agent systems | Agentic Workflows | Anomaly Detection | Content SafetyHybrid work model | Inclusive work environment | Reasonable accommodations | Remote work flexibilitySenior-level Full TimeAustralia - Melbourne - Hybrid R3d ago
-
Senior AI Engineer AUD 121K-135KAWS Bedrock | AWS SageMaker | Amazon S3 | CI/CD | DockerCorporate discounts | Home office financial support | Hybrid work environment | In-house training | Leave optionsSenior-level Full TimeSydney, Australia4d ago
-
Principal Data Engineer AUD 146K-147KAWS | Bash | Cloud Architecture | Cloud Native | CronAccessibility support | Inclusive workplaceSenior-level Full TimeSydney, NSW - CBP North, 1 …4d ago
-
Data Engineer Analyst (Fabric, Power BI) AUD 76K-81KAzure Databricks | Azure Synapse | CI/CD | DAX | Data FactoryMid-level Full TimePerth, Exchange Tower, Australia4d ago