Senior Software Engineer – Data Platform
Brisbane, Queensland, Australia
AUD 130K-155K (estimate) Senior-level Full Time
Tasks
- Build stream and batch data processing pipelines
- Contribute to architectural decisions using event sourcing and CQRS
- Design and implement telemetry ingestion components
- Evaluate and integrate emerging streaming and query technologies
- Host orchestrate and optimize data science machine learning workloads
- Integrate message brokers and caching systems
- Modernize deployments using containerization and Kubernetes
- Persist data using lakehouse architecture
- Process and persist high frequency telemetry data
- Transform monolith to containerized scalable cloud architecture
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon S3 | Apache Flink | Apache Spark | Batch Processing | CQRS | Daft | Dask | Delta Lake | Docker | DuckDB | Event Sourcing | Java | Kafka | Kubernetes | Lakehouse | Mqtt | PostgreSQL | Python | Redis | Scala | Spring Boot | Stream processing | Trino | Valkey
Education
N/A
Related jobs
-
Forward Deployed Engineer, Gen AI, Google Cloud AUD 110K-130KAPI Integration | Agent systems | Cloud deployment | Cloud platform | CrewAIMid-level Full TimeSydney NSW, Australia; Docklands VIC, Australia15h ago
-
Data Engineer AUD 120K-125KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCareer development opportunities | Discounted insurance | Employee assistance program | Flexibility | Hybrid workingMid-level Full TimeSA, Australia22h ago
-
Senior Data Engineer AUD 60K-78KAWS | AWS IAM | AWS Lambda | AWS MWAA | Amazon S3Employee network groups | Hybrid working | Staff travel discount | Travel benefitSenior-level Full TimeMelbourne, Victoria, Australia1d ago
-
Data Scientist | LLM Engineer | Senior Associate/Manager AUD 118K-140KAgile | Azure | Azure Functions | Azure Machine Learning | Azure OpenAIFlexible work | Parental leave | Work-life balanceSenior-level Full TimeSydney, Australia1d ago
-
Senior Solution Engineer AUD 151K-216KAnalytics | Cloud Computing | Data Lake | Data Warehouse | Data fabricSenior-level Full TimeAU-Perth-WW1d ago
-
Staff Software Engineer - (Data Platform Workflow) AUD 129K-145KAPI Design | AWS | Agent Skills Framework | Agent skills | CI/CDEquity packages | Flexible leave options | Flexible remote work | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R1d ago
-
Staff Software Engineer - (Data Platform Workflow) AUD 129K-145KAPI Design | AWS | Agent Skills Framework | Agent skills | BI toolsAnnual wellbeing allowance | Equity package | Flexible leave options | Flexible work arrangements | Parental leaveSenior-level Full TimeSydney, Australia R1d ago
-
Senior DevOps AI Engineer AUD 157K-200KAWS | Agent systems | Ansible | ArgoCD | AsyncioHybrid work | On-call rotationsSenior-level Full TimeSydney, Australia1d ago
-
Senior Quants/Analytics Specialist - CTT AUD 129K-142KApplied Mathematics | Azure | C# | C++ | CI/CDDiscounts on banking products | Flexible work arrangements | Learning and development opportunities | Volunteering opportunitiesSenior-level Full TimeSydney, NSW, Australia2d ago
-
Data Engineer AUD 105K-125KAWS | Anomaly Detection | Azure | CI/CD | Data GovernanceAdditional leave days | Employee assistance programs | Employee discounts | Micro-credentials | Parental leaveMid-level Full TimeMacquarie Park, Australia2d ago
-
Senior Data Scientist AUD 150K-175KAutoARIMA | AutoETS | Automl | CI/CD | Causal reasoningAI-first culture | Async workflows | Flexible experimentation pace | Humans in final review | Ownership cultureSenior-level Full TimeSydney, New South Wales, Australia2d ago
-
Azure | Azure Functions | Azure ML | Azure OpenAI | CI/CDFlexible work arrangements | Generous leave entitlements | Parental leave | Public holiday flexibility | Work visa sponsorshipSenior-level Full TimeSydney, Australia2d ago
-
Applied AI Engineer AUD 90K-100KASR | Agent Orchestration | Agent/tool use | Azure Cognitive | Azure Cognitive ServicesCommunity involvement support | Hybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (AUS), Australia R2d ago
-
Bash | Code Coverage | Coverage.py | Dagger | DockerFlexible schedule | Fully remote | Project-based collaboration | Supportive global communitySenior-level Full TimeAustralia - Remote R2d ago
-
Senior Data Engineer AUD 125KAzure Data | Azure Data Factory | Azure Databricks | CI/CD | Data FactoryHybrid workSenior-level Full Time TemporaryGeelong2d ago
-
Senior Data Engineer - Permanent, full-time position AUD 122K-125KAvailability Monitoring | Azure Data | Azure Data Factory | Azure Databricks | CI/CDSenior-level Full TimeGeelong2d ago
-
Data Engineer (Python) - 2 weeks contract AUD 75K-150KAzure Functions | CSV | Data Validation | Delta detection | ExcelFlexible working options | Leadership programs | Learning and development initiatives | MentorshipMid-level Full TimeMelbourne, Victoria, Australia2d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Flexible management approach | Remote/distributed teamMid-level Full TimeBrisbane, Australia3d ago
-
C# | MATLAB | NumPy | Pandas | PythonNon permanent employment | Part-time project workSenior-level Full TimeAustralia - Remote R3d ago
-
AI Solution Specialist, ANZ (Sydney/Melbourne-based) AUD 120K-152KAI Application Development | AI application | AI infrastructure | Application development | Artificial IntelligenceTravel opportunitiesExecutive-level Full TimeRemote Australia R4d ago
-
Senior Perception Software Engineer AUD 170K-224K3D LiDAR | C++ | CUDA | Ceres-Solver | Computer Vision401k contribution | Dental insurance | Federal Holidays | Health insurance | State HolidaysSenior-level Full TimeCharlestown, MA4d ago
-
Amazon Web Services | Apache Airflow | Apache Superset | BI Dashboards | Cloud DataAnnual vacation | English learning discounts | Fully remote work environment | Health reimbursement | High autonomySenior-level Full TimeAustralia R4d ago
-
Senior Data Platforms Engineer AUD 120K-130KAWS | Agile | CI/CD | Data Pipelines | Data ProcessingDiscounted flights | Discounts on retail technology beauty and wellness services | Discounts on travel insurance lounge membership car hire accommodation and experiences | Dress for your day policy | Flexible work from home or officeSenior-level Full TimeBrisbane4d ago
-
Data Engineer AUD 110K-140KAWS Redshift | Azure | CDP | Cloud Data | Cloud Data WarehouseAccommodation discounts | Car hire discounts | Discounted air travel | Employee assistance program | Flexible workingMid-level Full TimeBrisbane, Melbourne, Sydney5d ago
-
Senior AI Engineer AUD 150K-180K.NET | Azure | C# | Container Apps | DBTAnnual leave | Collaborative culture | Extra days off | Flexible working | Parental leaveSenior-level Full TimeMelbourne, VIC, Australia5d ago