Data Engineer
Tasks
- Build data ingestion frameworks for structured semi structured and streaming data
- Create data pipelines and feature engineering workflows for AI and machine learning
- Design develop and maintain operational dashboards and executive reporting
- Develop and maintain ETL and ELT pipelines
- Implement data retention partitioning indexing and optimization strategies
- Implement data security and access controls
- Maintain and optimize Microsoft SQL Server environments
- Migrate legacy data warehousing systems to modern analytical platforms
- Optimize SQL queries and database performance
- Own data platform architecture
Perks/Benefits
- Choice of IT equipment
- Diversity and inclusion
- Employee discounts
- Hybrid working
- Team events
- Training and development
Skills/Tech-stack
Airbyte | ClickHouse | Data Lakes | Data Warehousing | ELT | ETL | Embeddings | Grafana | Linux | OpenSearch | Power BI | Python | Reporting services | Rundeck | SQL | SQL Server | SQL Server Reporting | SQL Server Reporting Services | Semantic Search | Server Reporting Services | Streaming Data | Vector Databases | Windows server
Education
N/A
Roles
Related jobs
-
Senior Machine Learning Engineer - Platform AUD 148K-210KAPI Design | Agent Orchestration | CI/CD | Context Management | Distributed SystemsSenior-level Full TimeAustralia - Victoria - Fully Flexible R13h ago
-
AWS | Azure | CI/CD | Data Governance | Data LakeConference opportunities | Fully remote work | Modern work equipment | Professional development budget | Training budgetMid-level Full TimeAustralia R1d ago
-
Deep learning | Generative AI | Langchain | Language Models | Large Language ModelsEnglish CV required | Flexible hours during active phases | Part time freelance projects | Project based workMid-level FreelanceAustralia - Remote R3d ago
-
Freelance Machine Learning Engineer AUD 110KLLM | Langchain | MLOps | NumPy | PandasProject based workMid-level FreelanceAustralia - Remote R3d ago
-
Lead AI Engineer AUD 160K-191KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningLearning and development | Remote workSenior-level Full TimeSydney, Australia R5d ago
-
Staff Analytics Engineer AUD 150K-170KAnomaly Detection | CI/CD | DBT | Data Quality | Data TestingEmployee assistance program | Fitness Passport membership | Flexible work | Hybrid work | Mental health supportSenior-level Full TimeSydney, New South Wales 2000, Australia R5d ago
-
Staff Machine Learning Engineer AUD 152K-224KAPI Integration | CI/CD | Evaluation | Knowledge bases | LangchainHybrid work model | Remote work flexibilitySenior-level Full TimeAustralia - Victoria - Fully Flexible R5d ago
-
Bash | Black box testing | Black-box | Box testing | Claude CodeFlexible schedule | Freelance project-based collaboration | Global community support | Remote workSenior-level Full TimeAustralia - Remote R5d ago
-
Data Analysis | Data Ingestion | Data cleaning | Deep learning | Exploratory Data AnalysisProject based workMid-level FreelanceAustralia - Remote R5d ago
-
C# | MATLAB | NumPy | Pandas | PythonPart-time project-based workSenior-level Full TimeAustralia - Remote R7d ago
-
Data labeling | Data pipeline | Debugging | Inference | Inference OptimizationEquity compensation | Flexible leave options | Inclusive parental leave | Remote work within Australia | Wellbeing allowanceSenior-level Full TimeSydney, Australia R8d ago
-
NumPy | Pandas | Python | SciPy | SymPyFlexible part-time schedule | Freelance work | Project based workSenior-level FreelanceAustralia - Remote R8d ago
-
Combinatorics | Graph theory | Mathematical Modeling | NumPy | Number theoryFlexible schedule | Freelance project-based work | Part-time opportunitiesSenior-level FreelanceAustralia - Remote R9d ago
-
Deep learning | GEOS | GeoPolars | Geopandas | Geospatial DataAnnual flu vaccinations | Company subscription | Fully remote | Hybrid flexibility | In-office lunchSenior-level Full TimeBarangaroo, NSW, Australia R20d ago
-
Senior Analytics Engineer - Remote AUD 110K-150KAttribution Modeling | CRM | Conversion Tracking | Data Layer | Data PipelinesEmployee share options | Learning and development opportunities | Paternity leave | Remote work | Work from home stipendSenior-level Full TimeSydney, New South Wales 2000, Australia R1mo ago
-
3D Reconstruction | AWS | CI/CD | Cloud platform | Computer VisionAnnual flu vaccinations | Cycling showers | Gym access | Hybrid flexibility | In-office lunchSenior-level Full TimeBarangaroo, NSW, Australia R1mo ago
-
3D Modeling | 3D Reconstruction | AWS | Automation | CI/CDAnnual flu vaccinations | Cycling showers access | Hybrid flexibility | In-office lunch | Lunchtime gym accessSenior-level Full TimeBarangaroo, NSW, Australia R1mo ago
-
Evaluation Pipelines | Function Calling | Governance | Java | LLM tool-useEquity packages | Flexible leave options | Flexible remote work within Australia | Inclusive parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R1mo ago
-
Function Calling | Java | LLM tool-use | Langchain | LanggraphEquity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowanceSenior-level Full TimeSydney, Australia R1mo ago
-
Data Pipelines | Debugging | Inference Optimization | Kubernetes | Machine LearningEquity package | Flexible leave options | Inclusive parental leave | Office setup allowance | Remote work within AustraliaSenior-level Full TimeSydney, Australia R1mo ago
-
Staff Applied AI Engineer, AI Experiences & Agents AUD 240K-250KAPIs | Agent Orchestration | Embeddings | Evaluation | JavaScriptEmployee stock options | Generous time off | Hybrid work option | Parental leave | Remote work optionSenior-level Full TimeMelbourne, VIC, Sydney, NSW R1mo ago
-
Senior Analytics Engineer - Remote AUD 110K-130KAttribution Modeling | Braze | CRM | Conversion Tracking | Data LayerEgg freezing subsidy | Employee share options | Learning and development | Paternity leave | Remote workSenior-level Full TimeSydney, New South Wales 2000, Australia R1mo ago