Azure Data Engineer
Tasks
- Align security data with schemas naming conventions governance and organizational requirements
- Collaborate with detection engineering and security operations teams
- Design scalable security data ingestion pipelines for SIEM and cloud data platforms
- Ensure security telemetry integrity completeness timeliness and quality
- Improve ingestion frameworks and automation for scalability and efficiency
- Maintain documentation for log onboarding data mappings and pipeline configurations
- Monitor pipeline performance and optimize reliability throughput and costs
- Onboard new log sources and validate end to end data flows
- Parse normalize transform enrich validate security telemetry
- Perform telemetry gap analyses and recommend improvements
- Support logging practices for regulatory audit compliance retention and data integrity
- Troubleshoot ingestion parsing transformation schema and data quality issues
Perks/Benefits
Skills/Tech-stack
Automation | Azure | Azure Data | Azure Data Explorer | CSV | Cybersecurity telemetry | Data Explorer | Data Parsing | Data Quality | Data Transformation | Data Validation | Incident Response | Infrastructure as Code | JSON | Log Analytics | Log Management | Powershell | Python | Regex | Regular Expression | SIEM | Schema mapping | Scripting | Threat detection | XML | “as-code”
Education
N/A
Roles
Related jobs
-
Senior Data Engineer AUD 260K-340KAWS RDS | Azure | CDC | DAX | DBTAnnual short term incentive scheme | Hybrid work model | Paid parental leave | Restricted stock awards | Up to 5 weeks annual leaveSenior-level Full TimeSurry Hills, NSW, Australia R11h ago
-
Lead Data Engineer - Azure AUD 125K-140KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksEducation assistance program | Extra annual leave | Extra insurance | Flexible hybrid work model | Parental leaveSenior-level Full TimeSydney - Darling Park, Australia R2d ago
-
Agentic AI Engineer (AWS) AUD 100K-135KAWS | AWS CDK | Agent systems | Alembic | Amazon BedrockFlexible working options | Market-leading parental leave | Mentoring coaching programs | Paid volunteering days | Professional development reimbursementsMid-level Full TimeSydney, NSW, AU R2d ago
-
Data Engineer AUD 65K-70KAWS Redshift | Apache Spark | Automation | CI/CD | DBTDiscounts to retailers | Fitness passport | Flexible working | Paid parental leave | Professional developmentMid-level Full TimeHead Office- Melbourne, Australia R2d ago
-
Access Management | Azure | Azure Data | Azure Data Factory | Azure DatabricksClear communication | Fair disclosed margins | Hybrid work | Professional respectful experienceSenior-level Full TimeCanberra, Australian Capital Territory, Australia R2d ago
-
Solutions Engineer AUD 140K-180K.NET | Apache Flink | Apache Hadoop | Apache NiFi | Apache SparkCareer development | Employee resource groups | Flexible work from home | Paid time off | Paid volunteer timeSenior-level Full TimeAustralia-New South Wales-Sydney R3d ago
-
Benchmarking | CI/CD | Document Intelligence | Embeddings | Explainable AIFully remote work | Healthcare coverage | International opportunities | Long-term contract | Technical ownershipSenior-level Full TimeAustralia R3d ago
-
Software Engineer - AI Developer Tooling Workflows AUD 100K-100KAI Agents | APIs | CI/CD | Continuous Deployment | Continuous integrationEquity packages | Flexible leave options | Hybrid work flexibility | Inclusive parental leave | Wellbeing allowanceMid-level Full TimeSydney, Australia R4d ago
-
Data Engineer AUD 115K-120KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | BI semantic modelsCommunity service leave | Cultural leave | Discounts | Flexible working | Inclusive cultureMid-level Full TimeVIC - Melbourne - 655 Collins … R4d ago
-
Data Engineer AUD 125K-126KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageAdditional annual leave | Education assistance program | Employer funded insurance | Parental leave | Wellbeing leaveMid-level Full TimeSydney - Darling Park, Australia R7d ago
-
Machine Learning Platform Engineer SGD 139K-180KAWS | Azure | CI/CD | Dask | Distributed SystemsHealth and wellbeing resources | Paid volunteer daysMid-level Full TimeSydney - Australia - Sydney, 2000 … R7d ago
-
Senior Data Engineer - ATP AUD 153K-153KAgile | Azure DevOps | CI/CD | Confluence | Data ModellingAdditional leave | Career development opportunities | Discount on UNSW courses | Discounts on retail education and fitness passport | Flexible working optionsSenior-level Full TimeSydney, NSW R7d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Flexible work location | Fully remoteSenior-level Contract Full TimeAustralia R8d ago
-
APIs | AWS | Apache Airflow | CI/CD | Data PipelinesAutonomy | Collaborative team | Flexible location | Fully remote | Operational excellence focusSenior-level Full TimeAustralia R8d ago
-
Data Engineer AUD 120K-126KCode review | Data Modeling | Data Warehousing | Data integration | Data pipelineDiscounted air travel | Discounted lounge membership | Discounts on travel insurance and car hire | Dress for your day | Employee assistance programMid-level Full TimeBrisbane, Melbourne, Sydney R8d ago
-
Forward Deployed Engineer - Sydney AUD 116K-131KCode review | Full Stack | Full-Stack Development | Generative AI | JavaScriptHybrid work | Relocation assistance | Travel up to 50 percentMid-level Full TimeSydney, Australia R8d ago
-
Senior Data Engineer AUD 129K-142KAWS | Automation | Cybersecurity | Data Governance | Data ModellingFlexible work options | Hybrid work | Mentoring cultureSenior-level Full TimeMacquarie Park, NSW, AU, 2113 R9d ago
-
Senior Machine Learning Engineer (Platform / MLOPs) AUD 132K-180KAPI Development | AWS | Amazon EKS | ArgoCD | Arize AIAnnual flu vaccinations | Gym access | Hybrid flexibility | In-office lunch | Nearmap subscriptionSenior-level Full TimeBarangaroo, NSW, Australia R10d ago
-
Robotics Software Engineer AUD 401KBenchmarking | C++ | CI/CD | Collision Avoidance | Machine Learning401k matching | Dental insurance | Health insurance | Paid Holidays | Travel supportMid-level Full TimeCharlestown, MA R10d ago
-
Senior LLMOps Engineer AUD 147K-180KAlerting | Dashboarding | Data Modeling | Data Pipelines | DatadogEquity | Fertility support | Health and wellness allowance | Home office budget | Learning and development budgetSenior-level Full TimeMelbourne R11d ago
-
Forward Deployed Engineer GBP 25K-25K100GbE | C++ | Distributed Systems | Docker | File systemsOn-site work option | Travel up to 25 percentSenior-level Full TimeAustralia, AU R12d ago
-
AI Engineer AUD 132K-180KAWS | Agent Development | Amazon Bedrock | Artificial Intelligence | AutomationFlexible hours | Free food and snacks | Opportunity to drive projects | Socials and Community Groups | Training and developmentSenior-level Full TimeMelbourne, Victoria, Australia R14d ago
-
Infrastructure Engineer, APAC AUD 92K-127KAWS | Ansible | Bash | CI/CD | DockerCompany-provided equipment | Growth opportunities | Happy hours | Internet reimbursement | Learning opportunitiesMid-level Full TimeAdelaide (Hybrid) R15d ago
-
AI Engineering Lead AUD 137K-143KAgile | Amazon Web Services | Docker | IAM | LoggingDiscounted flights | Discounts on accommodation | Discounts on car hire | Discounts on experiences | Discounts on lounge membershipSenior-level Full TimeBrisbane, Sydney R15d ago
-
Forward Deployed AI Engineer, Australia AUD 119K-161KAWS | Agentic Workflows | Apache Iceberg | Apache NiFi | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Mental and physical wellness programsSenior-level Full TimeAustralia-Sydney-Remote R18d ago