Azure Data Engineer
Tasks
- Align data with schemas governance standards and naming conventions
- Build and maintain security telemetry transformation workflows
- Conduct telemetry gap analyses and recommend improvements
- Design scalable security data ingestion pipelines
- Ensure security telemetry integrity completeness timeliness and quality
- Maintain pipeline and log onboarding documentation
- Monitor pipeline performance and optimize reliability throughput and cost
- Onboard new log sources and validate end to end data flows
- Parse normalize transform and validate security telemetry
- Troubleshoot ingestion parsing transformation and data quality issues
Perks/Benefits
- Cross-functional collaboration
- Exposure to large scale security telemetry
- Professional growth
- Remote work
Skills/Tech-stack
Automation | Azure Data | Azure Data Explorer | CSV | Data Explorer | Data Quality | Data Transformation | Data Validation | Infrastructure as Code | JSON | Log Analytics | Powershell | Python | Regex | SIEM | XML | “as-code”
Education
N/A
Roles
Related jobs
-
AI Agents | AI Observability | APIs | AWS Bedrock | Access ControlAsynchronous collaborative model | Distributed international working environment | Flexible parental leave | Fully Remote Working Environment | Mental health and wellbeing supportSenior-level Full TimeSouth Africa R1d ago
-
AI Solutions Lead - Marketing & Content ZAR 600K-720KAI platforms | API Development | AWS | Data Privacy | Enterprise AIRemote work opportunity | Work-life balanceSenior-level Full TimeJohannesburg, Gauteng R2d ago
-
AI architecture | AWS | Cloud platform | Data Governance | Data PrivacyRemote work | Work-life balanceSenior-level Full TimeJohannesburg, Gauteng R2d ago
-
API | Authentication | Automated testing | Data Pipelines | GitMid-level Full TimeSouth Africa - Remote R2d ago
-
Staff Embedded Software Engineer ZAR 504K-576KC plus plus | C# | Communication Protocols | Containerization | CryptographyAnnual leave | Career development opportunities | Inclusive culture | Work-life balanceSenior-level Full TimeDurban, ZA, 3630 R3d ago
-
Mid-level Full TimeJohannesburg, ZA R3d ago
-
AI Agents | APIs | Access Control | Claude | Data handlingFully remote work | Work during U S business hours supportMid-level Full TimeEgypt R3d ago
-
Mid-level Full TimeEgypt R3d ago
-
API | API Integration | Agent Memory Management | Agent Orchestration | Agent memoryFlexible US business hours | Remote workSenior-level Full TimeSouth Africa - Remote R7d ago
-
AI code generation | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFully remote | Remote flexibility | Work autonomySenior-level Contract Full TimeSouth Africa R8d ago
-
APIs | AWS Lambda | AWS S3 | Amazon RDS | Amazon SNSAutonomy | Collaborative team environment | Fully remote | Ownership | Professional development focusSenior-level Full TimeSouth Africa R8d ago
-
Data Engineer ZAR 420K-464KAPI | Artificial Intelligence | DBT | Data Compliance | Data GovernanceCollaborative culture | Employee wellness programs | Hybrid work | Modern tooling | Professional developmentMid-level Full TimeCape Town, South Africa R8d ago
-
AWS | Autogen | Azure | Claude | Cloud platformBackup power required | Fixed internet required | Public holiday compensation | Remote workSenior-level Full TimeSouth Africa - Remote R9d ago
-
Staff Embedded Software Engineer ZAR 450K-576KC# | C++ | Containerization | Cryptography | EclipseAnnual leave | Career development opportunities | Inclusive culture | Work-life balanceSenior-level Full TimeDurban, ZA, 3630 R10d ago
-
AI Evaluation | API Integration | AWS | Access Control | Agent OrchestrationFlexible work hours | Fully remoteSenior-level Full TimeEgypt R10d ago
-
Mid-level Full TimeCape Town, Western Cape, South Africa R13d ago
-
API Integrations | Automation | CRM | JSON | LLMFlexible schedule | Remote workMid-level Part TimeEgypt R17d ago
-
Data Engineer ZAR 396K-456KAPI Development | AWS | Apache Spark | Automation | CI/CDCareer development opportunities | Employee discounts | Hybrid working | Paid sabbaticals | Paid time offSenior-level Full TimeCape Town, Western Cape, South Africa R1mo ago
-
Principal Clinical Data Engineer - based in South Africa ZAR 663K-663K21 CFR | 21 CFR Part 11 | CFR Part 11 | Cause analysis | Clinical dataSenior-level Full TimeSouth Africa-Bloemfontein-Remote R1mo ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | ChromaDBFlexible working hours | Remote workSenior-level Full TimeSouth Africa - Remote R1mo ago
-
Senior Clinical Data Engineer ZAR 663K-663K21 CFR | 21 CFR Part 11 | CFR Part 11 | Cause analysis | Clinical ResearchSenior-level Full TimeSouth Africa-Bloemfontein-Remote R1mo ago
-
AWS | Amazon Redshift | Apache Airflow | Azure | BigQueryCareer growth opportunities | Collaborative culture | Continuous learning | Flexible working arrangements | Fully remoteSenior-level Full TimeSouth Africa - Remote R1mo ago