Azure Data Engineer

Tasks

• Build security data ingestion pipelines for SIEM and cloud platforms
• Ensure telemetry integrity completeness timeliness and quality
• Improve ingestion frameworks automation and onboarding processes
• Maintain documentation for log onboarding and pipeline operations
• Map data to schemas naming conventions and governance standards
• Monitor pipeline performance and optimize reliability throughput and cost
• Onboard new log sources and validate end to end data flows
• Parse normalize transform and validate security telemetry
• Perform telemetry gap analyses and recommend improvements
• Support compliant logging retention and data integrity requirements
• Support detection engineering and security operations use cases
• Troubleshoot ingestion parsing transformation and data quality issues

Perks/Benefits

• Collaborative global working environment
• Cross-functional collaboration
• Exposure to large scale security telemetry
• Professional growth
• Remote work opportunity

Skills/Tech-stack

Automation | Azure | Azure Data | Azure Data Explorer | CSV | Data Explorer | Data Quality | Data Transformation | Data Validation | Infrastructure as Code | JSON | Log Analytics | Powershell | Python | Regex | Regular Expression | SIEM | SQL | Schema mapping | XML | “as-code”