Lead Flink Data Engineer IoT

Tasks

• Apply data quality gates
• Design data solutions on Flink
• Develop custom ProcessFunctions
• Document solutions
• Enforce data governance and security
• Implement IoT streaming pipelines
• Manage state and windowing
• Monitor and fine-tune pipelines
• Optimize Azure Flink clusters
• Participate in agile teams
• Transform and prepare data

Perks/Benefits

• N/A

Skills/Tech-stack

Apache Flink | Azure | Azure CLI | Azure Data | Azure Data Services | Azure DevOps | Azure Event | Azure Event Hubs | Azure SDK | CI/CD | Checkpointing | Custom ProcessFunctions | Data Governance | Data Modeling | Data Security | Data Services | Data Warehousing | Data patterns | DataStream API | Event Hubs | Flink 2.x | Flink State Management | GitHub | Java | Kafka | SQL | Sensor data | Sensor data patterns | State management | Watermark strategies