Lead Flink Data Engineer IoT

COP 30202K-39344K (estimate) Senior-level Contract Found 12d ago

Tasks

• Apply Data Quality tags
• Design data solutions on Flink
• Develop custom ProcessFunctions
• Implement streaming pipeline for IoT
• Integrate libraries into Flink runtime
• Maintain documentation
• Manage Azure resources
• Monitor and optimize pipelines
• Optimize State Backends
• Participate in agile activities
• Promote data governance and security
• Transform and clean data with SQL and Java

Perks/Benefits

• N/A

Skills/Tech-stack

Apache Flink | Artifacts | Azure Data | Azure Data Services | Azure DevOps | Azure Event | Azure Event Hubs | Azure ecosystem | CI/CD | Checkpointing | Data Governance | Data Modeling | Data Quality | Data Security | Data Services | Data Warehousing | Data patterns | Database Design | Enterprise AI | Event Hubs | Flink 2.x | Flink State Management | GitHub | Java | Kafka | Real Time | Real-time Streaming | SQL | Sensor data | Sensor data patterns | State management | Watermark strategies