Lead Flink Data Engineer IoT

BRL 304K-370K (estimate) Senior-level Contract Found 12d ago

Tasks

• Build real-time IoT streaming pipelines
• Design scalable data solutions on Flink
• Develop custom ProcessFunctions for sensor data
• Document implementations and configurations
• Enforce data governance and security standards
• Implement Data Quality tags and gatekeeping
• Integrate libraries into Flink runtime
• Manage Azure Flink clusters
• Monitor and tune data pipelines
• Optimize State Backends for high sensor concurrency
• Participate in agile teams
• Transform and prepare data with SQL and Java

Perks/Benefits

• N/A

Skills/Tech-stack

API Development | Agile methodology | Apache Flink | Azure Data | Azure Data Services | Azure DevOps | Azure ecosystem | CI/CD | Checkpointing | Data Governance | Data Modeling | Data Processing | Data Quality | Data Security | Data Services | Data Warehousing | Data integration | Data patterns | Flink 2.x | GitHub | Java | Kafka | Pipeline Development | SQL | Sensor data | Sensor data patterns | State management | Streaming Pipeline Development | Streaming pipeline | Watermark strategies