Data Engineer Lead (OT Data)
CAD 120K-145K (estimate) Senior-level Full Time
Tasks
- Apply security best practices
- Architect data pipelines
- Automate data delivery processes
- Build ETL/ELT pipelines
- Design time-series data models
- Develop data warehousing and lakehouse solutions
- Enable AI and ML model data infrastructure
- Ensure data quality and governance
- Implement Azure real time ingestion and processing
- Implement data standards and interoperability
- Implement master data management
- Ingest OT data from SCADA historians DCS PLC and IoT
Perks/Benefits
- N/A
Skills/Tech-stack
AI | Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Event | Azure Event Hubs | Azure IoT | Azure IoT Hub | Azure Stream | Azure Stream Analytics | Azure Synapse | CI/CD | Dagster | Data Factory | Data Lake Storage | Data Management | Data Modeling | Data Warehousing | Databricks Delta | Databricks Delta Lake | Delta Lake | Docker | ELT | ETL | Event Hubs | Git | IoT Hub | Kafka | Kubernetes | Machine Learning | Master Data | Master Data Management | Microsoft Azure | Modbus | Neo4j | NoSQL | OPC UA | PostgreSQL | PySpark | Python | SQL | SQL Server | Stream Analytics | Vector Databases
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Regions
Countries
States
Related jobs
-
Senior-level Full TimeDoha, Doha, Qatar1d ago
-
Data Analysis | Data integration | Deep learning | Electronic medical records | GenomicsSponsorship eligibilitySenior-level Full TimeDoha, QA, 241441mo ago
-
Senior-level Full TimeDoha Municipality, Doha, Qatar1mo ago
-
Mid-level Full TimeDoha, Qatar1mo ago