Data Engineer Lead (OT Data)
CAD 120K-145K (estimate) Senior-level Full Time
Tasks
- Apply security best practices
- Architect data pipelines
- Automate data delivery processes
- Build ETL/ELT pipelines
- Design time-series data models
- Develop data warehousing and lakehouse solutions
- Enable AI and ML model data infrastructure
- Ensure data quality and governance
- Implement Azure real time ingestion and processing
- Implement data standards and interoperability
- Implement master data management
- Ingest OT data from SCADA historians DCS PLC and IoT
Perks/Benefits
- N/A
Skills/Tech-stack
AI | Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Event | Azure Event Hubs | Azure IoT | Azure IoT Hub | Azure Stream | Azure Stream Analytics | Azure Synapse | CI/CD | Dagster | Data Factory | Data Lake Storage | Data Management | Data Modeling | Data Warehousing | Databricks Delta | Databricks Delta Lake | Delta Lake | Docker | ELT | ETL | Event Hubs | Git | IoT Hub | Kafka | Kubernetes | Machine Learning | Master Data | Master Data Management | Microsoft Azure | Modbus | Neo4j | NoSQL | OPC UA | PostgreSQL | PySpark | Python | SQL | SQL Server | Stream Analytics | Vector Databases
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Regions
Countries
States
Related jobs
-
Data Analyst (Oil and Gas) (Doha) USD 100K-140KDAX | Data Governance | Data Lake | Data Modeling | Data VisualizationSenior-level Full TimeDoha Municipality, Doha, Qatar6d ago
-
AI Specialist – Operational Digital Twin USD 112K-210KAPI Integration | Air-gapped | Data Governance | Fine Tuning | Function CallingMid-level Full TimeQAT Doha (GEC), Qatar8d ago
-
Programmer (AI/ML) – Operational Digital Twin USD 112K-196KAPIs | AWS | Accuracy Monitoring | Azure | Azure Machine LearningEntry-level Full TimeQAT Doha (GEC), Qatar15d ago
-
Senior-level Full TimeQatar, Qatar16d ago
-
Senior-level Full TimeDoha, Doha, Qatar22d ago
-
Machine Learning Engineer, Global Public Sector GBP 100K-170KBenchmarking | Bias Mitigation | Deep learning | Direct Preference Optimization | Distributed TrainingMid-level Full TimeDoha, Qatar; London, UK25d ago