Data Engineer Lead (OT Data)( Oil & Gas) (India)
INR 2040K-2400K (estimate) Senior-level Full Time
Tasks
- Adopt industry data standards like OSDU
- Automate processes and optimize infrastructure
- Build and maintain scalable data pipelines
- Collaborate with cross-functional teams
- Design data models for time-series data
- Develop cloud data solutions on Azure
- Ensure data quality and governance
- Implement data security best practices
- Implement master data management strategies
- Integrate high-volume industrial data sources
- Support AI/ML model infrastructure
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Synapse | CI/CD | Cybersecurity | Dagster | Data Factory | Data Lake Storage | Data platform | Databricks Delta | Databricks Delta Lake | Delta Lake | Docker | Enterprise knowledge | Enterprise knowledge graphs | Git | Historian systems | Industrial Protocols | Industrial protocols OPC | Industrial protocols OPC-UA | Kafka | Knowledge graphs | Kubernetes | Machine Learning | Modbus TCP/IP | Modbus/TCP | Neo4j | OPC UA | OSDU Data Platform | PostgreSQL | Protocols OPC-UA | PySpark | Python | SAP | SQL | SQL Server | TCP/IP
Education
Roles
Related jobs
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | C++ | DMZ | DNS | Data LakeEqual opportunity work environment | Travel as requiredSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India3h ago
-
AWS Data Engineer- Assistant Manager INR 1200K-2000KAWS Data | AWS Data Pipeline | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeBangalore, Karnataka, India4h ago
-
Data Engineering Professional INR 2000K-2146KAgile methodologies | Artificial Intelligence | Cloud Computing | Data Engineering | Data ManagementSenior-level Full TimeBengaluru, IN, 5601035h ago
-
Data Engineer INR 938K-1200KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India6h ago
-
Software Engineer III - Data Engineer INR 1500K-2146KAWS | Apache Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Sr. Azure Data Engineer INR 1500K-2000KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN14h ago
-
IN-Associate 2_Azure Data Engineer_OC D&A_Advisory_Bhubaneswar INR 1500K-2000KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBhubaneswar - Ihub, India14h ago
-
Mid-level Full TimeIndia - Hyderabad14h ago
-
Senior-level Full TimeIndia - Hyderabad14h ago
-
Mid-level Full TimeIndia - Hyderabad14h ago
-
Mid-level Full TimeIndia - Hyderabad14h ago
-
Senior-level Full TimeIndia - Hyderabad14h ago
-
Mid-level Full TimeIndia - Hyderabad14h ago
-
Senior Engineer Data - MDM INR 1628K-2146KAgile | Amazon Web Services | Azure | Cloud Platforms | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India14h ago
-
Lead Engineer Data INR 2156K-2400KAgile methodology | Automation | Azure | Azure Data | Azure Data FactoryFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India14h ago
-
TTT - GTP IT - Manager INR 1500K-2500KAI Agents | Alteryx | Automation frameworks | Cloud Platforms | Data ModelingMid-level Full TimeBengaluru, KA, IN, 56001614h ago
-
Mid-level Full TimePune, PDC3C, India14h ago
-
Azure Data Engineer INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Senior-level Full TimeIndia21h ago
-
Software Engineer Lead (Python + Snowflake) INR 2040K-3100KAirflow | CI/CD | DBT | Dagster | Data ModelingSenior-level Full TimeIndia (Noida)21h ago
-
Senior-level Full TimeIN-MH-Pune1d ago
-
Developer, Data Analytics INR 1200K-1968KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad1d ago
-
Senior Data Engineer INR 1300K-2000KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad1d ago
-
Software Engineer III Data Engineer-Python, AWS INR 2050K-3500KAWS | CI/CD | Databricks | ETL | PySparkSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Dashboards | Data CleansingSenior-level Full TimeBengaluru, Karnataka, India1d ago