Data Engineer Lead (OT Data)( Oil & Gas) (India)
INR 2040K-2400K (estimate) Senior-level Full Time
Tasks
- Adopt industry data standards like OSDU
- Automate processes and optimize infrastructure
- Build and maintain scalable data pipelines
- Collaborate with cross-functional teams
- Design data models for time-series data
- Develop cloud data solutions on Azure
- Ensure data quality and governance
- Implement data security best practices
- Implement master data management strategies
- Integrate high-volume industrial data sources
- Support AI/ML model infrastructure
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Synapse | CI/CD | Cybersecurity | Dagster | Data Factory | Data Lake Storage | Data platform | Databricks Delta | Databricks Delta Lake | Delta Lake | Docker | Enterprise knowledge | Enterprise knowledge graphs | Git | Historian systems | Industrial Protocols | Industrial protocols OPC | Industrial protocols OPC-UA | Kafka | Knowledge graphs | Kubernetes | Machine Learning | Modbus TCP/IP | Modbus/TCP | Neo4j | OPC UA | OSDU Data Platform | PostgreSQL | Protocols OPC-UA | PySpark | Python | SAP | SQL | SQL Server | TCP/IP
Education
Roles
Related jobs
-
Data Engineer Ii INR 1500K-2000KAWS Glue | AWS Lambda | Amazon EMR | Amazon Redshift | Amazon S3Community Outreach Programs Charity Events | Employee Resource Group | Employee stock purchase program | Health and wellness incentives | Remote workMid-level Full TimeBangalore, KA, IN, 5600765h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Databrick Developer INR 2000K-2040KAgile | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeIN-TN-Chennai23h ago
-
Senior-level Full TimeIN-AP-Hyderabad23h ago
-
Consultant- Data Support INR 316K-500KAlteryx | Azure Data | Azure Data Engineering | Azure Data Lake | Azure Databricks24/7 rotation | Customer service focusEntry-level Full TimeBangalore, Karnataka, India1d ago
-
Microsoft Fabric Data Engineer INR 1800K-2040KAzure Data | Azure Data Factory | Azure DevOps | CI/CD | Data FactorySenior-level Full TimeThane, Maharashtra, India1d ago
-
Consultant _ADF INR 2000K-2000KADF Mapping Data Flows | ARM Templates | Agile | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India1d ago
-
Lead Data Engineer INR 1200K-2000KAzure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryUK shift workSenior-level Full TimeBengaluru, KA, India1d ago
-
Azure Data Engineer Consultant INR 1600K-3000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksDiscounts on products and services | Maternity leave | Networking opportunities | Paternity leaveMid-level Full TimeBangalore, Karnataka, India1d ago
-
Data Quality Engineer-Azure Data Platform Testing INR 1500K-2000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeGurugram, Haryana, India1d ago
-
Data Engineer Ii INR 1200K-2000KAWS | Agile | Batch Processing | DBT | Data LakesExtensive training initiatives | Group insurance | Growth opportunities | Hospitalization insurance | Meal vouchersMid-level Full TimeBangalore, KA, IN, 5600761d ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Data Solutions Engineer - MI Solutions INR 1200K-1600KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data FactoryMid-level Full TimeGurgaon, India1d ago
-
Software Engineer II- Python, Databricks, AWS, Spark, IDMC INR 1500K-2200KAWS Lambda | Amazon Aurora | Amazon EKS | Amazon S3 | Apache AirflowMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff Software Engineer INR 3200K-4200KAWS EMR | AWS Glue | AWS Step Functions | Amazon Athena | Amazon S3Hybrid work | Learning opportunities | Onsite collaboration | Remote flexibilitySenior-level Full TimeIndia - Pune - Office1d ago
-
Data Engineer INR 2520K-3380KAzure Data | Azure Data Services | Azure DevOps | DAX | Data GovernanceLearning and career developmentSenior-level Full TimeChennai, IN, 600 0321d ago
-
Senior-level Full TimeBangalore, KA, IN1d ago
-
Data Engineer (Data Application Developer) INR 2516K-3356KAWS | Amazon Kinesis | Amazon SQS | DBT | Data ModelingCommunity involvement support | Employee support programs | Hybrid work options | In-person work options | Remote work optionsSenior-level Full TimeRemote (IND), India R1d ago
-
Data Engineer INR 2000K-2400KBig Data | Cloud Data | Cloud Data Platforms | Data Lakes | Data QualitySenior-level Full TimeBangalore, India1d ago
-
Senior-level Full TimeBangalore, KA, IN1d ago
-
Process Mining Data Engineer INR 1500K-1950KBusiness Process | Business Process Analysis | Celonis | Dashboard Development | Data ModelingHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeIND-Bangalore-A, RMZ Infinity, India1d ago
-
Mid-level Full TimeGera Commerzone SEZ, Pune, India1d ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …1d ago
-
Mid-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
IN_Manager_AI ML Engineer_GCC_Advisory_Noida INR 1500K-2500KApache Spark | CNTK | Caffe | Classification | Computer VisionMid-level Full TimeNoida, India1d ago