Data Engineer Lead (OT Data)( Oil & Gas) (Remote)
Maharashtra, Pune, India
R
INR 2000K-2040K (estimate) Senior-level Full Time
Tasks
- Adopt industry data standards like OSDU
- Automate processes and optimize infrastructure
- Build and maintain scalable data pipelines
- Collaborate with cross-functional teams
- Design data models for time-series data
- Develop cloud data solutions on Azure
- Ensure data quality and governance
- Implement data security best practices
- Implement master data management strategies
- Integrate high-volume real-time operational data
- Support AI/ML models for predictive analytics
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure Synapse | Big Data | CI/CD | Cybersecurity | Dagster | Data Factory | Data Lake | Data Modeling | Data Warehousing | Data integration | Databricks Delta | Databricks Delta Lake | Delta Lake | Distributed Computing | Docker | Git | Kafka | Kubernetes | Machine Learning | Modbus TCP/IP | Modbus/TCP | Neo4j | OPC UA | PostgreSQL | PySpark | Python | SAP | SQL | SQL Server | TCP/IP
Education
N/A
Roles
Related jobs
-
Senior Data Engineer II INR 2520K-3380KAPI Development | AWS | AWS RDS | Amazon Redshift | Apache SparkFlexible working model | Health and parental leave plans | Professional development stipend | Remote work optionSenior-level Full TimeBengaluru - BLR1 R1d ago
-
Data Engineer, Azure Databricks USD 36K-60KAWS | Azure | Data Engineering | Data Pipelines | DatabricksCollaborative work environment | Equity mission | Professional development opportunities | Remote work flexibilityMid-level Full TimeRemote - Türkiye, or Hybrid - … R2d ago
-
Sr.EM Data Engineering INR 2800K-3500KAPI Development | AWS | Automated testing | CI/CD | Data ProcessingDental insurance | Flexible time off | Medical insurance | Paid parental leave | SabbaticalSenior-level Full TimeIndia (Remote-First) R2d ago
-
AWS Data Engineer (Senior) INR 2500K-3100KAWS | Amazon Athena | Amazon EMR | Amazon Glue | Amazon RedshiftSenior-level Full TimeMumbai, MH R2d ago
-
Senior-level Full TimeIndia - Hyderabad - Remote R2d ago
-
Senior-level Full TimeIndia - Bangalore - 5th floor, … R2d ago
-
Data Engineer - Technology and Operations - Analyst INR 1500K-6000KAzure | Java | NoSQL | Python | SQLComprehensive healthcare | Flexible time off | Retirement plan | Support for working parents | Tuition reimbursementExecutive-level Full TimeHA3-Gurugram - DLF Cyber City, India R2d ago
-
Senior Data Engineer INR 2500K-2829KAWS | Apache Druid | Apache Flink | Apache Spark | Data Modeling401k retirement plan | Co-working reimbursement | Flexible remote work environment | Health, dental, vision benefits | Home office stipendSenior-level Full TimeIndia or Argentina R3d ago
-
Data Engineer INR 1500K-2000KADLS | AWS | Airflow | Azure | DBTBonuses | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceMid-level Full TimeIndia - Remote R3d ago
-
Data Engineer INR 400K-700KAI | API Integration | Alteryx | Automated testing | CI/CDCareer development | ESG initiatives | Employee incentive programs | Employee wellbeing resources | Flexible vacationEntry-level Full TimeIndia, Bengaluru, Karnataka R3d ago
-
Data Engineer, Aladdin Engineering, Vice President INR 1500K-6000KAirflow | CI/CD | Cosmos DB | DBT | Data GovernanceComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeHA3-Gurugram - DLF Cyber City, India R3d ago
-
Data & AI Operations Specialist INR 2040K-2800KAKS | Audit Logging | Azure Data | Azure Data Factory | Azure Machine LearningSenior-level Full TimeIndia - Remote R3d ago
-
Data Engineer INR 2520K-3100KAWS | Agile | Apache Spark | Azure | C#Hybrid work | Mental health days | Retirement savings | Tuition reimbursement | Volunteer daysMid-level Full TimeIndia, Bengaluru, Karnataka R3d ago
-
Remote - Data Engineering Analyst INR 1431K-2000KApache Airflow | Authentication | Azure | Azure Data | Azure Data FactoryPaid time off | Remote workSenior-level Contract Full TimeNew Delhi, Delhi, India - Remote R3d ago
-
Data Engineer, Aladdin Engineering, Vice President INR 1500K-6000KAWS | Airflow | Azure | CDC | CI/CDComprehensive healthcare | Flexible time off | Flexible work from home | Retirement plan | Tuition reimbursementExecutive-level Full TimeHA3-Gurugram - DLF Cyber City, India R4d ago
-
Senior Azure Data Engineer INR 1500K-2040KAgile | Azure | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeIndia-Hyderabad-Remote R4d ago
-
Senior-level Full TimePune, India R4d ago
-
Technical Lead - Data - India INR 2040K-3200KAWS | AWS RDS | Amazon Redshift | Data Modeling | Data WarehousingFlexible office work | Remote work flexibilitySenior-level Full TimeIndia R8d ago
-
Senior Data Engineer (Databricks & PySpark) INR 400K-1200KAzure | Azure Data | Azure Data Factory | Csharp | Data FactorySenior-level Full TimeChennai, IN - Remote R10d ago
-
Senior-level Full TimeIndia - Remote R10d ago
-
Senior Data Engineer INR 600K-1500KAgile | Analysis Services | Archimate | Azure Analysis | Azure Analysis ServicesSenior-level Full TimeIndia-Hyderabad-Remote R11d ago
-
Senior-level Full TimeVadodara, Gujarat, India - Remote R11d ago
-
Senior Data Engineer/Data Ops (m/f/d) INR 2520K-4000KApache Airflow | Apache Hadoop | Apache Spark | ClickHouse | Data ProcessingAnnual learning and development budget | Flexible schedule | Home office setup budget | Work from homeSenior-level Full TimeRemote EMEA/ Remote India R14d ago
-
Solutions Architect INR 2516K-3100KAWS | Airflow | Azure | Azure Data | Azure Data LakeBonuses for approved content | Broadband reimbursement | Medical insurance for parents | Medical insurance for self and family | Paid certificationsSenior-level Full TimeIndia - Remote R16d ago
-
Senior Data Engineer INR 2516K-3100KADLS | AWS | Airflow | Azure | CassandraAutonomy | Casual work environment | Growth opportunities | Remote-first environmentSenior-level Full TimeIndia - Remote R16d ago