Data Engineer

Why Ness

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression. 

You’ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities, and attractive compensation.

What you'll do

The project involves conducting a feasibility study to integrate AI into Solar Turbines’ InSight Platform. The goal is to improve decision-making and predictive maintenance capabilities by better-interpreting turbine data. The study will cover scoping, exploration, and feasibility assessment phases, focusing on high-impact AI use cases and data integration strategies.

What you’ll bring

• 5-7 years of experience in data engineering, particularly in handling IoT data, large datasets, and data integration.
• Experience with IoT data management, including ingestion, processing, and storage of large datasets from various sensor data sources.
• Strong knowledge of data pipeline development, ETL (Extract, Transform, Load) processes, and data integration techniques.
• Proficiency in big data technologies such as Hadoop, Spark, or similar frameworks for large-scale data processing.
• Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) for data storage, computing, and deployment of data solutions.
• Experience with SQL and NoSQL database systems (e.g., PostgreSQL, MySQL, MongoDB, Cassandra) for managing structured and unstructured data.
• Knowledge of reporting and data visualization tools such as Tableau, Power BI, or Looker to support data analysts.
• Proficiency in programming languages like Python, Java, or Scala used in data engineering tasks.
• Understanding of API development and data streaming technologies (e.g., Kafka, MQTT) for real-time data integration.
• Ability to collaborate with data scientists, analysts, and other stakeholders to provide data services and tools for analytics and reporting.
• Strong problem-solving skills, attention to detail, and ability to optimize data workflows for efficiency and scalability.
• Experience in industrial or energy sectors is a plus.

Tech Stack:

• Big Data Technologies: Hadoop, Spark, or equivalent.
• Cloud Platforms: AWS, Azure, Google Cloud.
• Databases: SQL (PostgreSQL, MySQL), NoSQL (MongoDB, Cassandra).
• Programming Languages: Python, Java, Scala.
• Data Streaming: Kafka, MQTT.
• Reporting/Visualization Tools: Tableau, Power BI, Looker.
  

Not checking every single requirement? If this role sounds good to you, even if you don’t meet every single bullet point in the job description, we encourage you to apply anyway. For most of the candidates that applied, we found a role that was a very good fit with their skills.Let’s meet and you may just be the right candidate for one of our roles.At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.