Data Engineer

Pune, India

Ollion

Empower your business with Ollion's cloud solution expertise. Tailored, innovative solutions that prioritize outcomes and customer experience.

View all jobs at Ollion

Apply now Apply later

Company Description

OUR STORY

Let’s be honest: there are lots of people out there doing what we do. We’re just not convinced they’re doing it right. Businesses are hungry for innovation and opportunity, but not at the cost of their independence. At Ollion, we’ve connected companies and capabilities around the world to help ambitious organizations make the most of their transformation and leave the status quo in the dust.

WORKING AT OLLION

Innovation is risky. It demands bold steps and big questions, but that’s the price of making change. We’ve got our head in the cloud and two feet on the ground, channeling tech’s endless potential towards a single goal: making a world of difference. And we’re building a global team to do just that— a team capable of making game-changing breakthroughs without ever losing sight of the people it will impact. This is more than consulting. This is the change you can be.

THE OLLION DIFFERENCE

At Ollion, we’re all in on your independence. Our teams are seasoned. Our solutions are straightforward—sometimes even groundbreaking. And our engagements? Exactly as long as you want them to be. We deliver fresh thinking and hard-earned insight in a way that works for you and your customers, arming your organization with everything you need to make your transformation truly mean something.

WORKING WITH OLLION (our clients’ experiences)

Progress matters more than process. Our global team of cloud-native pros is all about creating new and better ways to work—not just by solving your tech challenges, but by using technology to solve your business challenges. We keep the formulas, frameworks, and ten-point plans to a minimum, tackling your most pressing problems with a proprietary mix of good-old-fashioned ingenuity and refreshing humanity.

DIVERSITY AT OLLION 

One of our cultural keystones, ‘Find the angle’ recognizes that every individual has different aspirations, needs and brings a unique perspective. 

We value diversity, inclusion, and equity (DE&I) as core to our success. We believe that a diverse workforce brings together unique perspectives, experiences, and ideas, leading to innovation, creativity, and better outcomes for our clients and our organization. We are on a journey and are committed to building a workplace that celebrates and respects individuals from all backgrounds, including but not limited to race, ethnicity, gender, sexual orientation, age, disability, and cultural heritage.  

As our commitment to diversity and inclusion is reflected in our: 

  • Awareness and sensitisation programs: to create awareness and sensitisation. We encourage open dialogue, active listening, and mutual respect, creating a safe and supportive environment for everyone to contribute their unique perspectives and ideas. 
  • Dedicated efforts to building diverse teams: that leverage the strength of our differences to tackle complex challenges and drive innovation. By embracing diversity, we broaden our collective knowledge, enhance problem-solving capabilities, and unlock limitless potential for our employees.

Job Description

Job Overview

The Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.

The Data Engineer will help build a data and analytics consulting practice by taking part in recruiting efforts, creating technical collateral, and staying on top of technology trends with ongoing training and certifications. The entire consulting team will be responsible for building long-term strategic relationships with clients and participating in all aspects of project delivery

Key Responsibilities

  • Design, implement, and develop data pipelines to collect and process large amounts of data from various sources.
  • Implement data storage solutions that are scalable, secure, and efficient, such as data warehouses and databases.
  • Develop and implement data validation and testing processes to ensure that data is processed accurately and efficiently.
  • Automate data collection, processing, and reporting processes to minimize manual work and improve efficiency.
  • Create high quality documents to capture problem statements, requirements, solutions and designs.
  • Contribute to the development of reusable, repeatable collateral for use across the practice.
  • Implement data quality checks and validation processes to ensure the accuracy, consistency, and security of data.
  • Monitor data pipelines and processes, troubleshoot issues, and implement solutions to prevent recurrence
  • Maintain comprehensive documentation of data architectures, processes, and workflows to facilitate knowledge sharing and collaboration.

Qualifications

Key Requirements

Must Have

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 3-5 years of experience in data engineering
  • Excellent problem-solving, organization, debugging, and analytical skills.
  • Ability to work independently and in a team environment.
  • Excellent communication skills for effectively expressing ideas to team members and clients.
  • Understanding of relational database concepts and SQL.
  • Hands on experience in one RDBMS (MSSQL/MySQL/PostgreSQL)
  • Knowledge of cloud computing platforms, such as Amazon Web Services (AWS), Google Cloud Platform (GCP), or Microsoft Azure
  • Hands on Experience in Data processing frameworks such as Apache Spark/Beam/Flink
  • Experience in building data pipelines using orchestration tools or equivalent cloud services like Apache Airflow or NiFi, as well as ETL tools such as Azure Data Factory, AWS Glue, Matillion, or similar platforms.
  • Hands on Experience with any one of data warehousing solutions, such as Snowflake/ Google BigQuery, or Databricks
  • Debug and optimize existing data infrastructure and processes as needed.
  • Experience with at least one programming language, such as Python/ Java

Nice To Have

  • Experience building large-scale, high throughput, 24x7 data systems.
  • Any Data engineering certifications on any of the clouds
  • Experience with Visualization tools, such as Power BI, Looker, Tableau, and QuickSight.
  • Experience in designing, implementing, and managing event-driven data pipelines using Kafka or similar cloud-native streaming services like AWS Kinesis, Azure Event Hubs, or Google Cloud Pub/Sub.
  • Exposure to machine learning algorithms, AI, and/or LLM, with implementation in practice.
  • Experience with legacy data systems (e.g. Hadoop, Informatica).
  • Experience in Migrating Data Engineering workloads from on-prem to cloud or between clouds
  • Experience in GCP Data services is preferred

Additional Information

BENEFITS & PERKS FOR WORKING AT OLLION

Our employees multiply their potential because they have opportunities to: Create a lasting Impact, Learn and Grow professionally & personally, Experience great Culture, and Be your Whole Self!

Beyond an amazing, collaborative work environment, great people, and inspiring, innovative work, we have some great benefits and perks:

  • Benchmarked, competitive, in-market total rewards package including (but not limited to): base salary & short-term incentive for all employees
  • We are a virtualby-default, small but Global organization; ‘learn wherever, whenever’ frees our people from a rigid view of learning and growth
  • Retirement planning (i.e. CPF, EPF, company-matched 401(k))
  • Globally, we build benefit plans that offer choices for whatever stage in life our employees are in and allow for flexibility as life happens.  Employees have access to a fully comprehensive benefits package to choose the medical, dental, and vision insurance plan that best fits their lives. In addition to great healthcare coverage, we also offer all employees mental health resources and additional wellness programs.
  • Generous time off and leave allowances
  • And more!

Ollion is an equal opportunity employer. We celebrate diversity and we are committed to creating an inclusive environment for all employees. Ollion does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, parental status, military service, or other non-merit factor.

Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  5  1  0
Category: Engineering Jobs

Tags: Airflow Architecture AWS AWS Glue Azure BigQuery Computer Science Consulting Databricks Data pipelines Data quality Data Warehousing Engineering ETL Flink GCP Google Cloud Hadoop Informatica Java Kafka Kinesis LLMs Looker Machine Learning Matillion MS SQL MySQL NiFi Pipelines PostgreSQL Power BI Python QuickSight RDBMS Security Snowflake Spark SQL Streaming Tableau Testing

Perks/benefits: 401(k) matching Career development Competitive pay Equity / stock options Health care Insurance Medical leave Parental leave Startup environment Wellness

Region: Asia/Pacific
Country: India

More jobs like this