Data Engineer

Data Engineer

Description -

The Data Engineer will develop, test, and maintain Big Data solutions for a company. Gather large amounts of data from multiple sources and ensure that downstream users can access the data quickly and efficiently. Essentially, the company’s data pipelines are scalable, secure, and able to serve multiple users.

Job description

• Meeting with managers to determine the company’s Big Data needs.

• Developing Hadoop systems.

• Loading disparate data sets and conducting pre-processing services using Spark, Hive or Pig.

• Finalizing the scope of the system and delivering Big Data solutions.

• Managing the communications between the internal system and the vendor.

• Collaborating with the software research and development teams.

• Building cloud platforms for the development of company applications.

• Maintaining production systems.

• Training staff on data management.

Big Data Engineer Requirements:

• Bachelor’s degree in computer engineering or computer science.

• Previous experience as a big data engineer.

• In-depth knowledge of Data Bricks Hadoop, Spark, and similar frameworks.

• Good understanding of Azure environment

• Knowledge of ADF and scripting languages is preferred.

• Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.

• Familiarity with Mesos, AWS, and Docker tools.

• Excellent project management skills.

• Good communication skills.

• Ability to solve complex data, and software issues.

We love our work environment. We think you will too:

• It’s a friendly atmosphere with supportive leaders to bring your creativity to the max.

• Corporate Social Responsibility initiatives to help you make an impact to communities at large.

Job -

Data & Information Technology

Schedule -

Full time

Shift -

No shift premium (India)

Travel -

Relocation -

Equal Opportunity Employer (EEO) - 

HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

If you’d like more information about HP’s EEO Policy or your EEO rights as an applicant under the law, please click here: Equal Employment Opportunity is the Law Equal Employment Opportunity is the Law – Supplement