Senior Data Engineer (Neurolinguistic Project)

Company Description

Are you looking for a team of professionals at the forefront of cutting-edge technologies? Are you looking for a place to boost your Big Data career?   

 
We invite you to join our Big Data Competence Center, part of Sigma Software’s complex organizational structure. This center combines various clients, interesting projects, and activities to grow your professional skills. 

 
Among the other various projects, you will be working with one of the biggest American universities that conduct neurolinguistic research by gathering gigabytes of information, processing the data, and applying machine learning algorithms and models to audio and video files to obtain meaningful and revolutionary insights related to the research. 

CUSTOMER

The client's company is a well-known research center that is part of an Ivy League university. The company consists mostly of scientists and researchers in behavioral and linguistic fields. 

PROJECT

The team is working under a non-disclosure agreement (NDA) on a study concerning language semantics, focusing on developing and refining algorithms to align with natural human processes associated with the brain's language centers. 

Job Description

• Working with a modern data stack, producing well-designed technical solutions and robust code, and implementing data governance processes 
• Working closely and communicating professionally with the Customer’s team 
• Taking up responsibility for delivering solution features 
• Participating in the requirements gathering and clarification process 
• Writing unit and integration tests, implementing automated pipelines for code delivery 
• Developing new pipelines and features leveraging AWS cloud provider services 

Qualifications

• 4+ years of experience with Python and SQL 
• 2+ years of experience with Spark or other distributed frameworks 
• Strong experience with AWS, specifically Lambda, AWS Glue, SQS, RDS, and S3 
• Hands-on experience building ETL pipelines for analytics and internal operations 
• Effective communication skills, especially for explaining technical concepts to non-technical business leaders 
• Express leadership and self-organization skills to be able to tackle complex problems 
• Experience with distributed application concepts and DevOps tooling 
• Excellent writing and communication skills 
• Troubleshooting and debugging skills 
• At least an Upper-Intermediate level of English 

WOULD BE A PLUS: 

• Experience or theoretical knowledge of Machine Learning 
• Working with Docker and containers