Data Engineer
Lisbon, Portugal
Boost IT is a Portuguese technology consultancy company, we are integrated into one of the most entrepreneurial groups in Portugal, with investment in more than 30 companies.
We want to be known for being the most dynamic, energetic and reliable company to operate in the market and, for that, we want to count on you.
If you're passionate about technology and want to work on the most relevant technology projects, then this ad could be for you!
Tasks
- Responsible for implementing and maintaining the data and machine learning pipelines to ensure that data quality and consistency throughout the different stages of the application
- Responsible to ensure monitoring of the data pipelines including optimizing them across metrics such as performance, cost and reliability,
- Working together with the entire team and business stakeholders, the data engineer will ensure that data is available in an appropriate format to use for model training and reporting. This includes designing appropriate data stores, schema, indexation and partitioning.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience with data processing frameworks such as Apache Spark or Hadoop.
- Strong proficiency in SQL and experience with relational databases.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Excellent problem-solving skills and ability to work collaboratively in a team environment.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Azure Computer Science Data pipelines Data quality Engineering GCP Google Cloud Hadoop Machine Learning Model training Pipelines RDBMS Spark SQL
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.