Energy & Utilities l Data Engineer
Lisboa, Portugal
Devoteam
Transform your bussines with Devoteam, the AI-driven tech consulting. Become a leading company embracing AI for sustainable value.Company Description
At Devoteam, we believe that technology with strong human values can actively drive change for the better. Discover how Tech for People unlocks the future, creating a positive impact on the people and the world around us. We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue of €1B. We believe in transforming technology to create value for our clients, partners and employees in a world where technology is developed for people. We are proud of the culture we have built together. We are proud of our people at the service of technology. We are proud of our diverse environment. Because we are #TechforPeople. Join our multidisciplinary team of Cloud experts, Designers, Business consultants, Security experts, Engineers, Developers and other extraordinary talents, spread across more than 20 EMEA countries. Become one of our +10.000 tech and business leaders on cloud, data and cyber security. Let’s fuse creativity with technology together and build innovative solutions that actively change things for the better.
Job Description
- Serverless Infrastructure: Collaborate on AWS serverless design, development, and optimization for energy data pipelines;
- Tune components for performance, scalability, security and data privacy;
- Smart Device Integration: Integrate smart devices using AWS IoT Core with secure protocols; Troubleshoot problems and ensure perfect device connectivity;
- External Data Integration: Extract, standardize and enrich data from external partners through APIs; Ensure robust error handling and data validation;
- Database Management: Manage SQL and NoSQL databases, ensuring configuration and optimization;
- Implement data retention, backups and collaborate with analysts;
- Data Pipeline Design: Design end-to-end data pipelines with quality checks and monitoring; Improve pipelines to meet changing business needs;
- Data Lake Management: Architect scalable data lakes with partitioning, indexing and access controls;
- Maintain data lake integrity with data architects;
- Continuous Improvement: Stay up to date on data engineering trends and technologies;
- Optimize processes, improve performance and innovate in the platform architecture.
Qualifications
- Advanced programming skills in NodeJS;
- Experience in implementing AWS technologies;
- Experience in data engineering (e.g. AWS Glue, Amazon Athena, DBT, Spark);
- Experience in SQL databases (e.g. Amazon RDS and Amazon Aurora) and noSQL (e.g. Amazon DynamoDB);
- Knowledge of English;
- Flexibility in the learning process and strong critical sense;
- Understanding of networks, systems architecture and microservices architecture;
- Experience in developing RestFul APIs;
- Proven experience in Agile Scrum and/or Kanban projects.
Additional Information
The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile APIs Architecture Athena AWS AWS Glue Data pipelines dbt DynamoDB Engineering Kanban Microservices Node.js NoSQL Pipelines Privacy Scrum Security Spark SQL
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.