Data Engineer
New York, New York, United States
Description
Join our dynamic team at 257 as a Data Engineer and help shape the future of data-driven decision making in the energy industry. As a Data Engineer, you will be responsible for building and maintaining the data infrastructure, data pipelines, and scalable backend systems that enable our data analysts and scientists to extract valuable insights from large and complex datasets. This is an exciting opportunity to work with cutting-edge technologies and contribute to solving complex challenges in the energy sector.
Responsibilities
- Design, develop and maintain scalable and efficient data pipelines to capture and process large volumes of data from various sources.
- Implement data integration and transformation processes to ensure data consistency and accuracy.
- Collaborate with data analysts, scientists, and other cross-functional teams to understand data requirements and design appropriate data solutions.
- Optimize data processing and storage for performance and cost-efficiency.
- Identify and resolve issues related to data quality, data consistency, and data pipeline performance.
- Implement and maintain monitoring and alerting systems to ensure data pipelines are running smoothly.
- Stay up-to-date with the latest trends and technologies in data engineering and propose innovative solutions to enhance our data infrastructure.
- Participate in code reviews, provide constructive feedback, and ensure code quality and best practices are followed.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
- 5+ years of experience as a Data Engineer or in a similar role.
- Strong programming skills in Python or Java.
- Experience building and optimizing data pipelines using Apache Kafka, Apache Spark, or similar technologies.
- Familiarity with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.
- Knowledge of SQL and experience with relational databases such as MySQL or PostgreSQL.
- Knowledge of data modeling, data warehousing, and ETL processes.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration skills to work effectively in a cross-functional team.
- Experience in the energy or sustainability industry is a plus.
Why Join Us?
- Fascinating technical challenge - solving complex data engineering problems to drive data insights.
- Meaningful impact - contribute to the transition to renewable energy and reduce carbon emissions.
- Opportunity for growth - learn, develop, and advance your career in a rapidly evolving industry.
- Collaborative and inclusive work environment.
- Competitive compensation and benefits package.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: AWS Azure Computer Science Data pipelines Data quality Data Warehousing Engineering ETL GCP Google Cloud Java Kafka MySQL Pipelines PostgreSQL Python RDBMS Spark SQL
Perks/benefits: Competitive pay
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.