Data Engineer

• Design, implement, and maintain data pipelines to ensure seamless flow of data from various sources to storage systems.
• Work with large, complex datasets to ensure high performance, availability, and scalability of data systems.
• Collaborate with data scientists, analysts, and other engineering teams to deliver insights and business value from structured and unstructured data.
• Implement ETL (Extract, Transform, Load) processes to ensure accurate and efficient data processing.
• Develop and optimize data infrastructure and architecture for efficient storage and retrieval.
• Troubleshoot and resolve data issues, ensuring data integrity and accuracy.
• Ensure compliance with data governance, security policies, and industry best practices.
• Monitor and report on system performance, ensuring minimal downtime and maximum operational efficiency.
• Continuously evaluate and improve data processes, infrastructure, and tools.

Requirements

• Proven experience (3+ years) as a Data Engineer or similar role in data management, processing, and analytics.
• Experience with data modeling, ETL frameworks, and big data tools like Apache Hadoop, Spark, Kafka, etc.
• Proficiency in programming languages such as Python, Java, Scala, or SQL.
• Hands-on experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
• Familiarity with cloud platforms like AWS, Azure, or Google Cloud for data storage and processing.
• Experience with data warehousing solutions and BI tools such as Snowflake, Redshift, or BigQuery.
• Solid understanding of data pipeline automation, version control, and continuous integration/continuous deployment (CI/CD) best practices.
• Strong analytical and problem-solving skills with attention to detail.
• Ability to work in a fast-paced and collaborative environment.
• Excellent communication skills, both verbal and written, to interact with technical and non-technical teams.
• Ability to handle multiple tasks and deadlines effectively.
• Willingness to learn new technologies and continuously improve technical skills.
• Experience with data visualization and reporting tools is a plus (e.g., Tableau, Power BI).
• Knowledge of machine learning or data science concepts is a bonus.