Big Data Engineer

Optimiza is on the lookout for a Big Data Engineer to join our innovative technology team. In this senior-level role, you will be integral in designing and implementing large-scale data processing systems and solutions that enhance our data ecosystem. Your expertise will play a critical part in driving analytics initiatives, improving data accessibility, and enabling data-driven decision-making across the organization.

Key Responsibilities:

• Design, build, and maintain robust big data infrastructures and efficient data pipelines to handle massive volumes of data.
• Lead the development of data ingestion and processing workflows using big data technologies (e.g., Hadoop, Spark, Kafka).
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality and reliability.
• Optimize existing data processing frameworks and ensure that they adhere to best practices in data management and governance.
• Implement data security measures and compliance protocols within data architectures.
• Mentor and guide junior data engineers, fostering a culture of teamwork and continuous learning.
• Research and recommend new technologies, tools, and techniques to enhance big data capabilities.

Requirements

• Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
• 7+ years of experience in big data engineering, data architecture, or related roles.
• Extensive experience with big data technologies including Hadoop, Spark, Kafka, and distributed computing frameworks.
• Strong proficiency in programming languages such as Scala, Java, or Python.
• Solid understanding of SQL and NoSQL databases and data modeling principles.
• Experience with cloud-based data processing and storage solutions (e.g., AWS, Azure, GCP).
• Excellent analytical and problem-solving skills, with the ability to tackle complex issues.
• Strong communication and collaboration skills to work effectively in cross-functional teams.
• Relevant certifications in big data technologies are a plus.

Benefits

• Class A Health Insurance