Data Engineer

Data Engineer

Mindtech is your gateway to exciting and impactful tech projects. We specialize in end-to-end software outsourcing, linking Latin American talent with global opportunities. Our fast, cost-effective approach ensures that our clients receive exceptional service and innovative solutions. With a diverse team of over 70 skilled professionals across Latin America and the US, we are committed to delivering software that drives success.

Position Overview:

As a Data Engineer, your role is crucial in shaping our data infrastructure and analytics capabilities.

Key Responsibilities:

● Design and develop scalable data pipelines, ensuring they support the processing of large datasets efficiently.

● Integrate advanced analytics and machine learning models into our systems, leveraging your experience with Apache Spark for big data processing and analytics to derive insights and improve decision-making processes.

● Enhance our data governance and security measures, applying best practices to ensure compliance and protect sensitive information.

● Work closely with cross-functional teams, including data scientists and business stakeholders, to understand requirements and deliver high-impact data solutions.

● Deploy and manage robust data infrastructure, utilizing technologies like Kubernetes for orchestration, and ensuring high availability and performance of our data systems

Desired Skills & Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

● At least 2 years of relevant experience in data engineering, with a strong portfolio of designing and implementing data solutions.

● Deep expertise in big data technologies (Apache Spark, DBT), cloud platforms (AWS, Azure, GCP), and data development in data lake/delta lake architectures.

● Proficiency in programming languages (Python, Java, Scala), SQL, and infrastructure as code technologies (Terraform, Helm charts for Kubernetes).

● Expert knowledge of Kubernetes, object storages (S3, Azure Data Lake Store, MinIO), and data modelling (dimensional model - OLAP, data semantic layers).

● Strong problem-solving skills, excellent communication abilities, and the capacity to thrive in a fast-paced environment.