Senior Data Engineer

Company OverviewLean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer a multitude of opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries.   As an influential player in the tech industry, we are dedicated to delivering high-value machine learning applications and robust data systems. Headquartered in a prime location, Lean Tech is poised as a leader in the fast-paced freight industry, with a strong presence in the global market. Our team thrives on curiosity and a commitment to continuous improvement, making Lean Tech the ideal setting for those passionate about data engineering and innovation.Position OverviewAs an integral member of Lean Tech's team, this role focuses on enhancing data-driven decision-making through the development and maintenance of modern data infrastructure. The primary purpose is to advance Analytics and Data Science efforts by designing and deploying data platforms and pipelines. You'll collaborate with data and software engineers and data scientists to innovate data tools and systems supporting Analytics and Business Intelligence in the dynamic freight industry. The position’s key responsibilities include building data systems and ETL/ELT pipelines, ensuring secure integration of data platforms, and pioneering data quality frameworks. This role plays a crucial part within the Data Engineering team in establishing robust data foundations, which are pivotal for high-value machine learning applications.What You Will Be Doing

• Build and maintain robust ETL/ELT pipelines, ensuring efficient data extraction, transformation, and loading from diverse source systems into the data warehouse.
• Develop and manage data pipelines tailored to feature engineering for machine learning systems and orchestration of batch machine learning predictions.
• Collaborate closely with data engineering colleagues to review code, enhance design patterns, and implement new data systems using SQL and Python for optimal performance.
• Author and update technical and functional documentation for systems owned by Data Engineering, ensuring clarity and accessibility for team members.
• Collaborate closely with software and platform engineers to develop solutions that integrate effectively with their systems and code ownership models.
• Partner with Data Organization leadership to influence decisions regarding build-versus-buy, tooling selection, and the adoption and rollout of engineering standards.
• Demonstrate sound judgment in prioritizing technical investments, effectively balancing the need to address technical debt and build out platform capabilities with the delivery of key roadmap initiatives.
• Establish data quality frameworks, aimed at improving the observability and reliability of data pipelines and engineering systems.
• Promote a positive culture of learning and growth by mentoring other Data Organization engineers and sharing knowledge across Data Organization teams.
• Work alongside analysts and analytics engineers to refine and optimize systems supporting Business Intelligence, dashboarding, and reporting tools.
• Set up secure integrations between engineering and analytics platforms interfacing with the Data Platform.
• Participate in an on-call rotation, addressing and resolving data pipeline issues promptly to maintain system integrity.

Required Skills & Experience

• 5+ years of experience in a technical role focused on data, with practical knowledge of building and deploying ETL/ELT pipelines.
• Advanced proficiency in SQL, demonstrated by 2+ years of hands-on experience.
• Intermediate experience with Python for data transformation, analytics, and automation.
• Experience with modern data tooling, including Snowflake, Airflow, DBT, and Azure Data Factory (ADF).
• Intermediate skills in using Business Intelligence (BI) tools.
• Familiarity with agile frameworks for effective project management.
• Bachelor's degree in Computer Science, IT, Analytics, or a related field.
• Strong written and oral communication and presentation abilities.

Nice to Have

• Experience with cloud platforms such as AWS or Google Cloud Platform (GCP) for data engineering solutions.
• Experience with Platform Engineering tooling such as terraform, New Relic, Kubernetes
• Advanced certification in data analytics or data engineering, such as Microsoft Azure Data Engineer or Google Professional Data Engineer.
• Knowledge of machine learning techniques and frameworks.
• Familiarity with Docker or other containerization technologies for streamlined data deployments.

Soft Skills

• Effective communication: Utilize excellent written and oral communication skills to collaborate with team members and communicate complex technical concepts to non-technical stakeholders clearly and efficiently.
• Team collaboration: Work effectively within a collaborative, cross-functional team environment, drawing on the strengths of team members and contributing to shared goals.
• Problem-solving: Apply strong analytical skills to troubleshoot and resolve issues related to data integrity, pipeline efficiency, and system performance.
• Adaptability in agile frameworks: Demonstrate a flexible approach and willingness to learn within agile settings, supporting dynamic project requirements and priorities.
• Continuous learning: Show eagerness to explore new technologies and advance technical proficiency by learning from senior team members and industry trends.

Why You Will Love Working with Lean TechJoin a powerful tech workforce and help us change the world through technology Professional development opportunities with international customers Collaborative work environment Career path and mentorship programs that will lead to new levels. Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will play a vital role in our continued success. Lean Tech is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.