Senior Data Engineer

Company Overview: Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer a multitude of opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries. Currently, we are seeking a Senior Data Engineer to join our team. Here are the challenges that our next warrior will face and the requirements we look for:  Position Title: Senior Data Engineer Location: Remote - LATM What you will be doing: We are seeking a seasoned professional with deep expertise in SQL Server to enhance our data team's capabilities. This role primarily focuses on designing, implementing, and maintaining robust data infrastructure solutions that underpin our organization's product offerings. Key responsibilities include creating enterprise-level data architectures, managing transactional databases for critical business applications, and ensuring optimal database performance through advanced administration and optimization techniques. You will play a pivotal role in developing data ingestion and processing workflows while ensuring data quality and integrity. The position sits within the larger data team and actively collaborates with application development teams to maintain and optimize databases supporting OLTP workloads. Embrace the challenge of working with large-scale transactional databases and utilize your proficiency in SQL Server, T-SQL, and scripting tools such as PowerShell and Python for automation tasks. Note that while containerization technologies and data visualization tools are beneficial, the primary focus remains on backend data engineering tasks. A strong understanding of Azure SQL Database and maintaining SQL Server instances is crucial for this role.

• Design and implement enterprise-level data architectures using SQL Server technologies, ensuring robust and scalable solutions.
• Develop and maintain optimized data models, schemas, and database structures for enhanced performance.
• Create and manage efficient ETL/ELT pipelines utilizing custom solutions and third-party tools to facilitate seamless data integration.
• Establish and promote data governance standards and best practices to ensure data integrity and compliance.
• Oversee and enhance transactional databases that support key business applications, collaborating with development teams for optimal schema design.
• Implement database changes and migrations in alignment with application releases, ensuring consistency and accuracy.
• Monitor and optimize application database performance, effectively managing high transaction volumes to enhance system efficiency.
• Perform advanced SQL Server database administration, including installation, configuration, and maintenance to sustain reliable operations.
• Optimize database performance through strategic indexing, query tuning, and resource management.
• Implement comprehensive backup, recovery, and disaster recovery procedures to safeguard critical data assets.
• Build and sustain robust, scalable data ingestion and processing workflows tailored to organizational needs.
• Develop advanced stored procedures, functions, and complex SQL queries for precise data transformation.
• Extract and prepare data from various databases for analytics and reporting, ensuring real-time and batch processing capabilities.

Required Skills & Experience:

• 5+ years of hands-on experience with SQL Server (2016/2019/2022), with strong emphasis on SQL Server administration and optimization, including clustering and replication.
• Advanced proficiency in T-SQL, including the development of stored procedures, functions, and triggers.
• Extensive experience in designing and maintaining large-scale application databases, with a focus on ensuring performance and scalability.
• Proficient in database performance tuning and optimization for OLTP workloads, with a strong understanding of indexing strategies and query tuning.
• Proficiency in PowerShell and Python for automation and scripting tasks.
• Experience with transaction management, concurrency control, and locking mechanisms to ensure database integrity.
• Familiarity with data visualization tools (Power BI, Tableau, or similar)
• Knowledge of version control systems, such as Gitlab, and experience with database deployment and migration tools.
• Familiarity with cloud platforms, particularly Azure, and basic understanding of services like Azure SQL Database.
• Working knowledge of API integration and data exchange formats, including JSON and XML.
• Experience with application database monitoring and optimization under high transaction volumes.
• Understanding of database schema versioning and migration strategies.
• Intermediate proficiency in C# for scripting and automation is a plus.

Nice to Haves:

• Experience with Azure Data Factory for building ETL/ELT pipelines.
• Familiarity with containerization technologies like Docker or Kubernetes for deploying database solutions.
• A certification in cloud platforms, preferably Microsoft Certified: Azure Database Administrator Associate.
• Experience with data governance best practices, even if not mandated.
• Strong problem-solving skills and the ability to effectively collaborate with cross-functional teams.

Soft Skills:

• Effective communication skills to articulate complex technical concepts clearly, ensuring alignment across multidisciplinary teams. 
• Strong problem-solving skills to proactively identify issues within automation processes and develop efficient solutions. 
• Leadership and team collaboration skills to guide and mentor team members, fostering a culture of continuous improvement and innovation. 
• Adaptability and openness to learning, crucial for staying updated with industry trends and adopting new low-code/no-code technologies effectively. 
• Time management skills to prioritize tasks and manage multiple projects simultaneously, ensuring timely delivery and high-quality outcomes.

Why you will love Lean Tech:

• Join a powerful tech workforce and help us change the world through technology
• Professional development opportunities with international customers
• Collaborative work environment
• Career path and mentorship programs that will lead to new levels.

Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will play a vital role in our continued success. Lean Tech is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.