Senior Data Engineer
Colombia
Lean Tech
Lean Solutions Group is a top workforce optimization company. Explore our offshore and nearshore staffing solutions to transform your business operations.
Company Overview: Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer a multitude of opportunities for professionals to elevate their careers and experience substantial growth. Joining our team means engaging with expansive engineering teams across Latin America and the United States, contributing to cutting-edge developments in multiple industries. Currently, we are seeking a Senior Data Engineer to join our team. Here are the challenges that our next warrior will face and the requirements we look for: Position Title: Senior Data Engineer Location: Remote - LATM What you will be doing: We are seeking a seasoned professional with deep expertise in SQL Server to enhance our data team's capabilities. This role primarily focuses on designing, implementing, and maintaining robust data infrastructure solutions that underpin our organization's product offerings. Key responsibilities include creating enterprise-level data architectures, managing transactional databases for critical business applications, and ensuring optimal database performance through advanced administration and optimization techniques. You will play a pivotal role in developing data ingestion and processing workflows while ensuring data quality and integrity. The position sits within the larger data team and actively collaborates with application development teams to maintain and optimize databases supporting OLTP workloads. Embrace the challenge of working with large-scale transactional databases and utilize your proficiency in SQL Server, T-SQL, and scripting tools such as PowerShell and Python for automation tasks. Note that while containerization technologies and data visualization tools are beneficial, the primary focus remains on backend data engineering tasks. A strong understanding of Azure SQL Database and maintaining SQL Server instances is crucial for this role.
- Design and implement enterprise-level data architectures using SQL Server technologies, ensuring robust and scalable solutions.
- Develop and maintain optimized data models, schemas, and database structures for enhanced performance.
- Create and manage efficient ETL/ELT pipelines utilizing custom solutions and third-party tools to facilitate seamless data integration.
- Establish and promote data governance standards and best practices to ensure data integrity and compliance.
- Oversee and enhance transactional databases that support key business applications, collaborating with development teams for optimal schema design.
- Implement database changes and migrations in alignment with application releases, ensuring consistency and accuracy.
- Monitor and optimize application database performance, effectively managing high transaction volumes to enhance system efficiency.
- Perform advanced SQL Server database administration, including installation, configuration, and maintenance to sustain reliable operations.
- Optimize database performance through strategic indexing, query tuning, and resource management.
- Implement comprehensive backup, recovery, and disaster recovery procedures to safeguard critical data assets.
- Build and sustain robust, scalable data ingestion and processing workflows tailored to organizational needs.
- Develop advanced stored procedures, functions, and complex SQL queries for precise data transformation.
- Extract and prepare data from various databases for analytics and reporting, ensuring real-time and batch processing capabilities.
- 5+ years of hands-on experience with SQL Server (2016/2019/2022), with strong emphasis on SQL Server administration and optimization, including clustering and replication.
- Advanced proficiency in T-SQL, including the development of stored procedures, functions, and triggers.
- Extensive experience in designing and maintaining large-scale application databases, with a focus on ensuring performance and scalability.
- Proficient in database performance tuning and optimization for OLTP workloads, with a strong understanding of indexing strategies and query tuning.
- Proficiency in PowerShell and Python for automation and scripting tasks.
- Experience with transaction management, concurrency control, and locking mechanisms to ensure database integrity.
- Familiarity with data visualization tools (Power BI, Tableau, or similar)
- Knowledge of version control systems, such as Gitlab, and experience with database deployment and migration tools.
- Familiarity with cloud platforms, particularly Azure, and basic understanding of services like Azure SQL Database.
- Working knowledge of API integration and data exchange formats, including JSON and XML.
- Experience with application database monitoring and optimization under high transaction volumes.
- Understanding of database schema versioning and migration strategies.
- Intermediate proficiency in C# for scripting and automation is a plus.
- Experience with Azure Data Factory for building ETL/ELT pipelines.
- Familiarity with containerization technologies like Docker or Kubernetes for deploying database solutions.
- A certification in cloud platforms, preferably Microsoft Certified: Azure Database Administrator Associate.
- Experience with data governance best practices, even if not mandated.
- Strong problem-solving skills and the ability to effectively collaborate with cross-functional teams.
- Effective communication skills to articulate complex technical concepts clearly, ensuring alignment across multidisciplinary teams.
- Strong problem-solving skills to proactively identify issues within automation processes and develop efficient solutions.
- Leadership and team collaboration skills to guide and mentor team members, fostering a culture of continuous improvement and innovation.
- Adaptability and openness to learning, crucial for staying updated with industry trends and adopting new low-code/no-code technologies effectively.
- Time management skills to prioritize tasks and manage multiple projects simultaneously, ensuring timely delivery and high-quality outcomes.
- Join a powerful tech workforce and help us change the world through technology
- Professional development opportunities with international customers
- Collaborative work environment
- Career path and mentorship programs that will lead to new levels.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Category:
Engineering Jobs
Tags: APIs Architecture Azure Clustering Data governance Data quality Data visualization Docker ELT Engineering ETL GitLab JSON Kubernetes Pipelines Power BI Python SQL Tableau T-SQL XML
Perks/benefits: Career development Startup environment
Region:
South America
Country:
Colombia
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Power BI Developer jobsBusiness Intelligence Developer jobsPrincipal Data Engineer jobsBI Developer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsPrincipal Software Engineer jobsJunior Data Analyst jobsData Science Intern jobsDevOps Engineer jobsData Manager jobsData Science Manager jobsSoftware Engineer II jobsAccount Executive jobsStaff Software Engineer jobsData Analyst Intern jobsLead Data Analyst jobsBusiness Data Analyst jobsAI/ML Engineer jobsSr. Data Scientist jobsData Specialist jobsData Governance Analyst jobsSenior Backend Engineer jobsData Engineer III jobsBusiness Intelligence Analyst jobs
Consulting jobsMLOps jobsAirflow jobsOpen Source jobsEconomics jobsLinux jobsKPIs jobsKafka jobsTerraform jobsGitHub jobsJavaScript jobsPostgreSQL jobsRDBMS jobsData Warehousing jobsNoSQL jobsClassification jobsBanking jobsStreaming jobsScikit-learn jobsPrompt engineering jobsRAG jobsComputer Vision jobsPhysics jobsGoogle Cloud jobsPandas jobs
Hadoop jobsOracle jobsScala jobsdbt jobsBigQuery jobsLooker jobsReact jobsGPT jobsData warehouse jobsR&D jobsLangChain jobsScrum jobsPySpark jobsDistributed Systems jobsMicroservices jobsCX jobsELT jobsIndustrial jobsSAS jobsOpenAI jobsJira jobsRedshift jobsModel training jobsTypeScript jobsJenkins jobs