Senior Data Engineer

Location: Bogotá,Bogota,Colombia

Firm Mission Statement

Our mission is to change as many lives as possible by offering immigration solutions even in the most difficult cases. We look at all possible options to keep our clients in the United States with their families where they belong. We stand ready to fight even when success seems unsure because we understand how much better life can be with the dignity and peace of mind that comes with having documents.   

Position Purpose

A Sr Data Engineer will be responsible for designing, developing, and maintaining scalable data solutions that enhance our data infrastructure and support business insights. This role involves collaborating closely with cross-functional teams to ensure effective integration, processing, and data analysis across platforms. 

Essential Job Functions & Responsibilities

• Data Pipeline Development
• Design, build, and maintain efficient ETL/ELT pipelines using Azure Data Factory to extract, transform, and load data from Salesforce into Azure SQL databases.
• Leverage API integrations to connect and consolidate data from diverse sources, ensuring seamless data flow and synchronization.
• Utilize Python for advanced data processing tasks and automation scripts.
• Data Integration and Management
• Integrate Salesforce data with other enterprise systems and applications within the Azure environment.
• Ensure data quality and integrity across Salesforce and Azure SQL databases through effective data validation and cleansing processes.
• Develop and maintain data models and schemas that support reporting and analytics needs.
• Database Optimization and Performance Tuning
• Optimize and monitor Azure SQL databases for performance, scalability, and availability.
• Implement best practices for data storage, indexing, and partitioning to ensure high-performance data retrieval and processing.
• Use version control systems (e.g., Git) to manage database scripts, configurations, and code changes.
• Data Automation and Workflow Management
• Develop and automate data workflows using Azure Logic Apps and Power Automate to streamline processes and enhance operational efficiency.
• Implement automation solutions to reduce manual efforts and minimize errors in data handling.
• Data Security and Compliance
• Implement data governance practices and security controls to protect sensitive information within the Azure Cloud environment.
• Ensure compliance with data protection regulations (e.g., GDPR) and organizational standards.
• Collaboration and Support
• Work closely with business stakeholders, data analysts, and developers to understand data needs and provide tailored solutions.
• Collaborate with the analytics team to develop Power BI dashboards and reports that deliver actionable insights.
• Provide technical guidance and mentoring to junior data engineers and team members.
• Documentation and Reporting
• Create and maintain comprehensive documentation of data processes, pipeline configurations, integration flows, and automation scripts.
• Develop automated reporting mechanisms to monitor data pipeline performance and system health.

Essential Skills, Knowledge & Abilities

Minimum Qualifications

• Education & Experience
• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• 5+ years of experience in data engineering, with a focus on cloud-based solutions and data pipeline development.
• Technical Skills
• Proficiency in Salesforce data integration and experience with Salesforce APIs (REST, SOAP).
• Strong SQL skills and extensive experience with Azure SQL Database and Azure Data Factory.
• Solid experience with ETL/ELT tools and techniques; familiarity with data transformation tools within Azure (e.g., Azure Data Factory, Databricks).
• Proficiency in Python for data processing and automation tasks.
• Experience with version control systems like Git for managing code and database scripts.
• Knowledge of Azure Logic Apps and Power Automate for workflow automation.
• Experience in building and deploying CI/CD pipelines using Azure DevOps.
• Hands-on experience with Power BI for data visualization and reporting.
• Cloud & Data Services
• Strong understanding of Azure Cloud services, including Azure SQL, Azure Data Factory, Azure Logic Apps, and Azure DevOps.
• Knowledge of data governance and security best practices in a cloud environment.
• Soft Skills
• Excellent problem-solving skills with attention to detail.
• Strong communication skills and the ability to explain complex technical concepts to non-technical stakeholders.
• Ability to work collaboratively in a team environment and lead initiatives independently.