Data Engineer, Azure - Remote, Latin America

Tasks

• Build Lakehouse architectures
• Build data lake architectures
• Collaborate with data architects
• Design data warehouses
• Design dimensions and facts
• Develop ETL pipelines
• Document ETL workflows
• Ensure data security and compliance
• Implement data cataloging
• Implement delta lake concepts
• Ingest data from CSV files
• Ingest data from REST APIs
• Ingest data from database tables
• Maintain ETL processes
• Manage data using governance and privacy standards
• Model star schemas
• Monitor ETL jobs
• Optimize SQL query performance
• Optimize Spark SQL jobs
• Troubleshoot pipeline failures
• Tune ETL performance
• Validate data quality
• Write SQL queries

Perks/Benefits

• Company sponsored certifications and exams
• Conferences
• Continuing education
• Flexible working hours
• Paid time off
• Remote work
• Training

Skills/Tech-stack

Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Azure Synapse Notebooks | Azure Synapse Pipelines | CSV | Data Catalog | Data Governance | Data Lakes | Data Modeling | Data Privacy | Data Quality | Data Warehousing | Delta Lake | Dimensions and Facts | ETL | Git | Key Vault | Lakehouses | Linked Services | Performance Tuning | PySpark | Python | REST APIs | SLAs | SQL | SparkSQL | Star Schema | Synapse Analytics | Synapse Notebooks | Synapse Pipelines | T-SQL