Data Engineer (Databricks / Azure)
Tasks
- Build ETL and ELT processes
- Build batch and streaming pipelines
- Design data pipelines
- Develop data pipelines
- Develop solutions with Databricks
- Document data architectures
- Document data migration strategies
- Document technical processes
- Ensure data governance
- Ensure data quality
- Ensure data security
- Gather data requirements
- Investigate production data pipeline issues
- Maintain data pipelines
- Migrate data from on-premises to cloud
- Modernize data platforms
- Monitor cloud costs
- Optimize Databricks workloads
- Optimize cloud performance
- Resolve production data pipeline incidents
Perks/Benefits
- Childcare assistance
- Dental insurance
- English and Spanish classes
- Food allowance
- Gym benefits
- Health insurance
- Life insurance
- Meal allowance
- Private pension
Skills/Tech-stack
ARM | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQL | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Security | Databricks | Delta Lake | ELT | ETL | Infrastructure as Code | Lakehouse | Microsoft Azure | Python | SQL | Scala | Synapse Analytics | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
.NET | AWS | AWS Bedrock | Anthropic | CachingChildcare support | Dental insurance | Gym benefits | Health insurance | Life insuranceSenior-level Full TimeBelo Horizonte, MG11h ago
-
Analytics Engineer Sênior BRL 23K-31KAWS | Apache Spark | Azure | Cloud Computing | Data GovernanceMid-level Full TimeSão Paulo, Brazil11h ago
-
Engenheiro de Dados Sênior BRL 23K-31KData Architecture | Data Factory | Data Lake | Databricks | KafkaBenefits club | Childcare support | Dental insurance | Food benefits | Health insuranceMid-level Full TimeSão Paulo, SP13h ago
-
A/B | A/B Testing | API Gateway | AWS Lambda | Amazon BedrockChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil13h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsCareer growth | Collaborative team environment | Professional development | Remote workMid-level Full TimePorto Alegre, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsCareer growth | Professional development | Remote workMid-level Full TimeSão Paulo, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAgile | Azure Data | Azure Data Lake | Azure DevOps | Azure Key VaultCareer growth | Collaborative work environment | Professional development | Remote workMid-level Full TimeSalvador, Bahia, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsMid-level Full TimeRio de Janeiro, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CSVCareer growth opportunities | Collaborative team environment | Professional development | Remote workMid-level Full TimeRecife, Pernambuco, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Azure Synapse NotebooksCollaborative work environment | Professional development | Remote workMid-level Full TimeManaus, Amazonas, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAgile | Azure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse AnalyticsCollaborative work environment | Continuous learning | Professional development | Remote workMid-level Full TimeGoiânia, Goiás, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAgile | Azure Data | Azure Data Lake | Azure DevOps | Azure Key VaultCareer growth | Collaborative team environment | Continuous learning | Professional development | Remote workMid-level Full TimeFortaleza, Ceará, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CSVCareer growth | Collaborative work environment | Professional development | Remote workMid-level Full TimeCuritiba, Paraná, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsProfessional development opportunities | Remote workMid-level Full TimeBrasília, Federal District, Brazil R15h ago
-
Data Engineer (Azure) - Remote, Latin America BRL 264K-294KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CSVCollaborative work environment | Professional development | Remote workMid-level Full TimeBelo Horizonte, Minas Gerais, Brazil R15h ago
-
AWS EMR | AWS Glue | Amazon S3 | CI/CD | Data EngineeringBirthday day off | Childcare assistance | Dental insurance | Gym membership | Health insuranceSenior-level Full TimeBelo Horizonte, MG17h ago
-
Administrador de Dados - Engenharia e modelagem BRL 21K-23KCA Gen | DB2 | DCL | DDL | DMLDental plan | Gympass | Health insurance | Life insurance | Meal or food voucherEntry-level Full TimeRemoto, Brasil R18h ago
-
API Development | CI/CD | Cloud infrastructure | Containerization | Data PipelinesAsynchronous collaboration | Conference stipend | Flexible work environment | Hardware stipend | Professional learning stipendSenior-level Full TimeBrazil R19h ago
-
Apache Avro | Apache Kafka | Apache Spark | Asynchronous processing | Delta LakeCareer growth in globally distributed organization | Collaborative engineering culture | Exposure to modern data engineering architectures | Remote-friendly work environmentMid-level Full TimeBrazil23h ago
-
CA Gen | DB2 | DCL | DDL | DMLDental insurance | Gym membership support | Health insurance | Life insurance | Meal or food allowanceMid-level Full TimeBrazil1d ago
-
AWS | DBT | Data Modeling | Data Pipelines | Data QualityCollaborative environment | End to end data engineering ownership | Engineering quality focus | Fully remote | Latin America location requirementSenior-level Full TimeBrazil R1d ago
-
Machine Learning Engineer - ML Applications BRL 108K-132KAgile methodology | Algorithms | Amazon Web Services | Apache Spark | AutomationMid-level Full TimePOA05 - RS POA 95 (POA05), …1d ago
-
Mid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Azure DevOps Engineer (Cloud & AI Delivery) BRL 114K-136KAgile | Automation | Azure DevOps | CI/CD | ContainersCareer growth plan | English program | Fitness membership | Games and competitions | International projectsMid-level Full TimeSão Paulo R1d ago
-
Desenvolvedor(a) Backend Sênior Java BRL 80K-106KAWS | CI/CD | Design Patterns | Docker | EC2Development opportunities | Reward and recognition | Volunteering opportunities | Wellness programs | Work-life balanceMid-level Full TimeSão Paulo, Brazil1d ago