Data Engineer (Databricks / Azure)
Tasks
- Build ETL and ELT processes
- Build batch and streaming pipelines
- Design data pipelines
- Develop data pipelines
- Develop solutions with Databricks
- Document data architectures
- Document data migration strategies
- Document technical processes
- Ensure data governance
- Ensure data quality
- Ensure data security
- Gather data requirements
- Investigate production data pipeline issues
- Maintain data pipelines
- Migrate data from on-premises to cloud
- Modernize data platforms
- Monitor cloud costs
- Optimize Databricks workloads
- Optimize cloud performance
- Resolve production data pipeline incidents
Perks/Benefits
- Childcare assistance
- Dental insurance
- English and Spanish classes
- Food allowance
- Gym benefits
- Health insurance
- Life insurance
- Meal allowance
- Private pension
Skills/Tech-stack
ARM | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQL | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Security | Databricks | Delta Lake | ELT | ETL | Infrastructure as Code | Lakehouse | Microsoft Azure | Python | SQL | Scala | Synapse Analytics | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsMid-level Full TimeCampinas, Brazil13h ago
-
AWS CloudWatch | Amazon Web Services | Athena | Automation | CloudFormationFlextime | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksMid-level Full TimeRio de Janeiro, Brazil13h ago
-
AWS | AWS Systems Manager | AWS systems | Amazon RDS | AthenaEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsMid-level Full TimeCuritiba, Brazil13h ago
-
AWS | AWS CloudWatch | Amazon RDS | Athena | AutomationEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSorocaba, Brazil13h ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS SAMEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSão Paulo, Brazil13h ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS SAMEducation budget | Exciting projects | Fitness budget | Flextime | MentorshipMid-level Full TimeFlorianópolis, Brazil13h ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS ServerlessFlextime | Growth roadmaps | Mentorship | Office options | Remote optionsMid-level Full TimeSalvador, Brazil13h ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS SAMEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsMid-level Full TimePorto Alegre, Brazil13h ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS SAMFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimeBrasília, Brazil13h ago
-
AWS | AWS CloudFormation | AWS Glue | AWS SAM | Amazon AthenaEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSão Bernardo do Campo, Brazil13h ago
-
AWS | AWS SAM | Amazon RDS | Athena | AutomationFlextime | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksMid-level Full TimeRecife, Brazil14h ago
-
AWS | Amazon Redshift | DBT | Data Architecture | Data LakesFlextime | Growth roadmaps | Mentorship | Office options | Remote optionsMid-level Full TimeSão Paulo, Brazil14h ago
-
AWS | Algorithms | Amazon Redshift | DBT | Data LakeFlextime | Growth roadmaps | Mentorship | Office work options | Remote workMid-level Full TimePorto Alegre, Brazil14h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data StructuresFlextime | Mentorship | Personalized growth roadmaps | Remote work option | TechtalksMid-level Full TimeSão Bernardo do Campo, Brazil14h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Architecture | Data LakesFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimeBrasília, Brazil14h ago
-
AWS | Algorithms | Amazon Redshift | Computer Science | Computer science fundamentalsEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeRecife, Brazil14h ago
-
AWS | Algorithms | Amazon Redshift | Amazon Web Services | DBTEducation budget | Fitness budget | Flextime | Growth roadmaps | MentorshipMid-level Full TimeCampinas, Brazil14h ago
-
AWS | Amazon Redshift | DBT | Data Architecture | Data LakesFlextime | Growth roadmaps | Mentorship | Remote work options | TechtalksMid-level Full TimeRio de Janeiro, Brazil14h ago
-
AWS | Amazon Redshift | DBT | Data Architecture | Data LakehouseEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeFlorianópolis, Brazil14h ago
-
AWS | Algorithms | Amazon Redshift | DBT | Data LakesFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksMid-level Full TimeCuritiba, Brazil14h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Architecture | Data LakesEducation budget | Fitness budget | Flexible schedule | Flextime | MentorshipMid-level Full TimeSalvador, Brazil14h ago
-
AWS | Amazon Redshift | DBT | Data Lakes | Data WarehousingFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote workMid-level Full TimeSorocaba, Brazil14h ago
-
AWS | Algorithms | Amazon Redshift | Amazon Web Services | DBTFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsMid-level Full TimeBelo Horizonte, Brazil14h ago
-
Senior Data Management Professional - Data Engineering - Company Financials Market Data BRL 234K-275KArtificial Intelligence | CSV | Data Architecture | Data Modeling | Data QualitySenior-level Full TimeSao Paulo15h ago
-
Bash | Cloud infrastructure | Data Processing | Docker | GCPMid-level Full TimeSão Paulo, Brazil22h ago