Data Engineer Manager | Azure Databricks
Sao Paulo, Torre Paineira, Brazil
BRL 96K-119K (estimate) Mid-level Full Time
Tasks
- Build Spark transformations
- Build batch ingestion processes
- Build resilient scalable pipelines
- Collaborate with cross-functional teams
- Convert legacy scripts for modern architectures
- Develop ELT
- Develop ETL
- Develop data transformations
- Develop data workloads in Azure Databricks
- Document solutions
- Ensure data quality
- Ensure data traceability
- Fix defects
- Implement data governance
- Implement data monitoring
- Implement data observability
- Implement data pipelines
- Integrate with APIs
- Integrate with relational databases
- Migrate data workloads to Azure Databricks
- Model data for Lakehouse architecture
- Modernize Python scripts
- Process data with Apache Spark
- Run integration tests
- Run unit tests
- Support UAT stabilization
- Use Delta Lake for Lakehouse
- Validate migrated data assets
- Work in Agile Scrum
- Write Python code
- Write SQL queries
Perks/Benefits
- Birthday off
- Car allowance
- Career mentorship
- Childcare support
- Corporate vehicle
- Dental insurance
- Life insurance
- Meal allowance
- Medical insurance
- Multibenefits Card
- Parking
- Pregnancy Support Kit
- Private pension
- Results bonus
- Wellbeing Sessions
- Wellhub
Skills/Tech-stack
APIs | Apache Spark | Azure Databricks | Cloud Development | Data Governance | Data Modeling | Delta Lake | ELT | ETL | Git | Integration Testing | Kanban | Lakehouse | Observability | Python | Relational databases | SQL | Scrum | Unit Testing
Education
N/A
Related jobs
-
Automation | B2B | Cause analysis | Chain management | Change ManagementMid-level Full TimeSao Bernardo do Campo, SP, BR9h ago
-
Analytics | Cause analysis | Chain management | Change Management | Continuous ImprovementMid-level Full TimeSao Bernardo do Campo, SP, BR9h ago
-
Data Engineer – GIS / Geospatial BRL 319K-443KAnalytical modeling | Apache Airflow | ArcGIS | Automated testing | BigQuerySenior-level Full TimeBrasília, DF, Brazil13h ago
-
Azure | Azure ML | CI/CD | Data Governance | Data LakeChildcare support | Dental insurance | Discount club | Extended parental leave | Gym partnershipSenior-level Full TimeBrazil21h ago
-
Data Engineer Analyst BRL 304K-385KAirflow | Batch data | Batch data pipelines | BigQuery | CI/CDDaycare assistance | Dental plan | Discount on products | Employee support program | Extended maternity/paternity leaveMid-level Full TimeSão Paulo,São Paulo,BRA1d ago
-
Data Engineering Manager | Data Platform BRL 13K-18KApache Airflow | Apache Iceberg | CI/CD | Cloud platform | Data ComplianceDental insurance | Education benefit | Gym access | Health insurance | Home officeMid-level Full TimeSão Paulo, Brazil1d ago
-
[Job-31000] Senior Data Engineer, Brazil BRL 212K-270KAccess Control | Anomaly Detection | Apache Spark | Azure | Azure DataChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrazil1d ago
-
Data Engineer BRL 234K-300KAmazon Web Services | Apache Airflow | Apache Spark | Data Governance | Data ModelingEnglish collaboration | Remote workMid-level Full TimeBrazil1d ago
-
Accountability Model | Analytics | Clinical operations | Consent Management | Data Decision RightsContract opportunity | Fully remote working | Healthcare data governance transformation exposure | High visibility role | Strategic influence at system scaleSenior-level Contract Full TimeBrazil R1d ago
-
Agile | Azure DevOps | Backlog Grooming | Backlog Management | Business AnalysisCareer growth programs | Diversity, equity & inclusion initiatives | Employee assistance program | Employee discounts | Employee resource groupsMid-level Full TimeBrazil R1d ago
-
Consultor(a) Data Engineer Senior BRL 54K-72KAPI Apps | AWS | Access Control | Azure | Azure APIBirthday off | Career mentorship | Childcare assistance | Company results participation | Dental insuranceSenior-level Full TimeSao Paulo, Torre Paineira, Brazil1d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAWS | Amazon S3 | Apache Airflow | Azure | DBTFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeSão Bernardo do Campo, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAWS S3 | Apache Airflow | DBT | Git | JSONAnnual learning budget | Flexible hours | Internal tech talks | Local support | MentorshipSenior-level Full TimeCampinas, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAWS | Amazon S3 | Apache Airflow | Azure | DBTAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimePorto Alegre, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAWS S3 | Apache Airflow | Customer Data | Customer Data Platform | DBTAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeBrasília, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAmazon Web Services | Apache Airflow | DBT | Data Modeling | Data TransformationCollaborative culture | Flexible hours | Learning budget | Local support programs | MentorshipSenior-level Full TimeCuritiba, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAWS S3 | Apache Airflow | Customer Data | Customer Data Platform | DBTAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | Local supportSenior-level Full TimeSão Paulo, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAPI Integration | AWS S3 | Apache Airflow | Cloud Data | Cloud Data WarehouseAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeSorocaba, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAWS S3 | Apache Airflow | Customer Data | Customer Data Platform | DBTAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeRecife, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAPI Integration | AWS S3 | Amazon Web Services | Apache Airflow | DBTAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeBelo Horizonte, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAWS S3 | Apache Airflow | Customer Data | Customer Data Platform | DBTAnnual learning budget | Flexible hours | Local support programs | Mentorship | Remote workSenior-level Full TimeFlorianópolis, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAWS S3 | Apache Airflow | DBT | ETL | JSONFlexible hours | Learning budget | Local support | Mentorship | Remote workSenior-level Full TimeRio de Janeiro, Brazil2d ago
-
Senior Data Engineer ID82547 BRL 304K-370KAWS S3 | Amazon Web Services | Apache Airflow | DBT | Data ModelingAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | Local well being programsSenior-level Full TimeSalvador, Brazil2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive salary | Entrepreneurial team | Remote-friendlyMid-level Full TimeSalvador, Brazil2d ago
-
SR Data Engineer - Indaiatuba/SP BRL 70K-88KAPI Development | API Gateway | AWS Cloud | AWS Lambda | Agentic patternsCorporate university | Dental insurance | Gym membership | Health insurance | Life insuranceSenior-level Full TimeIndaiatuba,Sao Paulo,Brazil2d ago