Data Engineer Manager | Azure Databricks
Sao Paulo, Torre Paineira, Brazil
BRL 96K-119K (estimate) Mid-level Full Time
Tasks
- Build batch data ingestion pipelines
- Collaborate with multidisciplinary teams in Agile
- Convert legacy scripts to modern data architectures
- Create scalable resilient data pipelines with Apache Spark and Databricks
- Develop data migration workloads to Azure Databricks
- Develop data transformations with Python SQL and Spark
- Ensure data quality, traceability, and documentation
- Follow architecture standards and technical leadership patterns
- Implement ETL/ELT pipelines
- Implement data observability monitoring and governance
- Integrate with corporate systems APIs and relational databases
- Model data for Lakehouse using Delta Lake
- Modernize Python scripts
- Run unit and integration tests for migrated assets
- Support UAT stabilization and defect fixing
Perks/Benefits
- Birthday off
- Career mentoring
- Childcare assistance
- Life insurance
- Meal allowance
- Medical and dental insurance
- Multibenefit card
- Private pension
- Vehicle for managerial level
- Wellbeing Sessions
Skills/Tech-stack
Agile | Apache Spark | Azure | Azure Databricks | Cloudera | Delta Lake | ELT | ETL | Git | Hadoop | Kanban | Python | REST APIs | Relational databases | SQL | Scrum
Education
N/A
Language: pt
Views: 0
Clicks: 0
Saves: 0
Related jobs
-
AI Agents | Automation | CI/CD | Cloud Computing | Distributed SystemsCareer advancement | Collaborative globally distributed team | Flexible working arrangements | Fully remote | Inclusive workplace cultureSenior-level Full TimeBrazil R2d ago
-
Coordenador de Dados - Customer Intelligence BRL 117K-160KA/B | A/B Testing | AWS | B testing | Causal InferenceSenior-level Full TimeSão Paulo, Brazil2d ago
-
Applied Data Science Manager BRL 90K-99KAgile | Apache Spark | Artificial Intelligence | Hadoop | Machine LearningBirthday off | Flexible working hours | Work-life balanceMid-level Full TimeSao Paulo5d ago
-
Data Analytics Lead - Veeva Ostro BRL 305K-390KAI readiness | Data Architecture | Data Modeling | Data integration | Data setsLeadership opportunities | Team mentorship | Work from home flexibilitySenior-level Full TimeBrazil - São Paulo R5d ago
-
Gerente de Dados e Analytics BRL 80K-80KAWS | Apache Spark | Power BI | Python | SQLChildcare assistance | Dental insurance | EAP | Health insurance | Meal allowanceMid-level Full TimeSão Paulo, São Paulo, Brazil6d ago
-
Data Engineer II BRL 60K-60KApache Spark | Data Modeling | Data Quality | Data Warehousing | DatabricksFlexible work environment | Remote workEntry-level Full TimeSao Caetano do Sul, Brazil6d ago
-
Tech Lead – Engenharia de Dados I BRL 180K-213KAWS | Amazon Web Services | Cloud infrastructure | Cost Optimization | Data ArchitectureSenior-level Full TimeSão Paulo, Brazil7d ago
-
Automation | Causal Inference | Clustering | Databricks | Early WarningChildcare support | Corporate university | Dental insurance | Educational partnerships | Extended maternity leaveMid-level Full TimeOSASCO, Brazil; CURITIBA, PR, Brazil; OSASCO, …7d ago
-
AWS Glue | AWS IAM | Amazon EMR | Amazon Redshift | Amazon S3Birthday day off | Childcare support | Dental insurance | Gym membership | Health insuranceSenior-level Full TimeBelo Horizonte, MG; Curitiba, PR; Recife, …7d ago
-
Manager – Data Analytics and Risk Monitoring BRL 105K-170KAML | Dashboard Development | Data Visualization | Data analytics | ExcelSenior-level Full TimeSao Paulo, SP, Brazil7d ago
-
Chapter Lead Data Analytics BRL 183K-183KAgile | CI/CD | DAX | Data Governance | Data ModelingCasual office and dress code | Childcare subsidies | Days off | Dental insurance | Discounts on productsSenior-level Full TimeSão Paulo (SP) OR Campinas (SP)7d ago
-
Analista Sênior de Engenharia de Dados BRL 22K-23KAPI Development | Cloud Computing | Data Lakes | Data Monitoring | Data WarehousingChildcare assistance | Dental insurance | Extended maternity leave | Extended paternity leave | GympassMid-level Full TimeSao Paulo, Torre Paineira, Brazil8d ago
-
A/B | A/B Testing | Airflow | Azure | Azure DataChildcare support | Day off for anniversary | Dental plan | Extended parental leave | Flexible benefitsMid-level Full TimeSão Paulo, Brasil R8d ago
-
Senior Product Manager - AI Solutions (Brazil Based) BRL 210K-210KAI Governance | AML | API | Agent workflows | AgileSenior-level Full TimeSão Carlos, SP, Brazil12d ago
-
Senior Product Manager - AI Solutions BRL 210K-210KAPI Development | Agent Orchestration | Agile | Artificial Intelligence | AuditabilitySenior-level Full TimeSão Carlos, SP, Brazil12d ago
-
AI & Data Science Manager BRL 100K-139KAgent systems | BigQuery | CI/CD | Cloud Storage | FinOpsDaycare assistance | Dental plan | Discount on insurance | Discount on products | Employee assistance programMid-level Full TimeSão Paulo,São Paulo,BRA13d ago
-
Coordenador de Dados | Projetos BRL 72K-80KAgile | Amazon Web Services | CI/CD | Cloud platform | GitHubDental insurance | Employee discounts | Health insurance | Life insurance | Maternity leaveMid-level Full TimeSão Paulo, Brasil14d ago
-
LATAM Geo Leader, Generative AI Innovation Center BRL 234K-295KAnomaly Detection | Artificial Intelligence | Automated Analytics | Bias detection | ClassificationCareer growth | Flexible work hours | Inclusive team culture | Mentorship | Work-life balanceSenior-level Full TimeSao Paulo, Sao Paulo, BRA19d ago
-
Gerente de Dados | Senior Manager 2 [tag01] BRL 54K-72KAnalytics | Business Intelligence | Consultative selling | Data Architecture | Data GovernanceSenior-level Full TimeAA - São Paulo, Brazil20d ago
-
Senior Manager, Visa Consulting and Analytics (VCA), Core Consulting Practice, São Paulo or Brasilia, Brazil BRL 140K-146KAgile | Business Process | Business process improvement | Communication | ConsultingBi lingual support | Collaborative team environment | In-office work scheduleSenior-level Full TimeBrasilia, Brazil21d ago
-
Arquitetura de Dados | Híbrido/SP - 135094 BRL 118K-118KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageHybrid work modelSenior-level Full TimeAlphaville - Barueri, BR, 06.454-000 R22d ago
-
AWS | Amazon DynamoDB | Amazon Elasticsearch | Amazon Kinesis | Amazon RedshiftSenior-level Full TimeSao Paulo, Sao Paulo, BRA23d ago
-
Data Product Manager | Machine Learning Platform BRL 98K-107KAzure | CI/CD | Confluence | Data Drift | Data Drift DetectionChildcare subsidies | Dental insurance | Discounts on company products | Health insurance | Language and training platformsMid-level Full TimeRemote, Brazil R26d ago
-
Artificial Intelligence | Cloud Computing | Data Architecture | Data Engineering | Data ModelingEmployee wellbeing programs | Inclusion and diversity | Psychological safety culture | Remote workSenior-level Full TimeRemoto, Brasil R28d ago
-
AI | Backend Development | BigQuery | Data Science | JavaMid-level Full TimeSudeste,Brazil28d ago