Supervisor em Engenharia de Dados
BRLink - Tamboré, Brazil
BRL 54K-60K (estimate) Senior-level Full Time
Tasks
- Automate data pipelines
- Collaborate with Databricks vendor
- Create unit tests for pipelines
- Define data development best practices
- Design Lakehouse architecture
- Develop solution architectures for proposals
- Ensure data compliance
- Implement CI/CD for data
- Implement data architecture with Databricks
- Implement data governance policies
- Implement data security controls
- Implement infrastructure-as-code
- Lead technical team
- Optimize Spark cluster performance
- Optimize data partitioning
- Support delivery of AI and BI use cases
- Support pre-sales technical presentations
- Troubleshoot batch processing pipelines
- Troubleshoot streaming pipelines
- Tune spark queries
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Batch Processing | CI/CD | Data Compliance | Data Governance | Data Security | Data pipeline | Data pipeline automation | Databricks | Infrastructure as Code | Lakehouse Architecture | Partitioning | Pipeline Automation | Query Optimization | Streaming | Troubleshooting | Unit Testing | “as-code”
Education
N/A
Related jobs
-
AWS | Agile | Apache Spark | Azure DevOps | Cloud ComputingBirthday day off | Childcare support | Dental insurance | Education incentives | Employee discounts platformSenior-level Full TimeSão Paulo JK, SP, BR, 04543-0113d ago
-
Analista de Dados II - 135491 BRL 108K-119KAWS Glue | Amazon Athena | Amazon EMR | Amazon MSK | Amazon RedshiftMid-level Full TimeAlphaville - Barueri, BR, 06.454-0003d ago
-
Coordenador de Dados BRL 24K-24KAgile | Architecture | Business Intelligence | Data Governance | Data ModelingChildcare assistance | Dental insurance | Gym membership | Health insurance | Life insuranceSenior-level Full TimeBelo Horizonte, Minas Gerais, Brasil R4d ago
-
Lead Data Engineer (Brazil Based) BRL 234K-368KAI machine learning | AWS | AWS Glue | Amazon Athena | Amazon S3English language support | Travel opportunitiesSenior-level Full TimeSão Carlos, SP, Brazil4d ago
-
Coordenador de Dados - Customer Intelligence BRL 23K-23KA/B | A/B Testing | AWS | B testing | Causal InferenceMid-level Full TimeSão Paulo, Brazil4d ago
-
Analista Sênior de Engenharia de Dados e IA BRL 24K-31KABAC | AWS Glue | Access Management | Agent Orchestration | Amazon AthenaChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity and paternity leave | Health insuranceSenior-level Full TimeSão Paulo, Brasil R4d ago
-
Analytics | Automation | Business Intelligence | Customer Retention | DashboardingChildcare support | Day off | Dental insurance | Discount program | Food cardEntry-level Full TimeSão Paulo, Brasil R5d ago
-
AI Agents | Automation | CI/CD | Cloud Computing | Distributed SystemsCareer advancement | Collaborative globally distributed team | Flexible working arrangements | Fully remote | Inclusive workplace cultureSenior-level Full TimeBrazil R7d ago
-
Coordenador de Dados - Customer Intelligence BRL 117K-160KA/B | A/B Testing | AWS | B testing | Causal InferenceSenior-level Full TimeSão Paulo, Brazil8d ago
-
Applied Data Science Manager BRL 90K-99KAgile | Apache Spark | Artificial Intelligence | Hadoop | Machine LearningBirthday off | Flexible working hours | Work-life balanceMid-level Full TimeSao Paulo11d ago
-
Gerente de Dados e Analytics BRL 80K-80KAWS | Apache Spark | Power BI | Python | SQLChildcare assistance | Dental insurance | EAP | Health insurance | Meal allowanceMid-level Full TimeSão Paulo, São Paulo, Brazil11d ago
-
AWS | Alerting | Azure | BI | Cloud platformSenior-level Full TimeBarueri, São Paulo, Brasil11d ago
-
Data Engineer II BRL 60K-60KApache Spark | Data Modeling | Data Quality | Data Warehousing | DatabricksFlexible work environment | Remote workEntry-level Full TimeSao Caetano do Sul, Brazil11d ago
-
Tech Lead – Engenharia de Dados I BRL 180K-213KAWS | Amazon Web Services | Cloud infrastructure | Cost Optimization | Data ArchitectureSenior-level Full TimeSão Paulo, Brazil12d ago
-
Automation | Causal Inference | Clustering | Databricks | Early WarningChildcare support | Corporate university | Dental insurance | Educational partnerships | Extended maternity leaveMid-level Full TimeOSASCO, Brazil; CURITIBA, PR, Brazil; OSASCO, …12d ago
-
AWS Glue | AWS IAM | Amazon EMR | Amazon Redshift | Amazon S3Birthday day off | Childcare support | Dental insurance | Gym membership | Health insuranceSenior-level Full TimeBelo Horizonte, MG; Curitiba, PR; Recife, …13d ago
-
Chapter Lead Data Analytics BRL 183K-183KAgile | CI/CD | DAX | Data Governance | Data ModelingCasual office and dress code | Childcare subsidies | Days off | Dental insurance | Discounts on productsSenior-level Full TimeSão Paulo (SP) OR Campinas (SP)13d ago
-
Bank Central Regulations | COBIT | DAMA-DMBOK | DCAM | Data GovernanceAnnual bonus program | Birthday off | Childcare support | Dental insurance | Financial consultingMid-level Full TimeSão Paulo, Brasil R13d ago
-
Data Product Manager (DPM) - Sênior BRL 18K-18KAWS | Agile | Amazon Athena | Analytics | Artificial IntelligenceAlura | PLR | Remote workMid-level ContractBelo Horizonte, MG13d ago
-
A/B | A/B Testing | Airflow | Azure | Azure DataChildcare support | Day off for anniversary | Dental plan | Extended parental leave | Flexible benefitsMid-level Full TimeSão Paulo, Brasil R14d ago
-
Data Engineering Manager | Data Platform BRL 13K-18KApache Airflow | Apache Iceberg | CI/CD | Cloud platform | Data ComplianceDental insurance | Education benefit | Gym access | Health insurance | Home officeMid-level Full TimeSão Paulo, Brazil17d ago
-
AI Governance | AI RMF | Access Control | Apache Kafka | Azure DataCorporate university | Creche allowance | Day off | Dental insurance | Diversity programSenior-level Full TimeBarueri, São Paulo, Brasil18d ago
-
Coordenador de Dados - Customer Intelligence BRL 117K-160KA/B | A/B Testing | AWS | B testing | Causal InferenceSenior-level Full TimeSão Paulo, Brazil18d ago
-
AI & Data Science Manager BRL 100K-139KAgent systems | BigQuery | CI/CD | Cloud Storage | FinOpsDaycare assistance | Dental plan | Discount on insurance | Discount on products | Employee assistance programMid-level Full TimeSão Paulo,São Paulo,BRA18d ago
-
Coordenador de Dados | Projetos BRL 72K-80KAgile | Amazon Web Services | CI/CD | Cloud platform | GitHubDental insurance | Employee discounts | Health insurance | Life insurance | Maternity leaveMid-level Full TimeSão Paulo, Brasil19d ago