Engenheiro de Dados SR
Tasks
- Automate processes with RPA
- Build and maintain data lakes and lakehouse architectures
- Create pipelines for Analytics AI and Machine Learning
- Design and develop data pipelines with ETL and ELT
- Develop data pipelines with Python PySpark and Apache Spark
- Document data pipelines and data architectures
- Implement data quality practices
- Manage analytical tables with Apache Iceberg
- Orchestrate pipelines with Apache Airflow
- Query distributed systems with Trino
- Store data in MinIO
- Work with containerized environments with Docker
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Iceberg | Apache Spark | Data Lake | Data Quality | Distributed Systems | Docker | ELT | ETL | Lakehouse | Minio | NoSQL | PySpark | Python | RPA | SQL | Trino
Education
Roles
Related jobs
-
Mid-level Full TimeState of Rio Grande do Sul, …7h ago
-
AWS CloudFormation | Airflow | Amazon Kinesis | Amazon Redshift | BigQueryFlexible hours | Remote workMid-level Full TimeBrazil - Remote R21h ago
-
Senior Data Engineer BRL 234K-300KAgile | Analysis Services | Azure | Azure Analysis | Azure Analysis ServicesSenior-level Full TimeBrazil -Sao Paulo21h ago
-
Senior Data Engineer BRL 234K-300KAgile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataSenior-level Full TimeBrazil -Sao Paulo21h ago
-
Senior Data Engineer AI | Inglês BRL 78K-119KAzure Cognitive | Azure Cognitive Services | Azure Machine Learning | Cognitive Services | Data PipelinesSenior-level Full TimeBrazil - Sao Paulo1d ago
-
Senior-level Full TimeSão Paulo, Brazil1d ago
-
Data Architecture | Data Modeling | Data Normalization | Data pipeline | Dimensional ModelingMid-level Full TimeSão Paulo, SP, Brazil1d ago
-
Data Engineer BRL 120K-144KClassification | Clustering | DAX | Data Modeling | Data VisualizationCasual office dress code | Childcare subsidies | Clube Ben partnership | Days off | Dental insuranceMid-level Full TimeCampinas, São Paulo, Brazil1d ago
-
Data Engineer BRL 305K-385KAlerting | Apache Spark | Azure | CI/CD | Data GovernanceChildcare subsidies | Dental insurance | Health insurance | Language and training platforms | Life insuranceMid-level Full TimeCampinas, Brazil1d ago
-
Senior Data Engineer BRL 304K-370KAWS Lambda | Amazon RDS | Amazon S3 | Amazon Web Services | Apache SparkEquipment stipend | Flexible PTO | Learning and development stipend | Paid certifications exams | Professional development planSenior-level Full TimeBRAZIL R1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAmazon Web Services | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBelo Horizonte, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimePorto Alegre, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeCampinas, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeSão Bernardo do Campo, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeRecife, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeFlorianópolis, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeSão Paulo, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSalvador, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeSorocaba, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBrasília, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAmazon Web Services | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipSenior-level Full TimeRio de Janeiro, Brazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimeCuritiba, Brazil1d ago
-
API Integration | AWS S3 | Apache Airflow | CI/CD | DBTEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapMid-level Full TimeCuritiba, Brazil1d ago
-
BI Dashboards | Compliance analytics | Excel | Fraud Detection | KPIsDental insurance | Gym membership | Health insurance | Home office | Hybrid workSenior-level Full TimeSão Paulo, Brazil1d ago
-
Amazon Redshift | Canonical Metrics | DBT | Data Architecture | Data ModelingFully remote | Healthcare coverage | Home office equipment allowance | Learning and development budget | Paid parental leaveSenior-level Full TimeBrazil R1d ago