PIPELINE - Senior Principal Consultant (Dados + PySpark + Airflow)
SAO PAULO, SP, Brazil
BRL 119K-119K (estimate) Senior-level Full Time
Tasks
- Build orchestrate and monitor workflows
- Design, develop, and maintain data pipelines
- Integrate multiple data sources
Perks/Benefits
Skills/Tech-stack
AWS Athena | Airflow | Autonomous Database | Avro | Cloudera | Data Flow | Databricks | Git | Google BigQuery | JSON | OCI Data Flow | OCI Object Storage | OCI Streaming | ORC | Object storage | Oracle Database | Parquet | PySpark | SQL
Education
Roles
Related jobs
-
ADLS Gen2 | Apache Spark | Auto Loader | Azure | Azure DataSenior-level Full TimeAlphaville - Barueri, BR, 06.454-000 R11h ago
-
APIs | Airbyte | Airflow | DBT | Data ModelingFully remote | Home office setup budget | Language learning sessions | Paid sick days | Paid time offSenior-level Full TimeBrazil R1d ago
-
Fullstack AI Engineer BRL 230K-270KAI Foundry | AI Observability | AI Search | App Service | Azure AIWork from homeSenior-level Full TimeBrazil1d ago
-
Lead Data Engineer BRL 234K-300KApache Kafka | Azure Databricks | Azure Event | Azure Event Hubs | CI/CDWork from homeSenior-level Full TimeBrazil1d ago
-
Senior Machine Learning Engineer BRL 234K-295KAWS | Automated retraining | Azure | CI/CD | DatabricksWork from homeSenior-level Full TimeBrazil1d ago
-
Engenheiro(a) de Dados – CX Hub LATAM BRL 18K-18KAzure Data | Azure Data Factory | Data Factory | Data Governance | Data LakeSenior-level Full TimeWT - 2236 Torre B, Brazil1d ago
-
Engenharia de Dados AWS Pl/Sr - 132783 BRL 108K-118KAWS | AWS Glue | Apache Spark | Automated testing | Data LakeSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
[Job-29095] Engenheiro de Dados Sênior , Brazil BRL 18K-18KAzure Data | Azure Data Services | Azure ML | CI/CD | Data LakeChildcare assistance | Dental insurance | Discount platform | Employee performance bonus | Extended parental leaveSenior-level Full TimeBrazil1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsMid-level Full TimeManaus, Brazil1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data QualityEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeJoão Pessoa, Brazil1d ago
-
AWS | Amazon Redshift | DBT | Data Architecture | Data LakesFlextime | Growth roadmaps | Mentorship | Office options | Remote optionsMid-level Full TimeSão Luís, Brazil1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data ModelingFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksMid-level Full TimeTeresina, Brazil1d ago
-
AWS | Algorithms | Amazon Redshift | DBT | Data LakeEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeCampo Grande, Brazil1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsMid-level Full TimeNiterói, Brazil1d ago
-
AWS | Amazon Redshift | DBT | Data Engineering | Data LakesFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimeAracaju, Brazil1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsMid-level Full TimeSão José dos Campos, Brazil1d ago
-
AWS | Algorithms | Amazon Redshift | Computer Science | Computer science fundamentalsEducation budget | Fitness budget | Flextime | Growth roadmaps | MentorshipMid-level Full TimeMaceió, Brazil1d ago
-
AWS | Amazon Redshift | DBT | Data Lakes | Data QualityEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeUberlândia, Brazil1d ago
-
AWS | Amazon Redshift | Continuous Improvement | DBT | Data LakesEducation budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipMid-level Full TimeCuiabá, Brazil1d ago
-
AWS | Amazon Redshift | Amazon Web Services | DBT | Data LakesEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeGoiânia, Brazil1d ago
-
AWS | DBT | Data Architecture | Data Lakes | Data QualityEducation budget | Fitness budget | Flextime | Growth roadmaps | MentorshipMid-level Full TimeFortaleza, Brazil1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsMid-level Full TimeLondrina, Brazil1d ago
-
AWS | Amazon Redshift | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeRibeirão Preto, Brazil1d ago
-
Amazon Redshift | Amazon Web Services | Computer Science | Computer science fundamentals | DBTEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeBelém, Brazil1d ago
-
AWS | Amazon Redshift | DBT | Data Architecture | Data LakesEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeJoinville, Brazil1d ago