PIPELINE - Senior Principal Consultant (Dados + PySpark + Airflow)
SAO PAULO, SP, Brazil
BRL 119K-119K (estimate) Senior-level Full Time
Tasks
- Build orchestrate and monitor workflows
- Design, develop, and maintain data pipelines
- Integrate multiple data sources
Perks/Benefits
Skills/Tech-stack
AWS Athena | Airflow | Autonomous Database | Avro | Cloudera | Data Flow | Databricks | Git | Google BigQuery | JSON | OCI Data Flow | OCI Object Storage | OCI Streaming | ORC | Object storage | Oracle Database | Parquet | PySpark | SQL
Education
Roles
Related jobs
-
Data Engineer BRL 120K-144KClassification | Clustering | DAX | Data Modeling | Data VisualizationCasual office dress code | Childcare subsidies | Clube Ben partnership | Days off | Dental insuranceMid-level Full TimeCampinas, São Paulo, Brazil14h ago
-
Senior Data Engineer BRL 304K-370KAWS Lambda | Amazon RDS | Amazon S3 | Amazon Web Services | Apache SparkEquipment stipend | Flexible PTO | Learning and development stipend | Paid certifications exams | Professional development planSenior-level Full TimeBRAZIL R15h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAmazon Web Services | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBelo Horizonte, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimePorto Alegre, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeCampinas, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeSão Bernardo do Campo, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeRecife, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeFlorianópolis, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeSão Paulo, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSalvador, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeSorocaba, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBrasília, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAmazon Web Services | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipSenior-level Full TimeRio de Janeiro, Brazil20h ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimeCuritiba, Brazil20h ago
-
API Integration | AWS S3 | Apache Airflow | CI/CD | DBTEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapMid-level Full TimeCuritiba, Brazil20h ago
-
BI Dashboards | Compliance analytics | Excel | Fraud Detection | KPIsDental insurance | Gym membership | Health insurance | Home office | Hybrid workSenior-level Full TimeSão Paulo, Brazil23h ago
-
Airflow | Automated testing | BigQuery | CI/CD | Cloud ComposerRemote workMid-level Full TimeRemoto, Brasil R1d ago
-
Staff Data Engineer BRL 325K-443KAWS Glue | AWS Glue Catalog | Amazon MWAA | Amazon S3 | Apache AirflowRemote workSenior-level Full TimeSão Paulo, SP, Brazil R1d ago
-
Sr Analytics Engineer BRL 230K-295KAmazon Redshift | Apache Spark | DBT | Data Governance | Data MartsDental insurance | Health insurance | Home-office allowance | Language classes | Life insuranceSenior-level Full TimeBrazil - Remote R2d ago
-
CI/CD | Cloud Computing | Data Modeling | Dynamic Chunking | EmbeddingsChildcare support | Dental insurance | Fitness membership | Food Voucher | Health insuranceMid-level Full TimeSão Paulo, Brazil2d ago
-
Senior DataOps Engineer BRL 234K-275KAWS | Airflow | Alerting | CI/CD | DockerBirthday off | Discounts | English program | Extended maternity and paternity leave | Flexible hoursSenior-level Full TimeVitória, Espírito Santo2d ago
-
AWS Bedrock | AWS EKS | Agent systems | Apache Airflow | Apache SparkChildcare support | Dental insurance | Employee assistance program | Health insurance | Life insuranceMid-level Full TimeRio de Janeiro, Rio de Janeiro, …2d ago
-
DataOps Engineer BRL 234K-275KAWS | Alerting | Amazon EC2 | Amazon EKS | Amazon EMRDental insurance | Extended maternity leave | Extended paternity leave | Flexible hours | Health insuranceSenior-level Full TimeVitória, Espírito Santo2d ago
-
Engenheiro(a) de Dados Pleno BRL 23K-23KAWS | AWS Step Functions | Alerting | Apache Airflow | AzureDEI programs | Reward & recognition | Volunteering | Wellness | Work-life balanceEntry-level Full TimeSão Paulo, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksMid-level Full TimeSalvador, Brazil2d ago