Lead Data Engineer ID71008
Belo Horizonte, Brazil
R
BRL 319K-396K (estimate) Senior-level Full Time
Tasks
- Build and govern Airflow pipelines
- Coordinate with DevOps on requirements
- Define OLAP data architecture
- Deploy and manage AWS data stack
- Design ETL pipelines
- Design schema and data type strategy
- Develop data lake on object storage
- Implement near real time processing
- Lead and mentor developers
- Make partitioning and file format decisions
- Orchestrate batch workflows with DAGs
- Own data pipeline
- Review pull requests and enforce code quality
- Run serverless queries with Athena
Perks/Benefits
- Flexible hours
- Learning budget
- Mentorship
- Performance reviews
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
AWS EKS | Amazon Athena | Amazon S3 | Apache Airflow | BigQuery | ClickHouse | DAG | Data Lake | Data Pipelines | Docker | ETL | FastAPI | Flask | GraphQL | Kubernetes | Near-real-time | Near-real-time Processing | OLAP | ORC | Parquet | PostgreSQL | Presto | Python | REST | Real-time Processing | Schema Design | Snowflake | Spark SQL | Time processing | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Databases | Docker | Kubernetes | LLMAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeSão Bernardo do Campo, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud | Databases | Deployment | DockerAnnual learning budget | Flexible hours | Health and well-being programs | Mentorship | People focused supportSenior-level Full TimeBrasília, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KAI machine learning | CI/CD | Cloud | Databases | DockerAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeSão Paulo, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud | Database | Docker | KubernetesChallenging projects | Collaborative culture | Flexible hours | Internal tech talks | Learning budgetSenior-level Full TimeFlorianópolis, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud Computing | Databases | Docker | KubernetesFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeCampinas, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud Computing | Databases | Docker | KubernetesFlexible hours | Internal tech talks | Learning budget | Mentorship | Remote workSenior-level Full TimePorto Alegre, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Claude Code | Cloud | Cursor | DatabaseAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeSalvador, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Claude Code | Cloud Computing | Code Quality | CursorAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeBelo Horizonte, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud Computing | Databases | Docker | KubernetesAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeRecife, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud | Databases | Docker | KubernetesAnnual learning budget | Challenging projects | Collaborative culture | Flexible hours | MentorshipSenior-level Full TimeRio de Janeiro, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud Computing | Databases | Docker | KubernetesFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeSorocaba, Brazil R20h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud | Databases | Docker | KubernetesAnnual learning budget | Flexible hours | Mentorship | People focused support | Performance reviewsSenior-level Full TimeCuritiba, Brazil R20h ago
-
Senior Backend Software Engineer | AI Engine BRL 150K-181KAPI Design | AWS | AWS Lambda | Amazon SQS | Distributed SystemsFlexible work model | Health, dental, and life insurance | Home office reimbursement | Learning and development budget | Paid parental leaveSenior-level Full TimeBrazil (Remote) R1d ago
-
Senior-level Full TimeRemote - Brazil R1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EMRCollaborative environment | Continuous learning | Inclusive workplace | Professional development | Remote workSenior-level Full TimeBrazil R2d ago
-
Data Engineer BRL 120K-132KAWS | Apache Kafka | Apache Spark | CI/CD | Data ModelingInternational remote first environment | Professional growth opportunities | Remote workMid-level Full TimeBrasília, DF, Brazil R2d ago
-
Data Engineer BRL 136K-176KAWS | Apache Kafka | Apache Spark | CI/CD | Data ModelingInternational remote first environment | Professional growth | Remote workMid-level Full TimeBrasília, DF, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Amazon Athena | Amazon S3 | Apache Spark | BigQueryAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeBrasília, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeFlorianópolis, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeRecife, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon EKS | Amazon S3 | Apache AirflowFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeRio de Janeiro, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS Data | AWS Data Ecosystem | Amazon EKS | Amazon S3 | Apache AirflowAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeSão Bernardo do Campo, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | Modern projectsSenior-level Full TimePorto Alegre, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon EKS | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Flexible hours | Local support | Mentorship | Remote workSenior-level Full TimeSalvador, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Airflow | Amazon S3 | Apache Airflow | AthenaChallenging projects | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeCampinas, Brazil R2d ago