Lead Data Engineer ID71008
Belo Horizonte, Brazil
BRL 319K-396K (estimate) Senior-level Full Time
Tasks
- Define partitioning strategy and file formats
- Design and own ETL pipelines
- Design schema and data type strategy
- Drive AWS data stack architecture
- Extract transform and validate data from databases and APIs
- Guide developers and align with engineering practices
- Implement near real time processing for OLAP workloads
- Orchestrate batch workflows with DAGs in Airflow
- Own analytics architecture for data lake workloads
- Partner with DevOps to clarify requirements
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Annual performance and compensation reviews
- Collaborative culture
- Flexible hours
- Local support
- Mentorship
- No micromanagement
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
AI Assisted Development | AI-Assisted Development Tools | AWS Step Functions | Amazon Bedrock | Amazon S3 | Apache Airflow | Athena | Caching | DAG | Dagster | Data Lake | Development tools | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | Langchain | Luigi | Machine Learning | Monorepo | Nx | OLAP | ORC | Parquet | Partitioning | Poetry | PostgreSQL | Prefect | Presto | Pydantic | Pydantic AI | Python | Query Optimization | REST | React | Redis | Schema Design | Serverless | Step Functions | Trino | TypeScript | UV | YARN
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | CRM | DBT | Data cloud | GCPAnnual learning budget | Collaborative culture | Flexible hours | Internal technical talks | MentorshipSenior-level Full TimeBelo Horizonte, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KApache Airflow | DBT | Data cloud | GCP | JiraCollaborative culture | Flexible hours | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeSorocaba, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | CRM data | DBT | Data Modeling | Data cloudFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeRecife, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAI Assisted Development | AI-Assisted Development Tools | Airflow | Amazon Athena | Amazon EKSAnnual learning budget | Collaborative culture | Flexible hours | Local well being programs | MentorshipSenior-level Full TimeSão Bernardo do Campo, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS Bedrock | Airflow | Amazon S3 | Athena | BigQueryAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeSão Paulo, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Amazon S3 | Apache Spark | Athena | BigQueryAnnual learning budget | Flexible hours | Learning budget | Local well being support | MentorshipSenior-level Full TimeSalvador, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAI Assisted Development | AI-Assisted Development Tools | AWS Athena | Airflow | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeBrasília, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS S3 | AWS Step Functions | Amazon Athena | Apache Airflow | BigQueryAnnual learning budget | Flexible hours | Mentorship | People focused support | Performance reviewsSenior-level Full TimeCampinas, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAI code assistant | AWS EKS | Amazon Athena | Amazon S3 | Apache AirflowAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeRecife, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Amazon S3 | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeCuritiba, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS Bedrock | Apache Airflow | Athena | BigQuery | CachingAnnual performance reviews | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimePorto Alegre, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | CRM | DBT | Data cloud | ELTAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeCampinas, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAI Assisted Development | AI code review | AI-Assisted Development Tools | Airflow | Amazon S3Annual learning budget | Flexible hours | Internal TechTalks | Mentorship | Performance reviewsSenior-level Full TimeFlorianópolis, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | DBT | Data Modeling | Data Quality | Data cloudFlexible hours | Internal tech talks | Learning budget | Mentorship | Performance reviewsSenior-level Full TimeSão Paulo, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KApache Airflow | CRM | DBT | Data cloud | ELTCollaborative culture | Dedicated learning time | Flexible hours | Learning budget | MentorshipSenior-level Full TimeFlorianópolis, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS S3 | Amazon Athena | Apache Airflow | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Mentorship | Remote work | TechtalksSenior-level Full TimeRio de Janeiro, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | CRM | DBT | Data Modeling | Data QualityCollaborative culture | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimePorto Alegre, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | CRM | DBT | Data cloud | GCPAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | Performance reviewsSenior-level Full TimeSão Bernardo do Campo, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | DBT | Data cloud | ELT | ETLAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | Performance reviewsSenior-level Full TimeBrasília, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | DBT | Data cloud | ELT | ETLCollaborative culture | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeRio de Janeiro, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | CRM | DBT | Data Modeling | Data cloudAnnual learning budget | Competitive compensation reviews | Flexible hours | Internal tech talks | MentorshipSenior-level Full TimeCuritiba, Brazil5h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Apache Spark | Athena | BigQuery | CI/CDAnnual learning budget | Dedicated learning budget | Flexible hours | Internal tech talks | MentorshipSenior-level Full TimeSorocaba, Brazil5h ago
-
Senior Data Engineer ID81652 BRL 319K-396KAirflow | DBT | Data Quality | Data cloud | GCPCollaborative culture | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeSalvador, Brazil5h ago
-
AWS | Access Control | Azure | CI/CD | DBTAgile collaborative environment | Data governance exposure | Fully remote | Opportunity to work with modern cloud data technologies | Professional growthMid-level Contract Full TimeBrazil R16h ago
-
Engenheiro(a) de Dados SR BRL 20K-31KAgile | Code review | Data Architecture | Data Engineering | Data LineageDiversity and inclusion | Inclusion for people with disabilitiesSenior-level Full TimeSão Paulo, Brazil1d ago