Lead Data Engineer ID71008
Florianópolis, Brazil
BRL 305K-390K (estimate) Senior-level Full Time
Tasks
- Define OLAP data architecture
- Define pipeline dependencies and triggering
- Design ETL pipelines
- Design data lake partitioning and file formats
- Drive AWS data stack architecture
- Extract transform validate data
- Govern schema and data types
- Implement near real time processing
- Lead developers and align engineering practices
- Orchestrate batch workflows with Airflow DAGs
- Partner with DevOps on requirements
- Review pull requests and enforce code quality
Perks/Benefits
- Annual learning budget
- Flexible hours
- Learning budget
- Mentorship
- Remote work
- Supportive culture
- Techtalks
- Wellbeing programs
Skills/Tech-stack
AWS | Airflow | Amazon S3 | Athena | BigQuery | ClickHouse | DAG | Data Lake | Data pipeline | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | Near-real-time | Near-real-time Processing | OLAP | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Presto | Python | Query engines | REST APIs | Real-time Processing | Schema Design | Serverless Query | Serverless Query Engines | Snowflake | Spark SQL | Time processing | Trino | Trino/Presto
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Senior Data Engineer (AI Data Platform) BRL 319K-443KApache Airflow | CI/CD | Clustering | Cost Optimization | DBTSenior-level Full TimeBrasília, DF, Brazil9h ago
-
App Maint Engineer BackEnd SQL/ETL Sr BRL 119K-119KCloud Data | DevOps | ETL | GitHub | SQLRemote workEntry-level Full TimeBrasil10h ago
-
AWS Bedrock | Amazon Neptune | Amazon S3 | Clean Code | GitHybrid workMid-level Full TimeSão Paulo, Brasil12h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAI Assisted Development | AWS | Airflow | Amazon S3 | AthenaAnnual performance reviews | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeRio de Janeiro, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAmazon S3 | Apache Airflow | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | No micromanagementSenior-level Full TimePorto Alegre, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KApache Airflow | Athena | ClickHouse | Cost Optimization | DAGAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeCampinas, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAWS | Airflow | Amazon Athena | Apache Spark | BigQueryAnnual learning budget | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeRecife, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Collaborative culture | Flexible hours | Growth opportunities | Internal TechTalksSenior-level Full TimeCuritiba, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAWS Bedrock | AWS Step Functions | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeBrasília, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAI Assisted Development | AI-Assisted Development Tools | AWS Bedrock | Amazon Athena | Amazon EKSAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeSorocaba, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAWS | Airflow | Amazon EKS | Amazon S3 | Apache AirflowAnnual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipSenior-level Full TimeBelo Horizonte, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAmazon Athena | Amazon EKS | Amazon S3 | Apache Airflow | Apache SparkAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | No micromanagementSenior-level Full TimeSão Bernardo do Campo, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAWS EKS | Amazon Athena | Amazon S3 | Apache Airflow | Code QualityAnnual learning budget | Flexible hours | Mentorship | Remote work | Support programsSenior-level Full TimeSão Paulo, Brazil14h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAmazon S3 | Apache Airflow | Athena | ClickHouse | DAGAnnual performance reviews | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeSalvador, Brazil14h ago
-
Azure | Data Factory | Data Governance | Data Modeling | Data QualityCorporate English classes | Learning platforms | Professional development opportunities | Remote workSenior-level Full TimeBrazil R1d ago
-
AWS | Analytics engineering | Apache Airflow | Cloud platform | DBTFlexible remote environment | Fully remote work | International team collaboration | Long term opportunityMid-level Full TimeBrazil R1d ago
-
AWS | Amazon Kinesis | Apache Kafka | Apache Spark | Data DeduplicationRemote workMid-level Full TimeBrazil R1d ago
-
Analytics | Change Data Capture | Cloud Native | Data Architecture | Data CaptureFlexible medical insurance | Life insurance | Retirement options | Volunteer programsSenior-level Full TimeSAO PAULO, SP, Brazil1d ago
-
SR Engenharia de Dados BRL 20K-31KAWS | Azure | CI/CD | Clustering | Data IngestionBYOD support | Corporate university courses | Dental insurance | Flexible device policy | Flexible scheduleSenior-level Full TimeBrasil1d ago
-
AWS | Apache Airflow | Apache Spark | CI/CD | Cloud ComputingMid-level Full TimeSão Paulo, Brazil1d ago
-
Sr Data Engineer - Pessoa com deficiência (PCD) BRL 54K-60KAPIs | Batch Processing | BigQuery | Data pipeline | GitCareer growth | Hybrid work | Learning opportunities | Team collaboration | Workplace flexibilitySenior-level Full TimeSudeste,Brazil R1d ago
-
Senior Data Engineer (Databricks, Spark) BRL 319K-396KApache Iceberg | Apache Spark | CI/CD | Data Monitoring | Data QualityHybrid work flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Recognition programSenior-level Full TimeSão Paulo, Brazil R1d ago
-
Tech Lead Java Backend Developer BRL 234K-300KAPI Gateway | AWS | AWS Lambda | AWS Serverless | AWS Serverless ArchitectureRemote workSenior-level Full TimeBrazil1d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Glue Catalog | AWS LambdaAgile collaboration | Flexible work hours | Fully remote | Technical autonomySenior-level Contract Full TimeBrazil R1d ago
-
AWS | Agentic AI | Amazon Bedrock | Audit Logging | AuthenticationChildcare assistance | Continuous learning opportunities | Discounts through partner programs | Extended parental leave | Extended parental leave benefitsSenior-level Full TimeBrazil1d ago