Lead Data Engineer ID71008
Tasks
- Define DAG dependencies and triggers
- Define partitioning strategy
- Design ETL pipelines
- Design file formats and schema
- Drive AWS data lake architecture
- Implement near real time processing
- Lead engineering team and enforce code quality
- Orchestrate scheduled batch workflows with Airflow
- Review pull requests and ensure maintainability
- Validate extracted transformed data
Perks/Benefits
- Annual learning budget
- Flexible hours
- Internal TechTalks
- Mentorship
- People focused support
- Performance and compensation reviews
- Remote work
- Well-being programs
Skills/Tech-stack
AWS Bedrock | AWS Step Functions | Amazon S3 | Apache Airflow | Athena | BigQuery | Caching | ClickHouse | Dagster | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | Langchain | Luigi | ORC | Parquet | Poetry | PostgreSQL | Prefect | Presto | Pydantic AI | Python | REST | React | Redis | Serverless | Snowflake | Spark SQL | Step Functions | Trino | TypeScript | YARN
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
AWS Bedrock | Amazon Neptune | Amazon S3 | Clean Code | GitHybrid workMid-level Full TimeSão Paulo, Brasil5h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAI Assisted Development | AWS | Airflow | Amazon S3 | AthenaAnnual performance reviews | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeRio de Janeiro, Brazil6h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAmazon S3 | Apache Airflow | Athena | BigQuery | ClickHouseAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | No micromanagementSenior-level Full TimePorto Alegre, Brazil6h ago
-
Lead Data Engineer ID71008 BRL 305K-390KApache Airflow | Athena | ClickHouse | Cost Optimization | DAGAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeCampinas, Brazil6h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAWS | Airflow | Amazon Athena | Apache Spark | BigQueryAnnual learning budget | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeRecife, Brazil6h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Collaborative culture | Flexible hours | Growth opportunities | Internal TechTalksSenior-level Full TimeCuritiba, Brazil6h ago
-
Lead Data Engineer ID71008 BRL 305K-390KAI Assisted Development | AI-Assisted Development Tools | AWS Bedrock | Amazon Athena | Amazon EKSAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeSorocaba, Brazil6h ago
-
Azure | Data Factory | Data Governance | Data Modeling | Data QualityCorporate English classes | Learning platforms | Professional development opportunities | Remote workSenior-level Full TimeBrazil R17h ago
-
AWS | Analytics engineering | Apache Airflow | Cloud platform | DBTFlexible remote environment | Fully remote work | International team collaboration | Long term opportunityMid-level Full TimeBrazil R17h ago
-
AWS | Amazon Kinesis | Apache Kafka | Apache Spark | Data DeduplicationRemote workMid-level Full TimeBrazil R17h ago
-
Analytics | Change Data Capture | Cloud Native | Data Architecture | Data CaptureFlexible medical insurance | Life insurance | Retirement options | Volunteer programsSenior-level Full TimeSAO PAULO, SP, Brazil21h ago
-
AWS | Apache Airflow | Apache Spark | CI/CD | Cloud ComputingMid-level Full TimeSão Paulo, Brazil1d ago
-
Sr Data Engineer - Pessoa com deficiência (PCD) BRL 54K-60KAPIs | Batch Processing | BigQuery | Data pipeline | GitCareer growth | Hybrid work | Learning opportunities | Team collaboration | Workplace flexibilitySenior-level Full TimeSudeste,Brazil R1d ago
-
Tech Lead Java Backend Developer BRL 234K-300KAPI Gateway | AWS | AWS Lambda | AWS Serverless | AWS Serverless ArchitectureRemote workSenior-level Full TimeBrazil1d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Glue Catalog | AWS LambdaAgile collaboration | Flexible work hours | Fully remote | Technical autonomySenior-level Contract Full TimeBrazil R1d ago
-
AWS | Agentic AI | Amazon Bedrock | Audit Logging | AuthenticationChildcare assistance | Continuous learning opportunities | Discounts through partner programs | Extended parental leave | Extended parental leave benefitsSenior-level Full TimeBrazil1d ago
-
AlloyDB | Bash | CDC | Cloud Bigtable | Cloud SQLCollaboration with enterprise customers | Exposure to advanced cloud technologies | Opportunity for large scale transformation projects | Professional growth | Remote work flexibilitySenior-level Full TimeBrazil R1d ago
-
Data Engineer (CRM) USD 85K-97KApache Airflow | Cloud platform | DBT | Data Governance | Data ModelingAgile team collaboration | English communication environment | Remote workMid-level Full TimeBrazil / Colombia / Argentina / … R1d ago
-
Analytics Engineer BRL 119K-119KAirflow | BigQuery | CI/CD | Cloud platform | DBTDental insurance | Gym membership | Health insurance | Home office | Life insuranceEntry-level Full TimeSão Paulo, Brazil1d ago
-
Data QA Engineer – Enterprise Data | Brazil BRL 212K-270KApache JMeter | Data Normalization | Data Warehousing | Database Indexing | Database TestingFlexible scheduling | Paid time off | Remote work | Work autonomyMid-level Full TimeSão Paulo R1d ago
-
AWS Athena | AWS EC2 | AWS EMR | AWS Kinesis | AWS LambdaCareer Development Programs | Childcare support | Dental insurance | Extended family leave | Food VoucherMid-level Full TimeSão Paulo, São Paulo, Brazil2d ago
-
AWS | Apache Airflow | Apache Spark | CI/CD | Data ContractsMid-level Full TimeSão Paulo, Brazil2d ago
-
Senior-level Full TimeRio de Janeiro R2d ago
-
Senior Data Engineer (Databricks, Spark) BRL 319K-396KAWS Glue | AWS Lake | AWS Lake Formation | Amazon S3 | Apache IcebergHybrid work | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeSão Paulo, Brazil2d ago
-
[Job-30696] Senior GenAI Engineer, Brazil BRL 234K-275KAWS | Agentic AI | Amazon Bedrock | Authentication | AzureChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrazil2d ago