Lead Data Engineer ID71008
Tasks
- Architect partitioning and file formats
- Collaborate with DevOps on requirements
- Define schema and data type strategy
- Design and own ETL pipelines
- Develop serverless query workflows with Athena
- Govern data lake architecture on S3
- Implement near real time processing for OLAP workloads
- Lead developers and align engineering practices
- Manage Kubernetes deployments with EKS
- Orchestrate DAG based workflows with Airflow
- Review pull requests and enforce code quality
Perks/Benefits
- Flexible hours
- Learning budget
- Mentorship
- People focused support
- Performance and compensation reviews
- Remote work
- Techtalks
- Wellbeing programs
Skills/Tech-stack
AWS Data | AWS Data Ecosystem | Amazon S3 | Apache Airflow | Athena | BigQuery | ClickHouse | DAG | Data Ecosystem | Data Lake | Data pipeline | Docker | EKS | ETL | FastAPI | File format | Flask | GraphQL | GraphQL API | Kubernetes | Near-real-time | Near-real-time Processing | OLAP | ORC | Parquet | Partitioning | PostgreSQL | Presto | Python | REST | REST API | Real-time Processing | Schema Design | Snowflake | Spark SQL | Time processing | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Databases | Docker | Kubernetes | LLMAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeSão Bernardo do Campo, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud | Databases | Deployment | DockerAnnual learning budget | Flexible hours | Health and well-being programs | Mentorship | People focused supportSenior-level Full TimeBrasília, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KAI machine learning | CI/CD | Cloud | Databases | DockerAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeSão Paulo, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud | Database | Docker | KubernetesChallenging projects | Collaborative culture | Flexible hours | Internal tech talks | Learning budgetSenior-level Full TimeFlorianópolis, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud Computing | Databases | Docker | KubernetesFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeCampinas, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud Computing | Databases | Docker | KubernetesFlexible hours | Internal tech talks | Learning budget | Mentorship | Remote workSenior-level Full TimePorto Alegre, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Claude Code | Cloud | Cursor | DatabaseAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeSalvador, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Claude Code | Cloud Computing | Code Quality | CursorAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeBelo Horizonte, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud Computing | Databases | Docker | KubernetesAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeRecife, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud | Databases | Docker | KubernetesAnnual learning budget | Challenging projects | Collaborative culture | Flexible hours | MentorshipSenior-level Full TimeRio de Janeiro, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud Computing | Databases | Docker | KubernetesFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeSorocaba, Brazil R21h ago
-
Senior Full Stack Engineer ID78855 BRL 319K-396KCI/CD | Cloud | Databases | Docker | KubernetesAnnual learning budget | Flexible hours | Mentorship | People focused support | Performance reviewsSenior-level Full TimeCuritiba, Brazil R21h ago
-
Senior Backend Software Engineer | AI Engine BRL 150K-181KAPI Design | AWS | AWS Lambda | Amazon SQS | Distributed SystemsFlexible work model | Health, dental, and life insurance | Home office reimbursement | Learning and development budget | Paid parental leaveSenior-level Full TimeBrazil (Remote) R1d ago
-
Senior-level Full TimeRemote - Brazil R1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EMRCollaborative environment | Continuous learning | Inclusive workplace | Professional development | Remote workSenior-level Full TimeBrazil R2d ago
-
Data Engineer BRL 120K-132KAWS | Apache Kafka | Apache Spark | CI/CD | Data ModelingInternational remote first environment | Professional growth opportunities | Remote workMid-level Full TimeBrasília, DF, Brazil R2d ago
-
Data Engineer BRL 136K-176KAWS | Apache Kafka | Apache Spark | CI/CD | Data ModelingInternational remote first environment | Professional growth | Remote workMid-level Full TimeBrasília, DF, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Amazon Athena | Amazon S3 | Apache Spark | BigQueryAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeBrasília, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeFlorianópolis, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS EKS | Amazon Athena | Amazon S3 | Apache Airflow | BigQueryFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeBelo Horizonte, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeRecife, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon EKS | Amazon S3 | Apache AirflowFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeRio de Janeiro, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS Data | AWS Data Ecosystem | Amazon EKS | Amazon S3 | Apache AirflowAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeSão Bernardo do Campo, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | Modern projectsSenior-level Full TimePorto Alegre, Brazil R2d ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon EKS | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Flexible hours | Local support | Mentorship | Remote workSenior-level Full TimeSalvador, Brazil R2d ago