Lead Data Engineer ID71008
BRL 319K-396K (estimate) Senior-level Full Time
Tasks
- Coordinate requirements with DevOps team
- Create Airflow DAG workflows
- Define near real time OLAP processing
- Design data lake architecture
- Enforce code quality standards
- Govern schema and file format strategy
- Lead development team technical direction
- Orchestrate batch scheduled jobs
- Own ETL pipeline design
- Partition data lake datasets
- Review pull requests
Perks/Benefits
- Annual learning budget
- Flexible hours
- Mentorship
- People focused support
- Remote work
- Technical talks
- Well-being programs
Skills/Tech-stack
AWS Data | AWS Data Ecosystem | Amazon EKS | Amazon S3 | Apache Airflow | Athena | BigQuery | ClickHouse | Dagster | Data Ecosystem | Data Lake | Data pipeline | Docker | ETL | FastAPI | Flask | GraphQL | Kubernetes | Linux | Luigi | MacOS | Near-real-time | Near-real-time Processing | OLAP | ORC | Parquet | Partitioning | PostgreSQL | Prefect | Presto | Python | REST API | Real-time Processing | Schema Design | Snowflake | Spark SQL | Step Functions | Terminal Environments | Time processing | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Amazon Athena | Amazon S3 | Apache Spark | BigQueryAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeBrasília, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeFlorianópolis, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS EKS | Amazon Athena | Amazon S3 | Apache Airflow | BigQueryFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeBelo Horizonte, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeRecife, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon EKS | Amazon S3 | Apache AirflowFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeRio de Janeiro, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | Modern projectsSenior-level Full TimePorto Alegre, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon EKS | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Flexible hours | Local support | Mentorship | Remote workSenior-level Full TimeSalvador, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Airflow | Amazon S3 | Apache Airflow | AthenaChallenging projects | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeCampinas, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon S3 | Apache Airflow | Apache SparkFlexible hours | Internal technical talks | Learning budget | Mentorship | Performance and compensation reviewsSenior-level Full TimeSão Paulo, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS Data | AWS Data Ecosystem | Amazon S3 | Apache Airflow | AthenaFlexible hours | Learning budget | Mentorship | People focused support | Performance and compensation reviewsSenior-level Full TimeCuritiba, Brazil R11h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Amazon EKS | Amazon S3 | Apache Spark | AthenaAnnual learning budget | Competitive performance reviews | Flexible hours | Mentorship | People focused supportSenior-level Full TimeSorocaba, Brazil R11h ago
-
API | Amazon Web Services | Apache Airflow | Apache NiFi | BitbucketDental insurance | Discounts on courses and universities | Fully remote | Health insurance | Meal allowanceMid-level Full TimeBrazil R20h ago
-
Lead Data Scientist, AdTech BRL 300K-370KAWS | Adtech | Collaborative Filtering | Content-Based Filtering | Content-basedDiversity and inclusion focus | Remote-first cultureSenior-level Full TimeBelo Horizonte, Brazil (remote); Brasilia, Brazil … R21h ago
-
Lead Applied Scientist, Marketing BRL 305K-390KAWS | AdTech Algorithms | Collaborative Filtering | Content-Based Recommendation | Content-basedSenior-level Full TimeBelo Horizonte, Brazil (remote); Brasilia, Brazil … R21h ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3100 percent remote work | Annual learning budget | Flexible hours | Internal TechTalks | Local well being programsMid-level Full TimeSão Bernardo do Campo, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Collaborative culture | Flexible hours | Learning budget | Mentorship | Remote workMid-level Full TimeRecife, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Data CatalogFlexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportMid-level Full TimeSão Paulo, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Access control RBAC | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportMid-level Full TimeCuritiba, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Flexible hours | Internal tech talks | Learning budget | Mentorship | Remote workMid-level Full TimeRio de Janeiro, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Flexible hours | Internal tech talks | Mentorship | Remote workMid-level Full TimeCampinas, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Access control RBAC | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportMid-level Full TimeFlorianópolis, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Flexible hours | Internal TechTalks | Learning budget | Mentorship | People focused supportMid-level Full TimePorto Alegre, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Data CatalogAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeSalvador, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Flexible hours | Internal TechTalks | Learning budget | Mentorship | People focused supportMid-level Full TimeBelo Horizonte, Brazil R1d ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Access Control | Amazon Athena | Amazon Redshift | Amazon S3Annual learning budget | Collaborative culture | Flexible hours | Internal tech talks | MentorshipMid-level Full TimeSorocaba, Brazil R1d ago