Lead Data Engineer ID71008
Porto Alegre, Brazil
R
BRL 319K-396K (estimate) Senior-level Full Time
Tasks
- Build data lake on S3 object storage
- Collaborate with DevOps on functional requirements
- Define schema and data type strategy
- Design and own ETL pipelines
- Design partitioning and file formats
- Develop serverless query workflows with Athena
- Implement near real time processing for OLAP workloads
- Lead engineering team and enforce code quality
- Orchestrate batch workflows using DAGs
- Review pull requests and enforce standards
Perks/Benefits
- Annual learning budget
- Collaborative culture
- Flexible hours
- Mentorship
- Modern projects
- No micromanagement
- People focused support
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
Airflow | Athena | BigQuery | ClickHouse | DAG | Docker | EKS | ETL | FastAPI | Flask | GraphQL | Kubernetes | ORC | Parquet | PostgreSQL | Presto | Python | REST | S3 | Snowflake | Spark SQL | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Amazon Athena | Amazon S3 | Apache Spark | BigQueryAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeBrasília, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | People focused supportSenior-level Full TimeFlorianópolis, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS EKS | Amazon Athena | Amazon S3 | Apache Airflow | BigQueryFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeBelo Horizonte, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeRecife, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon EKS | Amazon S3 | Apache AirflowFlexible hours | Learning budget | Mentorship | People focused support | Remote workSenior-level Full TimeRio de Janeiro, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS Data | AWS Data Ecosystem | Amazon EKS | Amazon S3 | Apache AirflowAnnual learning budget | Flexible hours | Mentorship | People focused support | Remote workSenior-level Full TimeSão Bernardo do Campo, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon EKS | Amazon S3 | Apache Airflow | AthenaAnnual learning budget | Flexible hours | Local support | Mentorship | Remote workSenior-level Full TimeSalvador, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Airflow | Amazon S3 | Apache Airflow | AthenaChallenging projects | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeCampinas, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS | Amazon Athena | Amazon S3 | Apache Airflow | Apache SparkFlexible hours | Internal technical talks | Learning budget | Mentorship | Performance and compensation reviewsSenior-level Full TimeSão Paulo, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAWS Data | AWS Data Ecosystem | Amazon S3 | Apache Airflow | AthenaFlexible hours | Learning budget | Mentorship | People focused support | Performance and compensation reviewsSenior-level Full TimeCuritiba, Brazil R12h ago
-
Lead Data Engineer ID71008 BRL 319K-396KAirflow | Amazon EKS | Amazon S3 | Apache Spark | AthenaAnnual learning budget | Competitive performance reviews | Flexible hours | Mentorship | People focused supportSenior-level Full TimeSorocaba, Brazil R12h ago
-
API | Amazon Web Services | Apache Airflow | Apache NiFi | BitbucketDental insurance | Discounts on courses and universities | Fully remote | Health insurance | Meal allowanceMid-level Full TimeBrazil R21h ago
-
Lead Data Scientist, AdTech BRL 300K-370KAWS | Adtech | Collaborative Filtering | Content-Based Filtering | Content-basedDiversity and inclusion focus | Remote-first cultureSenior-level Full TimeBelo Horizonte, Brazil (remote); Brasilia, Brazil … R22h ago
-
Lead Applied Scientist, Marketing BRL 305K-390KAWS | AdTech Algorithms | Collaborative Filtering | Content-Based Recommendation | Content-basedSenior-level Full TimeBelo Horizonte, Brazil (remote); Brasilia, Brazil … R22h ago
-
Data Engineer ID80135 BRL 161K-192KAWS Glue | Amazon Athena | Amazon Redshift | Amazon S3 | Data CatalogAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeSalvador, Brazil R1d ago
-
Generative AI Pipeline Engineer (Tech Lead) BRL 300K-360K3D Rendering | API Integration | Agentic Workflows | Blender | CADFitness allowance | Home office stipend | Medical insurance coverage | Ongoing learning | Paid vacationSenior-level Full TimeBrasília, Any, BR R1d ago
-
AWS | Azure | GCP | Git | Language ModelsAutonomy | Collaborative fast moving team | Continuous learning | Exposure to challenging technical problems | Flexible working hoursMid-level Full TimeBrazil R1d ago
-
Senior Data Engineer (Snowflake/SQL) - Software Industry BRL 234K-300KAWS DMS | AWS Data | AWS Data Migration | AWS Data Migration Service | AWS GluePaid time off | Remote work | Work autonomySenior-level Full TimeSão Paulo R2d ago
-
Senior Data Engineer BRL 319K-443KAWS | Amazon RDS | Apache Spark | Automation | CI/CDEquipment stipend | Flexible PTO | Learning and development plan | Paid Holidays | Paid certifications examsSenior-level Full TimeBRAZIL R2d ago
-
Data Pipelines | Data Preparation | Deep learning | GPU Computing | InferenceAutonomy | Fully remote | High ownership | Long-term career growth | Professional developmentSenior-level Full TimeBrazil R2d ago
-
Contractor: Lead Analytics Engineer USD 126K-150KAWS | Airflow | Automated testing | Cloud infrastructure | Continuous integrationBackground check requiredSenior-level ContractRemote - Argentina; Brazil;Chile; Costa Rica R3d ago
-
Axolotl | Deep learning | Direct Preference Optimization | Efficient Fine Tuning | Fine TuningContinuous learning | Fully remote | International team collaboration | Professional developmentMid-level Full TimeBrazil R3d ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Spark | Cloud ComputingContinuous learning | Fully remoteSenior-level Full TimeBrazil R3d ago
-
AWS Bedrock | Amazon Web Services | CI/CD | Cloud Computing | Data AnalysisCourse discounts | Dental insurance | Discounts and exclusive offers | Fully remote work | Health insuranceMid-level Full TimeBrazil R3d ago
-
AWS | Airflow | Amazon EKS | Amazon Redshift | Amazon S3Collaborative team | Continuous learning | Fully remote | Inclusive workplace | Occasional office visitsEntry-level Full TimeBrazil R3d ago