Lead Data Engineer ID71008
Salvador, Brazil
BRL 305K-390K (estimate) Senior-level Full Time
Tasks
- Build and govern data lake ETL pipelines
- Define near real time OLAP processing architecture
- Design and own ETL pipelines
- Design partitioning strategy and schema design
- Integrate with internal databases and external APIs
- Lead developer team and align engineering practices
- Orchestrate batch workflows with Airflow DAGs
- Partner with DevOps on AWS architecture requirements
- Review pull requests and enforce code quality
Perks/Benefits
- Annual performance reviews
- Flexible hours
- Learning budget
- Mentorship
- Remote work
- Techtalks
- Well-being programs
Skills/Tech-stack
Amazon S3 | Apache Airflow | Athena | ClickHouse | DAG | Data Lake | Data Modeling | Data pipeline | Docker | EKS | ETL | FastAPI | Flask | GraphQL | JavaScript | Kubernetes | Near-real-time | OLAP | ORC | Object storage | Parquet | Partitioning | PostgreSQL | Presto | Python | REST API | Real Time | Schema Design | Serverless computing | Spark SQL | Trino
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Language: en
Views: 1
Clicks: 1
Saves: 0
Related jobs
-
Access Controls | Airflow | Apache Spark | Asset bundles | CI/CDCertification incentives | Childcare allowance | Dental insurance | Educational discounts | Fitness and wellness benefitSenior-level Full TimeBrazil R1d ago
-
AWS Glue | AWS Lake | AWS Lake Formation | Amazon Athena | Amazon BedrockChildcare assistance | Continuous learning opportunities | Discounts through partner programs | Extended parental leave | Fitness and wellness programsMid-level Full TimeBrazil R1d ago
-
AI Transformation Engineer | (Hybrid/SP) BRL 117K-119KAPI Integration | AWS Bedrock | Azure OpenAI | Copilot Studio | FlowiseHybrid work | Training and mentoringSenior-level Full TimeSão Paulo, Brasil R1d ago
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R1d ago
-
Visagio Talentos - Formados: Data Science e IA Generativa RJ (Exclusiva para Pessoas com Deficiência) BRL 23K-31KAgile methodology | Data Analysis | Database Concepts | Language Processing | Machine LearningClient interaction | Team collaboration | Training coursesNone Full TimeRio de Janeiro, Brasil1d ago
-
Lead Data Engineer (Brazil Based) BRL 234K-368KAI machine learning | AWS | AWS Glue | Amazon Athena | Amazon S3English language support | Travel opportunitiesSenior-level Full TimeSão Carlos, SP, Brazil1d ago
-
Data Engineer - GCP | PL (Hybrid/SP) BRL 119K-119KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CassandraHybrid workSenior-level Full TimeSão Paulo, Brasil R1d ago
-
Data Engineer - GCP | SR (Hybrid/SP) BRL 119K-119KAPIs | AWS Glue | Apache Airflow | Apache Kafka | Apache SparkHybrid workSenior-level Full TimeSão Paulo, Brasil R1d ago
-
Access Control | Anomaly Detection | Audit Logging | CI/CD | ClassificationCompetitive salary | Exposure to MLOps and LLMOps | Hands on cutting edge AI work | Remote work model | Scalable security governance and observability focusSenior-level Full TimeBrazil1d ago
-
Analista Sênior de Engenharia de Dados e IA BRL 24K-31KABAC | AWS Glue | Access Management | Agent Orchestration | Amazon AthenaChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity and paternity leave | Health insuranceSenior-level Full TimeSão Paulo, Brasil R1d ago
-
AI Security | API Development | Agent systems | Agentic AI | Claude APIContract engagement | Fully remote work model | International technology focused environment | Opportunity for senior technical ownershipSenior-level Full TimeBrazil R1d ago
-
AWS | Apache Spark | Azure DevOps | CI/CD | Cloud ComputingChildcare assistance | Dental insurance | Hybrid work model | Life events support | Life insuranceMid-level Full TimeBrazil R1d ago
-
AWS | Agent systems | Autogen | Automated testing | AzureChildcare assistance | Continuous learning | Dental insurance | Employee discounts | Extended parental leaveSenior-level Full TimeBrazil1d ago
-
AWS Glue | Agile Scrum | Apache Airflow | Apache Kafka | Apache SparkAgile collaborative environment | Career growth | Continuous learning opportunities | Professional development | Technical challenging projects with business impactMid-level Full TimeBrazil1d ago
-
Engenheiro(a) de Machine Learning (AI/ML) BRL 48K-68KAI Agents | Computer Vision | Generative AI | LLM APIs | Language ModelsChild care support | Dental insurance | Discounted stock purchase | Extended maternity leave | Extended paternity leaveEntry-level Full TimeRecife, Armazem 9, Brazil2d ago
-
API Integration | AWS | Agile | Airflow | AzureChildcare support | Company profit sharing | Continuous learning platform | Dental insurance | Discount clubSenior-level Full TimeBrazil2d ago
-
Access Control | Anomaly Detection | Artificial Intelligence | Audit Logging | CI/CDCompetitive salary | Remote workSenior-level Full TimeBrazil2d ago
-
Apache Spark | Azure | CI/CD | Cassandra | Data GovernanceChildcare reimbursement | Dental insurance | English training online | Extended parental leave | Flexible benefits programSenior-level Full TimeRio de Janeiro, Brasil R2d ago
-
APIs | Agent Frameworks | Agent systems | Chunking | EmbeddingsMid-level Full TimeBrasil2d ago
-
Senior Data Engineer Brazil BRL 212K-270KApache Beam | Apache Flink | Apache Spark | CI/CD | Cloud platformCoworking credits | Dental insurance | Gympass | Health insurance | Meal allowanceSenior-level Full TimeAvenida das Nações Unidas, 12901,11° andar … R2d ago
-
LLMs Data Analyst | Senior (Hybrid/SP) BRL 84K-108KAWS | Anthropic | Azure OpenAI | CI/CD | Cloud platformHybrid workSenior-level Full TimeSão Paulo, Brasil R2d ago
-
[Job-31276] Engenheiro(a) de Dados PLENO, Brasil BRL 18K-18KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsDental insurance | Discount club | Food allowance | Gympass or Totalpass | Health insuranceMid-level Full TimeBrazil2d ago
-
Senior Data & AI Solutions Architect BRL 150K-180KAWS | Airflow | Amazon Redshift | Apache Kafka | Apache SparkSenior-level Full TimeSAO PAULO, SP, Brazil2d ago
-
AI Native Tech Lead BRL 235K-390KAI Agent | AI Agent Development | AI Agent Development Kit | Agent Development Kit | Cloud SQLInternal R and D projects | International mobility | Knowledge sharing | Personalized trainingSenior-level Full TimePALO IT Brazil R2d ago
-
AI Model Evaluation | AI model | AWS | Azure | Azure DataChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil R3d ago