Lead Data Engineer
Tasks
- Advise clients on distributed storage and computing technologies
- Collaborate with stakeholders on data quality and strategy
- Create design and develop data processing pipelines
- Define and incorporate data quality into daily work
- Define project scope and ensure on time delivery
- Deploy support and operate data pipelines using continuous delivery
- Design, develop and operate modern data architecture
- Develop data models using appropriate modeling techniques
- Implement data governance data security and data privacy
- Lead data engineering projects from inception to completion
- Partner with data scientists to implement scalable models
- Write clean iterative code with test driven development
Perks/Benefits
- N/A
Skills/Tech-stack
Big Data | Continuous Delivery | Data Architecture | Data Governance | Data Lake | Data Modeling | Data Pipelines | Data Privacy | Data Quality | Data Security | Data Visualization | Databricks | Distributed Processing | Distributed Storage | Generative AI | LLM | Language Models | Large Language Models | Machine Learning | NoSQL | SQL | Test-Driven | Test-Driven Development
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AI Data Engineer BRL 150K-240KAWS | AWS EventBridge | AWS Lambda | AWS S3 | Automated testingDEI initiatives opportunities | Fully remote or hybrid work | Healthcare stipend | National holidays | Paid mental health recharge daysMid-level Full TimeRemote - Brazil R14h ago
-
Amazon EMR | Apache Airflow | Apache Kafka | Big Data | Data ModelingCareer development opportunities | Dental insurance | Flexible schedule | Health insurance | Home office supportSenior-level Full TimeBrazil22h ago
-
Senior Analytics Engineer BRL 78K-108KA/B | A/B Testing | Apache Airflow | B testing | BigQueryRemote workSenior-level Full TimeBrasil R1d ago
-
AWS DMS | AWS Lambda | Airflow | CDC | CI/CDChildcare support | Dental insurance | Extended parental leave | Health insurance | Learning platformSenior-level Full TimeBrazil1d ago
-
A/B | A/B Testing | API Gateway | AWS | AWS LambdaChildcare assistance | Dental insurance | Discount club | Employee profit-sharing | Gym benefitsSenior-level Full TimeBrazil1d ago
-
Pessoa Engenheira de Dados Pleno BRL 96K-119KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud StorageMid-level Full TimeSão Paulo1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksMid-level Full TimeSorocaba, Brazil1d ago
-
Algorithms | Amazon Redshift | Amazon Web Services | DBT | Data LakeFlexible schedule | Personalized growth roadmap | Professional mentorship | Remote work options | TechtalksMid-level Full TimePorto Alegre, Brazil1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Architecture | Data LakeEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeRecife, Brazil1d ago
-
AWS | Amazon Redshift | Amazon Web Services | DBT | Data LakesFlexible schedule | Mentorship | Office option | Remote work option | TechtalksMid-level Full TimeSalvador, Brazil1d ago
-
AWS | Amazon Redshift | DBT | Data Engineering | Data LakesEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsMid-level Full TimeCuritiba, Brazil1d ago
-
AWS | Amazon Redshift | DBT | Data Lakes | Data ModelingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionMid-level Full TimeSão Bernardo do Campo, Brazil1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data QualityFitness budget | Flexible schedule | Mentorship | Remote work options | Team activity budgetMid-level Full TimeFlorianópolis, Brazil1d ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data StructuresEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeCampinas, Brazil1d ago
-
AWS | Algorithms | Amazon Redshift | Amazon Web Services | Computer ScienceEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeRio de Janeiro, Brazil1d ago
-
AWS | Amazon Redshift | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeBelo Horizonte, Brazil1d ago
-
AWS | Algorithms | Amazon Redshift | DBT | Data LakesEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeBrasília, Brazil1d ago
-
Algorithms | Amazon Redshift | Amazon Web Services | DBT | Data LakesEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSão Paulo, Brazil1d ago
-
[Job-28865] Engenheiro de Dados Senior, Brazil BRL 18K-18KACID | Azure | Azure Data | Azure Data Factory | Azure DatabricksChildcare support | Continuous learning platform | Dental insurance | Discounts | Extended parental leaveSenior-level Full TimeBrazil1d ago
-
AWS Athena | AWS Glue | AWS S3 | Amazon Redshift | Data ArchitectureHybrid workSenior-level Full TimeSão Paulo, Brasil1d ago
-
Engenheiro de Dados Sênior BRL 58K-72KAI | AWS | AWS Glue | Agile | Amazon AthenaTravel opportunitiesSenior-level Full TimeSão Carlos, SP, Brazil1d ago
-
Entry-level Full TimeLondrina1d ago
-
Analista de Dados Sênior (AWS) - 132464 BRL 96K-119KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaMid-level Full TimeAlphaville - Barueri, BR, 06.454-0002d ago
-
Principal Data Engineer Team Lead - OP02110 BRL 271K-370KAWS | Apache Airflow | Code Reviews | DBT | DagsterEnglish lessons | Health insurance | Paid sick days | Paid time off | Remote workSenior-level Full TimeSão Paulo, São Paulo, Brazil - … R2d ago
-
Consultor de Dados - Business Intelligence BRL 90K-102KArtificial Intelligence | DAX | Data Modeling | Data Pipelines | ETLOnline assessmentMid-level Full TimeBelo Horizonte, Brazil2d ago