Lead Data Engineer
Tasks
- Advise clients on distributed storage and computing technologies
- Collaborate with stakeholders on data quality and strategy
- Create design and develop data processing pipelines
- Define and incorporate data quality into daily work
- Define project scope and ensure on time delivery
- Deploy support and operate data pipelines using continuous delivery
- Design, develop and operate modern data architecture
- Develop data models using appropriate modeling techniques
- Implement data governance data security and data privacy
- Lead data engineering projects from inception to completion
- Partner with data scientists to implement scalable models
- Write clean iterative code with test driven development
Perks/Benefits
- N/A
Skills/Tech-stack
Big Data | Continuous Delivery | Data Architecture | Data Governance | Data Lake | Data Modeling | Data Pipelines | Data Privacy | Data Quality | Data Security | Data Visualization | Databricks | Distributed Processing | Distributed Storage | Generative AI | LLM | Language Models | Large Language Models | Machine Learning | NoSQL | SQL | Test-Driven | Test-Driven Development
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
[Job 28454] IA Data Engineer, Pleno BRL 20K-23KAutogen | Azure | Azure Data | Azure Data Factory | Azure DevOpsChildcare support | Dental insurance | Extended parental leave | Gympass | Health insuranceNone Full TimeBrazil13h ago
-
AWS | AWS Glue | AWS IAM | AWS Lake Formation | AWS LambdaMid-level Full TimeSão Paulo, Brazil16h ago
-
AI Engineer I (Remote) USD 30K-39KAWS | CI/CD | Docker | Entity recognition | Feature EngineeringFull-time employment | Remote workEntry-level Full TimeBrazil, Remote R17h ago
-
[Job - 28500] Senior Data Analytics, Brazil BRL 20K-40KAWS | Amazon QuickSight | Data Exploration | Data Modeling | Data QualityChildcare support | Dental insurance | Discount club | Extended parental leave | GympassSenior-level Full TimeBrazil20h ago
-
[Job-28403] Sr DataBricks DATAOps Engineer, Brazil BRL 212K-270KAzure DevOps | CI/CD | Cloud Engineering | Code review | Data GovernanceChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrazil22h ago
-
Amazon Athena | Amazon Redshift | Amazon S3 | Apache Airflow | BashAnnual profit-sharing | Childcare support | Dental insurance | Education budget | Extended maternity leaveMid-level Full TimeBRASIL, SÃO PAULO; BRASIL,BELO HORIZONTE23h ago
-
Especialista de Engenharia de Dados II BRL 23K-23KAPI Development | AWS Glue | AWS Lake Formation | AWS Lambda | Amazon AthenaCollaboration culture | Development opportunities | Wellness | Work-life balanceEntry-level Full TimeSão Paulo, Brazil23h ago
-
APIs | AWS | Backend Development | CI/CD | Cost OptimizationChildcare support | Dental insurance | Education budget | Extended maternity leave | Extended paternity leaveMid-level Full TimeBRASIL,BELO HORIZONTE23h ago
-
Entry-level Full TimeSão Paulo, Brazil1d ago
-
Data Scientist Specialist (Lending) BRL 184K-184KA/B | A/B Testing | AUC | AWS | Apache SparkDental insurance | Health insurance | Home-office allowance | Life insurance | Meal allowanceSenior-level Full TimeBrazil - Remote R1d ago
-
[GenAI] Sênior Software Engineer - híbrido Florianópolis MXN 120K-120KAPI Development | AWS | Amazon SQS | Azure | CI/CDChildcare support | Dental insurance | Education benefit | Flexible hours | GympassMid-level Full TimeFlorianopolis, Santa Catarina, Brasil1d ago
-
CRM | Data Modeling | Data Visualization | ERP | Performance AnalysisChildcare support | Dental insurance | Discount on Flights | Education incentive | Extended parental leaveEntry-level Full TimeSão Paulo1d ago
-
Middle Software Engineer (Python) BRL 304K-370KAgile | Apache PySpark | CI/CD | CSV | GitHybrid work | International projects | Medical healthcare | Ongoing learning reimbursement | Recognition programSenior-level Full TimeBrazil1d ago
-
Lead Solution Architect (AI & Data Applications) BRL 325K-430KAI Agents | Angular | CI/CD | Databricks | DockerSenior-level Full TimeBlumenau, SC, Brazil1d ago
-
AI First | Artificial Intelligence | Big Data | Consulting | Credit RiskEnglish fluency | Hybrid work | Spanish preferredMid-level Full TimeSao Paulo, BRAZIL, Brazil2d ago
-
AWS Glue | Azure Data | Azure Data Factory | Data Factory | Data GovernanceChildcare assistance | Dental insurance | Flexible schedule | Health insurance | Life insuranceEntry-level Full TimePompeia, State of São Paulo, Brazil2d ago
-
A/B | A/B Testing | B testing | Context Management | Data AnalysisFully remote | Healthcare coverage | Home office setup allowance | International company retreats | Learning and development stipendSenior-level Full TimeBrazil R2d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure SynapseSenior-level Full TimeSão Paulo, State of São Paulo, …2d ago
-
AWS Glue | Airflow | Azure Data | Azure Data Factory | BigQueryFlexible work hours | Remote workMid-level Full TimeBrazil - Remote R2d ago
-
Analista De Dados Pl BRL 108K-108KAPI Authentication | Azure | Data Factory | Data Governance | Data ModelingEnglish intermediate advanced support | Hybrid work | Technical mentorshipSenior-level Full TimeBR Sao Paulo (Alameda dos Arapanés), …2d ago
-
Engenheiro de Dados Senior BRL 60K-60KCloud Computing | Data Engineering | Data Pipelines | Data Quality | Data SecurityCareer growth opportunities | Flexible work model | In-person collaboration | Wellbeing supportSenior-level Full TimeTWGSP - Teleworker/Offsite - BRA - … R2d ago
-
Mid-level Full TimeSão Paulo, Brazil2d ago
-
Especialista de Engenharia de Dados I BRL 23K-24KAWS | Apache Spark | Autoloader | CI/CD | Data GovernanceMid-level Full TimeSão Paulo, Brazil2d ago
-
AWS | CI/CD | Data integration | GCP | LLMFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimeCampinas, Brazil2d ago
-
.NET | Apex | C# | C++ | DartRemote workSenior-level Part TimeBrasília, Brazil R3d ago