Lead Data Engineer
Tasks
- Architect scalable secure data pipelines
- Build data transformation pipelines with Databricks and DBT
- Create architecture and process documentation
- Ensure data integration between Snowflake and Azure
- Establish data engineering standards and governance
- Implement infrastructure as code with Terraform
- Lead and mentor data engineering team
- Own end to end data migration strategy
- Perform code reviews and enforce best practices
- Set up CI/CD workflows
- Troubleshoot complex technical issues
Perks/Benefits
Skills/Tech-stack
Apache Kafka | Azure Databricks | Azure Event | Azure Event Hubs | CI/CD | DBT | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Pipelines | Data Quality | Data Transformation | Databricks | Delta Live Tables | Delta Live) | ELT | ETL | Event Hubs | Git | Git based version control | Infrastructure as Code | Lakehouse Architecture | SQL | Security Compliance | Snowflake | Streaming Data | Terraform | Version control | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Fullstack AI Engineer BRL 230K-270KAI Foundry | AI Observability | AI Search | App Service | Azure AIWork from homeSenior-level Full TimeBrazil11h ago
-
Senior Machine Learning Engineer BRL 234K-295KAWS | Automated retraining | Azure | CI/CD | DatabricksWork from homeSenior-level Full TimeBrazil11h ago
-
[Job-29095] Engenheiro de Dados Sênior , Brazil BRL 18K-18KAzure Data | Azure Data Services | Azure ML | CI/CD | Data LakeChildcare assistance | Dental insurance | Discount platform | Employee performance bonus | Extended parental leaveSenior-level Full TimeBrazil17h ago
-
Data Analyst ID61986 BRL 240K-279KAPI Integrations | APM | AWS | CD pipelines | CI/CDEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeBelo Horizonte, Brazil20h ago
-
API Integration | APM | AWS | CI/CD | DatadogFlexible schedule | Mentorship | Office options | Personalized growth roadmap | Remote optionsMid-level Full TimeCampinas, Brazil20h ago
-
API Integration | APM | AWS | CI/CD | ContainerizationEducation budget | Fitness budget | Flextime | Mentorship | Office optionMid-level Full TimeSalvador, Brazil20h ago
-
API Integration | APM | AWS | CI/CD | DatadogEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsMid-level Full TimeFlorianópolis, Brazil20h ago
-
Data Analyst ID61986 BRL 240K-279KAPI Integrations | APM | AWS | CI/CD | DatadogEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeFlorianópolis, Brazil20h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsMid-level Full TimeManaus, Brazil20h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data QualityEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeJoão Pessoa, Brazil20h ago
-
AWS | Amazon Redshift | DBT | Data Architecture | Data LakesFlextime | Growth roadmaps | Mentorship | Office options | Remote optionsMid-level Full TimeSão Luís, Brazil20h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data ModelingFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksMid-level Full TimeTeresina, Brazil20h ago
-
AWS | Algorithms | Amazon Redshift | DBT | Data LakeEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeCampo Grande, Brazil20h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsMid-level Full TimeNiterói, Brazil20h ago
-
AWS | Amazon Redshift | DBT | Data Engineering | Data LakesFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimeAracaju, Brazil20h ago
-
Amazon Redshift | Amazon Web Services | DBT | Data Lakes | Data WarehousingEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsMid-level Full TimeSão José dos Campos, Brazil20h ago
-
AWS | Algorithms | Amazon Redshift | Computer Science | Computer science fundamentalsEducation budget | Fitness budget | Flextime | Growth roadmaps | MentorshipMid-level Full TimeMaceió, Brazil20h ago
-
AWS | Amazon Redshift | DBT | Data Lakes | Data QualityEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimeUberlândia, Brazil20h ago
-
API Integration | API proxying | Agent Pipelines | Agentic Workflows | Automated testingFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsMid-level Full TimeRecife, Brazil20h ago
-
.NET | AI Coding Assistants | AI coding | API Integration | API proxyingEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSão Bernardo do Campo, Brazil20h ago
-
API Integration | API proxying | Agent Pipelines | Agentic Workflows | Automated testingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsMid-level Full TimeBelo Horizonte, Brazil20h ago
-
.NET | API proxying | Agentic Workflow | Automated testing | C#Flexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsMid-level Full TimeSalvador, Brazil20h ago
-
.NET | API proxying | Automated testing | C# | CI/CDEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeCuritiba, Brazil20h ago
-
.NET | AI Coding Assistants | AI coding | API proxying | Agentic WorkflowsEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeSão Paulo, Brazil20h ago
-
.NET | AI Agent | API Integration | API proxying | Agentic WorkflowEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeBrasília, Brazil20h ago