Lead Data Engineer
Tasks
- Architect scalable secure data pipelines
- Build data transformation pipelines with Databricks and DBT
- Create architecture and process documentation
- Ensure data integration between Snowflake and Azure
- Establish data engineering standards and governance
- Implement infrastructure as code with Terraform
- Lead and mentor data engineering team
- Own end to end data migration strategy
- Perform code reviews and enforce best practices
- Set up CI/CD workflows
- Troubleshoot complex technical issues
Perks/Benefits
Skills/Tech-stack
Apache Kafka | Azure Databricks | Azure Event | Azure Event Hubs | CI/CD | DBT | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Pipelines | Data Quality | Data Transformation | Databricks | Delta Live Tables | Delta Live) | ELT | ETL | Event Hubs | Git | Git based version control | Infrastructure as Code | Lakehouse Architecture | SQL | Security Compliance | Snowflake | Streaming Data | Terraform | Version control | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AWS | Apache Airflow | Azure | CI/CD | Data EngineeringCareer growth opportunities | Continuous learning | Flexible working hours | Fully remote | Home office setup supportSenior-level Full TimeBrazil R6h ago
-
API Design | AWS | Apache Spark | CI/CD | CrossplaneCareer development | Dental insurance | Flexible schedule | Health insurance | Home office supportSenior-level Full TimeBrazil6h ago
-
Data Engineer (GTM) BRL 150K-230KAirflow | Apache Beam | Batch Ingestion | BigQuery | Clay401k retirement plan | Fully funded travel after four years | Gympass membership | Language learning opportunities | Medical, dental, and vision coverageMid-level Full TimeSão Paulo, SP6h ago
-
APIs | Apache Airflow | Azure Data | Azure Data Factory | Data FactoryDental insurance | Gym membership support | Health insurance | Life insurance | Meal or food allowanceMid-level Full TimeBrazil7h ago
-
Cloud Computing | Data Pipelines | ETL | Google Colab | Information RetrievalCareer growth | Continuous learning culture | Coworking access | Flexible schedule | Fully remote workMid-level Full TimeBrazil R7h ago
-
APIs | BigQuery | Copilot Studio | Data Governance | GeminiChildcare support | Dental insurance | Food Voucher | Gym pass | Health insuranceEntry-level Full TimeSão Paulo, Brazil16h ago
-
AI Agents | APIs | Automation | BI | BigQueryChildcare assistance | Dental insurance | Food Voucher | Gym membership | Health insuranceEntry-level Full TimeSão Paulo, Brazil16h ago
-
API Management | APIs | ArgoCD | Azure DevOps | CI/CDChildcare allowance | Company civic leave program | Dental insurance | Employee Assistance Program (EAP) | Extended maternity leaveSenior-level Full TimeSão Paulo17h ago
-
Engenheiro de Software Senior (.NET) | BTG Empresas BRL 119K-119K.NET | AWS | Azure | C# | CI/CDChildcare allowance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo17h ago
-
.NET | AWS | Azure | C# | CI/CDChildcare allowance | Dental insurance | EAP | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo17h ago
-
.NET | API Design | AWS | Asynchronous programming | C#Childcare assistance | Dental insurance | EAP | Employee assistance program | Extended parental leaveSenior-level Full TimeSão Paulo17h ago
-
.NET | Agile | Amazon Web Services | C# | CI/CDChildcare support | Dental insurance | Employee assistance program | Extended parental leave | Food allowanceSenior-level Full TimeSão Paulo17h ago
-
Engenheiro de Software .NET Pleno | BTG Empresas BRL 80K-80K.NET | .Net Core | AWS | Agile | Amazon SNSChildcare support | Dental insurance | Employee Assistance Program (EAP) | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo18h ago
-
AWS | Agile | Azure DevOps | CI/CD | Cloud ArchitectureChildcare assistance | Dental insurance | Employee assistance program | Gym membership | Health insuranceEntry-level Full TimeSão Paulo18h ago
-
Accessibility | CI/CD | CSS3 | Cypress | DatadogChildcare assistance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo18h ago
-
.NET | API Gateway | AWS Cloud | Azure DevOps | C#Childcare allowance | Dental insurance | Employee Assistance Program (EAP) | Extended maternity leave | Extended paternity leaveMid-level Full TimeSão Paulo18h ago
-
AI machine learning | Airflow | CI/CD | Cloud platform | DagsterCollaborative mission driven culture | Exposure to cutting edge AI and data technologies | High autonomy | High-impact strategic projects | Inclusive work environmentSenior-level Full TimeBrazil22h ago
-
AWS | AWS Glue | AWS IAM | AWS Lambda | Amazon RedshiftChildcare assistance | Continuous learning platforms | Dental insurance | Discounts and corporate benefits | Extended paternity leaveSenior-level Full TimeBrazil1d ago
-
AWS | AWS Glue | Amazon Athena | Amazon CloudWatch | Apache AirflowCollaborative knowledge sharing culture | Continuous learning | Flexible arrangements | Global innovation projects | Professional developmentSenior-level Full TimeBrazil1d ago
-
Airflow | Apache Spark | BigQuery | Cloud Storage | Cloud platformCollaborative culture | Continuous learning | Professional growth | Remote workMid-level Full TimeBrazil R1d ago
-
AWS | Airflow | Amazon Redshift | Azure | BigQueryFlexible working hours | Remote workSenior-level Full TimeBrazil - Remote R1d ago
-
Engenheiro/Engenheira de Dados - Python, AWS BRL 20K-31KAWS CloudFormation | AWS DevOps | AWS Glue | AWS Lambda | AWS Step FunctionsDental insurance | Employee wellness program | Flexible work hours | Health insurance | Hybrid workMid-level Full TimeBarueri, BR1d ago
-
Engenheiro/Engenheira de Dados - Snowflake BRL 80K-80KAirflow | Azure Data | Azure Data Factory | CI/CD | Data FactoryBenefits club | Career growth plan | Corporate university | Dental insurance | EquilibriumMid-level Full TimeBarueri, BR1d ago
-
Cientista de Dados - Python, AWS, ML BRL 18K-18KAWS | AWS IAM | AWS Lambda | Amazon EC2 | Amazon S3Dental insurance | Family care support | Flexible work | Hybrid work | Learning accessMid-level Full TimeBarueri, BR1d ago
-
Engenheiro/Engenheira de Dados - Power BI BRL 13K-18KAgile | Confluence | DAX | Data Governance | Data MartsCorporate learning access | Dental insurance | Extended parental leave | Family care program | Fertility supportMid-level Full TimeBarueri, BR1d ago