Lead Data Engineer
Tasks
- Collaborate with cross functional stakeholders on technical designs
- Define data platform architecture
- Design data pipelines and data models
- Design data platform scalability and reliability
- Drive CI CD adoption and release processes
- Drive data migration from Snowflake and SSIS to Azure Databricks and dbt
- Enforce architectural standards and engineering best practices
- Ensure reliable data integration and data quality
- Establish data observability
- Implement infrastructure as code with Terraform
- Lead data engineering team
- Maintain technical documentation
- Own data platform implementation delivery
- Troubleshoot complex platform issues
Perks/Benefits
Skills/Tech-stack
AWS | Azure | CI/CD | DBT | Data Architecture | Data Governance | Data Modeling | Data Observability | Data Pipelines | Data Quality | Databricks | Delta Live Tables | Delta Live) | ELT | ETL | Event Hubs | Git | Infrastructure as Code | Kafka | Lakehouse | Python | SQL | SSIS | Snowflake | Terraform | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Angular | CI/CD | Databases | Databricks | Distributed SystemsMentoring system | Professional developmentSenior-level Full TimeBlumenau, SC, Brazil11h ago
-
Senior Data Engineer BRL 234K-300KAlerting | CI/CD | Cause analysis | Compliance | Cost OptimizationRemote workSenior-level Full TimeBrazil17h ago
-
Tech Lead – Engenharia de Dados BRL 117K-142KAWS | Amazon Kinesis | Apache Spark | CI/CD | Data GovernanceSenior-level Full TimeSão Paulo, Brazil22h ago
-
Agile methodology | Amazon Web Services | Data Governance | Data Pipelines | Data QualityBike parking | Childcare assistance | Company shuttle | Dental insurance | Food VoucherMid-level Full TimeSão Paulo, Brazil22h ago
-
Asynchronous programming | CI/CD | Elasticsearch | Embeddings | Evaluation FrameworksHybrid work option | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBrazil23h ago
-
Analytics Platform Engineer BRL 305K-390KAWS | Apache Airflow | CI/CD | DBT Core | Data ClassificationRemote workSenior-level Full TimeBrazil1d ago
-
Apache Airflow | BigQuery | CI/CD | Cloud Storage | Cloud platformAgile culture | Career development | Hybrid workSenior-level Full TimeBrasil1d ago
-
Especialista I - Technical Lead BRL 210K-252KAWS | Acceptance Testing | CI/CD | Checkmarx | Distributed SystemsSenior-level Full TimeSão Paulo, SP, Brazil R1d ago
-
Machine Learning Engineer USD 132K-165KApache Spark | MLOps | Machine Learning | Pandas | PyTorchDistributed team | Flexible work schedule | Remote workMid-level Full TimeBogota R1d ago
-
[Job-30403] AI Engineer, Brazil BRL 319K-390KA2A | ACP | Agent Coordination Protocol | Agent Orchestration | Agent coordinationChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrazil1d ago
-
Data Analytics Engineer BRL 150K-220KApache Airflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerMid-level Full TimeSão Paulo1d ago
-
Ablation Studies | Active Learning | Adversarial Testing | Attention Mechanisms | BPEFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growthMid-level Full TimeBrazil R1d ago
-
API Management | AWS | Apigee | Bash | CI/CDFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growth opportunitiesSenior-level Full TimeBrazil R1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career growth opportunity | Competitive salary | Friendly work environment | Impact on learning accessibilityMid-level Full TimeRio de Janeiro, Brazil1d ago
-
Bash | Data pipeline | Docker | GCP | LinuxAsynchronous culture | Inclusive workplace | Remote work opportunityMid-level Full TimePorto Alegre, Brazil1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote/distributed workMid-level Full TimeSalvador, Brazil1d ago
-
PL Data Engineer - Indaiatuba/SP BRL 107K-107KAWS | Agile | CI/CD | Data Pipelines | Data WarehousingCorporate university | Dental insurance | Eye Care Benefit | Gym membership | Health insuranceMid-level Full TimeIndaiatuba,Sao Paulo,Brazil1d ago
-
AWS | Azure | CI/CD | Databricks | GitHubChildcare assistance | Corporate university | Dental insurance | Education partnerships | Health insuranceSenior-level Full TimeOSASCO, Brazil; OSASCO, SP, Brazil; OSASCO1d ago
-
API Integration | Automation | Blaze Advisor | CI/CD | Data AnalysisChildcare support | Dental insurance | Extended parental leave | Gym membership | Health insuranceSenior-level Full TimeBrazil2d ago
-
AWS | Amazon ECS | Apache Airflow | Apache Hadoop | Apache HiveChildcare subsidy | Day off on birthday | Dental plan | Discounts On Everyday Services | Discounts at educational institutionsSenior-level Full TimeBrasil2d ago
-
[Job-30060] Engenheiro de Dados Sênior , Brazil BRL 18K-18KAzure | Azure DevOps | Azure Machine Learning | CI/CD | Data GovernanceChildcare support | Dental insurance | Discount club | Extended parental leave | GympassSenior-level Full TimeBrazil2d ago
-
Alerting | Anti-Bot | Anti-bot evasion | Asynchronous programming | Bot EvasionFlexible working arrangements | International engineering team | Learning and coaching | Optional office near Berlin | Remote-first cultureSenior-level Full TimeBrazil2d ago
-
Anomaly Detection | Azure Databricks | CI/CD | Classification | ClusteringChildcare assistance | Dental insurance | Extended parental leave | Food allowance | Gym membership discountMid-level Full TimeBrazil2d ago
-
[Job - 30376] AI Developer PL/SR (.NET + AWS) BRL 132K-144K.NET | AWS Lambda | Agent planning | Amazon DynamoDB | Amazon EC2Senior-level Full TimeBrazil2d ago
-
Analista de Ciência de Dados em IA Pleno BRL 78K-160KAdversarial Testing | Bias detection | Chunking | Embeddings | FairnessCLT employment | Flexible schedule | Remote workSenior-level Full TimeSão Paulo2d ago