Data Platform Lead
BRL 304K-390K (estimate) Senior-level Full Time
Tasks
- Architect data replication using CDC
- Build CDC data pipelines
- Build batch data pipelines
- Build streaming data pipelines
- Create shared libraries
- Define reusable ingestion patterns
- Deploy platform services
- Design data platform capabilities
- Enforce data pipeline standards
- Ensure data observability and alerting
- Implement CI/CD pipelines
- Implement data governance
- Implement data platform solutions
- Ingest source data
- Manage data access governance
- Mentor engineers on platform standards
- Prepare and model data
- Provide production support
- Support data engineering applications
- Test data pipelines
- Tune pipeline performance
Perks/Benefits
- N/A
Skills/Tech-stack
Asset bundles | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Functions | Azure Pipelines | Bicep | Blob Storage | CI/CD | Data Catalog | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data pipeline | Delta Live Tables | Delta Live) | DevOps | GitHub | Infrastructure as Code | Networking | Purview | SQL | Security | Unity Catalog | “as-code”
Education
Roles
Data Engineer | Data Platform | Data Platform Lead | Engineer | Lead | Platform Lead
Regions
Countries
States
Related jobs
-
Apache Spark | Cloud Computing | DBT | Data Ingestion | Data ModelingFlexible project allocation | International collaboration | Project variety | Remote-first | Technical autonomySenior-level ContractBrazil R20h ago
-
AWS | Airflow | Alerting | Aurora | CI/CDAnnual goal based bonuses | Birthday day off | Childcare assistance | Corporate training platform | Coworking accessSenior-level Full TimeBrazil R20h ago
-
Apache Airflow | CI/CD | DBT | Git | Medallion ArchitectureAutonomy | Collaborative culture | End-to-end ownership | Flexible working environment | Professional growthSenior-level Full TimeBrazil21h ago
-
Data Insights - Tech Senior Associate BRL 234K-300KApache Airflow | Business Intelligence | CRM | Classification | Data AnalysisEnglish Portuguese fluency support | Hybrid workSenior-level Full TimeSão Paulo, SP, Brazil R2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeSão Paulo, Brazil2d ago
-
Senior Data Engineer (AI Data Platform) BRL 319K-443KApache Airflow | CI/CD | Clustering | Cost Optimization | DBTSenior-level Full TimeBrasília, DF, Brazil3d ago
-
Mid Level Machine Learning Engineer BRL 150K-170KAzure Cloud | Azure DevOps | BentoML | Databricks | Inference ServerCasual office dress code | Childcare subsidies | Days off | Dental insurance | Health insuranceMid-level Full TimeCampinas, São Paulo, Brazil3d ago
-
App Maint Engineer BackEnd SQL/ETL Sr BRL 119K-119KCloud Data | DevOps | ETL | GitHub | SQLRemote workEntry-level Full TimeBrasil3d ago
-
Senior Machine Learning Engineer BRL 319K-443KAzure | Azure DevOps | BentoML | Databricks | Feature StoreCasual office dress code | Childcare subsidies | Days off | Dental insurance | Discounts on company productsSenior-level Full TimeCampinas, São Paulo, Brazil3d ago
-
Classification | Clustering | Credit Scoring | Data Visualization | Decision TreesChildcare support | Dental insurance | EAP | Extended maternity leave | Extended paternity leaveMid-level Full TimeSão Paulo3d ago
-
Lead Data Engineer ID71008 BRL 305K-390KApache Airflow | Athena | ClickHouse | Cost Optimization | DAGAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeCampinas, Brazil3d ago
-
Lead Data Engineer ID71008 BRL 305K-390KAWS | Airflow | Amazon Athena | Apache Spark | BigQueryAnnual learning budget | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeRecife, Brazil3d ago
-
Lead Data Engineer ID71008 BRL 305K-390KAirflow | Athena | BigQuery | ClickHouse | DAGAnnual learning budget | Collaborative culture | Flexible hours | Growth opportunities | Internal TechTalksSenior-level Full TimeCuritiba, Brazil3d ago
-
Lead Data Engineer ID71008 BRL 305K-390KAI Assisted Development | AI-Assisted Development Tools | AWS Bedrock | Amazon Athena | Amazon EKSAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportSenior-level Full TimeSorocaba, Brazil3d ago
-
Lead Data Engineer ID71008 BRL 305K-390KAWS EKS | Amazon Athena | Amazon S3 | Apache Airflow | Code QualityAnnual learning budget | Flexible hours | Mentorship | Remote work | Support programsSenior-level Full TimeSão Paulo, Brazil3d ago
-
Lead Data Engineer ID71008 BRL 305K-390KAWS | Airflow | Amazon S3 | Athena | BigQueryAnnual learning budget | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeFlorianópolis, Brazil3d ago
-
Lead Data Engineer ID71008 BRL 305K-390KAmazon S3 | Apache Airflow | Athena | ClickHouse | DAGAnnual performance reviews | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeSalvador, Brazil3d ago
-
Azure | Data Factory | Data Governance | Data Modeling | Data QualityCorporate English classes | Learning platforms | Professional development opportunities | Remote workSenior-level Full TimeBrazil R3d ago
-
AWS | Analytics engineering | Apache Airflow | Cloud platform | DBTFlexible remote environment | Fully remote work | International team collaboration | Long term opportunityMid-level Full TimeBrazil R3d ago
-
AWS | Amazon Kinesis | Apache Kafka | Apache Spark | Data DeduplicationRemote workMid-level Full TimeBrazil R3d ago
-
Cientista de Dados | Remota - 135147 BRL 119K-119KAI Agents | Agent systems | Azure AI | Data Engineering | Data GovernanceRemote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0003d ago
-
AWS AppFlow | AWS Glue | AWS Lambda | AWS Redshift | AnalyticsDiscounts and partnerships | Employee assistance program | Learning and development training | Life insurance | Meal allowanceMid-level Full TimeSão Paulo, SP, BR, 04538-1323d ago
-
Arquitetura GenAI | Remota - 134499 BRL 119K-132K.NET | AI Search | Agile methodology | Amazon Bedrock | Anthropic ClaudeRemote workSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0003d ago
-
Engenheiro/Engenheira de Machine Learning Sênior BRL 60K-60KAWS Athena | AWS CLI | AWS Glue | AWS QuickSight | Amazon S3Dental insurance | Family care support | Flexible work | Health insurance | Hybrid workMid-level Full TimeBarueri, BR3d ago
-
Apache Spark | Azure Databricks | ELT | ETL | PythonBirthday off day | Career mentoring | Childcare support | Company results participation | Dental insuranceEntry-level Full TimeSao Paulo, Torre Paineira, Brazil3d ago