Data Engineer Pleno
Tasks
- Build and maintain data warehouse
- Build data ingestion pipelines
- Build feature stores
- Collaborate with stakeholders on platform initiatives
- Create scalable data models for analytics
- Design data storage and processing architectures
- Develop batch and streaming data pipelines
- Develop machine learning pipelines
- Establish ETL ELT processes
- Implement data governance for data models
- Manage data quality standards
- Mentor team members on data engineering best practices
- Monitor and tune query performance
- Optimize data warehouse cost
- Perform data transformation with dbt
- Set up streaming real time processing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS DMS | AWS Lambda | AWS Step Functions | Airflow | Amazon EC2 | Amazon ECR | Amazon EKS | Amazon RDS | Amazon S3 | Apache Kafka | Apache Storm | CI/CD | CloudFormation | DBT | Dimensional Modeling | Docker | ELT | ETL | Feature Engineering | Feature Store | GitLab | IAM | IoT | Jenkins | Kinesis | Kubernetes | Luigi | OLAP | OLTP | Prefect | Python | Query Optimization | SQL | Serverless | Snowflake | Step Functions | Terraform | Window Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
APIs | Artificial Intelligence | Data Analysis | Generative AI | GitChildcare assistance | Corporate university | Dental insurance | Extended maternity leave | Extended paternity leaveMid-level Full TimeSÃO PAULO, Brazil; SÃO PAULO, SP, …7h ago
-
DBT | Data Modeling | ELT | ETL | GitLabPaid time off | Remote work | Work autonomy | Work with top companiesSenior-level Full TimeSão Paulo R2d ago
-
API Automation | API Testing | AWS Lambda | Amazon S3 | Apache NiFiExciting projects | Flexible hours | Mentorship | Personalized growth roadmap | Remote work optionMid-level Full TimeCampinas, Brazil2d ago
-
API Automation | API Testing | AWS Lambda | Amazon S3 | Apache NiFiFlextime | Mentorship | Personalized growth roadmap | Remote work | TechtalksMid-level Full TimeBelo Horizonte, Brazil2d ago
-
API Testing | Bitbucket | CI/CD | Case management | Data ValidationFlexible hours | Mentorship | Personalized growth roadmaps | Remote work | TechtalksMid-level Full TimeSão Paulo, Brazil2d ago
-
API Automation | API Testing | Bitbucket | CI/CD | Case managementFlexible hours | Flextime | Mentorship | Personalized growth roadmap | Remote work optionMid-level Full TimeSão Bernardo do Campo, Brazil2d ago
-
API Testing | APIs | Bitbucket | CI/CD | GitHubFlexible hours | Flextime | Mentorship | Personalized growth roadmap | Remote work optionMid-level Full TimePorto Alegre, Brazil2d ago
-
API Testing | Bitbucket | CI/CD | DDL | DMLFlextime | Mentorship | Personalized growth roadmap | Remote work options | TechtalksMid-level Full TimeRecife, Brazil2d ago
-
API Testing | Bitbucket | CI/CD | GitHub | InsomniaFlexible hours | Flextime | Mentorship | Personalized growth roadmaps | Remote work optionsMid-level Full TimeCuritiba, Brazil2d ago
-
API Automation | API Testing | Bitbucket | CI/CD | Case managementFlexible hours | Flextime | Mentorship | Personalized growth roadmaps | Professional growthMid-level Full TimeBrasília, Brazil2d ago
-
API Testing | Bitbucket | CI/CD | Data Validation | ETLFlexible hours | Flextime | Mentorship | Personalized growth roadmap | Remote work optionsMid-level Full TimeRio de Janeiro, Brazil2d ago
-
API Testing | Bitbucket | CI/CD | Case management | Defect LifecycleFlexible hours | Flextime | Mentorship | Personalized growth roadmap | Remote work optionsMid-level Full TimeSorocaba, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KCI/CD | Debugging | GitLab CI | GitLab CI/CD | LLMFlexible hours | Mentorship | Professional growth | Remote work | TechtalksSenior-level Full TimeSorocaba, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KCI/CD | Code review | Codemod | Debugging | GitLabFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeSalvador, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KAgentic Workflows | CI/CD | Code Analysis | Codemods | DebuggingExciting projects | Flexible hours | Flextime | Mentorship | Personalized growth roadmapSenior-level Full TimeRecife, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KCI/CD | Code Analysis | Code review | Codemod | Cost TrackingFlexible hours | Professional growth | Remote workSenior-level Full TimeCampinas, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KAutomated Code Transformation | CI/CD | Code review | Code transformation | CodemodsFlexible hours | Flextime | Mentorship | Personalized growth roadmap | Remote work optionSenior-level Full TimeSão Paulo, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KAutomated Code Transformation | CI/CD | Code Analysis | Code transformation | CodemodFlextime | Mentorship | Professional growth | Remote work option | TechtalksSenior-level Full TimeBelo Horizonte, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KAgentic Workflows | Automated remediation | CI/CD | Code review | CodemodsFlexible hours | Flextime | Mentorship | Personalized growth roadmaps | Professional growthSenior-level Full TimeFlorianópolis, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KAgentic Workflows | CI/CD | Code Analysis | Codemod | DebuggingFlexible hours | Mentorship | Personalized growth roadmap | Remote work options | TechtalksSenior-level Full TimeRio de Janeiro, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KAgentic Workflows | Automated remediation | CI/CD | Codemods | DebuggingFlexible hours | Flextime | Growth roadmap | Mentorship | Remote workSenior-level Full TimeSão Bernardo do Campo, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KAutomated remediation | CI/CD | Code Analysis | Code review | CodemodsFlexible hours | Flextime | Mentorship | Personalized growth roadmaps | Professional growthSenior-level Full TimeBrasília, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KAutomated Code Transformation | CI/CD | Code review | Code transformation | CodemodsFlexible hours | Mentorship | Professional growth | Remote work | TechtalksSenior-level Full TimePorto Alegre, Brazil2d ago
-
Senior/Lead Platform Engineer ID69155 BRL 234K-316KAutomated remediation | CI/CD | Code review | Code transformation | DebuggingFlextime | Mentorship | Professional growth | Remote work options | TechtalksSenior-level Full TimeCuritiba, Brazil2d ago
-
API Testing | Bitbucket | CI/CD | GitHub | InsomniaFlextime | Mentorship | Personalized growth roadmap | Remote work options | TechtalksMid-level Full TimeSalvador, Brazil2d ago