Data Engineer Pleno
Tasks
- Build and maintain data warehouse
- Build data ingestion pipelines
- Build feature stores
- Collaborate with stakeholders on platform initiatives
- Create scalable data models for analytics
- Design data storage and processing architectures
- Develop batch and streaming data pipelines
- Develop machine learning pipelines
- Establish ETL ELT processes
- Implement data governance for data models
- Manage data quality standards
- Mentor team members on data engineering best practices
- Monitor and tune query performance
- Optimize data warehouse cost
- Perform data transformation with dbt
- Set up streaming real time processing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS DMS | AWS Lambda | AWS Step Functions | Airflow | Amazon EC2 | Amazon ECR | Amazon EKS | Amazon RDS | Amazon S3 | Apache Kafka | Apache Storm | CI/CD | CloudFormation | DBT | Dimensional Modeling | Docker | ELT | ETL | Feature Engineering | Feature Store | GitLab | IAM | IoT | Jenkins | Kinesis | Kubernetes | Luigi | OLAP | OLTP | Prefect | Python | Query Optimization | SQL | Serverless | Snowflake | Step Functions | Terraform | Window Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Especialista de Dados/IA BRL 20K-31KAWS Glue | Amazon Web Services | Anomaly Detection | Apache Airflow | Big DataSenior-level Full TimeOsasco,São Paulo, Brasil12h ago
-
AWS | AWS Fargate | AWS Glue | AWS Lambda | AWS Step FunctionsChildcare assistance | Continuous learning platform | Discount club | Extended parental courses | Extended paternity leaveSenior-level Full TimeCampinas, SP R15h ago
-
Engenheiro(a) de Machine Learning (GenAI / LLMs) BRL 85K-150KAWS | Agile | Clean Code | Data Pipelines | GRPCChildcare support | Dental insurance | Extended maternity leave | Extended paternity leave | GympassSenior-level Full TimeRecife, Armazem 9, Brazil1d ago
-
Engenharia de Dados PL/SR - 131289 BRL 72K-72KAWS Glue | Amazon Athena | Amazon EMR | Amazon MSK | Amazon RedshiftRemote workSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0002d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeRio Branco, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Growth roadmap | MentorshipSenior-level Full TimeBoa Vista, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Flexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeMacapá, Brazil2d ago
-
Backend Engineer (Senior) ID55642 EUR 54K-76KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Growth roadmap | MentorshipSenior-level Full TimePorto Velho, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimePalmas, Brazil2d ago
-
Full Stack AI Engineer ID55910 BRL 234K-316KAPIs | AWS | Azure | CI/CD | ClaudeEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeSorocaba, Brazil2d ago
-
Senior Software Engineer – C# ID55642 BRL 234K-368KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipSenior-level Full TimeBoa Vista, Brazil2d ago
-
Senior Software Engineer – C# ID55642 BRL 234K-368KAmazon Web Services | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeMacapá, Brazil2d ago
-
Senior Software Engineer – C# ID55642 BRL 234K-368KAWS | Apache Spark | C# | C++ | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRio Branco, Brazil2d ago
-
Senior Software Engineer – C# ID55642 BRL 234K-368KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimePalmas, Brazil2d ago
-
Senior Software Engineer – C# ID55642 EUR 57K-76KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimePorto Velho, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeRio Branco, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeMacapá, Brazil2d ago
-
Data Engineer (FinOps) ID56348 EUR 55K-65KAWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimePorto Velho, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsMid-level Full TimeBoa Vista, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | Cloud platform | DBTEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsMid-level Full TimePalmas, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Modern projectsMid-level Full TimeRio Branco, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimePalmas, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterFlexible schedule | Growth roadmaps | Mentorship | Office option | Remote work optionMid-level Full TimeBoa Vista, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsMid-level Full TimeMacapá, Brazil2d ago
-
FinOps Data Engineer ID56348 EUR 55K-65KAWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimePorto Velho, Brazil2d ago