Data Engineer Pleno
Tasks
- Build and maintain data warehouse
- Build data ingestion pipelines
- Build feature stores
- Collaborate with stakeholders on platform initiatives
- Create scalable data models for analytics
- Design data storage and processing architectures
- Develop batch and streaming data pipelines
- Develop machine learning pipelines
- Establish ETL ELT processes
- Implement data governance for data models
- Manage data quality standards
- Mentor team members on data engineering best practices
- Monitor and tune query performance
- Optimize data warehouse cost
- Perform data transformation with dbt
- Set up streaming real time processing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS DMS | AWS Lambda | AWS Step Functions | Airflow | Amazon EC2 | Amazon ECR | Amazon EKS | Amazon RDS | Amazon S3 | Apache Kafka | Apache Storm | CI/CD | CloudFormation | DBT | Dimensional Modeling | Docker | ELT | ETL | Feature Engineering | Feature Store | GitLab | IAM | IoT | Jenkins | Kinesis | Kubernetes | Luigi | OLAP | OLTP | Prefect | Python | Query Optimization | SQL | Serverless | Snowflake | Step Functions | Terraform | Window Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Especialista de Dados/IA BRL 20K-31KAWS Glue | Amazon Web Services | Anomaly Detection | Apache Airflow | Big DataSenior-level Full TimeOsasco,São Paulo, Brasil13h ago
-
Senior Data Platform Engineer (Python/AWS/MDM) - Finance BRL 234K-295KAWS CDK | AWS CloudFormation | AWS Glue | AWS Lambda | AWS Step FunctionsEngagement activities | Paid time off | Remote work | Work autonomy | Work-life balanceSenior-level Full TimeSão Paulo R13h ago
-
Senior Machine Learning Engineer BRL 234K-295KAWS | Azure | CI/CD | Databricks | GCPFull-time employment | Work from homeSenior-level Full TimeBrazil16h ago
-
AWS | AWS Fargate | AWS Glue | AWS Lambda | AWS Step FunctionsChildcare assistance | Continuous learning platform | Discount club | Extended parental courses | Extended paternity leaveSenior-level Full TimeCampinas, SP R17h ago
-
Engenheiro(a) de Machine Learning (GenAI / LLMs) BRL 85K-150KAWS | Agile | Clean Code | Data Pipelines | GRPCChildcare support | Dental insurance | Extended maternity leave | Extended paternity leave | GympassSenior-level Full TimeRecife, Armazem 9, Brazil1d ago
-
Engenharia de Dados GCP - 132668 BRL 119K-119KAPI Integration | Airflow | BigQuery | CI/CD | Cloud ComposerHybrid schedule 3 days onsite weekly | Remote or hybrid workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados Sênior (Híbrido/SP) - 132000 BRL 48K-48KAWS | AWS Kinesis | Amazon Redshift | Apache Airflow | Apache KafkaHealth insurance | Hybrid work schedule | Paid time offMid-level Full TimeAlphaville - Barueri, BR, 06.454-000 R1d ago
-
Engenharia de Dados PL/SR - 131289 BRL 72K-72KAWS Glue | Amazon Athena | Amazon EMR | Amazon MSK | Amazon RedshiftRemote workSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0002d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeRio Branco, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Growth roadmap | MentorshipSenior-level Full TimeBoa Vista, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Flexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeMacapá, Brazil2d ago
-
Backend Engineer (Senior) ID55642 EUR 54K-76KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Growth roadmap | MentorshipSenior-level Full TimePorto Velho, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimePalmas, Brazil2d ago
-
Full Stack AI Engineer ID55910 BRL 234K-316KAPIs | AWS | Azure | CI/CD | ClaudeEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeSorocaba, Brazil2d ago
-
Senior Software Engineer – C# ID55642 BRL 234K-368KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipSenior-level Full TimeBoa Vista, Brazil2d ago
-
Senior Software Engineer – C# ID55642 BRL 234K-368KAmazon Web Services | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeMacapá, Brazil2d ago
-
Senior Software Engineer – C# ID55642 BRL 234K-368KAWS | Apache Spark | C# | C++ | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRio Branco, Brazil2d ago
-
Senior Software Engineer – C# ID55642 BRL 234K-368KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimePalmas, Brazil2d ago
-
Senior Software Engineer – C# ID55642 EUR 57K-76KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimePorto Velho, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeRio Branco, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeMacapá, Brazil2d ago
-
Data Engineer (FinOps) ID56348 EUR 55K-65KAWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flextime | Mentorship | Office optionsMid-level Full TimePorto Velho, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsMid-level Full TimeBoa Vista, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | Cloud platform | DBTEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsMid-level Full TimePalmas, Brazil2d ago
-
AWS | Apache Airflow | CI/CD | DBT | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Modern projectsMid-level Full TimeRio Branco, Brazil2d ago