Data Engineer
Tasks
- Automate deployments with CI/CD
- Build and maintain ETL/ELT pipelines
- Collaborate with analysts and data scientists
- Containerize data services
- Design analytics optimized schemas
- Develop and monitor streaming data pipelines
- Document data models and pipelines
- Enforce data governance and documentation
- Ensure compliance with data regulations
- Implement data partitioning and clustering
- Implement data validation anomaly detection and logging
- Ingest structured and unstructured data
- Maintain low latency ingestion
- Manage data warehouses
- Monitor pipeline health and resolve failed jobs
- Optimize SQL queries for cost and latency
- Orchestrate containers with Kubernetes
- Orchestrate data workflows
- Provision and manage cloud infrastructure with Terraform or CloudFormation
- Support BI dashboard development
- Tune query performance
Perks/Benefits
Skills/Tech-stack
AWS Glue | Airflow | Azure Data | Azure Data Factory | BigQuery | CI/CD | CloudFormation | DBT | Dagster | Data Factory | Docker | GCP Dataflow | GDPR | GitHub Actions | GitLab CI | Great Expectations | HIPAA | Jenkins | Kafka | Kinesis | Kubernetes | Looker | Luigi | Power BI | Prefect | PubSub | Python | Redshift | SQL | Scala | Snowflake | Tableau | Terraform
Education
N/A
Roles
Related jobs
-
.Net 8.0 | AI Pipelines | API Integration | ASP.Net Core | AlertingLeadership opportunity | Remote work | U.S. business hoursSenior-level Full TimeBrazil - Remote R19h ago
-
.NET | Apex | C# | C++ | DartRemote workSenior-level Part TimeBrasília, Brazil R1d ago
-
Computational Algorithms | Generative AI | Machine Learning | NumPy | Numerical MethodsPart-time freelance | Remote workMid-level FreelanceBrazil - Remote R1d ago
-
Computational Algorithms | Machine Learning | NumPy | Numerical Methods | PandasFlexible schedule | Freelance work | Part-time | Remote workMid-level FreelanceBrazil - Remote R1d ago
-
LLMs | Langchain | MLOps | Matplotlib | NumPyFlexible schedule | Part-time freelance | Remote workMid-level FreelanceBrazil - Remote R1d ago
-
Bash | Coverage py | Dagger | Docker | GcovFlexible schedule | Freelance project-based collaboration | Fully remote work | Supportive global communitySenior-level Full TimeBrazil - Remote R1d ago
-
PP - Data Engineer - 175 BRL 264K-368KAutomation Testing | Data Modeling | Data Warehousing | ETL | PySparkMid-level Full TimeBrazil - Remote R1d ago
-
UA - SSr. LLM Engineer - 0026 BRL 325K-430KAPIs | AWS | AWS Bedrock | Agent Based Prompting | Agent-basedSenior-level Full TimeBrazil - Remote R1d ago
-
DevOps & Site Reliability Engineer BRL 108K-136KAmazon Web Services | Azure | Azure Pipelines | Bash | CI/CDCareer development | English program | Fitness program | Home office | International projectsMid-level Full TimeBrasília, Federal District, Brazil R1d ago
-
DevOps & Site Reliability Engineer BRL 108K-136KAmazon Web Services | Azure | Azure Pipelines | Bash | CI/CDCareer development | English program | Fitness program | Games and competitions | International projectsMid-level Full TimeSão Paulo R1d ago
-
Senior Analytics Engineer (Contractor - ASAP) BRL 305K-396KCI/CD | DBT | DBT Cloud | Data Governance | Data LineageFlexible scheduling | Fully remote | Long-term collaboration | Professional supportSenior-level ContractBrazil R2d ago
-
Machine Learning Engineer BRL 172K-188KAirflow | Amazon SageMaker | CI/CD | Docker | Feature SelectionAnnual trip | Choose laptop and peripherals | Flexible working hours | Sharing Groups | Sports groupsMid-level Full TimeBlumenau, State of Santa Catarina, Brazil … R2d ago
-
Senior Data Platform Engineer (Python/AWS) - Finance BRL 258K-360KAWS CDK | AWS Glue | AWS Lambda | AWS Step Functions | Amazon ECSPaid time off | Remote work | Work autonomy | Work with top US companiesSenior-level Full TimeSão Paulo R5d ago
-
Master Data Engineer BRL 216K-275KData Cleansing | Data Integrity | Data Management | Data Quality | Data pipelineFlexible working hours | Laptop provision | Mentoring | Online courses | Referral bonusSenior-level Full TimeSão Paulo, São Paulo, Brazil - … R5d ago
-
AI & LLM Engineering Lead BRL 305K-396KAPI Design | AWS | Azure | CI/CD | Cloud infrastructureContinuous learning culture | Mentorship | Remote workSenior-level Full TimeRemote, Brazil R5d ago
-
AI & LLM Engineering Lead BRL 305K-396KAPI Design | AWS | Azure | CI/CD | Cloud platformRemote workSenior-level Full TimeRemote, Brazil R5d ago
-
Apache Airflow | Apache Hive | Apache Spark | Cause analysis | Data ModelingPaid time off | Remote work | Work autonomy | Work with top companiesSenior-level Full TimeSão Paulo R6d ago
-
Mid Software Engineer BRL 304K-396KAPI Design | Batch Processing | BigQuery | Data Enrichment | Data GovernanceMid-level Full TimeBrazil Sao Paulo - Remote Office R6d ago
-
Senior Data Engineer - Technology BRL 304K-370KAWS Glue | Agile | Amazon Athena | Amazon QuickSight | Amazon S3Autonomy | Career growth | Paid time off | Remote work | Work with top American companiesSenior-level Full TimeSão Paulo R7d ago
-
BigQuery | Cloud Data | Cloud Data Warehouses | Data Architecture | Data GovernanceDiversity and inclusion initiatives | Well-being benefitsSenior-level Full TimeFlorianópolis R8d ago
-
AWS | Akamai | Ansible | CI/CD | CloudFormationCareer advancement | Collaborative culture | Professional developmentMid-level Full TimeFoz do Iguaçu, Brazil (Hybrid) R8d ago
-
AI GTM Engineer BRL 234K-300KAI Models | API Management | JavaScript | Prompt engineering | PythonCollaborative environment | Company-provided gear | Flexible paid time off | Impactful products | Professional developmentSenior-level Full TimeBrazil - Remote R8d ago
-
Team Lead - Software Engineering BRL 234K-300KAPIs | AWS | Agile | CI/CD | Data platformsFlexible hours | Professional growth opportunities | Remote workSenior-level Full TimeSão Paulo, State of São Paulo, … R10d ago
-
AI | APIs | Agentic Orchestration | Data Pipelines | Machine LearningCareer growth opportunities | Remote workSenior-level Contract Full TimeSão Paulo, State of São Paulo, … R10d ago
-
AI Native Full Stack Engineer - OPS00063 BRL 234K-300KAI Development | Cloud Platforms | Data Engineering | Debugging | JavaHealth insurance | Paid days off | Wellness allowanceSenior-level Full TimeSão Paulo, São Paulo, Brazil - … R12d ago