Data Engineer
Tasks
- Automate deployments with CI/CD pipelines
- Build ETL/ELT pipelines
- Build analytics ready datasets for reporting
- Build real-time streaming data pipelines
- Collaborate with analysts data scientists and business stakeholders
- Containerize data services with Docker
- Create dashboard and reporting data models
- Deploy and manage services with Kubernetes
- Design data warehouse schemas
- Enforce data governance naming lineage and documentation
- Implement audit ready data processes
- Implement data quality validation anomaly detection logging and monitoring
- Implement data transformations using dbt
- Ingest data from APIs SaaS databases files and streaming systems
- Manage and optimize cloud data warehouses
- Manage cloud infrastructure with Infrastructure as Code
- Monitor pipeline health and resolve failures
- Optimize streaming throughput and reliability
- Orchestrate data workflows
Perks/Benefits
Skills/Tech-stack
AWS | Airflow | Amazon Redshift | Azure | BigQuery | CI/CD | CloudFormation | DBT | Dagster | Docker | ELT | ETL | GCP | GDPR | GitHub Actions | GitLab CI | Great Expectations | HIPAA | Jenkins | Kafka | Kafka Connect | Kinesis | Kubernetes | Prefect | PubSub | Python | SQL | Scala | Snowflake | Terraform
Education
N/A
Roles
Related jobs
-
Staff Machine Learning Operations Engineer - Brazil BRL 230K-265KAWS | Alerting | Apache Airflow | Azure | CI/CDFlexible work hours | Home office setup support | Remote environment | Self-managed PTO | Work in your own time zoneSenior-level Full TimeBrazil R22h ago
-
Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerContinuous learning | Flexible schedule | Knowledge sharing | Professional development | Remote workMid-level Full TimeBrazil R1d ago
-
Agile | Apache Hadoop | Apache Hive | Apache Spark | Azure BlobHybrid workSenior-level Full TimeAlphaville - Barueri, BR, 06.454-000 R1d ago
-
DevOps Architect BRL 240K-275KAmazon Linux | Ansible | Azure | Bash | CI/CDExchange program | Health insurance | Life insurance | OPD | Paid time offSenior-level Full TimeBrazil - Remote R4d ago
-
Engenharia de Dados & Big Data (Híbrido/SP) - 133188 BRL 96K-119KAgile | Apache Hadoop | Apache Hive | Apache Spark | Azure BlobMid-level Full TimeAlphaville - Barueri, BR, 06.454-000 R4d ago
-
API | Access Control | Airbyte | BigQuery | CRMPaid time off | Remote work | Work with autonomySenior-level Full TimeSão Paulo R5d ago
-
Amazon Redshift | Apache Airflow | Apache Kafka | Apache Spark | DBTContinuous learning environment | Flexible working hours aligned to Central Time | Fully remote | International team culture | Long-term contractSenior-level Full TimeBrazil R6d ago
-
Apache Airflow | Azure | Azure Data | Azure Data Factory | Data FactoryCorporate English classes | Food allowance | Healthcare plan | Home-office allowance | Learning IncentiveSenior-level Full TimeBrazil R6d ago
-
A/B | A/B Testing | Automation | B testing | CDCBirthday day off | Childcare assistance | Company-provided equipment | Coworking space access | Dental insuranceSenior-level Full TimeBrazil R6d ago
-
AWS | AWS Glue | AWS Lambda | Amazon S3 | AzureAutonomy | Collaborative learning environment | Flexibility | Fully remote work BrazilSenior-level Full TimeBrazil R6d ago
-
API Integration | Automation | Claude | Data Architecture | Data ModelingCollaborative fast-paced culture | Flexible working hours | Fully remote | High ownershipSenior-level Full TimeBrazil R6d ago
-
Apache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsInclusive culture | Integral well being | Professional development | Remote workSenior-level Full TimeFlorianópolis, Santa Catarina, Brasil R6d ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible hours | Part-time schedule | Project based workSenior-level Full TimeBrazil - Remote R6d ago
-
Bioinformatics Engineer II (Remote/Brazil) BRL 144K-156KAWS | Bash | Cell analysis | Cloud Computing | ContainerizationLaptop provided | Remote work | Supportive inclusive environmentMid-level Full TimeBrazil R6d ago
-
Machine Learning Engineer BRL 108K-132KAWS | AWS Edge | Agents | Anomaly Detection | CDNAutonomous role | Distributed team | Remote workMid-level Full TimeSão Paulo R7d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon ECSInternational team | Learning and growth opportunities | Paid time off | Remote workSenior-level Full TimeBrazil R7d ago
-
API Integration | AWS | Anthropic Claude | Azure | CrewAICareer development plan | Client acquisition bonuses | Company-provided equipment | Continuous learning support | English classesMid-level Full TimeBrazil R7d ago
-
AUC | Docker | Embeddings | Explainable AI | F1-scoreDiscount partnerships | Education assistance | Family benefits | Health insurance | Home-office allowanceSenior-level Full TimeBrazil R7d ago
-
Anomaly Detection | Data Modeling | Data Pipelines | Docker | Industrial analyticsCareer growth opportunities | Flexible work environment | International team collaboration | Remote workMid-level Full TimeBrazil R7d ago
-
Senior Machine Learning Engineer BRL 120K-138KA/B | A/B Testing | AWS | B testing | CI/CDAnnual leave | Dental plan | Discounts | Enhanced family leave | Gym membershipSenior-level Full TimeSao Paulo R8d ago
-
Accelerate | Data Analysis | Deep learning | Diffusers | Generative AIAutonomy and ownership | Career growth opportunities | Flexible distributed environment | Fully remote | Global collaborationMid-level Full TimeBrazil R8d ago
-
Data Curation | Deep learning | Distributed machine learning | Experiment design | GPU ComputingAccess to high-performance computing | Flexible work schedule | Fully remote | Professional growth opportunitiesSenior-level Full TimeBrazil R8d ago
-
Apache Flink | Apache Kafka | Avro | CI/CD | Distributed SystemsEnglish communication required | Hybrid workSenior-level Full TimeSão Paulo, State of São Paulo, … R9d ago
-
Code repositories | Data Mapping | Data Modeling | Data integration | Design PatternsHealthcare data domain exposure | Long-term engagement | Occasional onsite travel for workshops | Remote Work USSenior-level Contract Full TimeBrazil - Remote R11d ago
-
Data Engineer, Azure - Remote, Latin America BRL 200K-250KAzure DevOps | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CSVCompany-sponsored certification | Conferences | Continuing education | Flexible working hours | Paid time offMid-level Full TimePorto Alegre, Brazil R11d ago