Data Engineer
Tasks
- Automate deployments with CI/CD
- Build and maintain ETL/ELT pipelines
- Containerize data services
- Design analytics optimized schemas
- Develop and monitor streaming pipelines
- Document data models and pipelines
- Enforce data governance and documentation
- Ensure low latency ingestion
- Implement data validation checks and logging
- Ingest structured and unstructured data
- Manage data warehouses
- Optimize SQL queries and warehouse performance
- Orchestrate containers with Kubernetes
- Orchestrate data workflows
- Provision cloud infrastructure with Terraform or CloudFormation
- Support BI dashboard development
Perks/Benefits
Skills/Tech-stack
APIs | Airflow | Amazon Kinesis | Amazon Redshift | BigQuery | CI/CD | Cloud Pub/Sub | CloudFormation | DBT | Dagster | Data Warehousing | Docker | ELT | ETL | GitHub Actions | GitLab CI | Google Cloud | Google Cloud Pub/Sub | Great Expectations | Jenkins | Kafka | Kubernetes | Looker | Luigi | Power BI | Prefect | Pub/Sub | Python | SQL | Scala | Snowflake | Snowflake Schema | Star Schema | Streaming | Tableau | Terraform
Education
N/A
Roles
Related jobs
-
Forward Deployed Engineer (AI) - Advertising (Brazil) BRL 234K-275KAutoGPT | Chain-of-Thought | Embedding Models | Few-Shot Learning | Few-shotPaid time off | Remote work | Work autonomy | Work-life balanceSenior-level Full TimeBrazil R13h ago
-
Data Engineer BRL 200K-250KAgentic AI | Apache Airflow | DBT | Data Modeling | Data QualityFully remote work up to four weeks per year | Hybrid work scheduleMid-level Full TimeSão Paulo, São Paulo, Brazil R14h ago
-
AWS Bedrock | Amazon SageMaker | Amazon Web Services | Autogen | Automated testingChildcare assistance | Dental plan | Education assistance | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo, SP R17h ago
-
Amazon Web Services | Cloud platform | Data Integrity | Data Migration | Data PipelinesMid-level Contract Full TimeBrazil - Remote R1d ago
-
CI/CD | ClickHouse | Datadog | Distributed Systems | ElasticsearchContinuous learning | Integral well being | Mentoring | Remote workSenior-level Full TimeRemoto, Brasil R1d ago
-
Senior Data Engineer (Credit) BRL 180K-184KAI tools | Analytics engineering | DBT | Data Integrity | Data ModelingAnnual performance bonus | Health, dental, and vision plans | Remote work | Stock optionsSenior-level Full TimeBrazil R1d ago
-
A/B | A/B Testing | AUC | AWS | Apache SparkDental insurance | Fitness and wellness support | Fully remote | Health insurance | Home-office allowanceMid-level Full TimeBrazil R2d ago
-
API Integration | Artificial Intelligence | CRM Integration | Data-driven | Data-driven workflowsCareer growth opportunities | Continuous learning | Fully remoteMid-level Full TimeBrazil R2d ago
-
AWS | Apache Flink | Apache Hadoop | Apache Hive | Apache ImpalaCareer development access | Employee resource groups | Flexible work from home | Generous paid time off | Paid volunteer timeMid-level Full TimeBrazil-Remote R2d ago
-
Data Engineer (Brazil) BRL 240K-279KAWS | Apache Airflow | Apache Spark | Apache Spark Streaming | Data GovernanceCross-functional collaboration | Data driven product impactMid-level Full TimeRemote (Brazil) R2d ago
-
C# | Data Analysis | MATLAB | NumPy | PandasPart-time projects | Project based workSenior-level FreelanceBrazil - Remote R3d ago
-
Engenheiro de Dados Azure BRL 48K-80KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeTWGSP - Teleworker/Offsite - BRA - … R3d ago
-
AWS | Anthropic Claude | Azure | Data Preprocessing | FaissMentorship | Remote workMid-level ContractBrazil R3d ago
-
AI Engineer II - Marketing USD 39K-72KAWS | BERT | CI/CD | Docker | EmbeddingsFull-time employment | Remote workMid-level Full TimeBrazil, Remote R3d ago
-
AI Engineering I - Marketing USD 30K-39KAPI Development | AWS | Attention Mechanisms | CI/CD | Data ModelingFull-time employment | Remote workEntry-level Full TimeBrazil, Remote R3d ago
-
Sr. AI Engineer - Marketing USD 50K-120KAWS | AWS CloudWatch | Amazon SageMaker | Apache Spark | CI/CDSenior-level Full TimeBrazil, Remote R3d ago
-
Senior Data Engineer BRL 18K-18KA/B | A/B Testing | Apache Spark | B testing | Credit RiskChildcare assistance | Dependent health coverage | Flexible vacation | Health insurance | Learning budgetSenior-level Full TimeSão Paulo, Remote R4d ago
-
Senior-level Full TimeBrazil - Remote R4d ago
-
Intermediate/Senior Data Engineer - OP02112 BRL 160K-188KAWS | Airflow | DBT | Dagster | Data IngestionEnglish lessons | Health insurance | Learning programs | Medical leave | Paid sick daysMid-level Full TimeSão Paulo, São Paulo, Brazil - … R4d ago
-
Data Engineer (Python | Airflow | Machine Learning) BRL 214K-252KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | CI/CDEnglish program | Fitness program | Home office | International projects | Remote workMid-level Full TimeSão Paulo R4d ago
-
Python Engineer (AI / Machine Learning Focus) BRL 234K-295KAWS | Agents | Artificial Intelligence | Automation | Cloud platformCareer growth | English program | Fitness benefits | Games and competitions | Home officeSenior-level Full TimeSão Paulo R4d ago
-
AI coding | AI coding tools | API Design | Anthropic API | AuthenticationCareer growth | English program | Fitness program | Home office | International projectsSenior-level Full TimeBrasília, Federal District, Brazil R4d ago
-
Research Scientist - Graph Foundation Models BRL 264K-312KAgile | Data Processing | Data pipeline | Deep learning | Distributed SystemsAccess to global AI advisors | Extended parental leave | National health plan | Remote work | Unlimited vacationMid-level Full TimeSão Paulo R4d ago
-
Data Scientist Specialist (Lending) BRL 184K-184KA/B | A/B Testing | AUC | AWS | Apache SparkDental insurance | Gym membership | Health insurance | Home-office allowance | Life insuranceSenior-level Full TimeBrazil - Remote R5d ago
-
AI Data Engineer BRL 150K-240KAWS | AWS EventBridge | AWS Lambda | AWS S3 | Automated testingDEI initiatives opportunities | Fully remote or hybrid work | Healthcare stipend | National holidays | Paid mental health recharge daysMid-level Full TimeRemote - Brazil R8d ago