Data Engineer (On-Site) | Engenheiro de Dados (Remoto)
Tasks
- Build incremental data pipelines
- Classify standardize validate and enrich data using AI
- Define similarity criteria and confidence thresholds
- Design ETL/ELT pipelines
- Develop scalable data lake architectures
- Document data flows and technical decisions
- Implement attribute extraction from documents and text
- Implement validation rules and alerting
- Ingest and integrate structured semi structured unstructured data
- Monitor data quality and pipeline reliability
- Optimize SQL queries for analytics
- Participate in code reviews and architecture discussions
- Perform entity resolution and record deduplication
- Translate business requirements into scalable solutions
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon DynamoDB | Amazon ECS | Amazon ECS Fargate | Amazon Kinesis | Amazon Kinesis Firehose | Amazon S3 | Apache Hudi | Apache Iceberg | Change Data Capture | Checkpointing | Data Capture | Data Cleansing | Data Engineering | Data Lake | Data Quality | Data Standardization | Deduplication | Delta Lake | Docker | ECS Fargate | ELT | ETL | Entity Extraction | Entity Matching | Entity Resolution | Failure recovery | Fuzzy Matching | Git | Idempotency | Infrastructure as Code | Kinesis Firehose | LLM | Language Models | Language Processing | Large Language Models | Machine Learning | Match and merge | Medallion Architecture | Natural Language | Natural Language Processing | Observability | Orchestration | Parquet | Probabilistic matching | Python | Record Linkage | Reprocessing | SQL | Step Functions | Terraform | Text Classification | “as-code”
Education
N/A
Roles
Related jobs
-
AWS | Ansible | Azure | Azure Machine Learning | CI/CDBirthday day off | Dental insurance | Educational partnerships with discounts | Fully remote | Group life insuranceMid-level Full TimeBrazil R22h ago
-
APIs | Automation | Bot lifecycle | Bot lifecycle management | Generative AICollaborative multidisciplinary team | Fully remote work | Professional growth opportunitiesSenior-level Full TimeBrazil R23h ago
-
APIs | Apache Spark | CI/CD | Chunking | Cloud platformChildcare assistance | Dental insurance | Educational Institution Partnerships | Fully remote work | Health insuranceSenior-level Full TimeBrazil R1d ago
-
AWS Cloud | AWS Glue | AWS IAM | Amazon EMR | Amazon S3Birthday day off | Dental insurance | Fully remote | Gym membership | Health insuranceSenior-level Full TimeBrazil R1d ago
-
Artificial Intelligence | Data Annotation | Data Operations | Human-in-the-loop | LLM EvaluationCollaborative cross-functional environment | Exposure to Leading AI Organizations | Fully remote | Professional growthSenior-level Full TimeBrazil R1d ago
-
Senior ML Engineer with Python (IR-536) BRL 319K-396KA/B | A/B Testing | Async/Await | Asyncio | Azure BlobCareer growth path | Extra absence days | Flexible hours | Team events | Training budgetSenior-level Full TimeBrazil - Remote R1d ago
-
Senior AI/ML Engineer - Technology BRL 300K-360KCI/CD | Deep learning | Experiment tracking | Fine Tuning | HuggingFace TransformersPaid time off | Remote work | Work autonomy | Work-life balanceSenior-level Full TimeSão Paulo R1d ago
-
CI/CD | Computer Vision | Data Augmentation | Deep learning | Edge AIFully remote work | Professional growthSenior-level Full TimeBrazil R2d ago
-
Agile | Alation | Apache Spark | Automated testing | Azure DataContract with potential extension | Flexible remote collaboration | Fully remote work | Opportunity to work with modern data technologies | Work from anywhere in LATAMMid-level Contract Full TimeBrazil R2d ago
-
API Integration | AWS Bedrock | Agents SDK | Arize | Azure AICareer growth opportunities | Childcare assistance | Dental insurance | Flexible working environment | Fully remote workSenior-level Full TimeBrazil R2d ago
-
Data Governance & Platform Manager USD 75K-100KAccess Control | Amazon Redshift | Apache Airflow | DBT | Data ContractsAI tools access | Self serve analytics autonomySenior-level Full TimeBrazil - Remote R2d ago
-
Senior Python Backend Developer / ML Engineer (IR-535) BRL 319K-430KAB Testing | Abstract Base Classes | Async/Await | Asyncio | Audit LoggingCareer path | Flexible hours | Team events | Training workshops | Udemy coursesSenior-level Full TimeBrazil - Remote R2d ago
-
Especialista I - Technical Lead BRL 210K-252KAWS | Acceptance Testing | CI/CD | Checkmarx | Distributed SystemsSenior-level Full TimeSão Paulo, SP, Brazil R2d ago
-
Machine Learning Engineer USD 132K-165KApache Spark | MLOps | Machine Learning | Pandas | PyTorchDistributed team | Flexible work schedule | Remote workMid-level Full TimeBogota R2d ago
-
AI Safety | Adversarial Testing | Bias detection | Chunking | Diffusion ModelsComprehensive Labor Benefits | Continuous learning | Flexible working hours | Inclusive, diverse culture | Long-term stabilityMid-level Full TimeBrazil R3d ago
-
Ablation Studies | Active Learning | Adversarial Testing | Attention Mechanisms | BPEFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growthMid-level Full TimeBrazil R3d ago
-
API Management | AWS | Apigee | Bash | CI/CDFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growth opportunitiesSenior-level Full TimeBrazil R3d ago
-
Mid-level Contract Full TimeBrazil - Remote R3d ago
-
CUDA | Computer Vision | Deep learning | GPU Optimization | Image ProcessingCollaborative environment | Flexible work location | Fully remote | Professional growth opportunitiesSenior-level Full TimeBrazil R4d ago
-
CUDA | Computer Vision | Deep learning | GPU Programming | Machine LearningCollaborative team | Flexible work hours | Fully remoteSenior-level Full TimeBrazil R4d ago
-
AWS Glue | Apache Airflow | Apache Kafka | Apache Spark | BigQueryCollaborative environment | Continuous learning | Fully remote work | Professional growth opportunitiesMid-level Full TimeBrazil R4d ago
-
Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CDDental insurance | Employee assistance program | Flexible work hours | Gympass | Life insuranceMid-level Full TimeSão Paulo, BR R4d ago
-
AI Lead (Brazil) BRL 144K-146KAI Platform | Analytics | Data Analysis | Language Processing | Machine LearningCareer growth opportunities | Remote-first companySenior-level Full TimeRemote/Brazil R5d ago
-
AIOps | AWS | Anomaly Detection | Azure | Azure OpenAIAutonomy | Collaborative team environment | Flexible schedule | Fully remote | Learning opportunitiesMid-level Full TimeBrazil R6d ago
-
Airbyte | Apache Airflow | Apache Iceberg | Cloud platform | DBTContinuous learning | Fully remote work | Global distributed team | Health benefits | Home office setup allowanceSenior-level Full TimeBrazil R7d ago