Data Engineer Ii
Tasks
- Apply data quality validations
- Create data dictionaries
- Create data lineage
- Define and maintain data quality KPIs
- Deliver curated tables for consumption
- Develop and optimize ETL/ELT pipelines
- Document technical processes
- Ensure LGPD compliance
- Ensure data security compliance
- Handle nulls duplicates and anomalies
- Implement data catalogs and metadata
- Ingest raw data
- Maintain data contracts
- Monitor pipelines and resolve inconsistencies with alerts
- Translate business requirements into technical solutions
Perks/Benefits
- Childcare assistance
- Day off on birthday
- Dental insurance
- Fitness benefits
- Health insurance
- Life insurance
- Meal allowance
- Meal voucher
- Parental leave support
- Seguro de vida
- Training programs
Skills/Tech-stack
AWS | AWS Data | AWS Data Catalog | AWS Glue | Amazon EMR | Amazon S3 | Apache Airflow | Apache Kafka | Apache Spark | CI/CD | Data Catalog | Data Contracts | Data Governance | Data Lineage | Data Quality | Data Security | Datahub | ELT | ETL | Git | Kubernetes | LGPD | PySpark | Python | SQL
Education
N/A
Regions
Countries
States
Related jobs
-
Grupo QuintoAndar| People Analytics Specialist BRL 144K-144KData Accuracy | Data Quality | Experimental Design | Hypothesis Testing | Machine LearningAtypical Parenthood subsidy | Benefits club | Childcare subsidy | Day off birthday | Dental planSenior-level Full TimeSão Paulo, São Paulo, Brazil14h ago
-
Data Analyst, Product GBP 95K-124KA/B | A/B Testing | Analytical Functions | Apache Airflow | B testingSenior-level Full TimeUnited Kingdom17h ago
-
Databricks | ELT | ETL | Power Apps | Power AutomateBirthday day off | Birthday recognition | Collaborative inclusive environment | Dental insurance | Gym membershipEntry-level Full TimeSão Paulo, SP, Brazil18h ago
-
APIs | Attribution Modeling | Campaign Optimization | Causal Inference | ClusteringAccess to diverse client datasets | Collaborative team environment | Hybrid work model | Knowledge sharing | Opportunities for challenging projectsMid-level Contract FreelanceBrazil21h ago
-
Forward Deployed Engineer, Enterprise AI [LATAM] BRL 319K-396KAWS | Automated testing | Cloud Computing | Cloud platform | ComplianceSenior-level Full TimeSão Paulo, Brazil23h ago
-
Forward Deployed Engineer, Enterprise AI [LATAM] BRL 234K-295KAI | API Design | AWS | Cloud Computing | Cloud platformSenior-level Full TimeSão Paulo, Brazil23h ago
-
AWS | Apache Airflow | Apache Spark | Azure | Azure DataBirthday day off | Casual dress code | Dental insurance | Educational partnerships | Extended maternity and paternity leaveSenior-level Full TimeBrazil1d ago
-
Adversarial Testing | Artificial Intelligence | Bias Assessment | Experiment tracking | Hallucination detectionContract based opportunity | Opportunity to work on advanced AI systems | Remote work flexibilitySenior-level Contract Full TimeBrazil R1d ago
-
Cloud infrastructure | Containerization | Docker | GPU Computing | KubernetesCareer growth in AI infrastructure | Four-day work week | Fully remote | Global team collaboration | Open communication inclusive cultureSenior-level Full TimeBrazil R1d ago
-
AWS Textract | Autogen | Azure Form Recognizer | CI/CD | Computer VisionBirthday day off | Childcare assistance | Cultural partnerships | Dental insurance | Family support for new parentsSenior-level Full TimeBrazil R1d ago
-
Data Engineer BRL 216K-275KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Data IngestionWork from homeSenior-level Full TimeBrazil1d ago
-
Arquitetura de Dados e IA | Remota - 134857 BRL 119K-119KAWS Glue | AWS SageMaker | Agile | Amazon Athena | Amazon EMRRemote workSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados AWS (Pleno/Sênior) | Remota - 134904 BRL 120K-120KAWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step FunctionsRemote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados AWS (Pleno/Sênior) | Remota - 134905 BRL 120K-120KAWS Glue | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step FunctionsRemote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados AWS Sênior | Remota - 134936 BRL 120K-120KAWS Glue | AWS Lambda | AWS Step Functions | Amazon EventBridge | Amazon S3Collaborative team | Independent work | Problem solving support | Remote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
[Job-30692] Senior AI Engineer, Brazil BRL 230K-265KAgent Orchestration | Artificial Intelligence | CI/CD | Code review | DevOpsChildcare assistance | Continuous learning platform | Discount club | Extended paternity leave | Gym and wellness partnershipsSenior-level Full TimeBrazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | Batch ProcessingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeRecife, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | Batch Processing | CI/CD | DagsterEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeCampinas, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | CI/CD | Dagster | Data LineageEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBrasília, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | CI/CD | Dagster | Data Lineage | Data QualityEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRio de Janeiro, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSalvador, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | CI/CD | Dagster | Data LineageEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBelo Horizonte, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | CI/CD | DagsterEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimePorto Alegre, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | Batch Processing | CI/CD | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsSenior-level Full TimeCuritiba, Brazil1d ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSão Paulo, Brazil1d ago