Engenharia de Dados Especialista - 132193
Alphaville - Barueri, BR, 06.454-000
BRL 84K-84K (estimate) Senior-level Full Time
Tasks
- Apply deduplication and late arriving data handling
- Build data lineage and traceability
- Build end-to-end data pipelines
- Collaborate with analytics teams on data consumption patterns
- Define analytical dimensional modeling
- Design data contracts between producers and consumers
- Ensure pipeline observability with metrics and alerts
- Implement Slowly Changing Dimensions SCD
- Implement data quality validation in pipelines
- Set partitioning bucketing and compression strategies
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Adaptive Partitioning | Amundsen | Apache Airflow | Apache Flink | Apache Iceberg | Apache Parquet | Apache Spark | Big Table | CI/CD | ClickHouse | Contract testing | Data Bucketing | Data Compression | Data Contract Testing | Data Deduplication | Data Lineage | Data Partitioning | Data Uniqueness | Data completeness | Data contract | Data freshness | Data mesh | Data orchestration | Datahub | DuckDB | Great Expectations | Integration Testing | Java | Lakehouse Architecture | Late Arriving Data | One Big Table | OpenMetadata | Polars | Pydeequ | Python | Referential Integrity | SCD Type 1 | SCD Type 3 | SCD Type-2 | SQL | Schema Validation | Slowly Changing Dimensions | Snowflake Schema | Soda Core | Star Schema | Type 1 | Type 2) | Unit Testing | Z-ordering
Education
N/A
Roles
Related jobs
-
Analista de Desenvolvimento de Software I BRL 60K-60KAWS EC2 | AWS EKS | AWS EMR | AWS S3 | AWS SQSDevelopment opportunities | Reward and recognition | Volunteering | Wellness | Work-life balanceMid-level Full TimeSão Paulo, Brazil17h ago
-
Apache Spark | Azure Compute | Azure DevOps | Azure Networking | Azure StorageWork from homeSenior-level Full TimeBrazil19h ago
-
Lead Data Engineer BRL 234K-300KAzure | Azure Databricks | CI/CD | Compliance | DBTFull-time employment | Work from homeSenior-level Full TimeBrazil19h ago
-
Mid-level Full TimeState of Rio Grande do Sul, …22h ago
-
Analytics Engineer BRL 23K-23KAWS | Big Data | Data Governance | Data Modeling | Data QualityCareer development support | Casual environment | Dental insurance | Health insurance | Meal benefit cardEntry-level Full TimeHybrid, SP R1d ago
-
AWS CloudFormation | Airflow | Amazon Kinesis | Amazon Redshift | BigQueryFlexible hours | Remote workMid-level Full TimeBrazil - Remote R1d ago
-
Senior Data Engineer BRL 234K-300KAgile | Analysis Services | Azure | Azure Analysis | Azure Analysis ServicesSenior-level Full TimeBrazil -Sao Paulo1d ago
-
Senior Data Engineer BRL 234K-300KAgile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataSenior-level Full TimeBrazil -Sao Paulo1d ago
-
Overseas Contractor BRL 305K-396KAWS | Amazon Aurora | Amazon Aurora MySQL | Amazon DynamoDB | Apollo GraphQLAgile team collaboration | Hybrid work | Remote workSenior-level ContractSão Paulo, SP, BR1d ago
-
Senior Data Engineer AI | Inglês BRL 78K-119KAzure Cognitive | Azure Cognitive Services | Azure Machine Learning | Cognitive Services | Data PipelinesSenior-level Full TimeBrazil - Sao Paulo1d ago
-
Senior-level Full TimeSão Paulo, Brazil1d ago
-
Data Architecture | Data Modeling | Data Normalization | Data pipeline | Dimensional ModelingMid-level Full TimeSão Paulo, SP, Brazil1d ago
-
Data Engineer BRL 120K-144KClassification | Clustering | DAX | Data Modeling | Data VisualizationCasual office dress code | Childcare subsidies | Clube Ben partnership | Days off | Dental insuranceMid-level Full TimeCampinas, São Paulo, Brazil1d ago
-
Data Engineer BRL 305K-385KAlerting | Apache Spark | Azure | CI/CD | Data GovernanceChildcare subsidies | Dental insurance | Health insurance | Language and training platforms | Life insuranceMid-level Full TimeCampinas, Brazil1d ago
-
Senior Data Engineer BRL 304K-370KAWS Lambda | Amazon RDS | Amazon S3 | Amazon Web Services | Apache SparkEquipment stipend | Flexible PTO | Learning and development stipend | Paid certifications exams | Professional development planSenior-level Full TimeBRAZIL R1d ago
-
[job-28646] Developer Master IA (SDLC+GenAI) BRL 18K-18KAgent systems | Automated testing | CI/CD | Code review | Data PrivacyChildcare support | Dental insurance | Discount club | Extended parental leave | GympassSenior-level Full TimeBrazil1d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAmazon Web Services | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBelo Horizonte, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionSenior-level Full TimePorto Alegre, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeCampinas, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeSão Bernardo do Campo, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeRecife, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeFlorianópolis, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | ConcurrencyFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeSão Paulo, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSalvador, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 305K-396KAWS | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeSorocaba, Brazil2d ago