Data Engineer - Data Foundry Engineer
Tasks
- Build dataset lifecycle for training data
- Build labeling pipeline infrastructure
- Define data quality standards
- Design data pipelines for data ingestion
- Document data sources and pipeline logic
- Integrate ETL ELT processes
- Participate in architecture decisions
- Perform code reviews and technical mentorship
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon Kinesis | Apache Airflow | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | DBT | Dagster | Data mesh | Databricks | Delta Lake | ELT | ETL | GRPC | GRPC API | Go | Great Expectations | Medallion Architecture | Prefect | Python | REST | REST APIs | SQL | Soda | Streamlit | Temporal
Education
N/A
Roles
Data Engineer | Data Foundry Engineer | Engineer | Foundry Engineer
Related jobs
-
Senior Data Governance - Remoto | Inglês BRL 80K-114KAmazon Web Services | Amazon Web Services (AWS) | Data Catalog | Data Classification | Data GovernanceCareer growth | Inclusive culture | Remote workSenior-level Full TimeBrazil - Sao Paulo R1d ago
-
Especialista em Engenharia de Dados - NaPista BRL 54K-60KBusiness Intelligence | Dashboard Development | Data Modeling | Data Pipelines | Data VisualizationHybrid work scheduleSenior-level Full TimeSão Paulo1d ago
-
Staff AI Engineer (Remoto) MXN 420K-480KAPIs | AWS | Amazon SageMaker | Azure | CI/CDChild care assistance | Dental insurance | Education benefit | Flexible schedule | GympassSenior-level Full TimeFlorianopolis, Santa Catarina, Brasil R1d ago
-
Engenheiro de Dados - área hospitalar BRL 18K-18KAWS | Apache Airflow | Apache Spark | Cloud platform | ComplianceRemote workSenior-level Full TimeSão Paulo, State of São Paulo, …1d ago
-
Data Analyst USD 96K-138KAutomation | CTE | Data Migration | Database Integrity | Debugging10 paid holidays per year | Annual performance reviews | Career growth opportunities | Learning culture | Quarterly performance bonusEntry-level ContractColombia; Argentina; Brazil; Mexico; Ecuador; Uruguay; …1d ago
-
Analista de Dados Pleno - 127203 INT BRL 107K-118KAPIs | Apache Airflow | Apache NiFi | Automated testing | AvroMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados Pl/Sr - 132117 BRL 108K-118KAWS CodePipeline | AWS Glue | AWS KMS | AWS Lambda | AWS Step FunctionsSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCollaborative work environment | Flexible work model | Learning platform | Onsite and Remote Flexibility | Wellness programSenior-level Full TimeSão Paulo, Brasil1d ago
-
Data Science Modelling BRL 102K-108KCause analysis | Data Visualization | Forecasting | Google AdWords | Google AnalyticsHybrid work | Remote work on designated days | Wellbeing programsMid-level Full TimeBusiness Unit Head Office - São …1d ago
-
Senior-level Full TimeBrasil2d ago
-
Lead Data Engineer BRL 305K-396KBig Data | CI/CD | Data Architecture | Data Engineering | Data GovernanceSenior-level Full TimeBrazil, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | Concurrency debuggingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBelo Horizonte, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | Concurrency | CsharpEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeSão Bernardo do Campo, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAmazon Web Services | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBrasília, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeCampinas, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSorocaba, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimePorto Alegre, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Growth roadmap | MentorshipSenior-level Full TimeRecife, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | C# | Concurrency | SQLEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeSalvador, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | Cloud NativeEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeFlorianópolis, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C Sharp | Cloud NativeEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeRio de Janeiro, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeCuritiba, Brazil2d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | Concurrency | CsharpEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSão Paulo, Brazil2d ago
-
Engenheiro De Dados Pleno BRL 60K-60KBigQuery | Cloud Storage | Google Cloud | Google Cloud Storage | KNIMESenior-level Full TimeValinhos, State of São Paulo, Brazil2d ago
-
Senior Big Data Engineer - SAP Concur Complete BRL 304K-396KACID | AWS CDK | AWS EMR | AWS Glue | AWS KinesisHealth and well-being benefits | Hybrid work | Inclusive culture | Learning opportunities | Skill growthSenior-level Full TimeSão Leopoldo, BR, 93022-7182d ago