Data Engineer
Tasks
- Coordinate with stakeholders to communicate architecture and requirements
- Design data platform architecture
- Develop data ingestion transformation and cleanup pipelines
- Gather business and technical requirements
- Govern data frameworks and performance
- Implement data modeling and data design
- Integrate data lake and data warehouse systems
- Tune and optimize data storage and processing
Perks/Benefits
Skills/Tech-stack
Amazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Data Ingestion | Data Lake | Data Modeling | Data Warehousing | ETL | HDFS | Hadoop | Hive | Java | Kubernetes | Linux | Luigi | NoSQL | Oozie | Pentaho | Python | SQL | Web Services | YARN
Education
N/A
Roles
Related jobs
-
AWS Textract | Autogen | Azure Form Recognizer | CI/CD | Computer VisionBirthday day off | Childcare assistance | Cultural partnerships | Dental insurance | Family support for new parentsSenior-level Full TimeBrazil R8h ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | Batch ProcessingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeRecife, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | Batch Processing | CI/CD | DagsterEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeCampinas, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | CI/CD | Dagster | Data LineageEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBrasília, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | CI/CD | Dagster | Data Lineage | Data QualityEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeRio de Janeiro, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSalvador, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | CI/CD | Dagster | Data LineageEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBelo Horizonte, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | CI/CD | DagsterEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimePorto Alegre, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | Batch Processing | CI/CD | DagsterEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsSenior-level Full TimeCuritiba, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSão Paulo, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS | AWS Kinesis | Apache Airflow | Apache Kafka | AzureEducation budget | Fitness budget | Flextime | Mentorship | Office optionsSenior-level Full TimeFlorianópolis, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KApache Airflow | Automated testing | CI/CD | Dagster | Data LineageEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSorocaba, Brazil22h ago
-
Senior Data Engineer ID71670 BRL 300K-368KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeSão Bernardo do Campo, Brazil22h ago
-
AI Agents | AWS Bedrock | Anthropic Claude | Cause analysis | Cloud infrastructureChildcare assistance | Continuous learning opportunities | Dental insurance | Discount programs | Food allowanceSenior-level Full TimeBrazil1d ago
-
AI Foundry | API Management | AWS Bedrock | Active Directory | Application InsightsAccess to multicultural global projects | Birthday day off | Development tracks | Equipment provided | Fitness programsSenior-level Full TimeBrazil R1d ago
-
AWS | Automation | Azure | CI/CD | Cloud ComputingDigital transformation exposure | Inclusive environment | Professional growth | Renewable contractSenior-level Full TimeBrazil1d ago
-
AWS Glue | Apache Airflow | Apache Kafka | Apache Spark | CassandraCollaborative environment | Continuous learning and knowledge sharing | Fully remote work model | Inclusive workplace open to diverse backgrounds | Professional growth opportunitiesSenior-level Full TimeBrazil R1d ago
-
Senior Applied AI Software Engineer BRL 300K-360KAI orchestration | API Development | AWS | Agentic Workflows | Automated testingRemote work | Work in US Eastern time zoneSenior-level Full TimeSão Paulo, SP, Brazil R1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Continuing education | Flexible working hours | Paid time off | Remote workSenior-level Full TimePorto Alegre, Brazil R1d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Continuing education | Flexible working hours | Paid time off | Remote workSenior-level Full TimeSão Paulo, Brazil R1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Continuing education | Flexible working hours | Paid time off | Remote workSenior-level Full TimeSalvador, Bahia, Brazil R1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCertification support | Company-sponsored coursework | Conference attendance | Continuing education | Flexible working hoursSenior-level Full TimeRio de Janeiro, Brazil R1d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Conference attendance | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeRecife, Pernambuco, Brazil R1d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeCompany-sponsored certifications | Conference support | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeManaus, Amazonas, Brazil R1d ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompany-sponsored certifications | Conferences | Continuing education | Flexible working hours | Paid time offSenior-level Full TimeGoiânia, Goiás, Brazil R1d ago