Big Data Engineer
Tasks
- Build data integration services
- Collaborate on system architecture improvements
- Design data flow optimization
- Develop ETL pipelines
- Improve development practices
- Maintain data quality checks
- Monitor performance metrics
- Perform root cause analysis
- Troubleshoot production data issues
- Validate data processing
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS DynamoDB | AWS Glue | AWS Lambda | AWS S3 | Cause analysis | Data Quality | ETL | MongoDB | NoSQL | Performance Monitoring | PySpark | Python | Root Cause Analysis | Root cause | SQL
Education
N/A
Roles
Related jobs
-
AWS Glue | Apache Airflow | Apache Kafka | Apache Spark | BigQueryCollaborative environment | Continuous learning | Fully remote work | Professional growth opportunitiesMid-level Full TimeBrazil R4h ago
-
Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CDDental insurance | Employee assistance program | Flexible work hours | Gympass | Life insuranceMid-level Full TimeSão Paulo, BR R15h ago
-
AI Lead (Brazil) BRL 144K-146KAI Platform | Analytics | Data Analysis | Language Processing | Machine LearningCareer growth opportunities | Remote-first companySenior-level Full TimeRemote/Brazil R1d ago
-
AIOps | AWS | Anomaly Detection | Azure | Azure OpenAIAutonomy | Collaborative team environment | Flexible schedule | Fully remote | Learning opportunitiesMid-level Full TimeBrazil R1d ago
-
[Job - 30345] AI Engineer - Mid Level BRL 80K-106KAPI Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Amazon BedrockChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveMid-level Full TimeBrazil2d ago
-
Cloud Computing | Data Modeling | Data Quality | Data integration | DatabricksChildcare support | Corporate university | Dental insurance | Educational partnerships | Flexible benefitsEntry-level Full TimeOSASCO, Brazil; CURITIBA, PR, Brazil; OSASCO, …2d ago
-
AI Engineer - RAG & Semantic Search BRL 60K-60KAPI Development | Agile | Chroma | Cohere | EmbeddingsDental insurance | Education assistance | Employee discounts | Flexible work options | Health insuranceMid-level Full TimeSao Paulo, SÃO PAULO, Brazil2d ago
-
ADLS Gen2 | AKS | Agent Jobs | Apache Airflow | Apache HadoopChildcare assistance | Dental insurance | Discount club | Extended parental leave | Food allowanceSenior-level Full TimeBrazil2d ago
-
AWS Lambda | Amazon S3 | Amazon SQS | Azure DevOps | BDDChildcare support | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil2d ago
-
[Job - 30061] Analista de Dados Sênior BRL 20K-23KA/B | A/B Testing | Azure Data | Azure Data Factory | Azure MLChild care support | Dental insurance | Extended parental leave | Gym discounts | Health insuranceMid-level Full TimeBrazil2d ago
-
AWS CodePipeline | AWS FinOps | AWS Lambda | AWS Observability | Amazon EKSSenior-level Full TimeBrazil2d ago
-
AWS | Apache Spark | Automation | CI/CD | Cloud platformFlexible work schedule | Learning and development opportunities | Mentorship | Remote work | Training and tutorialsSenior-level ContractBlumenau, SC, Brazil2d ago
-
Airbyte | Apache Airflow | Apache Iceberg | Cloud platform | DBTContinuous learning | Fully remote work | Global distributed team | Health benefits | Home office setup allowanceSenior-level Full TimeBrazil R3d ago
-
Engenharia de Dados AWS (Pleno/Sênior) - 134592 BRL 80K-96KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeAlphaville - Barueri, BR, 06.454-0003d ago
-
AWS Lambda | Chunking | Docker | Embeddings | Function CallingPTO | Remote workMid-level Full TimeBrazil - Remote R3d ago
-
Embedded Software Engineer BRL 120K-120KARM | Arcnet | Authorization to Operate | C# | C++Dental assistance dependents | Employee assistance program | Life insurance | Meal Policy | Medical assistance dependentsMid-level Full TimeContagem, MG, Brazil3d ago
-
Embedded Software Analyst BRL 130K-130KARM | Arcnet | C plus plus | C# | CVEDental Assistance for dependents | Employee assistance program | Extended maternity leave | Language incentive policy | Life insuranceMid-level Full TimeContagem, MG, Brazil3d ago
-
AWS | Adtech | Agile | Apache Spark | Data EngineeringContinuous learning | Healthcare benefits | Professional growth opportunities | Remote work possibilitiesSenior-level Full TimeBrazil4d ago
-
Airbyte | Airflow | Analytics | Automated testing | BigQueryChildcare assistance | Continuous learning opportunities | Dental insurance | Discount programs | Food allowanceSenior-level Full TimeBrazil4d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Processing | DockerAsynchronous culture | Laid-back atmosphere | Remote workMid-level Full TimeSão Paulo, Brazil4d ago
-
Entry-level Full TimeBrazil - Remote R4d ago
-
AWS RDS | Amazon EC2 | Amazon S3 | Backup and Restore | BashChildcare assistance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo-SP / Rio de Janeiro-RJ4d ago
-
Mid-level Full TimeBrazil, Remote R4d ago
-
[Job - 30367] Engenheiro de Dados Sênior BRL 20K-31KAzure Data | Azure Data Lake | Azure Data Services | Azure ML | CI/CDChildcare assistance | Continuous learning platform | Dental insurance | Extended parental leave | Gym discountsSenior-level Full TimeBrazil4d ago
-
Senior / Principal Machine Learning Engineer BRL 300K-360KAWS | Agile | Apache Spark | Data Pipelines | Distributed SystemsSenior-level Full TimeSão Paulo, SP, Brazil4d ago