Mid-Level Data Engineer
Tasks
- Apply data validation rules
- Apply security privacy compliance requirements
- Automate operational tasks
- Build data transformation logic
- Collaborate with data governance security compliance teams
- Create data ingestion processes
- Create unit tests
- Develop Spark workloads
- Develop data pipelines
- Ensure data contracts compliance
- Follow coding and engineering standards
- Implement schema mappings
- Investigate data quality issues
- Maintain data classification information
- Maintain data schemas
- Manage metadata and documentation
- Monitor pipeline workflows
- Participate in code reviews
- Perform data quality checks
- Set up alerting and incident support
- Support auditability documentation metadata lineage
- Support data lineage activities
- Troubleshoot pipeline failures
- Validate transformations
- Write Python scripts
- Write SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Management | Apache Spark | Authentication | Authorization | Automation | Azure | Data Governance | Data Lineage | Data Quality | Data Transformation | Data Validation | Data Warehousing | Databricks | ELT | ETL | Git | Google Cloud | Least Privilege | Metadata Management | Python | Relational databases | SQL | Secrets management | Version control
Education
Associate Degree | Bachelor of Engineering | Bachelor of Engineering in Computer Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Master of Science
Roles
Related jobs
-
AI | Autonomous Systems | C++ | Computer Vision | DockerContinuous learning | Fully remote | Knowledge sharing | Opportunity to contribute to open-source projectsSenior-level Full TimeBrazil R5h ago
-
AWS | Azure | CI/CD | Databricks | Databricks SQL100 percent remote within Latin America | Long term project extension potential | Professional growthSenior-level Full TimeBrazil R5h ago
-
Staff AI Engineer BRL 234K-275KAI Services | AWS | AWS Bedrock | AWS CodeDeploy | Agent systemsChild care assistance | Flexible hours | Health and dental plan | Life insurance | Monthly meal and culture voucherSenior-level Full TimeRemote, Brazil R21h ago
-
AWS | Agent-based | Agent-based systems | Agentic Programming | Amazon S3Career growth | Flexible collaboration | Fully remoteSenior-level Full TimeBrazil R1d ago
-
Agentic patterns | FastAPI | LLM Evaluation | Language Models | Large Language ModelsSenior-level Full TimeBrazil (Remote) R1d ago
-
ABAP | ABAP development | API Design | Alerting | Apache SparkSenior-level Full TimeSão Leopoldo, BR, 93022-718 R2d ago
-
AWS | Ansible | CI/CD | CloudWatch | DASTBirthday day off | Childcare assistance | Day off for birthday | Dental insurance | Flexible scheduleMid-level Full TimeRio de Janeiro, State of Rio … R2d ago
-
Data Engineer Sr. BRL 235K-396KAmazon Redshift | Data Modeling | Data Pipelines | Data Storytelling | Data VisualizationRemote work | Work-life balance flexibilitySenior-level Full TimeRemote, Brazil R2d ago
-
Distributed Systems | Embeddings | Java | Kubernetes | LLM InferenceCollaborative flat structure culture | Direct access to technical leadership | Exposure to cutting edge generative AI technologies | High autonomy and flexibility | High ownership of projectsEntry-level Full TimeBrazil R3d ago
-
Técnico Databricks / Hadoop BRL 21K-25KAWS | Apache Airflow | Azure | Azure Data | Azure Data FactoryMid-level Full TimeTWGSP - Teleworker/Offsite - BRA - … R3d ago
-
AI Engineer II (Remote) USD 39K-72KAWS | CI/CD | Docker | Embeddings | Entity recognitionRemote workMid-level Full TimeBrazil, Remote R5d ago
-
Senior Data Engineer USD 75K-92KAgile | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkHealth benefits | Parental leave | Stock options | Tuition reimbursement | Unlimited PTOSenior-level Full TimeRemote (Brazil) R5d ago
-
Senior Enterprise AI Engineer (AWS Bedrock) BRL 240K-300KAPI Gateway | AWS API | AWS API Gateway | AWS Bedrock | AWS Bedrock AgentsCareer growth | English program | Fitness program | International projects | Professional developmentSenior-level Full TimeSão Paulo R5d ago
-
Senior LLM Engineer (RAG & AWS Bedrock) BRL 300K-360KAPI Gateway | AWS | AWS Bedrock | Chatbot Development | ChromaDBCareer development | English program | Fitness membership | Games and competitions | International projectsSenior-level Full TimeSão Paulo R5d ago
-
Senior AI Solutions Engineer (Python & AWS Bedrock) BRL 181K-181KAI Agents | API Gateway | AWS API | AWS API Gateway | AWS BedrockCareer growth | English program | Fitness membership | Games and competitions | International projectsSenior-level Full TimeSão Paulo R5d ago
-
Full Stack Automation Engineer BRL 319K-443KAWS | AWS Lambda | CI/CD | Chunking | DockerPTO | Remote workMid-level Full TimeBrazil - Remote R6d ago
-
AI Studio | Apache Airflow | Apache Spark | Azure AI | Azure AI StudioRemote workSenior-level Full TimeBrazil - Sao Paulo R6d ago
-
AI Agents | AWS | Amazon Bedrock | Autogen | CI/CDEnglish communication environment | Flexible contractor schedule | International team collaboration | Remote workMid-level Contract Full TimeBrazil R7d ago
-
AI Governance | Agile | Artificial Intelligence | Automation | Cloud ComputingRemote workSenior-level Full TimeSao Paulo, Brazil R7d ago
-
AI Governance | Agile | Artificial Intelligence | Automation | Cloud PlatformsRemote workSenior-level Full TimeSao Paulo, Brazil R7d ago
-
LATAM I Analytics Engineer USD 36K-60KAmazon Redshift | BigQuery | CI/CD | Cloud platform | DBTCompany MacBook | Learning time | Paid holiday | Remote work flexibility | Work from home budgetMid-level Full TimeBrazil R8d ago
-
Senior-level Contract Full TimeSão Paulo, State of São Paulo, … R8d ago
-
Senior MLOps Engineer USD 155KAWS Lambda | Alerting | Amazon ECS | Bamboo | BatchingHome office setup | National holidays | Paid time off | Remote flexibility | Stock optionsSenior-level Full TimeBrazil R8d ago
-
CKAN | COBIT | Cloud Pak for Data | DAMA-DMBOK | Data Catalog100 percent remote work | Collaborative work culture | Continuous learning | Enterprise data environment experience | Flexible work modelSenior-level Full TimeBrazil R8d ago
-
Data Engineer, Data Platform BRL 319K-412KAWS Athena | AWS CDK | AWS CloudFormation | AWS Kinesis | Amazon EKSChild care assistance | Extended parental leave | Flexible work schedule | Health dental life insurance | Language development incentiveMid-level Full TimeBrazil R8d ago