Engenheiro de Dados (GCP/Databricks) Especialista
Tasks
- Automate deployment
- Build distributed data processing solutions
- Collaborate with BI, Analytics, and Data Science teams
- Design data lake architecture
- Design data warehouse architecture
- Develop ELT pipelines
- Develop ETL pipelines
- Enable real time and batch ingestion
- Enforce DataOps practices
- Ensure data governance
- Ensure data quality
- Ensure data security
- Implement CI/CD workflows
- Implement Lakehouse architecture
- Integrate data sources
- Optimize batch data pipelines
- Optimize data processing performance
- Optimize streaming data pipelines
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Spark | BigQuery | CI/CD | Cloud Composer | Cloud Storage | Cloud platform | Data Governance | Data Modeling | Data Quality | Data Security | Data Streaming | Databricks | Dataflow | Dimensional Modeling | Distributed Systems | Docker | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Kafka | Kubernetes | Lakehouse | PubSub | PySpark | Python | SQL | Terraform | Version control
Education
N/A
Roles
Related jobs
-
DevOps Architect BRL 240K-275KAmazon Linux | Ansible | Azure | Bash | CI/CDExchange program | Health insurance | Life insurance | OPD | Paid time offSenior-level Full TimeBrazil - Remote R3d ago
-
Engenharia de Dados & Big Data (Híbrido/SP) - 133188 BRL 96K-119KAgile | Apache Hadoop | Apache Hive | Apache Spark | Azure BlobMid-level Full TimeAlphaville - Barueri, BR, 06.454-000 R3d ago
-
API | Access Control | Airbyte | BigQuery | CRMPaid time off | Remote work | Work with autonomySenior-level Full TimeSão Paulo R4d ago
-
Amazon Redshift | Apache Airflow | Apache Kafka | Apache Spark | DBTContinuous learning environment | Flexible working hours aligned to Central Time | Fully remote | International team culture | Long-term contractSenior-level Full TimeBrazil R5d ago
-
Apache Airflow | Azure | Azure Data | Azure Data Factory | Data FactoryCorporate English classes | Food allowance | Healthcare plan | Home-office allowance | Learning IncentiveSenior-level Full TimeBrazil R5d ago
-
A/B | A/B Testing | Automation | B testing | CDCBirthday day off | Childcare assistance | Company-provided equipment | Coworking space access | Dental insuranceSenior-level Full TimeBrazil R5d ago
-
AWS | AWS Glue | AWS Lambda | Amazon S3 | AzureAutonomy | Collaborative learning environment | Flexibility | Fully remote work BrazilSenior-level Full TimeBrazil R5d ago
-
API Integration | Automation | Claude | Data Architecture | Data ModelingCollaborative fast-paced culture | Flexible working hours | Fully remote | High ownershipSenior-level Full TimeBrazil R5d ago
-
Apache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsInclusive culture | Integral well being | Professional development | Remote workSenior-level Full TimeFlorianópolis, Santa Catarina, Brasil R5d ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible hours | Part-time schedule | Project based workSenior-level Full TimeBrazil - Remote R5d ago
-
Bioinformatics Engineer II (Remote/Brazil) BRL 144K-156KAWS | Bash | Cell analysis | Cloud Computing | ContainerizationLaptop provided | Remote work | Supportive inclusive environmentMid-level Full TimeBrazil R6d ago
-
Machine Learning Engineer BRL 108K-132KAWS | AWS Edge | Agents | Anomaly Detection | CDNAutonomous role | Distributed team | Remote workMid-level Full TimeSão Paulo R6d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon ECSInternational team | Learning and growth opportunities | Paid time off | Remote workSenior-level Full TimeBrazil R6d ago
-
API Integration | AWS | Anthropic Claude | Azure | CrewAICareer development plan | Client acquisition bonuses | Company-provided equipment | Continuous learning support | English classesMid-level Full TimeBrazil R6d ago
-
AUC | Docker | Embeddings | Explainable AI | F1-scoreDiscount partnerships | Education assistance | Family benefits | Health insurance | Home-office allowanceSenior-level Full TimeBrazil R6d ago
-
Actor-critic | Exploration/exploitation | Machine Learning | Multi-Modal | Multi-modal AICareer growth opportunities | Flexible work culture | Fully remote work | Global collaboration opportunities | Innovation-focused environmentMid-level Full TimeBrazil R6d ago
-
Anomaly Detection | Data Modeling | Data Pipelines | Docker | Industrial analyticsCareer growth opportunities | Flexible work environment | International team collaboration | Remote workMid-level Full TimeBrazil R6d ago
-
AI/MLOps Engineer BRL 230K-265KA/B | A/B Testing | AWS | Azure | B testingFlexible working hours | Laptop provided | Mentoring | Online courses | Referral bonusSenior-level Full TimeSão Paulo, State of São Paulo, … R6d ago
-
Artificial Intelligence | Cloud platform | Code review | Document processing | Evaluation PipelinesSenior-level Full TimeBrazil (Remote) R7d ago
-
Senior Machine Learning Engineer BRL 120K-138KA/B | A/B Testing | AWS | B testing | CI/CDAnnual leave | Dental plan | Discounts | Enhanced family leave | Gym membershipSenior-level Full TimeSao Paulo R7d ago
-
Accelerate | Data Analysis | Deep learning | Diffusers | Generative AIAutonomy and ownership | Career growth opportunities | Flexible distributed environment | Fully remote | Global collaborationMid-level Full TimeBrazil R7d ago
-
Data Curation | Deep learning | Distributed machine learning | Experiment design | GPU ComputingAccess to high-performance computing | Flexible work schedule | Fully remote | Professional growth opportunitiesSenior-level Full TimeBrazil R7d ago
-
Engenheiro de Dados de Gestão de Receita BRL 25K-31KAWS | Alteryx | Amazon Web Services | Apache Spark | Data GovernanceContinuous learning opportunities | Health insurance | Paid time off | Remote work optionsMid-level Full TimeBRA - IRON MOUNTAIN DO BRASIL … R7d ago
-
Apache Flink | Apache Kafka | Avro | CI/CD | Distributed SystemsEnglish communication required | Hybrid workSenior-level Full TimeSão Paulo, State of São Paulo, … R8d ago
-
Airflow | Amazon Redshift | BigQuery | CI/CD | CloudFormationFlexible schedule | Remote workSenior-level Full TimeBrazil - Remote R10d ago