Data Engineer (Databricks) | Specialist (Remoto)
Tasks
- Build data pipelines
- Conduct refinement review and retrospective
- Create standardized pipeline template
- Implement Databricks MLOps pipeline
- Ingest transform and serve data
- Maintain scalable data pipelines
- Manage data with Unity Catalog
- Migrate models in waves by criticality
- Organize tables in Delta Lake
- Participate in agile sprints
- Perform technical discovery and inventory models
- Prepare data generate features
- Run model serving monitoring and retraining
- Train validate register and deploy models
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Apache Airflow | Apache Kafka | Apache Spark | Cassandra | DBT | Databricks | Delta Lake | Google BigQuery | MLflow | MongoDB | PostgreSQL | PySpark | Unity Catalog
Education
N/A
Roles
Related jobs
-
AI Model Evaluation | AI model | AWS | Azure | Azure DataChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil R1d ago
-
Azure | CI/CD | Databricks | Git | GitHub100 percent remote | Childcare assistance | Continuous learning platform | Dedicated language learning platform | Dental insuranceMid-level Full TimeBrazil R1d ago
-
AWS Glue | AWS Glue Data Catalog | AWS Lake | AWS Lake Formation | AWS LambdaContinuous professional development | Fully remote within Brazil | Technical mentorship | Technical ownershipMid-level Full TimeBrazil R1d ago
-
Senior-level Full TimeBrazil Sao Paulo - Remote Office R1d ago
-
AWS | AWS Lambda | Amazon EventBridge | Apache Spark | Data GovernanceChildcare assistance | Dental insurance | Exclusive Financial Product Discounts | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo, Brasil R1d ago
-
AWS | Apache Spark | Azure DevOps | CI/CD | Data GovernanceChildcare assistance | Dental insurance | Education investment | Individual development plan | Life insuranceSenior-level Full TimeBrasil R1d ago
-
Engenheiro de Dados SR BRL 60K-72KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeSão Paulo, Brasil R1d ago
-
BigQuery | Data Architecture | Data Modeling | Data pipeline | Database optimizationChildcare allowance | Dental insurance | Extended maternity leave | Extended parental leave | Flexible meal benefitsMid-level Full TimeBarueri, São Paulo, Brasil R1d ago
-
Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryConference talk sponsorship | Employee leave policies | Home office fund | Learning and development budget | Medical insuranceMid-level Full TimeBrazil R1d ago
-
API Development | Airflow | Amazon Redshift | ClickHouse | DBTDental insurance | Education and courses stipend | Health plan | Paid annual leave | Sports incentiveEntry-level Full TimeSão Paulo, SP R2d ago
-
Senior Data Engineer BRL 234K-295KAWS Data | AWS Glue | AWS data platform | Amazon Web Services | Apache FlinkSenior-level Full TimeSao Paulo, SP, Brazil R3d ago
-
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS Step FunctionsAutonomy | Continuous learning | Fully remote | MentorshipSenior-level Full TimeBrazil R3d ago
-
Apache Spark | Big Data | Data Mining | Data Modeling | Data PipelinesBonus Salaries | Childcare assistance | Dental insurance | Extended parental leave | Flexible working hoursSenior-level Full TimeBrasil R3d ago
-
Mid-level Full TimeRemote - Brazil R3d ago
-
Anthropic Claude | Application Insights | Asynchronous systems | Azure Application Insights | Azure OpenAIB2B contract arrangement | Flexible work environment | Long-term engagement | Remote workSenior-level Contract Full TimeBrazil R5d ago
-
CAS | Engenharia de Dados - Foco em Seguros BRL 18K-18KApache Spark | Data Engineering | Data Lake | Data Modeling | DataOpsChildcare support | Dental insurance | Extended parental leave | Food allowance | GympassSenior-level Full TimeBrasil R5d ago
-
Senior Data Engineer - Databricks BRL 319K-455KAWS | Apache Spark | Automation Scripting | CI/CD | Cloud SecurityEquipment and office stipend | Flexible PTO | Learning and development stipend | Paid exams and certifications | Professional development planSenior-level Full TimeBRAZIL R5d ago
-
Data Engineer (Python) |JR (Remote) BRL 23K-23KAWS Glue | Amazon Athena | Amazon EMR | Amazon Redshift | Amazon S3Remote workEntry-level Full TimeBrasil R5d ago
-
API Integration | Alerting | Apache Airflow | Authentication | BackfillAccess to company products | Career growth | Company off-sites | Family benefits | Fully remoteMid-level Full TimeBrazil R6d ago
-
Senior-level Full TimeBrasil R7d ago
-
AI Governance | Axon | Business glossary | CRM | Cloud Data Governance and CatalogCompetitive compensation | Inclusive workplace | Professional growth | Remote workMid-level Full TimeBrazil R7d ago
-
Senior Data Engineer BRL 271K-370KAPI Development | AWS | Agile | Alerting | AzureCasual office and dress code | Childcare subsidies | Days off | Discounts on company products | Health, dental, and life insuranceSenior-level Full TimeRemote, Brazil R8d ago
-
Airflow | Apache Flink | Apache Kafka | Apache Spark | Business IntelligenceBenefits club for exams | Course discounts | Dental insurance | Meal allowance | Medical insuranceSenior-level Full TimeBrasil R8d ago
-
AWS | Airflow | Apache Spark | Azure | Cloud ComputingAI powered job matching | Cross-functional collaboration | Fully remote | Modern cloud data engineering environmentMid-level Full TimeBrazil R9d ago
-
Engenheiro de Dados Pleno | Plataforma de Dados BRL 23K-23KAgile | Apache Airflow | CI/CD | Cloud Workflows | Cloud loggingDental insurance | Employee discounts | Health insurance | Life insurance | Maternity leaveMid-level Full TimeRio de Janeiro, Brasil R9d ago