Data Engineer (Databricks) | Specialist
Tasks
- Automate machine learning lifecycle
- Build data pipelines
- Design MLOps pipelines
- Develop feature engineering workflows
- Govern data with Unity Catalog
- Improve pipeline performance and reliability
- Ingest transform deliver data
- Inventory existing machine learning models
- Manage Delta Lake tables
- Migrate models to standardized pipeline
- Participate in agile sprint delivery
- Serve monitor and retrain models
- Train validate register deploy models
Perks/Benefits
- Agile collaborative environment
- Career growth
- Continuous learning opportunities
- Professional development
- Technical challenging projects with business impact
Skills/Tech-stack
AWS Glue | Agile Scrum | Apache Airflow | Apache Kafka | Apache Spark | Cassandra | Cloud platform | DBT | Databricks | Delta Lake | Feature Engineering | Google BigQuery | Google Cloud | Google Cloud Platform | ML Ops | MLflow | MongoDB | PostgreSQL | PySpark | SQL | Unity Catalog
Education
N/A
Roles
Related jobs
-
Access Controls | Airflow | Apache Spark | Asset bundles | CI/CDCertification incentives | Childcare allowance | Dental insurance | Educational discounts | Fitness and wellness benefitSenior-level Full TimeBrazil R1d ago
-
AWS Glue | AWS Lake | AWS Lake Formation | Amazon Athena | Amazon BedrockChildcare assistance | Continuous learning opportunities | Discounts through partner programs | Extended parental leave | Fitness and wellness programsMid-level Full TimeBrazil R1d ago
-
Visagio Talentos - Formados: Data Science e IA Generativa RJ (Exclusiva para Pessoas com Deficiência) BRL 23K-31KAgile methodology | Data Analysis | Database Concepts | Language Processing | Machine LearningClient interaction | Team collaboration | Training coursesNone Full TimeRio de Janeiro, Brasil1d ago
-
Lead Data Engineer (Brazil Based) BRL 234K-368KAI machine learning | AWS | AWS Glue | Amazon Athena | Amazon S3English language support | Travel opportunitiesSenior-level Full TimeSão Carlos, SP, Brazil1d ago
-
Data Engineer - GCP | PL (Hybrid/SP) BRL 119K-119KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CassandraHybrid workSenior-level Full TimeSão Paulo, Brasil R1d ago
-
Data Engineer - GCP | SR (Hybrid/SP) BRL 119K-119KAPIs | AWS Glue | Apache Airflow | Apache Kafka | Apache SparkHybrid workSenior-level Full TimeSão Paulo, Brasil R1d ago
-
Analista Sênior de Engenharia de Dados e IA BRL 24K-31KABAC | AWS Glue | Access Management | Agent Orchestration | Amazon AthenaChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity and paternity leave | Health insuranceSenior-level Full TimeSão Paulo, Brasil R1d ago
-
AWS | Apache Spark | Azure DevOps | CI/CD | Cloud ComputingChildcare assistance | Dental insurance | Hybrid work model | Life events support | Life insuranceMid-level Full TimeBrazil R1d ago
-
AWS | Agent systems | Autogen | Automated testing | AzureChildcare assistance | Continuous learning | Dental insurance | Employee discounts | Extended parental leaveSenior-level Full TimeBrazil1d ago
-
AWS | Analytics engineering | Artificial Intelligence | Automated testing | Cloud ArchitectureChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity leave | Extended paternity leaveMid-level Full TimeSão Paulo, Brasil R2d ago
-
API Integration | AWS | Agile | Airflow | AzureChildcare support | Company profit sharing | Continuous learning platform | Dental insurance | Discount clubSenior-level Full TimeBrazil2d ago
-
Apache Spark | Azure | CI/CD | Cassandra | Data GovernanceChildcare reimbursement | Dental insurance | English training online | Extended parental leave | Flexible benefits programSenior-level Full TimeRio de Janeiro, Brasil R2d ago
-
Senior Data Engineer Brazil BRL 212K-270KApache Beam | Apache Flink | Apache Spark | CI/CD | Cloud platformCoworking credits | Dental insurance | Gympass | Health insurance | Meal allowanceSenior-level Full TimeAvenida das Nações Unidas, 12901,11° andar … R2d ago
-
LLMs Data Analyst | Senior (Hybrid/SP) BRL 84K-108KAWS | Anthropic | Azure OpenAI | CI/CD | Cloud platformHybrid workSenior-level Full TimeSão Paulo, Brasil R2d ago
-
Data Management | Data Management Cloud | Data Quality | IBM DB2 | Informatica Data QualityMid-level Full TimeBrasil R2d ago
-
[Job-31276] Engenheiro(a) de Dados PLENO, Brasil BRL 18K-18KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsDental insurance | Discount club | Food allowance | Gympass or Totalpass | Health insuranceMid-level Full TimeBrazil2d ago
-
Senior Data & AI Solutions Architect BRL 150K-180KAWS | Airflow | Amazon Redshift | Apache Kafka | Apache SparkSenior-level Full TimeSAO PAULO, SP, Brazil2d ago
-
AI Model Evaluation | AI model | AWS | Azure | Azure DataChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil R3d ago
-
Azure | CI/CD | Databricks | Git | GitHub100 percent remote | Childcare assistance | Continuous learning platform | Dedicated language learning platform | Dental insuranceMid-level Full TimeBrazil R3d ago
-
AWS Glue | AWS Glue Data Catalog | AWS Lake | AWS Lake Formation | AWS LambdaContinuous professional development | Fully remote within Brazil | Technical mentorship | Technical ownershipMid-level Full TimeBrazil R3d ago
-
Agile | Apache Spark | Automated testing | Azure Databricks | CI/CDChildcare assistance | Continuous learning opportunities | Dental insurance | Extended paternity leave | Food allowanceSenior-level Full TimeBrazil3d ago
-
Senior-level Full TimeBrazil Sao Paulo - Remote Office R3d ago
-
AI Data Engineer III BRL 300K-360KAirflow | Async Programming | BM25 | CI/CD | DBTBonuses | Minimal travel | Remote workSenior-level Full TimeRemote Brazil R3d ago
-
Machine Learning Engineer - Especialista BRL 119K-120KAPIs | Airflow | Azure | Cloud platform | CrewAIMid-level Full TimeRIO DE JANEIRO, RIO DE JANEIRO, …3d ago
-
Pricefx Configuration Engineer - Data & Analytics BRL 100K-121KAgile | Artificial Intelligence | CRM | Cause analysis | Data AnalysisChildcare | Funeral assistance | Health insurance | Life insurance | Meal ticketsMid-level Full TimeCuritiba, PR, BR, 80420-0003d ago