DevOps / DataOps Engineer – Databricks Platform | Senior (Remote)
Tasks
- Automate artifact promotion between environments
- Automate secret management and audit trails
- Build pipelines as code
- Define architecture standards and documentation
- Design CI/CD pipeline
- Enforce governance and security controls
- Implement infrastructure-as-code
- Implement quality gates and automated tests
- Implement unity catalog permissions RBAC
- Manage databricks workspaces and compute policies
- Manage release deployment and rollback
- Monitor pipelines and workloads
- Package and deploy databricks workloads
- Set up versioning branching and code review
- Troubleshoot infrastructure and data pipelines
- Validate data contracts
Perks/Benefits
Skills/Tech-stack
AWS | Asset bundles | Azure | Bitbucket Pipelines | CI/CD | Cluster policies | Code Analysis | Code review | Contract testing | Data Contract Testing | Data contract | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks CLI | Datadog | Git | GitHub Actions | GitLab CI | Gitflow | Infrastructure as Code | Linting | Pytest | Python | RBAC | SQL | Secret Scopes | Service principals | Static Code Analysis | Terraform | Test automation | Trunk-based | Trunk-based development | Unity Catalog | Wheel Packaging | “as-code”
Education
N/A
Roles
Related jobs
-
Entry-level Full TimeBrasil R1d ago
-
Analytics | Business Intelligence | CSS | Dashboard Design | Data ModelingAnnual bonus program | Birthday day off | Childcare support | Dental insurance | Discount clubSenior-level Full TimeBrasil R1d ago
-
APIs | Airflow | BigQuery | CI/CD | Cloud platformAuxílio home office | Auxílio medicamentos | Day off aniversário | Estacionamento | Gympass/TotalpassMid-level Full TimeBrasil R1d ago
-
Access Controls | Airflow | Apache Spark | Asset bundles | CI/CDCertification incentives | Childcare allowance | Dental insurance | Educational discounts | Fitness and wellness benefitSenior-level Full TimeBrazil R1d ago
-
AWS Glue | AWS Lake | AWS Lake Formation | Amazon Athena | Amazon BedrockChildcare assistance | Continuous learning opportunities | Discounts through partner programs | Extended parental leave | Fitness and wellness programsMid-level Full TimeBrazil R1d ago
-
AI Transformation Engineer | (Hybrid/SP) BRL 117K-119KAPI Integration | AWS Bedrock | Azure OpenAI | Copilot Studio | FlowiseHybrid work | Training and mentoringSenior-level Full TimeSão Paulo, Brasil R2d ago
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R2d ago
-
Data Engineer - GCP | SR (Hybrid/SP) BRL 119K-119KAPIs | AWS Glue | Apache Airflow | Apache Kafka | Apache SparkHybrid workSenior-level Full TimeSão Paulo, Brasil R2d ago
-
Analista Sênior de Engenharia de Dados e IA BRL 24K-31KABAC | AWS Glue | Access Management | Agent Orchestration | Amazon AthenaChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity and paternity leave | Health insuranceSenior-level Full TimeSão Paulo, Brasil R2d ago
-
AI Security | API Development | Agent systems | Agentic AI | Claude APIContract engagement | Fully remote work model | International technology focused environment | Opportunity for senior technical ownershipSenior-level Full TimeBrazil R2d ago
-
AWS | Apache Spark | Azure DevOps | CI/CD | Cloud ComputingChildcare assistance | Dental insurance | Hybrid work model | Life events support | Life insuranceMid-level Full TimeBrazil R2d ago
-
AWS | Analytics engineering | Artificial Intelligence | Automated testing | Cloud ArchitectureChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity leave | Extended paternity leaveMid-level Full TimeSão Paulo, Brasil R3d ago
-
Apache Spark | Azure | CI/CD | Cassandra | Data GovernanceChildcare reimbursement | Dental insurance | English training online | Extended parental leave | Flexible benefits programSenior-level Full TimeRio de Janeiro, Brasil R3d ago
-
Senior Data Engineer Brazil BRL 212K-270KApache Beam | Apache Flink | Apache Spark | CI/CD | Cloud platformCoworking credits | Dental insurance | Gympass | Health insurance | Meal allowanceSenior-level Full TimeAvenida das Nações Unidas, 12901,11° andar … R3d ago
-
LLMs Data Analyst | Senior (Hybrid/SP) BRL 84K-108KAWS | Anthropic | Azure OpenAI | CI/CD | Cloud platformHybrid workSenior-level Full TimeSão Paulo, Brasil R3d ago
-
Data Management | Data Management Cloud | Data Quality | IBM DB2 | Informatica Data QualityMid-level Full TimeBrasil R3d ago
-
AI Model Evaluation | AI model | AWS | Azure | Azure DataChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil R3d ago
-
Azure | CI/CD | Databricks | Git | GitHub100 percent remote | Childcare assistance | Continuous learning platform | Dedicated language learning platform | Dental insuranceMid-level Full TimeBrazil R3d ago
-
AWS Glue | AWS Glue Data Catalog | AWS Lake | AWS Lake Formation | AWS LambdaContinuous professional development | Fully remote within Brazil | Technical mentorship | Technical ownershipMid-level Full TimeBrazil R3d ago
-
Senior-level Full TimeBrazil Sao Paulo - Remote Office R3d ago
-
AI Data Engineer III BRL 300K-360KAirflow | Async Programming | BM25 | CI/CD | DBTBonuses | Minimal travel | Remote workSenior-level Full TimeRemote Brazil R3d ago
-
Staff Automation Engineer & AI Engineer BRL 183K-183KAWS | Audit trails | Automation Anywhere | Blue Prism | CrewAIFlexible meal allowance | Health and dental insurance | Home-office allowance | Life insurance | Remote workSenior-level Full TimeBrazil - Remote R3d ago
-
AWS | AWS Lambda | Amazon EventBridge | Apache Spark | Data GovernanceChildcare assistance | Dental insurance | Exclusive Financial Product Discounts | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo, Brasil R4d ago
-
AWS | Apache Spark | Azure DevOps | CI/CD | Data GovernanceChildcare assistance | Dental insurance | Education investment | Individual development plan | Life insuranceSenior-level Full TimeBrasil R4d ago
-
Engenheiro de Dados SR BRL 60K-72KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeSão Paulo, Brasil R4d ago