Data Architect (Databricks Scalability)
Brazil, Colombia
COP 61528K-78000K (estimate) Senior-level Full Time
Tasks
- Assess Databricks environment
- Collaborate with stakeholders on technical decisions
- Configure autoscaling
- Define data ingestion patterns
- Define data orchestration patterns
- Define data serving patterns
- Define data transformation patterns
- Define deployment approaches
- Define integration approaches
- Design AI ready Databricks capabilities
- Design enterprise knowledge workflows
- Design retrieval vector search patterns
- Document current-state architecture
- Document target state architecture
- Enable model serving
- Establish compute governance
- Identify cost inefficiencies
- Identify performance bottlenecks
- Identify scalability constraints
- Optimize workloads
- Plan implementation sequencing
- Produce architecture documentation
- Produce dependency views
- Tune cluster performance
Perks/Benefits
- Hybrid/Remote flexibility
- International projects
- Medical healthcare
- Ongoing learning reimbursement
- Recognition program
- Referral bonuses
- Sports compensation
- Team events
- Top tier equipment provision
- Well-being program
Skills/Tech-stack
Access Control | Apache Spark | Autoscaling | Cluster tuning | Compute governance | Data Governance | Data Ingestion | Data Transformation | Data orchestration | Data serving | Databricks | Databricks SQL | Delta Lake | Enterprise Knowledge Management | Enterprise knowledge | GenAI | Knowledge Management | Lakehouse | Model Serving | Performance Tuning | Retrieval-Augmented Generation | Vector Search | Workload optimization
Education
N/A
Roles
Architect | Data Architect | Data Engineer | Data Platform | Data Platform Engineer | Engineer | Platform Engineer
Regions
States
Related jobs
-
Anthropic | Benchmarking | CI/CD | Docker | FastAPIAutonomy | Fully remote | PJ contract structureSenior-level Full TimeBrazil R6h ago
-
API documentation | Airflow | Amazon Web Services | Apache Beam | Apache SparkBirthday day off | Dental insurance | Educational support programs | Fitness and wellness partnerships | Fully remote workMid-level Full TimeBrazil R6h ago
-
Mid-level Full TimeBogota, Colombia R14h ago
-
AI Engineer II - Marketing USD 39K-72KAWS | CI/CD | Docker | Entity recognition | Feature EngineeringFull-time employment | Remote workMid-level Full TimeBrazil, Remote R14h ago
-
[job-30578] Sr Data Engineer, Brazil BRL 18K-18KApache Airflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeChildcare assistance | Continuous learning platform | Discount club | Extended parental leave | Gym membership discountSenior-level Full TimeBrazil17h ago
-
Data Engineer USD 120K-147KAWS | Apache Airflow | Apache Spark | Azure | Batch ProcessingFully remote | Professional growth opportunitiesMid-level Full TimeBrazil R17h ago
-
Data Engineer Manager COP 60000K-61528KCode Refactoring | Data Governance | Data Modeling | Data Quality | Data pipelineCareer development plans | Company-provided equipment | English lessons | Flexible working options | Mentorship programsSenior-level Full TimeBogotá, Bogota, Colombia17h ago
-
Engenheiro de Dados Sênior BRL 30K-31KApache Kafka | Data Factory | Data Lake | Data Modeling | Data orchestrationChildcare assistance | Dental insurance | Flexible/Office work model | Gympass | Health insuranceMid-level Full TimeSão Paulo, SP18h ago
-
AI Engineer II (Remote) USD 39K-72KAWS | Attention Mechanism | BERT | CI/CD | Distributed SystemsCode reviews | Mentorship | Remote workMid-level Full TimeBogota, Colombia R18h ago
-
AI Engineer II (Remote) USD 39K-72KAWS | BERT | CI/CD | Docker | EmbeddingsFull-time employment | Remote workMid-level Full TimeBrazil, Remote R18h ago
-
Agile | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache IcebergRemote workMid-level Full TimeSouth Africa - Cape Town19h ago
-
[Job-30263] AI Data Engineer / Snowflake Cortex Engineer BRL 180K-180KAccess Control | Anomaly Detection | Data Engineering | Data Governance | Data ModelingChildcare assistance | Continuous learning platform | Discount club | Extended paternity leave | Free well being platformSenior-level Full TimeBrazil20h ago
-
Engenheiro(a) GenAI & Machine Learning BRL 23K-31KAWS EKS | Agent systems | Apache Airflow | Apache Spark | Azure OpenAIChildcare assistance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveMid-level Full TimeRio de Janeiro20h ago
-
Data Insights - Tech Senior Associate BRL 234K-368KApache Airflow | Apache Spark | Business Intelligence | CRM | Data AnalysisHybrid workSenior-level Full TimeSão Paulo, SP, Brazil21h ago
-
[Job-30559] Engenheiro de Dados Sênior , Brazil BRL 20K-31KAutomated testing | Azure | CI/CD | Code review | Data LakeChildcare support | Dental insurance | Discount platform | Extended parental leave | GympassSenior-level Full TimeBrazil23h ago
-
Azure DevOps | Bicep | CI/CD | Change Data Capture | Data CaptureChildcare assistance | Continuous learning initiatives | Dental insurance | Extended parental leave | Fitness and wellness programsMid-level Full TimeBrazil1d ago
-
Bicep | CI/CD | Data Architecture | Data Engineering | DatabricksChildcare assistance | Continuous learning initiatives | Dental insurance | Extended parental leave | Fitness and wellness programsMid-level Full TimeBrazil1d ago
-
Data Engineer (Mid/Senior) COP 82000K-94620KApache Airflow | Cloud Dataflow | Cloud Dataproc | Cloud Storage | Data GovernanceSenior-level Full TimeAlgeria (West)1d ago
-
AI Agents | AWS Lambda | Amazon S3 | Amazon SQS | Automated testingChildcare assistance | Continuous learning | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil1d ago
-
Consultor(a) Data Engineer Senior BRL 54K-72KAWS | Azure | CI/CD | DBT | Data IngestionBirthday off | Career mentorship | Childcare assistance | Dental insurance | Health insuranceSenior-level Full TimeSao Paulo, Torre Paineira, Brazil1d ago
-
Apache Spark | Business Intelligence | Cloud Computing | Data Architecture | Data setsFlexible schedule | Hybrid workEntry-level Full TimeGTM, GT1d ago
-
API Integration | AWS | Agent Frameworks | Autogen | AzureApplication video interview | Competitive pay | Growth opportunities | Remote workMid-level Full TimeColumbia - Bogotá1d ago
-
Agile | Apache Airflow | BigQuery | CI/CD | Cloud Storage1 on 1 feedbacks | Career development | Flexible working environment | Hybrid workSenior-level Full TimeSão Paulo1d ago
-
Solutions Architect - Lakebase BRL 325K-455KAI Governance | AWS | Apache Spark | Azure | Backup and RecoverySenior-level Full TimeSao Paulo, Brazil1d ago
-
AI Deployment Engineer, Enterprise BRL 300K-360KCost Optimization | Data Governance | Debugging | Evaluation | GovernanceSenior-level Full TimeSão Paulo1d ago