Senior Databricks Administrator/Architect
EUR 20K Senior-level Full Time
Tasks
- Administer and maintain Azure Databricks workspaces and clusters
- Architect scalable enterprise data platform solutions using Azure Databricks
- Deploy and configure CI CD pipelines for Databricks
- Design and develop data engineering frameworks for batch streaming and real time analytics
- Develop reusable architecture patterns and platform documentation
- Establish data governance standards with Unity Catalog
- Implement data security architecture with identity and access controls
- Implement monitoring logging and alerting for data platforms
- Optimize Databricks workloads with performance tuning and cost optimization
- Support migration to Lakehouse architecture on Azure Databricks
- Troubleshoot production incidents for data pipelines and Spark workloads
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Application Insights | Asset bundles | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hub | Azure Key Vault | Azure Monitor | Azure RBAC | Azure SQL | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Lineage | Data Quality | Data Vault | Data encryption | Databricks (asset) | Databricks Asset Bundles | Databricks ML | Delta Lake | Dimensional Modeling | Entra ID | Event Hub | Feature Store | Generative AI | Identity Management | Infrastructure as Code | Key Vault | Log Analytics | Managed Identities | Medallion Architecture | Metadata Management | Microsoft Entra | Microsoft Entra ID | Microsoft Fabric | Model Serving | Power BI | Private Endpoint | Privileged Identity | Privileged Identity Management | PySpark | Python | SQL | Spark | Spark SQL | Synapse Analytics | Terraform | Unity Catalog | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Administrator | Architect | Data Architect | Data Engineer | Databricks Administrator | Engineer
Related jobs
-
Data Engineer EUR 20K-23KApache Spark | Data Architecture | Data Exploration | Data Modeling | Data ProcessingContinuous training | Flexible schedule | Hybrid work model | Life and accident insuranceEntry-level Full TimeSpain R1d ago
-
Lead Data architect EUR 37K-42KAccess Management | Batch Processing | BigQuery | BigQuery ML | BigtableFlexible working schedule | Hybrid or remote work | Life and accident insurance | Professional development opportunitiesSenior-level Full TimeSpain R1d ago
-
Corporate Analytics Advisor EUR 38K-52KAzure Data | Azure Data Lake | Data Governance | Data Lake | Data ModelingCoworking space | Diversity and inclusion | Health insurance | Home allowance | Hybrid workMid-level Full TimeBarcelona, Barcelona, Spain R1d ago
-
Mid-Level Big Data Developer EUR 38K-48KANSI SQL | Agile | Amazon EMR | Apache Spark | Azure DatabricksCET working hours | International projects | Multicultural team | Remote workMid-level Full TimeMálaga, AN, Spain R1d ago
-
API Gateway | API Security | AWS | Agile | Alerting100 percent remote | Access to certifications | Childcare vouchers | Events meetups and techdays | Extra rest daysSenior-level Full TimeMadrid, Spain R1d ago
-
Apache Airflow | Data Pipelines | Data Quality | Data Transformation | Data WarehousingFlexible start date | Hybrid workEntry-level InternshipMadrid - Hybrid, Barcelona - Hybrid R1d ago
-
Senior Data Engineer - Platform EUR 62K-75KBigQuery | Cloud Functions | Cloud Run | Cloud Storage | Data GovernanceOpen source friendly environment | Training and certification supportSenior-level Full TimeMadrid R2d ago
-
Analytics Engineer - Fintech EUR 48K-60KAirflow | Alerting | CI/CD | Cloud Composer | DBTHybrid workMid-level Full TimeMadrid R2d ago
-
Amazon RDS | Amazon Redshift | Apache Airflow | Cause analysis | Data ModelingAnnual company retreats | Flexible working hours | Paid annual leave | Premium equipment | Remote-firstSenior-level Full TimeSpain R2d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Digital transformation project exposure | Fully remote | Opportunity to use AI powered engineering tools | Remote flexibility | Work with modern Microsoft Azure data ecosystemSenior-level Contract Full TimeSpain R2d ago
-
APIs | AWS Lambda | AWS S3 | Amazon RDS | Amazon SNSAutonomy | Collaborative team | Flexible location | Fully remote | OwnershipSenior-level Full TimeSpain R2d ago
-
AWS | Async/Await | Asynchronous programming | Azure | CI/CDAsynchronous Working Environment | Career development | Hardware provided | Hybrid arrangements | Opportunity to work abroadSenior-level Full TimeSpain R2d ago
-
Expert Data Science EUR 35K-65KAgentic artificial intelligence | Artificial Intelligence | Data Governance | Data Quality | Data VisualizationGlobal recognition programs | Hybrid working | Insurance plans | Paid parental leave | Relocation support not offeredSenior-level Full TimeBarcelona Gran Vía, Spain R3d ago
-
Expert Data Science EUR 35K-65KAgentic artificial intelligence | Artificial Intelligence | Data Governance | Data Quality | Data ScienceHybrid working | Insurance plans | Paid parental leave | Relocation support none | Retirement plansSenior-level Full TimeBarcelona Gran Vía, Spain R3d ago
-
Data Engineer EUR 48K-60KAmazon DynamoDB | Amazon SageMaker | Amazon Web Services | Apache Spark | C#Flexible working model | Health resources | Holiday and leave allowance | Hybrid work model | Meal voucherMid-level Full TimeBarcelona R3d ago
-
Data Engineer / Architect EUR 54K-79KAWS | Apache Spark | Azure | Big Data | CI/CDBirthday day off | English lessons | Flexible schedule | Flexible work from home | Free Microsoft certificationsSenior-level Full TimeSpain - Remote R4d ago
-
AWS | Apache Kafka | CI/CD | Docker | ELK100 percent remote work | Collaborative culture | Company offsite weeks | Complex digital health projects | Flexible work locationSenior-level Full TimeSpain R4d ago
-
Application Modernization | Architecture planning | Artificial Intelligence | Assessment | End to EndChildcare voucher | Continuous training | Fitness and wellbeing programs | Flexible schedule | Meal cardSenior-level Full TimeMadrid, Spain R4d ago
-
AI Engineering Workflow Developer (mf/d) EUR 40K-60KCI/CD | Docker | FastAPI | Git | GitHub API26 plus working days vacation | Childcare support | English and German language classes | Flexible working hours | Free access to specialist servicesEntry-level Full TimeGranada, AN, Spain R4d ago
-
Alerting | Data Pipelines | Distributed Systems | JAX | LoggingMid-level Full TimeSpain R4d ago
-
LLM Application Engineer EUR 49K-67KAPI Integration | Agent Frameworks | Backend Services | Context engineering | Database IntegrationMid-level Full TimeSpain R4d ago
-
AWS | Airflow | Backfills | CI/CD | DBT23 paid holidays | Additional paid holiday on birthday or work anniversary | Flexible working hours | Hybrid work option | Kindergarten supportSenior-level Full TimeBarcelona R5d ago
-
AI Engineer EUR 54K-75K.NET | API Design | AWS | Backend Development | CI/CDContinuous learning and development | Flexible hours | Home office setup support | Hybrid working setup | Language classesMid-level Full TimeBarcelona - Passeig de Gràcia 110, … R5d ago
-
API Gateway | AWS | AWS Lambda | AWS Secrets | AWS Secrets ManagerCareer growth plan | Childcare check | Flexible working hours | Inclusive multicultural environment | Medical insuranceSenior-level Full TimeMadrid, Spain R5d ago
-
Senior Data Engineer - Analytics Platform EUR 55K-74KAccess Control | BigQuery | CI/CD | Cost Optimization | DBTCertification support | Hybrid work | Open Source friendly | Performance bonus | Training opportunitiesSenior-level Full TimeMadrid R5d ago