Big Data Architect
Tasks
- Define scalable ETL and ELT pipelines
- Define technology stack and implementation standards
- Design cloud storage strategies for large data
- Design data lakehouse data mesh and modern data warehouses
- Design end-to-end data architectures
- Establish data access patterns and governance
- Evaluate and drive adoption of emerging data technologies
- Implement CI/CD for data pipelines
- Lead technical architecture decisions with stakeholders
- Set up DataOps data quality and observability frameworks
Perks/Benefits
- Conferences and courses
- Hybrid work model
- Intensive work schedule
- Official certifications
- Remote work options
- Telework expense support
- Training budget
Skills/Tech-stack
AWS | Amazon SageMaker | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Spark | Azure | Big Data | CI/CD | DBT | DBT Cloud | Data Architecture | Data Governance | Data Lakehouse | Data Observability | Data Pipelines | Data Quality | Data Warehouse | Data mesh | DataOps | Databricks | Delta Lake | Delta Live Tables | Delta Live) | ELT | ETL | GCP | Git | Kafka | Kinesis | Kubeflow | MLOps | MLflow | Modern Data Warehouse | Parquet | Python | Scala | Snowflake | Spark Structured Streaming | Streaming Data | Streaming data pipelines | Structured Streaming | Vertex AI
Education
Roles
Related jobs
-
Data Engineering Lead / Evangelist EUR 52K-77KAgile methodology | Coaching | Community building | Data Engineering | Data GovernanceFlexible working hours | Free parking | Health insurance | Hybrid work model | Life insuranceSenior-level Full TimeDigital Hub Madrid, Spain R2d ago
-
Agent Orchestration | Asynchronous Messaging | C# | EIDAS 2 | EmbeddingsAccident insurance | Childcare support | Continuous learning | Coursera access | Experience daysMid-level Full TimeSeville, AN, Spain R3d ago
-
AI Architect EUR 36K-45KAI Search | ARM | Access Management | Azure AI | Azure AI SearchContract indefinite | Everywhere work model | Extra vacation days | Flexible working hours | Intensive Friday scheduleSenior-level Full TimeHíbrido (28009, Madrid, MD, España) R7d ago
-
A2A | API Gateway | AWS Bedrock | AWS CloudFormation | Agent architectureContinuous learning plan | Flexible compensation plan | Flexible working hours | Hybrid work | Medical team at officesSenior-level Full TimeMadrid, ES R8d ago
-
API Gateway | AWS | AWS Bedrock | Agent to Agent | ApigeeFlexible compensation plan | Flexible working hours | Health program | Hybrid work | Learning and developmentSenior-level Full TimeBarcelona, ES R8d ago
-
API Integration | Agent Orchestration | Asynchronous Messaging | C# | EmbeddingsAccident insurance | Continuous learning | Coursera access | Experience days | Flexible hoursMid-level Full TimeMadrid, MD, Spain R12d ago
-
Data Architect Python (ESP/UK) EUR 54K-72KAWS | Cloud platform | Data Governance | Data Lineage | Data ModelingSenior-level Full TimeRemote , Spain R12d ago
-
Cloud Database Administrator EUR 65K-65KApache Cassandra | Backup and Recovery | Database monitoring | Database performance | Database performance tuningChildcare vouchers | Flexible compensation benefits | Flexible work time | Hybrid work | In-house parkingMid-level Full TimePrat de Llobregat (BCN), ES R12d ago
-
AI Solutions Architect (IT) EUR 60K-86KAWS | Artificial Intelligence | Automation | Cisco Meraki | Cloud ArchitectureSenior-level Full TimeRemote - Spain R14d ago
-
Tech Lead .Net (Zaragoza) EUR 35K-42K.NET | API Management | ASP.Net Core | Azure | Azure APIBonus | Flexible work hours | Life insurance | Naturer Activities | Paid trainingSenior-level Full TimeBARCELONA, Spain R16d ago
-
Arquitecto/a de interoperabilidad con IA (LLM) EUR 30K-36KAPI Integration | Agent Orchestration | Asynchronous Messaging | C# | DocumentationAccident insurance | Childcare support | Coursera access | Experience days | Extra paid time offMid-level Full TimeMadrid, MD, Spain R17d ago
-
Data Architect EUR 36K-45KAWS | AWS Glue | Apache Airflow | Apache Iceberg | AzureConference access | Course access | Flexible schedule | Friday workdays off | Hybrid work optionSenior-level Full TimeLogroño, Spain R22d ago
-
Agent Orchestration | C# | CDA | EIDAS | EmbeddingsAccident insurance | Additional paid time off | Childcare support | Continuous learning | Experience daysEntry-level Full TimeSeville, AN, Spain R25d ago
-
Sr. BI & Data Architect [Fixed Term Contract] EUR 49K-79KApache Spark | CI/CD | Data Governance | Data Lineage | DatabricksSenior-level Contract Full Time TemporaryRemote, REMOTE, Spain R30d ago
-
Sr. BI & Data Architect [Fixed - Term Contract] EUR 54K-84KCI/CD | Data Governance | Data Lineage | Databricks | Delta LakeSenior-level Contract Full TimeRemote, REMOTE, Spain R1mo ago