Senior Data Engineer
Tasks
- Build Delta Live Tables silver and gold layers
- Catalog data assets with metadata and security classifications
- Collaborate with platform and agent teams on governed tooling
- Conduct PR reviews and enforce engineering standards
- Contribute to data engineering continuous improvement
- Design ingestion into bronze layer
- Generate typed relationship graph for digital twin
- Implement automated data quality testing frameworks
- Implement entity resolution and canonical IDs
- Mentor engineers and lead architectural discussions
- Monitor pipeline health and quality metrics
- Own serving layer for AI agent interactive latency
- Set up Unity Catalog governance including row level security lineage audit logging
- Translate analytical requirements into structured reusable datasets
Perks/Benefits
Skills/Tech-stack
AWS | Access Management | Amazon S3 | Asset bundles | Auto Loader | Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | CQRS | Change Data Capture | Cloud Storage | Data Capture | Data Governance | Data Lake Storage Gen2 | Data Modeling | Data Observability | Data Quality | Data Testing | Databricks | Databricks (asset) | Databricks Asset Bundles | Delta Lake | Delta Live Tables | Delta Live) | Entity Resolution | Event Driven | Event-driven architecture | GCP | Google Cloud | Google Cloud Storage | HNSW | IAM | IVFFlat | Identity and Access Management | Identity and access | Index Tuning | Knowledge graph | Lakehouse Architecture | Lineage | PGVector | Pgtrgm | PostgreSQL | PySpark | Python | Row Level Security | SQL | Structured Streaming | Unity Catalog
Education
N/A
Roles
Related jobs
-
AWS | Autoscaling | Azure | Bash | CI/CDFully remote within Europe | Healthcare coverage | Paid parental leave | Professional growth | Relocation assistanceMid-level Full TimePortugal R9h ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R20h ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami20h ago
-
Data Engineering | ETL | IBM DataStage | Python | StambiaElectric bikes | Green transportation budget | Hybrid work policy | Lactation Room | Prayer roomSenior-level Full TimeLisbon, Lisbon, Portugal21h ago
-
Alerting | Amazon Aurora | Amazon Redshift | CI/CD | DashboardsContinuous improvement culture | Cross-functional collaboration | Exposure to modern data platforms | Fully remote work | Opportunity to influence engineering standardsSenior-level Full TimePortugal R1d ago
-
Azure | Data Drift | Data Modeling | Data Processing | Data QualityFlexible schedule | Freelance service agreement | Remote workMid-level Full TimePortugal - Remote R1d ago
-
AI Engineer EUR 50K-60K.NET | AI Foundry | AI Search | Azure AI | Azure AI FoundryHybrid work | Professional developmentSenior-level Full TimeLisbon, Portugal1d ago
-
Junior AI & Data Engineer EUR 18K-27KAgile | CI/CD | Docker | Kubernetes | Machine LearningCareer development | Discounts | Flexible work hours | Health insurance | Hybrid work modelEntry-level Full TimeLisboa, PT, 1200-246 R1d ago
-
Senior Machine Learning Engineer EUR 64K-85KCost Optimization | Data Pipelines | Data Preparation | Debugging | GPU ComputingSenior-level Full TimePortugal1d ago
-
Member of Technical Staff, Machine Learning EUR 55K-79KData Pipelines | Fine Tuning | GPU Computing | Inference | JAXSenior-level Full TimePortugal1d ago
-
Full Stack Engineer, AI systems EUR 54K-75KAPI Architecture | Anthropic | Docker | Kubernetes | Language ModelsSenior-level Full TimePortugal1d ago
-
Backend Engineer, AI (Agent Systems) EUR 54K-75KAlerting | Batching | Caching | Distributed Systems | DockerMid-level Full TimePortugal1d ago
-
Applied AI Engineer EUR 54K-75KAgent workflows | Deep learning | Evaluation | Fine Tuning | InferenceSenior-level Full TimePortugal1d ago
-
A/B | A/B Testing | B testing | Chroma | EmbeddingsHybrid work modelSenior-level Full TimeLisbon, Portugal R2d ago
-
AWS | Azure | BERT | CI/CD | Deep learningBirthday off | Family coverage | Health insurance | Mobility program | Real work/life balanceEntry-level Full TimePorto, Portugal R2d ago
-
Staff/Lead Python Engineer (FastAPI, Orchestration) EUR 82K-112KAsynchronous programming | Cloud platform | Concurrent programming | FastAPI | GenAIAnnual learning and development budget | Co-working budget | Company laptop | Enhanced parental leave | Flexible scheduleSenior-level Full TimeRemote Anywhere R2d ago
-
API Design | Algorithms | Backend Services | Cloud Functions | Cloud platformSenior-level Full TimeBraga, Portugal2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeCoimbra, Portugal2d ago
-
Senior DevOps Engineer (Porto) EUR 50K-65KAirflow | Argo CD | Azure | Bash | CI/CDInclusive environmentSenior-level Full TimeLeça do Balio, Porto, Portugal3d ago
-
AI Engineer EUR 39K-48KAI Agents | AI Foundry | AI Search | API Design | Agent systemsFlexible leaveSenior-level Full TimeLisbon, Portugal R4d ago
-
Senior-level Full TimePorto, Portugal4d ago
-
Mid-level Full TimePorto, Portugal4d ago
-
Azure Data | Azure Data Factory | DBT | Data Factory | Data WarehousingMid-level Full TimePorto, Portugal4d ago
-
Engineering - Internal AI Transformation USD 74K-110KAPIs | Agentic Workflows | Auditability | Authentication | DockerAnnual company offsite | Co-working stipend | Learning and development stipend | Social travel stipendEntry-level Full TimeUnited States R4d ago
-
Data Engineer (all genders) EUR 42K-55KAmazon Web Services | Apache Kafka | Apache Spark | Azure Event Hubs | BashDiscounts | Flexible hours | Free language courses | Health offers | Hybrid workMid-level Full TimeLisbon, Portugal4d ago