Data Engineer (.Net)
Tasks
- Apply data quality governance and documentation best practices
- Build CI/CD pipelines
- Build and optimize data pipelines using Apache Spark and Databricks
- Create and manage data workflows and orchestration
- Design and optimize ETL and ELT processes
- Develop data access and transformation components using Entity Framework SQL and Python
- Develop data driven applications using .NET
- Ensure monitoring and observability for reliability and performance
- Implement Delta Lake and AutoLoader solutions
- Implement scalable modern data architectures
- Integrate data solutions with enterprise platforms
Perks/Benefits
Skills/Tech-stack
.NET | Apache Spark | Autoloader | C# | CI/CD | Dagster | Databricks | Delta Lake | ELT | ETL | Entity Framework | Hangfire | Monitoring | Observability | Python | SQL
Education
Roles
Related jobs
-
ARM GNU tools | Automation Scripting | Bare Metal | C# | CANCanteen | Career progression | Continuous professional development | Discounts on products | Flexible work conditionsEntry-level Full Time InternshipOvar, Portugal16h ago
-
Lead Data & Analytics Engineer EUR 50K-68KAWS | Agile | Artificial Intelligence | Azure | Cloud platformCareer benefits | Diverse and inclusive culture | Financial benefits | Flexible work arrangements | Healthcare benefitsSenior-level Full TimePortugal - ACC1d ago
-
Senior Machine Learning Engineer (m/f/d) EUR 32K-45KAWS | CI/CD | Data Modeling | Database systems | DockerBirthday day off | Family service discounts | Flexible work setup | Learning and knowledge exchange | Meal allowanceSenior-level Full TimeLisbon, Portugal1d ago
-
Senior ML Ops / LLM Ops Engineer EUR 54K-75KAWS | Access Control | Azure | Clustering | DVCCareer path management | On-call support | Startup environment | Training and certificationSenior-level Full TimeLisbon, Portugal1d ago
-
AWS Lambda | Airflow | Amazon IAM | Amazon S3 | CI/CDFlexible working hours | Fully remote | Professional growth opportunities | Supportive team culture | Work-life balanceMid-level Full TimePortugal R1d ago
-
AI Engineer EUR 39K-48KAI Agents | AI Foundry | AI Search | API Versioning | Agent systemsFlexible leave | Global Wellbeing Days | Paid time off | Remote working opportunitiesSenior-level Full TimeLisbon, Portugal R1d ago
-
AI Engineer / Agent Developer EUR 53K-75KAI Agents | AI Foundry | AI Services | APIs | Automated testingCareer growth | International team | Learning with enterprise technologySenior-level Full TimePorto, Porto, Portugal1d ago
-
Senior Data Platform Engineer (Kafka/Docker/Kubernetes) - Hybrid Lisbon (2 days/week office) EUR 42K-54KApache Flink | Apache Kafka | Apache Spark | CI/CD | DockerHybrid workSenior-level Full TimeLisbon, Portugal R1d ago
-
Agent Frameworks | Context Management | Embeddings | Language Models | Language ProcessingAnnual leave | Flexible schedule | Health insurance | Hybrid work model | Professional development budgetSenior-level Full TimePorto, Portugal R1d ago
-
Forward Deployed Engineer (all genders) EUR 49K-67KABAC | API Integration | Agent Orchestration | Amazon Web Services | Asynchronous programmingMid-level Full TimeLisbon, Lisbon, Portugal1d ago
-
Mid-level Full TimeLisbon, Lisbon, Portugal1d ago
-
Mid-level Full TimeLisbon, Lisbon, Portugal1d ago
-
Analytics Engineer - OpenData EMEA (Remote) EUR 50K-85KCode review | Data Cleansing | Data Frames | Data Modeling | Data ObservabilityCharitable contributions | Family health insurance | Fitness reimbursement | Private pension contributions | Work from anywhereMid-level Full TimePortugal - Lisbon R1d ago
-
Senior Data Engineer - Platforms EUR 66K-89KADLS | Agile | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePorto, PT, 4100-1362d ago
-
Apache Airflow | BigQuery | Build tool | Cloud platform | Data BuildCareer progression opportunities | Health insurance | Meal card | Special discounts | Welcome kitMid-level ContractLisbon2d ago
-
Lead Data Engineer EUR 31K-34KAWS Redshift | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeFlexible pay | Medical insurance | Unlimited access to technological trainingSenior-level Full TimeLisboa, Lisboa2d ago
-
Mid Data Engineer EUR 30K-32KAWS | Apache Spark | Azure | Azure Data | Azure Data FactoryFlexible pay | Medical insurance | Remote work option | Unlimited training accessSenior-level Full TimeLisboa, Lisboa2d ago
-
AI Engineer EUR 39K-48KAI Foundry | AI Search | API Design | Agent systems | Agentic WorkflowsFlexible leave | Global Wellbeing Days | Growth opportunities | Mentorship | Paid time offSenior-level Full TimeLisbon, Portugal R2d ago
-
API | Anomaly Detection | CI/CD | Cause analysis | CrewAICanteen | Career progression | Flexible benefits platform | Free parking lot | Health insuranceSenior-level Full TimeBraga, Braga, Portugal2d ago
-
(Senior) ML Ops Engineer EUR 55K-66KAWS | Agile | Amazon SageMaker | Apache Airflow | AzureFlexible working hours | Professional development opportunitiesSenior-level Full TimeLousado, Braga, Portugal2d ago
-
API Integration | Batch Processing | BigQuery | CI/CD | Cloud platformCareer coaching | Career progression | Health insurance | Meal card | Welcome kitMid-level ContractLisbon R3d ago
-
API Integration | Apache Hadoop | Apache Hive | Apache Kafka | Apache SparkCareer progression | Discounts | Health insurance | Meal card | Welcome kitSenior-level ContractLisbon R3d ago
-
Amazon Redshift | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseEntry-level Full TimePorto, Portugal3d ago
-
Apache Airflow | BigQuery | Cloud platform | DBT | DataflowAnnual off-site events | Co-working space allowance | ESOP (equity) | Flexible asynchronous schedule | Fully remoteSenior-level Full TimePortugal R3d ago
-
Senior AI Engineer (Remote) EUR 56K-79KAPIs | AWS | Agent workflows | Azure | Cost OptimizationHybrid work | Remote work | Stock options program | Travel flexibility | Work and Swim programSenior-level Full TimePortugal R3d ago