Senior Software Engineer (big data)
Tasks
- Architect and evolve cloud data pipelines
- Build data pipelines at scale
- Collaborate with data science and research teams
- Ensure reliability and scalability of pipeline systems
- Ingest security intelligence data
- Integrate new data sources and features
- Process terabytes of data for daily ratings
- Refine rating algorithms
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Algorithms | Apache Iceberg | Apache Spark | CI/CD | Computer Science | Computer science fundamentals | Data Lakehouse | Data Structures | Design | Elasticsearch | Hadoop | Java | Kubernetes | OLAP | OpenSearch | Python | Starrocks
Education
N/A
Related jobs
-
Data Engineer (Hybrid) EUR 40K-48KBusiness Process | Business process understanding | Dashboarding | Data Engineering | Data PipelinesEqual opportunity employment | Hybrid workMid-level Full TimeLisbon, Lisbon, Portugal R1d ago
-
Senior-level Full TimeRemote, Portugal R2d ago
-
Data Engineer / Analyst EUR 40K-48KData Analysis | Data Engineering | Data Pipelines | Databricks | PythonHybrid work modelMid-level Full TimeLisbon, Lisbon, Portugal R2d ago
-
AWS | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkRemote work | Travel up to 15%Senior-level Full TimePorto, Portugal R6d ago
-
Senior ML Engineer @JobCloud EUR 50K-74KAWS | Agent systems | Cloud Computing | Containerization | Data QualityConference budget | Flexible work arrangement | Fully remote or hybrid work | Gym allowance | Meal allowanceSenior-level Full TimeVila Nova de Gaia, Portugal R8d ago
-
Senior Data Engineer ZAR 540K-675KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Remote-firstSenior-level Full TimePortugal; South Africa R8d ago
-
Data Engineer EUR 30K-49KAWS | Alteryx | Apache Spark | Azure Data | Azure Data FactoryHybrid workMid-level Full TimeLisbon - Antonio, Portugal R9d ago
-
C# | MATLAB | NumPy | Pandas | PythonNon permanent assignment | Part-time project workSenior-level Full TimePortugal - Remote R9d ago
-
Senior Machine Learning Engineer: Ranking (Remote) USD 80K-120KAirflow | Databricks | Feature Store | Luigi | Machine LearningApple laptops provided | Fully remote team | Maternity and paternity leave | Regular team offsites | Training and development budgetSenior-level Full TimePortugal - Remote R9d ago
-
Mid-Level AI Engineer EUR 45K-70KAWS | Big Data | Event Driven | Event-driven architecture | Google CloudFlexible working hours | Friday afternoons off | Remote-first environment | Training programs | Transportation supportMid-level Full TimeLisboa, Portugal R9d ago
-
Mid-Level AI Engineer EUR 45K-70KAWS | BERT | Big Data | Event Driven | Event-driven architectureFlexible working hours | Friday afternoons off | Quarterly off-sites | Remote-first environment | Training programsMid-level Full TimeLisboa, Portugal R9d ago
-
Senior Data Engineer EUR 50K-70KAWS S3 | Amazon Web Services | Apache Airflow | Apache Spark | Azure DatabricksAnnual team trip | Flexible working hours | Health insurance | Laptop and peripherals | Open holidaysSenior-level Full TimePorto, Porto District, Portugal - Remote R10d ago
-
Computer Vision | Deep learning | GDAL | Geopandas | Image ProcessingAdditional vacation days | Birthday day off | Flexible work environment | Gym memberships | Health insuranceMid-level Full TimeMatosinhos, Portugal R12d ago
-
Amazon Redshift | BigQuery | CI/CD | Cloud Data | Cloud Data WarehouseRemote workSenior-level Full TimePorto, Portugal R13d ago
-
Access Control | Airflow | Amazon Redshift | BigQuery | CI/CDFlexible schedule | Remote workSenior-level Full TimePortugal - Remote R14d ago
-
Senior Software Engineer (big data) EUR 100K-129KAWS | Algorithms | Apache Iceberg | Apache Spark | CI/CDSenior-level Full TimeRemote Portugal R14d ago
-
Analytics Application Engineer/Developer EUR 44K-54KAPI Integration | Agile | Angular | Bootstrap | CI/CDHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadershipMid-level Full TimeLisbon - Antonio, Portugal R14d ago
-
Senior-level Full TimePortugal - Remote R15d ago
-
API | AWS | AWS Kinesis | Apache Airflow | Apache KafkaRemote workSenior-level Full TimePorto, Portugal R16d ago
-
Amazon SageMaker | Apache Airflow | CI/CD | Distributed Systems | DockerCross-functional collaboration | Remote workSenior-level Full TimePorto, Portugal R17d ago
-
AI Software Engineer EUR 85K-102KAdobe Firefly | Agile | Anthropic | Autogen | DALL-EAnnual retreats | Co-working space | Conference access | Gym membership | Home office supportMid-level Full TimeLisbon, Remote, PT R18d ago
-
Software Engineer - Data Engineering EUR 18K-23KAirbyte | Airflow | Apache Beam | BigQuery | Data integrationHybrid work arrangement | Inclusive culture | Learning and development support | Life event leave | Social eventsMid-level Full TimeLisbon, Portugal R22d ago
-
Platform Engineer - Compute EUR 70K-98KAWS | Argo CD | CI/CD | Crossplane | DockerCollaborative environment | Remote work | Training and developmentEntry-level Full TimePortugal R22d ago
-
Data Engineer EUR 45KData Modeling | Data Pipelines | Docker | Flink | KafkaAutonomy and ownership | Career development | Continuous feedback | Flexible work hours | Hardware and software setupMid-level Full TimeLisbon, Portugal R22d ago
-
Software Engineer II - Data Platform EUR 50K-60KAlgorithms | Apache Tomcat | Cloud infrastructure | Data Processing | Data StructuresDonation matching | Employee assistance program | Flexible schedule | Health benefits | Remote work optionsMid-level Full TimePortugal - Hybrid or Remote R23d ago