Senior Software Engineer (big data)
Tasks
- Architect and evolve data pipeline
- Build large-scale data pipelines
- Collaborate with data science and research teams
- Collect aggregate analyze data at scale
- Deliver security ratings using rating algorithm
- Ensure reliability and scalability of pipeline
- Ingest security intelligence data
- Integrate new data sources
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Algorithms | Apache Iceberg | Apache Spark | CI/CD | Data Lakehouse | Data Structures | Data Warehouse | Elasticsearch | Hadoop | Java | Kubernetes | OLAP | OpenSearch | Python | Starrocks
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Software Engineer
Related jobs
-
GCP Data Engineer | BPCE-SI EUR 35K-54KApache Airflow | BigQuery | Cloud APIs | Cloud Composer | Cloud platformElectric bikes | Flexible work policy | Green transportation budget | Hybrid work policy | Inclusive DEI strategyMid-level Full TimePortugal, Portugal R5h ago
-
A/B | A/B Testing | Apache Spark | B testing | Deep learningCompany laptop | Fully remote work | Home office stipend | Learning and development budget | Paid Maternity LeaveSenior-level Full TimePortugal R1d ago
-
Data Engineering Specialist EUR 28K-49KBI | Classification | Data Bricks | Data Engineering | Data LakesHybrid work | Inclusive work culture | Professional developmentMid-level Full TimeLisbon - Antonio, Portugal R1d ago
-
Data & Automation Engineer EUR 56K-79KAPIs | Azure | Chatbots | Data Pipelines | DatabricksEmployee development opportunities | Flexible work environment | Health and inclusion support | Hybrid work model | Internal mobilitySenior-level Full TimeLisboa, PT R3d ago
-
Data Engineer EUR 38K-65KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SynapseFlex Options | Health insurance | Meal allowance | No-term contract | Paid vacationSenior-level Full TimeLisbon, Portugal R4d ago
-
Mid-level Full TimeAnywhere, Portugal R5d ago
-
API Security | Access Control | Airflow | Amazon Redshift | BigQueryFlexible hours | Remote workSenior-level Full TimePortugal - Remote R7d ago
-
Sr. Applied AI Engineer EUR 58K-81KAgent Orchestration | Agentic loops | Asynchronous services | Benchmarking | CachingEmployee resource groups | Flexible work environment | Hybrid work model | Remote work optionSenior-level Full TimeLisbon, Portugal R9d ago
-
AWS Lambda | AWS S3 | Apache Airflow | Apache Kafka | CI/CDHealth benefits | Mentoring | Professional development | Remote workSenior-level Full TimePorto, Portugal R9d ago
-
Senior Software Engineer (big data) EUR 72K-88KAWS | Algorithms | Apache Iceberg | Apache Spark | CI/CDSenior-level Full TimeRemote Portugal R9d ago
-
Senior Software Engineer (big data) EUR 72K-88KAWS | Apache Iceberg | Apache Spark | CI/CD | Data LakehouseSenior-level Full TimeRemote Portugal R9d ago
-
Senior-level Full TimeRemote, Portugal R11d ago
-
AWS | Amazon Kinesis | Apache Airflow | Apache Kafka | Apache SparkRemote work | Travel up to 15%Senior-level Full TimePorto, Portugal R15d ago
-
Senior ML Engineer @JobCloud EUR 50K-74KAWS | Agent systems | Cloud Computing | Containerization | Data QualityConference budget | Flexible work arrangement | Fully remote or hybrid work | Gym allowance | Meal allowanceSenior-level Full TimeVila Nova de Gaia, Portugal R17d ago
-
Senior Data Engineer ZAR 540K-675KAWS | Airflow | Amazon Redshift | Apache Flink | Apache SparkFlexible work practices | Remote-firstSenior-level Full TimePortugal; South Africa R17d ago
-
Data Engineer EUR 30K-49KAWS | Alteryx | Apache Spark | Azure Data | Azure Data FactoryHybrid workMid-level Full TimeLisbon - Antonio, Portugal R17d ago
-
Senior Machine Learning Engineer: Ranking (Remote) USD 80K-120KAirflow | Databricks | Feature Store | Luigi | Machine LearningApple laptops provided | Fully remote team | Maternity and paternity leave | Regular team offsites | Training and development budgetSenior-level Full TimePortugal - Remote R17d ago
-
Mid-Level AI Engineer EUR 45K-70KAWS | Big Data | Event Driven | Event-driven architecture | Google CloudFlexible working hours | Friday afternoons off | Remote-first environment | Training programs | Transportation supportMid-level Full TimeLisboa, Portugal R18d ago
-
Mid-Level AI Engineer EUR 45K-70KAWS | BERT | Big Data | Event Driven | Event-driven architectureFlexible working hours | Friday afternoons off | Quarterly off-sites | Remote-first environment | Training programsMid-level Full TimeLisboa, Portugal R18d ago
-
Amazon Redshift | BigQuery | CI/CD | Cloud Data | Cloud Data WarehouseRemote workSenior-level Full TimePorto, Portugal R22d ago
-
Analytics Application Engineer/Developer EUR 44K-54KAPI Integration | Agile | Angular | Bootstrap | CI/CDHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadershipMid-level Full TimeLisbon - Antonio, Portugal R22d ago
-
Senior-level Full TimePortugal - Remote R23d ago
-
API | AWS | AWS Kinesis | Apache Airflow | Apache KafkaRemote workSenior-level Full TimePorto, Portugal R25d ago
-
Amazon SageMaker | Apache Airflow | CI/CD | Distributed Systems | DockerCross-functional collaboration | Remote workSenior-level Full TimePorto, Portugal R26d ago
-
AI Software Engineer EUR 85K-102KAdobe Firefly | Agile | Anthropic | Autogen | DALL-EAnnual retreats | Co-working space | Conference access | Gym membership | Home office supportMid-level Full TimeLisbon, Remote, PT R27d ago