Senior Data Engineer (Hadoop, Spark)
Tasks
- Automate testing for components
- Build data pipelines using PySpark
- Collaborate with business analysts on requirements
- Define data solutions architecture and design
- Develop and maintain scalable data solutions
- Implement and maintain Hadoop ecosystem components
- Implement monitoring and performance scalability processes
- Participate in sprint planning sprint reviews and retrospectives
- Perform code reviews and mentoring
- Provide production support and troubleshooting
Perks/Benefits
- Access to e-learning platform
- Hybrid work
- Life insurance
- Meal subsidy
- Medical insurance
- Online training
- Social events
- Sports allowance
Skills/Tech-stack
Ansible | Apache Airflow | Apache Elasticsearch | Apache Hadoop | Apache Hive | Apache Spark | Big Data | Big Data Modeling | Cloud Design | Cloud Design Patterns | Data Ingestion | Data Modeling | Data integration | Debugging | Design Patterns | DevOps | ETL | Elasticsearch | Git | GitHub | Java | Java APIs | Jenkins | Jira | Kanban | Linux | NoSQL | PL/SQL | PySpark | Python | REST API | Relational Database | SQL | Scala | Scrum | Spark Streaming | Unix | YARN
Education
N/A
Roles
Related jobs
-
Staff AI Engineer (AI Enablement Platform) PLN 246K-400KAPI Design | APIs | AWS | Agent Orchestration | AzureMentoring | Mentorship | Professional developmentSenior-level Full TimePoland19h ago
-
Android AOSP | Android HAL | C# | Debugging | Device treeAdditional days off | English language lessons | Hybrid work | Multisport funding | Paid volunteering daysMid-level Full TimeWarsaw, Poland1d ago
-
Analytics Engineer (m/f/d) PLN 211K-320KDAX | Data Query | Data Query Optimization | Data Visualization | DatabricksCross functional international environment | Remote work option | Technology monitoring and choices | Training opportunitiesSenior-level Full TimeWarszawa, Województwo mazowieckie, Poland R1d ago
-
Data Engineer - HR support (m/f/n) PLN 96K-110KData Governance | Data Migration | Data Privacy | Data Quality | DatabricksFlexible working model | Remote work optionsEntry-level Full TimeWarszawa, Województwo mazowieckie, Poland1d ago
-
Senior Forward Deployed Engineer, GenAI, Google Cloud PLN 364K-374KAPI Integration | Agent systems | Cloud platform | CrewAI | Data PipelinesBenefits | Bonus | EquitySenior-level Full TimeWarsaw, Poland1d ago
-
Embedded Software Engineer (Poland) PLN 190K-268KARM Cortex | ARM Cortex-M | Analog electronics | Automated testing | BLEMedical insurance | Remote workSenior-level Full TimeKraków, Poland R1d ago
-
Agile | Apache Airflow | Apache Spark | BigQuery | Cloud ComposerCareer growth | Remote/hybrid work | Training and mentoringSenior-level Full TimePoland1d ago
-
Senior SW Engineer – AI Infrastructure & Optimization PLN 280K-383KCUDA | Cloud Platforms | Distributed Systems | GPU Performance | GPU Performance OptimizationSenior-level Full TimeKraków, Małopolskie, PL1d ago
-
Computer Vision | Deep learning | Diffusers | Diffusion Models | Generative AIAnnual vacation | Conference reimbursement | English learning discounts | Fully remote | Health allowanceSenior-level Full TimePoland R1d ago
-
Agent Orchestration | Chatbot Development | DPO | Deep learning | Distributed TrainingConference support | English learning discounts | Fully remote | Health support budget | Home-office allowanceSenior-level Full TimePoland R1d ago
-
Senior Data Engineer (Snowflake) CAD 120K-150KAirbyte | Azure Data | Azure Data Factory | Coalesce.io | Data FactoryEquipment provision | Hybrid work flexibility | Medical healthcare | Ongoing learning reimbursement | Recognition programSenior-level Full TimeBulgaria, Georgia, Lithuania, Poland, Romania, Uzbekistan1d ago
-
Senior-level Full TimeWarsaw, PL / Serbia / Romania1d ago
-
Apache Airflow | DBT | Data Governance | Data Lineage | Data ModelingEmployment opportunity after internship | Flexible working hours | Hybrid work | Paid internship | Training and development programEntry-level Full Time InternshipKrakow, Poland1d ago
-
Senior Data Consultant (Hadoop, Spark) PLN 250K-326KAgile | Airflow | Ansible | Apache Airflow | Apache HiveAgile environment | Code mentoring | Flexible office work 2 days per weekSenior-level Full TimeKraków, PL, 30-3021d ago
-
AI Agents | API Integration | AWS | Agent Orchestration | Backend DevelopmentEqual opportunity workplace | Remote workSenior-level Full TimePoland - Remote R1d ago
-
Ansible | Cloud | Configuration Management | Containers | Infrastructure as a codeHybrid workMid-level Contract Full Time TemporaryPOL - Gdansk, Poland1d ago
-
Sr. Software Engineer, Inference PLN 321K-470KAutoscaling | BF16 | C++ | CI/CD | CUDACritical illness cover | Employee assistance programme | Family dental insurance | Family medical insurance | Life assuranceSenior-level Full TimeWarsaw, Poland1d ago
-
Data Engineer (m/f/d) PLN 276K-276KAWS | Ansible | Apache Airflow | Apache Kafka | Apache SparkInternational cross functional environment | Remote work option | Training opportunitiesMid-level Full TimeWarszawa, Województwo mazowieckie, Poland R2d ago
-
Mid/Senior AI engineer with networking experience PLN 250K-374KAPI Integration | Agentic Workflows | CI/CD | Data Validation | Deep learningFlexible working hours | Hybrid work | Professional training | Remote work | Training budgetSenior-level Full TimeWarszawa, Poland R2d ago
-
Senior Data Engineer (Snowflake) CAD 120K-150KAirbyte | Azure Data | Azure Data Factory | Coalesce.io | Data FactoryHybrid/Remote flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Referral bonusesSenior-level Full TimeBulgaria, Georgia, Lithuania, Poland,Romania, Uzbekistan2d ago
-
Senior-level Full TimeViessmann Technika Grzewcza Sp. z o. …2d ago
-
Applied Machine Learning Engineer PLN 206K-280KAI Agents | Azure DevOps | Bayesian statistics | CI/CD | Cloud MonitoringSenior-level Full Time(HE)Office KRK Pawia, Poland2d ago
-
Head of AI - Finance PLN 182K-228KAI Services | APIs | Amazon Bedrock | Artificial Intelligence | AutomationHybrid work modelExecutive-level Full TimeWarsaw - Poland2d ago
-
AWS | BigQuery | Code review | Data Warehousing | Google CloudAdditional vacation days | English courses | Flexible work | Health insurance | Hybrid workMid-level Full TimePoland4d ago
-
Senior Data Engineer PLN 289K-325KAWS Glue | AWS Lambda | AWS Redshift | AWS Step Functions | AirflowBusiness travel insurance | Cell phone and internet stipend | Home office stipend | Life insurance | Medical insuranceSenior-level Full TimeWarsaw5d ago