Senior Data Consultant (Hadoop, Spark)
Tasks
- Automate testing
- Build and maintain scalable data pipelines
- Collaborate with business analysts
- Contribute to system architecture and design
- Design and develop data solutions
- Implement ETL frameworks
- Implement monitoring and performance tooling
- Participate in sprint planning and retrospectives
- Perform code reviews
- Provide production support
- Troubleshoot production issues
Perks/Benefits
Skills/Tech-stack
Agile | Airflow | Ansible | Apache Airflow | Apache Hive | Apache Kafka | Apache Spark | Data Modeling | DevOps | ETL | Elasticsearch | Git | GitHub | Hadoop | Java | Java API | Jenkins | Jira | Kanban | Linux | PL/SQL | PySpark | Python | REST API | SQL | Scala | Scrum | Spark Streaming | Unix | YARN
Education
N/A
Roles
Consultant | Data Consultant | Data Engineer | Engineer | Senior Data Consultant
Related jobs
-
AWS | Azure | CI/CD | Cloud platform | DockerAccess to cutting edge tools and platforms | Career development | Hybrid work | Inclusive innovation driven culture | MentorshipMid-level Full TimePoznan, Wielkopolskie, Poland7h ago
-
AI Engineer PLN 179K-254KAI Foundry | AI Search | API Design | Automated Evaluation | Azure AIEmployee resource groups | Flexible leave | Global Wellbeing Days | Growth opportunities | Paid time offSenior-level Full TimePoland, Poland9h ago
-
Senior Data Solutions Engineer PLN 208K-320KAWS | Azure | Data Modeling | Data Pipelines | Data WarehousingAccommodation covered | Free breakfasts | Hybrid working model | International projects | No dress codeSenior-level Full TimeKraków, Województwo małopolskie, Poland11h ago
-
[CMI] Machine Learning Engineer PLN 226K-336KAmazon SageMaker | Audit Logging | Automated retraining | CI/CD | Cloud infrastructureExternal training | Flexible work hours | Insurance | Internal training | International business tripsSenior-level Full TimeKraków, Lesser Poland Voivodeship, Poland13h ago
-
Data & AI Internship Program (She/He/They) PLN 60K-60KAggregation | Data Engineering | Data Pipelines | Data Visualization | Data WarehousingBuddy support | Career development | Flexible working hours | Long-term employment opportunity | MentorshipEntry-level Full Time InternshipWarsaw, Sienna 39, Poland20h ago
-
Asset Management | Data Analysis | Failure Mechanisms | Predictive Modeling | Probabilistic ModelingAnnual performance bonus | Disability programs | Flexible work hours | Hybrid work | Life insuranceSenior-level Full TimePL-PDK-WARSAW-ALEJA KRAKOWSKA 110/114 BLD 3014613, Poland R20h ago
-
AI Automation & Analytics Engineer PLN 204K-291KAPIs | Anomaly Detection | Anthropic Claude | Azure | Azure OpenAICollaborative workplace culture | Continuous learning opportunities | Multisport card subsidy | Private medical care | Professional onboardingMid-level Full TimeStare Miasto, Poland20h ago
-
Lead Software Engineer (AI) PLN 246K-340KAgent SDK | Background Jobs | Claude Agent SDK | Evaluation | HatchetCareer development | Knowledge sharing | Learning and development budget | Online and offline events | Paid sicknessSenior-level Full TimeKraków, Poland1d ago
-
Senior Data Engineer (Big Data) PLN 189K-320KAWS | AWS Kinesis | Apache Kafka | Apache Spark | AzureHybrid work environment | Long-term projectSenior-level Full TimeVarsòvia, Warsaw, Poland1d ago
-
Test - nazwa stanowiska PLN 237K-328KAI Agents | APIs | Amazon Web Services | Automated testing | AzureBuddy onboarding program | Certificate training programs | Flexibility in working hours | Remote work option | Udemy learning platformSenior-level Freelance Full TimePoland R1d ago
-
AI Engineer PLN 179K-254KAI Foundry | AI Search | API Design | API Versioning | Agent OrchestrationEmployee resource groups | Flexible leave | Global Wellbeing Days | Growth opportunities | Inclusive work environmentSenior-level Full TimePoland, Poland1d ago
-
(Senior) Data Analytics Consultant (m/f/n) PLN 220K-326KApache Airflow | Apache Spark | Bash | DBT | Data GovernanceSenior-level Full TimeKraków, Województwo małopolskie, Poland1d ago
-
Data Engineer PLN 276K-276KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaCareer growth | Coworking space | English classes | MacBook provided | MentorshipMid-level Full TimePoland1d ago
-
Senior AI Engineer PLN 228K-324KAWS | Angular | Azure | CI/CD | DatabricksDiscretionary year end shutdown | Family building benefits | Fitness support | Healthcare benefits | Location-specific perksSenior-level Full TimePOL - Mazowieckie - Warsaw - …1d ago
-
Senior-level Full TimePOL – Krakow – Cytiva, Poland1d ago
-
Senior Machine Learning Engineer (Large Systems) PLN 350K-474KC++ | CUDA | Cloud Computing | Deep learning | Distributed TrainingAnnual leave policy | Employee pension matched up to 4 percent | Gym card | Medical and dental health plansSenior-level Full TimeGdańsk, Pomeranian Voivodeship, Poland2d ago
-
Apache Airflow | BigQuery | Cloud platform | DBT | Data WarehousingAnnual off-site events | Co-working space allowance | Employee stock ownership program | Flexible asynchronous schedule | Fully remoteSenior-level Full TimePoland R2d ago
-
Senior AI Engineer (Remote) PLN 211K-310KAPIs | AWS | Agentic Systems | Azure | Backend DevelopmentHybrid work | Professional development | Remote work | Stock options program | Wellbeing supportSenior-level Full TimeWarsaw R2d ago
-
AI Engineer (AWS Bedrock) PLN 146K-229KAI Governance | AWS Bedrock | AWS Lambda | Amazon ECS | Amazon EKSHealthcare | International projects | Long-term contractMid-level Full TimeWarsaw, Poland2d ago
-
Gen AI Software Engineer PLN 217K-383KAWS IAM | AWS Lambda | AWS S3 | Amazon Bedrock | Amazon SageMakerHybrid work model | Life insurance | Paid sick leave | Paid vacation | Private medical insuranceEntry-level Full TimeKrakow, Malopolskie, Poland2d ago
-
APIs | Data Governance | Data Mapping | Data Modelling | Data QualityEmployment by staffing company | Hybrid work model | Work on banking industry projectSenior-level Full TimeGdynia, Poland2d ago
-
AI Engineer | Global (based in Poland) PLN 140K-229KAgent Development | Agent Development Kit | CI/CD | Cloud platform | Data PipelinesAdditional days off | Cafeteria programme | English working environment | Internal training program | Mostly remote workMid-level Full TimeWarszawa, Województwo mazowieckie, Poland2d ago
-
Machine Learning Engineer, Consumer Alliance PLN 276K-360KApache Spark | Experimentation | Feature Engineering | Kafka | KubernetesBreakout zones | Cycle parking | Global collaboration | Knowledge sharing culture | Modern office workspaceSenior-level Full TimeWarszawa, Masovian Voivodeship, Poland2d ago
-
C# | C++ | Data Serialization | Debian | DockerHealth insurance | Internal trainings | Tech lunches | WorksmileEntry-level Full TimeKatowice, Województwo Śląskie, Poland2d ago
-
Senior Data Engineer PLN 177K-329KAutomation | CI/CD | Containerization | Data Modeling | Data ValidationHealth and welfare benefits | On site access via VPN | Remote-first collaborationSenior-level Full TimeWarsaw, Poland2d ago