Data Engineer - Warsaw
Tasks
- Architect data pipelines
- Build data validation testing monitoring
- Build web scraping workflows
- Collaborate with AI and ML teams
- Develop data pipelines
- Enforce data governance privacy lineage
- Evaluate GenAI tooling
- Ingest normalize enrich data
- Maintain data pipelines
- Optimize pipeline performance
- Scale scraping processes
- Scrape and crawl websites
- Support vendor onboarding integration
- Validate scraped data quality compliance
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | AWS Fargate | AWS Glue | AWS Step Functions | Amazon EMR | Apache Arrow | Apache Spark | BeautifulSoup | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Warehousing | Databricks | Delta Lake | HTML | HTTP | Linux | Pandas | Python | Requests | SQL | Scala | Scrapy | Selenium | Step Functions | Unity Catalog | Unix | Version control | Web Scraping
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Staff Software Engineer, BigLake Federation PLN 232K-348KApache Iceberg | Apache Spark | Big Data | Cloud Computing | Data analyticsSenior-level Full TimeWarsaw, Poland9h ago
-
AI Solutions Engineer - Mergers & Acquisitions PLN 170K-315KAPI Development | API Gateway | AWS | Authentication | AuthorizationDedicated training budget | Flex location | Group life insurance | Multisport | Private healthcareMid-level Full TimeWarsaw Grafit, Poland20h ago
-
Agent Orchestration | Amazon Neptune | D3.js | Entity Resolution | Entity recognitionAsynchronous collaboration | Flexible schedule | Remote workSenior-level Full TimePoland - Kraków1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Backfill | Data Capture | Data FilteringFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote optionsSenior-level Full TimeWrocław, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Capture | Data Migration | GCP DataflowFlextime | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeSzczecin, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud DataStream | Cloud Dataflow | Cloud platform | Data BackfillFlextime | Mentorship | Office options | Personalized growth roadmaps | Professional growthSenior-level Full TimeWarsaw, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Capture | Dataflow | DatastreamEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeLublin, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Backfill | Data Capture | Data FilteringEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeKraków, Poland1d ago
-
Senior Backend Engineer ID63544 PLN 250K-342KChange Data Capture | Cloud platform | Data Capture | Data Migration | DataflowCompetitive compensation | Education budget | Exciting projects | Fitness budget | FlextimeSenior-level Full TimeGdańsk, Poland1d ago
-
Senior Data Engineer (ADB, Python) CAD 120K-160KASP.Net Core | Angular | Apache Spark | Azure Cloud | Azure DataHybrid/Remote flexibility | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBulgaria, Georgia, Poland, Romania, Uzbekistan1d ago
-
Senior/Lead Data Engineer (Databricks, Power BI) RON 312K-396KApache Spark | Azure Synapse | Cloud Data | Cloud data platform | DAXHybrid/Remote flexibility | International projects | Medical healthcare | Ongoing learning reimbursement | Recognition programSenior-level Full TimeBulgaria, Poland, Romania1d ago
-
Middle DataOps Engineer USD 120K-155KAgile | Azure | Azure DevOps | Azure Monitor | BashHybrid options | International projects | Local benefits | Medical healthcare | Ongoing learning reimbursementMid-level Full TimeBulgaria, Georgia, Hungary, Lithuania, Poland, Romania, …1d ago
-
Middle DataOps Engineer USD 120K-155KARM Templates | Azure | Azure DevOps | Azure Monitor | BashHybrid work flexibility | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesMid-level Full TimeBulgaria, Georgia, Hungary, Lithuania, Poland, Romania, …1d ago
-
Mid-level Full TimeWrocław1d ago
-
AI Engineer PLN 246K-384KAI Foundry | AI Search | API Design | Audit Logging | Automated EvaluationFlexible leave | Global Wellbeing Days | Professional growth opportunities | Remote working opportunitiesSenior-level Full TimePoland, Poland1d ago
-
Senior/Lead Data Engineer (Databricks, Power BI) RON 312K-396KApache Spark | Azure Synapse | DAX | Data Warehousing | DatabricksHybrid work flexibility | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBulgaria, Poland, Romania1d ago
-
Senior/Lead Data Engineer (Databricks, Power BI) RON 312K-396KApache Spark | Azure Synapse | DAX | Data Modeling | Data WarehousingHybrid/Remote flexibility | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBulgaria, Poland , Romania1d ago
-
Senior Data Solutions Engineer PLN 220K-384KAWS | Azure | Cloud | Data Modeling | Data WarehouseEmployee-oriented culture | Free breakfasts | Friendly team | Growth opportunities | Hybrid work modelSenior-level Full TimeKraków, Województwo małopolskie, Poland1d ago
-
Machine Learning Credit Model Developer PLN 115K-264KAgile | Classification | Collection systems | Credit Decision Scorecards | Credit RiskSenior-level Full TimeWarszawa (Pańska 97), Poland1d ago
-
Machine Learning Credit Model Developer PLN 115K-264KAgile | Classification | Credit Decision Scorecards | Credit Risk | Credit Risk ManagementSenior-level Full TimeWarszawa (Pańska 97), Poland1d ago
-
Reliability & Data Analysis Engineer PLN 186K-228KAgile | Apache Spark | CI/CD | Data Aggregation | Data CleansingEmployee pension scheme | Employee recognition program | Flexible working hours | Learning and development program | Life insuranceMid-level Full TimePOL - Rzeszow, Poland1d ago
-
Reliability & Data Analysis Engineer PLN 186K-228KAWS | Agile | Azure | CI/CD | Cloud platformAdditional paid time off | Employee pension scheme | Employee recognition program | Flexible working hours | Learning programsMid-level Full TimePOL - Rzeszow, Poland1d ago
-
Senior Data Engineer with German PLN 241K-385KAWS | Agile | Apache Kafka | Apache Spark | AvroCoaching | Continuous learning | Diverse and inclusive culture | Flexible work modelSenior-level Full TimeKatowice, Śląskie, PL, 40-2021d ago
-
Next Frontier Quantum Associate PLN 125K-190KAzure Quantum | CI/CD | Cryptography | Docker | GitCoaching | Continuous learning | Diverse, inclusive cultureMid-level Full TimeWrocław, DS, PL, 50-0861d ago
-
Data Engineer PLN 276K-276KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaCareer growth | Coworking space option | English classes | MacBook provided | MentorshipMid-level Full TimePoland2d ago