Data Engineer - Web Scraping
Tasks
- Build data ingestion pipelines
- Build scalable data processing workflows
- Clean transform validate datasets
- Design web scraping systems
- Develop automation tools and frameworks
- Develop web scrapers
- Implement data quality control checks
- Investigate data pipeline issues
- Schedule monitor optimize scraping workflows
Perks/Benefits
- Autonomy
- Collaborative team culture
- Continuous learning
- Flexible work environment
- High ownership
- Professional growth
Skills/Tech-stack
APIs | AWS | AWS Lambda | Amazon RDS | Amazon S3 | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Docker | GitLab CI | GitLab CI/CD | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Agent Orchestration | Amazon Neptune | D3.js | Data Visualization | Entity ResolutionAsynchronous collaboration | Flexible schedule | Growth opportunities | Remote workSenior-level Full TimePoland - Kraków15h ago
-
Senior Data Engineer (Snowflake) CAD 120K-145KAirbyte | Azure Data | Azure Data Factory | Coalesce.io | Data FactoryHybrid/Remote flexibility | Medical healthcare | Ongoing learning reimbursement | Referral bonuses | Sports compensationSenior-level Full TimeBulgaria, Georgia, Lithuania, Poland,Romania, Uzbekistan23h ago
-
Senior Data Engineer PLN 177K-312KAWS CloudFormation | AWS Glue | AWS Step Functions | Amazon Athena | Amazon DynamoDBIn office hybrid or remote flexibility | International projects | Medical healthcare | Ongoing learning and reimbursement | Recognition programSenior-level Full TimeBulgaria, Hungary, Poland23h ago
-
Python developer with Gen AI/Agent (Python/GCP) PLN 340K-340KAI Agent Builder | AI Pipelines | AI Training | AI Workbench | API IntegrationEnglish proficiency | Remote workSenior-level Full TimePoland, Gdansk, Katowice, Krakow, Lodz, Poznan, …23h ago
-
Regular Data Engineer | Inetum PLN 276K-276KARM Templates | Active Directory | Azure | Azure Active Directory | Azure DataCertification funding | Charitable initiatives participation | Conference participation | Inclusive work culture | Sports program participationMid-level Full TimeWarsaw, Masovian Voivodeship, Poland23h ago
-
Software Engineer - Openflow Connectors PLN 166K-249KAPI Design | CDC | Data Ingestion | Data Processing | JavaMid-level Full TimePL-Warsaw-Lixa C1d ago
-
Senior Cloud Data Engineer (Azure Fabric Dynamics) PLN 266K-392KApache Spark | Azure | CI/CD | Cost estimation | Data LakehouseAI tools | Remote work | Training and certificationsSenior-level Full TimeGliwice R1d ago
-
Analytics Engineer PLN 153K-211KApache Airflow | DBT | Data Modeling | Data Warehousing | Data pipelineMid-level Full TimeWarsaw1d ago
-
Data Engineer PLN 276K-276KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaCoworking space | English classes | MacBook provided | Mentorship | Remote workMid-level Full TimePoland1d ago
-
Senior Cloud Data Engineer (Azure) PLN 266K-392KApache Spark | Azure | Azure Synapse | Azure Synapse Analytics | CI/CDSenior-level Full TimeGliwice1d ago
-
Senior GenAI Engineer PLN 213K-268KAWS | Autogen | Azure | Azure DevOps | CI/CDContinuous learning | Diverse and inclusive cultureSenior-level Full TimeWrocław, DS, PL, 50-0861d ago
-
AI Developer Enablement Lead PLN 276K-408KArtificial Intelligence | CI/CD | Change Management | Code generation | Code reviewCalm app subscription | Days of disconnect | EAP support | Fitness reimbursement | Medical, dental & vision coverageSenior-level Full TimePoland R1d ago
-
Middle Data Engineer PLN 206K-328KApache Airflow | Apache Spark | Data Modeling | Data Observability | Data Pipeline MonitoringBonuses | Corporate gifts | Educational courses | English classes | Hybrid workSenior-level Full TimePoland - Remote R1d ago
-
Intern Data Engineer PLN 62K-78KCI/CD | Data Modelling | ETL | GitLab CI | GitLab CI/CDBuddy program | Certification opportunities | Hybrid work | Laptop provided | Training accessEntry-level InternshipWarszawa, PL1d ago
-
Database Administrator Engineer GBP 50K-55KDMV | Database performance | Database performance tuning | Deadlock troubleshooting | Execution PlansFlexible work environment | Referral bonusMid-level ContractHybrid (United Kingdom); Remote (Poland) R1d ago
-
Agent Orchestration | D3.js | Data Visualization | Entity Resolution | Entity recognitionSenior-level Full TimePoland - Kraków1d ago
-
Staff Forward Deployed Engineer, GenAI, Google Cloud PLN 480K-492KAPIs | Agent Frameworks | Agent systems | Cloud platform | CrewAISenior-level Full TimeWarsaw, Poland2d ago
-
Agile | Amazon Web Services | Azure | Big Data | CI/CDCareer development support | Coaching | Hybrid work model | Learning and development | MentorshipEntry-level InternshipKatowice, Śląskie, PL, 40-2022d ago
-
Software Engineer - Data Scientist PLN 139K-210KApache Spark | Azure | Azure Machine Learning | Bias and fairness | ClassificationSenior-level Full TimeBE Warsaw, Poland2d ago
-
Senior Software Engineer, Storage Platform PLN 304K-386KAgile | Confluence | Data Consistency | Distributed Systems | Email integrationsSenior-level Full TimeWarsaw, Poland2d ago
-
Cloud Backend Engineer (Database) PLN 220K-338KAWS RDS | Apache Druid | Apache Kafka | Apache Pinot | CassandraSenior-level Full TimeDublin, Ireland; Krakow, Poland2d ago
-
Senior Data Engineer GBP 91K-124KAccess Control | Airflow | BigQuery | CI/CD | Census401k employer match | Hackathons | Health and wellness benefits | Learning and development budget | Open source support fundSenior-level Full TimeGermany R2d ago
-
Senior-level Contract Full TimeWarsaw2d ago
-
Senior Java Engineer PLN 231K-328KBig Data | Concurrency | Data Governance | Data Lakes | Data ManagementSenior-level ContractRemote (Poland) R2d ago
-
Mid/Senior SASE Automation Engineer PLN 237K-353KAnsible | CI/CD | Continuous integration | Docker | NGFWFlexible hours | Hands-on onboarding | Hybrid work | Internal training sessions | Remote workSenior-level Full TimeWarszawa, Poland R3d ago