Senior Data Engineer - Web Scraping
Tasks
- Build database ingestion processes
- Design web scrapers
- Develop automation tools
- Develop data pipelines
- Implement data quality checks
- Investigate data incidents
- Orchestrate workflows with Apache Airflow
- Set up alerting systems
- Transform scraped data
Perks/Benefits
- Autonomy
- Collaborative team environment
- Flexible work location
- Fully remote
- Operational excellence focus
- Ownership
- Professional development
Skills/Tech-stack
API | AWS Lambda | AWS S3 | Amazon RDS | Amazon SNS | Amazon SQS | Apache Airflow | CI/CD | Docker | GitHub Actions | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI Engineer PLN 206K-287KAPI Integration | Agent Frameworks | Automation | Business Intelligence | CRMMid-level Full TimeKraków, Małopolskie, PL R17h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Fully remoteSenior-level Contract Full TimePoland R22h ago
-
Infrastructure & AI Lead PLN 179K-280KAI Deployment | Access Management | Artificial Intelligence | Fintech | IT administrationFitness allowance | Hybrid work | Meal allowance | Phone allowance | Private healthcareSenior-level ContractWarsaw, Poland, Poland (Hybrid) R1d ago
-
Data Engineer (Databricks) PLN 129K-136KCloud platform | Cluster management | Data Lake | Data Modeling | Data QualityHybrid work model | Private health care | Savings plans | Sport cards | Stock plansMid-level Full TimeWARSAW PLANT & GO, Poland R1d ago
-
524 | Senior Data Support Engineer PLN 206K-350KAWS | DBT | DBT Cloud | Data Ingestion | Data ModelingSenior-level Full TimePoland - Remote R1d ago
-
AI/ML Engineer PLN 153K-240KAWS | Azure | Deep learning | Docker | EmbeddingsContinuous learning | Diverse and inclusive culture | Flexible work modelMid-level Full TimeKatowice, Śląskie, PL, 40-202 R2d ago
-
Senior GenAI Engineer PLN 234K-254KAWS | Autogen | Azure | CI/CD | DockerCoaching | Continuous learning | Flexible work arrangement | Inclusive cultureSenior-level Full TimeKatowice, Śląskie, PL, 40-202 R2d ago
-
1122 | Python/AI Agent Engineer PLN 242K-287KAzure AI | Azure OpenAI | Data Mapping | Data Normalization | Data TransformationSenior-level Full TimeWarsaw, Masovian Voivodeship, Poland - Remote R2d ago
-
Alerting | Data Pipelines | Distributed Systems | Inference | JAXMid-level Full TimePoland R3d ago
-
General Pipeline - FullStack Applied AI Engineer USD 150K-250KAWS | Access Control | Asynchronous programming | Authentication | AuthorizationSenior-level Full TimeUnited States R3d ago
-
Software Developer / Data Engineer PLN 276K-276KAPI Design | AWS | Access Layer | Airflow | AngularContinuous learning culture | Hybrid work schedule | MentorshipMid-level Full TimePoland - Warsaw R3d ago
-
AI Engineer PLN 176K-176KAzure | CI/CD | Cloud Native | Cloud Native Services | Distributed SystemsFlex fund | Mentoring programs | Partially remote work | Training | Voluntary charity programsEntry-level Full TimeWARSAW DOWNTOWN OFFICE, Poland R3d ago
-
Cybersecurity Engineer, Data & AI SME PLN 195K-268KAI Security | AI/ML | AI/ML Security | Automation | Capacity ManagementAnnual bonus | Family benefits | Free parking | Hybrid work | Learning and developmentMid-level Full TimePoznan Business Garden, Poland R3d ago
-
Senior Analytics Engineer USD 144K-192KAirflow | Apache Superset | BigQuery | DBT | Data PipelinesEducation reimbursement | Equipment reimbursement | Fully remote | Mental health care program | Overseas conferencesSenior-level Full TimeKazakhstan R3d ago
-
Senior AI/ML Engineer PLN 242K-255KAgentOps | Azure | Azure Bicep | Azure Cloud | Azure Cloud StorageCommunity involvement | Community service day | Electricity bill allowance | Employee resource groups | Flexible working hoursSenior-level Full TimeWarsaw, Masovian Voivodeship, Poland R3d ago
-
Senior Software Engineer, Generative AI PLN 206K-254KAWS | Azure | Cloud Computing | Cloud platform | Data ScienceHybrid work environment | Talent community job alertsSenior-level Full TimePOL GPC Krakow, Poland R4d ago
-
Access Permissions | Azure Data | Azure Data Factory | Azure DevOps | Azure SynapseExtra vacation days | Flexible work (remote/hybrid) | Health insurance | Internal conferences and meetups | MentorshipMid-level Full TimePoland R6d ago
-
Robotics & Software Engineer PLN 4750K-6250KAPI Integration | Heuristics | Industrial robotics | Management systems | Operating SystemEnglish-speaking environment | Equity | Flexible working hours | Partial remote work | Relocation packageMid-level Full TimeWarsaw, Poland R6d ago
-
Senior Robotics & Software Engineer PLN 6500K-8000KAPI Development | Industrial Automation | Python | Robot Control | RoboticsEnglish-speaking environment | Equity | Flexible working hours | Partly remote work | Play with robots dailySenior-level Full TimeWarsaw, Poland R6d ago
-
Data Engineer PLN 276K-276KAST Parsing | CI/CD | Data Cleansing | Data Transformation | DockerCompany paid premium medical | Company-paid certifications | Full remote work | Language courses | Meetups conferences workshopsMid-level Full TimePoland R6d ago
-
Data Engineer PLN 276K-276KAST Parsing | CI/CD | Docker | Git | Integration TestingCompany-paid certifications | Internal Meetups Conferences Workshops | Language courses | MyBenefit Cafeteria Platform | Premium medical packageMid-level Full TimePoland R6d ago
-
Senior Data Engineer - Superior Retail Execution PLN 154K-242KApache Spark | Artificial Intelligence | Azure | CI/CD | Cloud OperationsPrivate healthcare | Savings plans | Sport cards | Stock plans | Training and certificationsSenior-level Full TimeWARSAW PLANT & GO, Poland R7d ago
-
Data Engineer PLN 166K-240KAzure | Azure Databricks | Big Data | Data Governance | Data LakeEmployee benefit platform access | Home-office equipment | Hybrid work model | Life insurance | Private medical careMid-level Full TimeGdańsk, PL R7d ago
-
Engineer, Embedded Software Test - Python PLN 111K-139KCI/CD | CIP | Embedded Systems | Ethernet/IP | GitHubDigital course library | Employee assistance program | Mindfulness programs | Volunteer donation matching | Volunteer paid time offMid-level Full TimePoland Katowice (Francuska 46) R7d ago
-
Data Engineer (On-site) PLN 140K-216KAzure | Azure Databricks | Big Data | Data Governance | Data IngestionHome-office package | Hybrid working model | Life insurance | Private medical care | Training accessMid-level Full TimeGdańsk, PL R7d ago