Senior Data Engineer - Web Scraping
Tasks
- Automate web scraping platform tools
- Build and maintain data pipelines
- Clean transform and prepare large datasets
- Create data quality control checks
- Design web scrapers
- Develop deploy and maintain web scraping solutions
- Implement alerting and incident response
- Improve data products and infrastructure
- Ingest data into databases and data warehouses
- Orchestrate scheduled workflows
Perks/Benefits
Skills/Tech-stack
APIs | AWS Lambda | AWS S3 | Amazon RDS | Amazon SNS | Amazon SQS | Apache Airflow | Data Warehousing | Docker | GitHub Actions | HTML | JavaScript | Jenkins | Kubernetes | Pandas | Python | SQL | Scrapy | Selenium | XPath
Roles
Related jobs
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Fully remote | Remote working autonomy | Work-life balance flexibilitySenior-level Contract Full TimeAustria R1d ago
-
AWS Well Architected | Agentic AI | Amazon Bedrock | Amazon SageMaker | Amazon Web Services4-day work week | AWS certifications paid | Afterwork events | Low travel | OffsitesSenior-level Full TimeWien, Remote (AT) R1d ago
-
Data Analytics Engineer – Pega CDH EUR 95K-112KDatabricks | KPI Monitoring | Propensity Modeling | PySpark | Python401k | Educational assistance | Employer-paid disability insurance | Employer-paid life insurance | Medical/Dental/Vision insuranceMid-level Full TimeVienna, VA, United States R2d ago
-
Senior Generative AI Engineer (m/w/d) - Austria EUR 60K-84KAWS | Agentic AI | Azure | Conversational AI | Data ScienceCoaching | Company pension | Corporate benefits | Fitness facilities | Flexible working hoursMid-level Full TimeHybrid, Wien, Innsbruck R9d ago
-
AI workflow | AI workflow automation | APIs | Authentication | CRM IntegrationExperimentation time | Flexible schedule | Focus time | Lunch and dinner provided | Minimal meetingsMid-level Full TimeVienna, Vienna, Austria R14d ago
-
Forward Deployed AI Engineer EUR 49K-67KAWS | Agentic Workflows | Apache Iceberg | Apache NiFi | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH policy | Generous PTO | Internet reimbursementMid-level Full TimeAustria-Remote R17d ago
-
Condition-Based Monitoring | Data Pipelines | Data Quality | Feature Engineering | IoTChildcare support | Education Catalog | Employee discounts | Fitness activities | Flexible working hoursSenior-level Full TimeWien-Favoriten, Wien, Austria; Wien-Favoriten R1mo ago
-
AI Engineer (f/m/d) EUR 55K-55KCI/CD | Cloud Computing | Containerization | Docker | Infrastructure as CodeCompany pension scheme | Flexible working hours | Health and social benefits | Remote work option | Training and further education opportunitiesMid-level Full TimeAUT.Reutte, Austria R1mo ago
-
Data Science Engineer (f/m/d) EUR 45KLanguage Processing | Machine Learning | Model Monitoring | Natural Language | Natural Language ProcessingBirthday off | Company training | Device choice | Flexible hours | Hybrid workingMid-level Full TimeVienna R1mo ago