Senior Software Engineer (R-19021)
Tasks
- Build data cleaning validation transformation workflows
- Collaborate with teams on data requirements and specs
- Design web scraping solutions
- Develop automated data pipelines
- Document scraping processes and schemas
- Handle anti bot mechanisms
- Improve automation and process efficiency
- Monitor and troubleshoot scraping jobs
- Prepare production ready datasets for MDR
- Support vendor to in house transition
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Airflow | BeautifulSoup | CAPTCHA | CI/CD | CSS | Cron | DOM | Docker | HTML | Headless browser | JSON | MySQL | Playwright | PostgreSQL | Proxy rotation | Python | REST API | Request throttling | SQL | Scrapy | Selenium
Education
N/A
Roles
Related jobs
-
Software Engineer, AI Agents, Tools and Productivity INR 1300K-2000KAccessibility | Algorithms | Data Modeling | Data Structures | Distributed SystemsMid-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India3h ago
-
Mid-level Full TimePune, Maharashtra, India3h ago
-
AWS Lead Data Engineer INR 2000K-2040KAWS | AWS Glue | AWS architecture | Agile methodology | Amazon AuroraSenior-level Full TimeGurugram, Haryana, India3h ago
-
DE&A - Core - Cloud Data Engineering - Azure Data Engineering INR 1500K-2000KAggregation pipelines | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBMid-level Full TimePune, Maharashtra, India5h ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-2450KAWS | AWS CDK | AWS Lambda | Agile | AirflowSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Software Engineer III - AWS, PySpark, ETL INR 2000K-2450KAWS EMR | Agile | Apache Spark | CI/CD | Data ModelingSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Senior AI/ML Engineer I INR 2500K-4000KAgentic AI | Azure | BERT | Continuous integration | Distributed SystemsCertification programs | Education reimbursement | Employee Assistance Program (EAP) | Flexible work options | Health coverageSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Senior Embedded DevOps Engineer INR 2229K-2500KAutomotive Software | Build Tools | CI/CD | Change Management | Cloud ComputingSenior-level Full TimeBangalore, IN, 5601006h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2000KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India6h ago
-
Azure Data Engineer - Associate Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Flow | Azure Data Lake | Azure DatabricksMid-level Full TimeBangalore, Karnataka, India7h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 1628K-2040K.NET | AWS | AWS CloudFormation | AWS Lambda | Amazon EC2Senior-level Full TimeGurugram, Haryana, India7h ago
-
Data Engineer INR 960K-1400KADO | Automated testing | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, Maharashtra, India8h ago
-
Mid-level Full TimePune, India8h ago
-
Senior-level Full TimeChennai, TN, India8h ago
-
Data Engineer II - Python, AWS, Spark INR 1500K-2000KAWS Cloud | Amazon Web Services | Apache Hadoop | Apache Spark | CI/CDMid-level Full TimeHyderabad, Telangana, India9h ago
-
Sr.Manager Software Engineer INR 2050K-3000KAWS EKS | Agent Development | Amazon ECS | Amazon EMR | Amazon Web ServicesSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Applied AI ML Sr Associate INR 2500K-3500KAWS Lambda | AWS S3 | AWS Step Functions | Agentic AI | Amazon AthenaSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Machine Learning Data Engineer III INR 2500K-5000KAPI Development | AWS | Amazon Bedrock | Application development | DatabricksSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Applied AI ML Associate INR 1068K-1496KAWS Lambda | AWS S3 | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India10h ago
-
Senior-level Full TimeBengaluru, India11h ago
-
Senior-level Full TimeBengaluru, India11h ago
-
Database Support Engineer INR 1971K-3285KAWS Aurora | Amazon EBS | Amazon EC2 | Amazon RDS | Amazon S3Adoption leave | Employee assistance program | Health care benefits | Maternity leave | Mental wellness programsSenior-level Full TimeBengaluru, India11h ago
-
Azure DevOps | Business Intelligence | CI/CD | Data Assurance | Data ManagementSenior-level Full TimeKolkata DN 57, India14h ago
-
Senior-level Full TimeIND-Tamil Nadu-Chennai-KLA, India14h ago
-
Sr. Software Engineer - AI/ML INR 2500K-4500KA/B | A/B Testing | AI Search | AKS | APIsFamily-friendly benefits | Hands-on learning | Inclusive work environment | Professional development | Tech talksSenior-level Full TimeIND-Tamil Nadu-Chennai-KLA, India14h ago