Python , web scrapping data conversion VBA
Tasks
- Automate data collection from APIs and web scraping
- Build production-grade data pipelines
- Design data ingestion pipelines
- Enable end to end workflow automation
- Ensure data quality, governance, and validation
- Establish development standards for testing documentation and logging
- Implement workflow orchestration and monitoring
- Integrate pipelines with data storage and processing
- Productionize analytical models
- Troubleshoot production pipeline issues
Perks/Benefits
Skills/Tech-stack
API Integration | Alerting | BeautifulSoup | Data Automation | Data Engineering | Data Governance | Data Quality | Data Validation | Data pipeline | Error Handling | Excel | Git | HTML | JSON | Logging | Modular Design | Monitoring | NumPy | Pandas | Performance optimization | Python | Requests | Retries | Reusability | Scheduling | Schema evolution | Selenium | Web Scraping | Workflow Orchestration | XML
Education
N/A
Roles
Related jobs
-
Senior Software Engineer, AI and Infrastructure, CMCS INR 2500K-5000KAPIs | As-a-Service | C++ | CPU | Data ProcessingSenior-level Full TimeHyderabad, Telangana, India4h ago
-
Applied Artificial Intelligence & Machine Learning- Markets Operations - Vice President INR 3000K-3000KAWS | Agile | Azure | Containerization | Data PreprocessingExecutive-level Full TimeBengaluru, Karnataka, India6h ago
-
Lead Software Engineer - Java, Streaming, AWS INR 2000K-3500KAWS | Agile | Amazon EKS | Amazon EMR | Amazon KinesisSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Software Engineer III - AWS, PySpark, ETL INR 2050K-3300KAWS | AWS EMR | Agile | Apache Spark | CI/CDSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Sr. Data Engineer USD 127K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityComprehensive benefits | Extensive training initiatives | Group insurance | Growth opportunities | Hospitalization insuranceSenior-level Full TimeBangalore, FL, US, 5600769h ago
-
Value Reporting Data Engineer INR 1431K-2000KData Governance | Data Lakehouse | Data pipeline | Databricks | DataverseMid-level Full TimeKochi, Kerala, India9h ago
-
Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior Data Engineer INR 2520K-3500KAI Platform | Apache Airflow | Apache Spark | CI/CD | Cloud StorageBackground checks during recruitment | Creche allowance | Cultural events | Flexible work model | Lab daysSenior-level Full TimeBangalore10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
IN_Senior Associate_Agentic AI Developer_One cloud_Advisory_Pune INR 2755K-4225KAWS Bedrock | CI/CD | Deep learning | Faiss | FastAPIFlexible work arrangements | Mentorship | Wellbeing supportSenior-level Full TimePune, India15h ago
-
PySpark Data Engineer with Cloudera and Cloud Expertise INR 2400K-3500KAWS EMR | Apache Airflow | Apache Atlas | Apache Oozie | Apache SparkFlexible workplace arrangements | Learning and development programs | MentoringSenior-level Full TimeBengaluru - BCIT, India15h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
Tech Lead - Data Bricks Job INR 2040K-3500KAgile | Azure | Azure Data | Azure Data Factory | Azure DatabricksContinuous learning | Flexible work arrangementsSenior-level Full TimeHyderabad, TG, IN15h ago
-
Senior AI Engineer INR 2500K-4800KAI auditability | AI guardrails | Accelerate | Access Controls | AdaptersSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Lead/Senior Software Engineer – User Foundations Platform INR 2500K-3500KAWS | Azure | CI/CD | Databases | Distributed SystemsSenior-level Full TimeIND - Bangalore - Ecoworld 6B …15h ago
-
AI Engineer (GDC)-65851 INR 60K-180KAWS | Agentic AI | CI/CD | Data Engineering | FastAPIFlexible work arrangements | Health and wellbeing benefits | Work-life balanceEntry-level Full Time(DEAI DS) IN Bengaluru - Residency …15h ago
-
V&V Engineer - Med Tech / Embedded System INR 480K-900KC plus plus | C# | CAN | CI/CD | Defect ManagementMid-level Full Timecoimbatore, India22h ago
-
AI Engineer I (Remote) USD 30K-39KAWS | Agentic Systems | Attention Mechanisms | BERT | CI/CDFull-time employment | Remote workEntry-level Full TimeIndia, Remote R23h ago
-
API Design | API Gateway | AWS Bedrock | AWS Lambda | Access ControlHybrid work | MentorshipSenior-level Full TimeBengaluru, INDIA, India1d ago