Python Pyspark
Tasks
- Build ETL/ELT pipelines
- Develop PySpark batch processing jobs
- Develop PySpark streaming processing jobs
- Document data pipelines and transformations
- Integrate pipelines with cloud storage
- Monitor and troubleshoot Spark jobs
- Perform data quality validation
- Process structured and unstructured data
- Transform large datasets
Perks/Benefits
- N/A
Skills/Tech-stack
AWS S3 | Amazon EMR | Amazon Redshift | Apache Spark | Azure Data | Azure Data Lake | Data Lake | Databricks | ELT | ETL | Hadoop | PySpark | Python | SQL
Education
N/A
Roles
Related jobs
-
Database Developer INR 500K-1200KCommon table expressions | Database Design | Database Schema | Database normalization | Execution PlansEntry-level Full TimeTelangana, Hyderabad, India4h ago
-
Software Developer – QA Automation & AI Integration (Backend) INR 1170K-2500KAPI Integration | Automated testing | BDD | CI/CD | CucumberAI certifications | Mentorship | TrainingMid-level Full TimeIndia-Hyderabad5h ago
-
Senior-level Full Timebangalore, India9h ago
-
Senior Application Developer, AI INR 2500K-3500KAI Foundry | AI Studio | AWS | Authentication | AzureSenior-level Full TimeHyderabad, Telangana, India18h ago
-
Application Developer, AI INR 1400K-2250KAI Foundry | AI Studio | ASP.Net Core | Agile | App ServicesMid-level Full TimeHyderabad, Telangana, India18h ago
-
IN-Manager_Palantir _ Data and Analytics_Advisory_Pan India INR 1960K-2400KAWS | Amazon Web Services | Cloud services | Informatica Intelligent Cloud | Informatica Intelligent Cloud ServicesFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India18h ago
-
Lead I, Software Developer INR 3000K-4000K.Net Core | API | AWS | AWS CloudFormation | Amazon EMRContinuing education program | Continuous learning resources | Family-friendly perks | Generous time off | Health care coverageSenior-level Full TimeIN - AHMEDABAD, India18h ago
-
IN-Associate_IICS Developer_OC D&A_Advisory_Kolkata INR 1400K-2000KCloud services | Data Quality | Device Management | ETL | Informatica Intelligent CloudEntry-level Full TimeKolkata Y-14, India18h ago
-
IN-Senior Associate_IICS Developer_OC D&A_Advisory_Kolkata INR 1200K-2000KAWS | Apache Airflow | Apache Hadoop | Azure Data | Azure Data FactoryFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata Y-14, India18h ago
-
IN_Senior Associate_IICS Developer _OC D&A_Advisory_Kolkata INR 1200K-2000KCloud services | Data Quality | ETL | Informatica Intelligent Cloud | Informatica Intelligent Cloud ServicesSenior-level Full TimeKolkata Y-14, India18h ago
-
Cloud services | Data Quality | Informatica Intelligent Cloud | Informatica Intelligent Cloud Services | Intelligent Cloud ServicesFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportEntry-level Full TimeKolkata Y-14, India18h ago
-
Amazon Web Services | Apache Airflow | Apache Hadoop | Azure Data | Azure Data FactoryEntry-level Full TimeKolkata Y-14, India18h ago
-
IN-Manager_Palantir _ Data and Analytics_Advisory_Pan India INR 1960K-2400KAmazon Web Services | Amazon Web Services (AWS) | Business Intelligence | Business Intelligence and Reporting Tools | Business Intelligence and Reporting Tools BIRTFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India18h ago
-
Consultant - Python Developer with Gen AI using GCP INR 2500K-3285KAPI Development | Data Pipelines | Gemini Enterprise | Google ADK | Google VertexWork from client office 5 days per weekSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Assistant Manager Power BI INR 1000K-1350KCognos | Dashboard publishing | Data Modelling | Data Preparation | Data RefreshContinuous learning | Flexible scheduling | MentorshipMid-level Full TimeIndia-Bangalore1d ago
-
Entry-level Full TimeIndia1d ago
-
Full Stack Builder (Team of One - prospecting) INR 2500K-5000KAPI | Angular | Evaluation | JavaScript | LLMBuilder culture | High autonomy | Remote-first environmentSenior-level Full TimeDelhi R1d ago
-
SAP Analytics Cloud (SAC) Developer INR 2516K-3356KAllocations | Analytics Cloud | Analytics designer | BW Queries | CDS ViewsSenior-level Full TimeHyderabad, TG, IN1d ago
-
SAP Analytics Cloud (SAC) Developer INR 2516K-3356KAllocations | Analytics Cloud | Analytics designer | Authorization | BW QueriesSenior-level Full TimeHyderabad, TG, IN1d ago
-
DataStage Developer - Senior Analyst JV INR 2229K-2800KAggregations | Autosys | Batch Processing | Data Standardization | Data TransformationSenior-level Full TimeChennai, TN, IN1d ago
-
Data Warehousing | Dimensional Modeling | Informatica PowerCenter | Linux | Microsoft SQLMid-level Full TimeBhubaneswar - Ihub, India1d ago
-
Application Development Data Analyst – Assistant Vice President INR 1500K-4000KApplication Lifecycle Management | Application lifecycle | Automation | Capacity Planning | Cause analysisExecutive-level Full TimePLOT NO-1, S.NO. 77, India1d ago
-
LLM Model Developer INR 1500K-2000KData Preprocessing | Dataset handling | Language Models | Language Processing | Large Language ModelsMid-level Full TimePune, PDC3C, India1d ago
-
LLM Model Developer INR 1500K-2000KData Preprocessing | Language Models | Language Processing | Large Language Models | Model EvaluationMid-level Full TimeBengaluru, BDC7C, India1d ago
-
LLM Model Developer INR 1500K-2000KData Preprocessing | Data sets | Deep learning | Evaluation metrics | Language ModelsMid-level Full TimeBengaluru, BDC7B, India1d ago