Pyspark Developer
Tasks
- Analyze and evaluate processes and data
- Apply supervised machine learning
- Apply unsupervised machine learning
- Build and redesign data processing code
- Design data preprocessing pipelines
- Extract data using SQL
- Identify data inconsistencies
- Integrate data using coding
- Manage data warehouses and datasets
- Monitor data and processes
- Optimize compute and data processes
- Support data governance and security
- Tune queries and improve performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Spark | Automation | Data Governance | Data Preprocessing | Data Security | Data Warehousing | Machine Learning | Performance Tuning | PySpark | Python | Query Tuning | SQL | Scala | Shell Scripting | Supervised Learning | Unix | Unsupervised Learning
Education
N/A
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer | Spark Developer
Related jobs
-
Software Engineer INR 1500K-2000KAgile | Amazon Glue | Azure Data | Azure Data Factory | Data ArchitectureMid-level Full TimeHyderabad, India7h ago
-
Data Scientist/Data Engineer/Data Analyst INR 1500K-2000KA/B | A/B Testing | AWS Glue | Amazon Redshift | Amazon S3Mid-level Full TimeChennai City Corporation, India7h ago
-
Mid-level Full TimeHyderabad, India7h ago
-
Mid-level Full TimeHyderabad, India7h ago
-
Mid-level Full TimeBangalore North, India7h ago
-
Data Engineer INR 400K-1200KApache Airflow | Apache Spark | Azure Data | Azure Data Factory | CI/CDSenior-level Full TimeCoimbatore, India7h ago
-
AI Engineer : Mumbai INR 2500K-4170KAPI Development | AWS | Agentic AI | Ansible | AzureEquity compensation | Mentoring | Training programsSenior-level Full TimeMaharashtra, Mumbai, India8h ago
-
Mid-level Full TimeIN-KA-Bangalore8h ago
-
Senior-level Full TimeIN-AP-Hyderabad8h ago
-
Data Engineer INR 2000K-2400KAirflow | Apache Spark | Cloud platform | Data Modeling | Google BigQuerySenior-level Full TimeIN-KA-Bangalore8h ago
-
Python AI ML INR 2500K-4500KAdvanced search | Advanced search algorithms | Agile | ChromaDB | FaissSenior-level Full TimeIN-AP-Hyderabad8h ago
-
Senior Engineer - PowerBI with Databricks INR 2400K-3500KDashboard Design | Data Modeling | Data Quality | Data Visualization | Data pipelineCareer growth | Mentorship | Paid certification support | Recognition and rewards | Snack allowanceSenior-level Full TimeHyderabad, TS, India10h ago
-
Senior Staff Engineer, Data Science INR 2000K-3380KAWS | Azure | Classification | Cloud platform | Data AnalysisSenior-level Full TimeRemote, India R10h ago
-
Senior Staff Engineer, Data Science INR 2000K-3380KAWS | Azure | Classification | Continuous Improvement | Data AnalysisContinuous improvement culture | Global team environment | MentorshipSenior-level Full TimeRemote, India R10h ago
-
Senior BI Engineer - Power BI INR 2400K-3380KAzure SQL | DAX | Data Modeling | Data Warehousing | DatabricksCareer growth | Mentorship | Recognition rewards | Snack zone | Training supportSenior-level Full TimeHyderabad, TS, India10h ago
-
Conversational AI/Gen AI Chatbot Developer INR 1500K-2200KAngular | CSS | Cognigy | Conversational AI | Generative AIMid-level Full Timebangalore, India10h ago
-
Lead Engineer - Power BI INR 2040K-3500KAzure SQL | DAX | Data Warehousing | Databricks | ETLCareer growth | Certification cost support | Mentorship | Recognition and rewards | SnacksSenior-level Full TimeHyderabad, TS, India10h ago
-
Senior AI Developer (LangGraph AI Agents with 8 to 11 years ) INR 2500K-4500KAPI Integration | Anthropic API | Asynchronous programming | Azure OpenAI | CI/CDSenior-level Full TimeBengaluru, KA, India10h ago
-
Python / Pyspark / GCP INR 2156K-2700KBigQuery | Cloud Bigtable | Cloud platform | Cucumber | Google CloudEntry-level Full TimeBangalore, Karnataka, India11h ago
-
Software Engineer III - Data Engineer INR 2000K-2755KAWS | Apache Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Mid-level Full TimeHyderabad, Telangana, India12h ago
-
Lead Software Engineer - Pyspark / Bigdata INR 1800K-3200KAgile | Application Resiliency | Application development | Big Data | CI/CDSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Associate III- Business Intelligence-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 1000K-1500KAdvanced Excel | Caret | Classification | Clustering | Data AnalysisMid-level Full TimeBangalore, Karnataka, India13h ago
-
Advanced Excel | Caret | Classification | Clustering | Data AnalysisMid-level Full TimeBangalore, Karnataka, India13h ago
-
Senior-level Full TimeIndia13h ago