PySpark Big Data Developer
Location(s): Pune, Maharashtra, India
INR 2040K-3000K (estimate) Senior-level Full Time
Tasks
- Coach analysts
- Conduct feasibility studies
- Consult with users and stakeholders
- Debug data processing issues
- Develop ETL pipelines
- Develop and install customer exposure systems
- Ensure data quality and integrity
- Estimate time and cost
- Optimize scalable data processing
- Participate in full SDLC
- Perform analysis design construction testing implementation
- Plan IT and manage risk
- Provide user and operational support
- Recommend security measures
- Resolve performance bottlenecks
- Write Python code
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Spark | Autosys | CI/CD | Confluence | DevOps | ETL | Git | HDFS | Jira | Oracle | PySpark | Python | SQL | SQL Server | Shell Scripting | Sqoop | Tableau
Education
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer | PySpark Developer
Related jobs
-
Lead Data engineer, Sr. Specialist INR 2800K-3880KAWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Domestic relocation | Flexible work arrangements | Hybrid work arrangements | Travel 10 percentSenior-level Full TimeIND - Telangana - Hyderabad, India3h ago
-
Entry-level InternshipHyderabad, India11h ago
-
Entry-level InternshipHyderabad, India11h ago
-
Assistant Manager INR 1000K-2000KBusiness Intelligence | Data Modeling | Data Quality | Logistic Regression | Machine LearningMid-level Full TimeIndia12h ago
-
DTICI_T8_Data_engineer_Manufacturing_Operations INR 1500K-2500KAgile | Apache Spark | Azure | Azure Blob | Azure Blob StorageSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
AWS | Airflow | Apache Spark | Azure | Cause analysisSenior-level Full TimePune, Maharashtra, India12h ago
-
AWS Snowflake INR 1500K-2000KAmazon Web Services | DBT | Data Modeling | Data Pipelines | Data WarehousingMid-level Full TimeIN-TN-Chennai13h ago
-
Confluent Kafka Data Engineer INR 1500K-2500KApache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-KA-Bangalore13h ago
-
GEN AI Developer INR 2000K-5000KAgile | Continuous integration | Data Modeling | Generative AI | Language ProcessingSenior-level Full TimeIN-KA-Bangalore13h ago
-
AI Automation Expert INR 2000K-5000KAgentic AI | Azure OpenAI | Confluence | Copilot Studio | Enterprise IntegrationSenior-level Full TimeIN-KA-Bangalore13h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeIN-MH-Mumbai13h ago
-
GCP Data Engineer INR 1500K-2500KADLS Gen2 | Airflow | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-MH-Mumbai13h ago
-
Mid-level Full TimeIndia13h ago
-
Principal AI Engineer with Java INR 2475K-4800KAI Services | Agent Framework | Agentic AI | Alembic | AutogenEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India13h ago
-
Sr. Associate Director, Software Engineering Specialist INR 1600K-2400KAirflow | Apache Beam | Apache Flink | BigQuery | CI/CDFlexible working | Inclusive workplace | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R13h ago
-
Mid-level Full TimePune, Maharashtra, India14h ago
-
Power BI Developer INR 1200K-1800KCopilot | DAX | Power BI | Power Query | SQLWork from office 5 days per weekMid-level Full TimeGurugram, Haryana, India14h ago
-
Senior Power BI Developer INR 1632K-2500KCopilot | DAX | Data Visualization | M-language | Power BIWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India14h ago
-
Senior Software Engineer, AI/ML Computer Vision, Google Cloud INR 3000K-5000KC++ | Computer Vision | Data Processing | Debugging | Image classificationSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Lead Assistant Manager INR 1500K-2800KAccess Control | Caching | Data Governance | Databricks | Databricks SQLSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Associate Director - Forward Deployed Engineer/AI Engineer INR 1500K-3000KAI Foundry | AWS Bedrock | Agent systems | App Service | Artificial IntelligenceMid-level Full TimeBangalore, Karnataka, India15h ago
-
Senior-GDC INR 2400K-3500KAPIs | Azure | Azure Data | Azure Data Factory | Azure DatabricksCoaching junior engineers | Knowledge transferSenior-level Full TimeBangalore, Karnataka, India15h ago
-
Associate Director- AI Engineer - Solution Architect INR 1500K-3000KAI Act | Agent systems | App Service | Azure App | Azure App ServiceMid-level Full TimeBangalore, Karnataka, India15h ago
-
Assistant Manager - Azure Data Engineer INR 1500K-2000KApache Spark | Azure | DBX Notebooks | Data Infrastructure | Data ModelingMid-level Full TimeBangalore, Karnataka, India16h ago
-
Security Services Data Modelling and Engineering - Associate INR 1500K-2400KAI enablement | Apache Spark | Data Architecture | Data Catalog | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India16h ago