Big Data Pyspark Developer
PLOT NO-1, S.NO. 77, India
INR 2800K-4000K (estimate) Senior-level Full Time
Tasks
- Analyze business client needs and document requirements
- Assess applicability of prior experience and evaluate options
- Create reports, metrics, and presentations
- Define project objectives through research
- Develop data models and ETL workflows
- Ensure compliance with laws, rules, and regulations
- Identify technology risks and business implications
- Write and optimize data processing pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Avro | Bitbucket | CSV | Data Engineering | ETL | Git | Hadoop | Hive | Impala | JSON | Parquet | PySpark | Python | SQL | Shell Scripting | Spark SQL | Unix | YARN
Education
N/A
Roles
Big Data Developer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
Senior-level Full TimeIN-AP-Hyderabad7h ago
-
Platform Engineer (AI) INR 1500K-2000KEmbeddings | Generative AI | Language Models | Large Language Models | Machine LearningMid-level Full TimeIN-TN-Chennai7h ago
-
MLOps Engineer INR 2500K-4000KArtificial Intelligence | Embeddings | Language Models | Large Language Models | Machine LearningEntry-level Full TimeIN-AP-Hyderabad7h ago
-
Senior Software Engineer (AI) INR 2000K-4500KAPI Design | AWS | Agent Frameworks | Aurora | CI/CDFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India7h ago
-
Lead- Data Analysis INR 2800K-4000KAlteryx | Automation | Correlation Analysis | Dashboards | Data ModelingEmployee discounts | Financial coaching | Health insurance | Hybrid work | Mental health supportSenior-level Full TimeBengaluru, Karnataka, India, India R7h ago
-
Senior-level Full TimeIndia7h ago
-
Senior-level Full TimeIndia7h ago
-
Senior-level Full TimeBengaluru, KA, India8h ago
-
Data Engineer INR 1800K-3000KAWS AppSync | Agentic Workflows | Amazon DynamoDB | Amazon S3 | FastAPIMid-level Full TimePune, Maharashtra, India8h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Language Processing | Linear Algebra | Machine LearningEntry-level Full TimeIndia9h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Language Processing | Linear Algebra | Machine LearningEntry-level Full TimeIndia9h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia9h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia9h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia9h ago
-
Amaze - Cloud Data Engineer INR 2500K-4800KAWS AI | Azure AI | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeIndia9h ago
-
Amaze - Cloud Data Lead INR 2000K-4800KAWS | Azure | Data Quality | Data pipeline | Data pipeline orchestrationSenior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Senior Digital & GenAI Architect - Consulting Partner INR 2000K-4500KAWS | Agent Framework | Azure Agent | Azure Agent Framework | Generative AISenior-level Full TimeIndia9h ago
-
ML-Ops INR 2500K-4800KAsyncio | Benchmarking | CI/CD | CProfile | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Gen AI Developer Specialist INR 2000K-3300KA/B | A/B Testing | Agent systems | B testing | EvaluationSenior-level Full TimeIndia9h ago
-
Gen AI Developer Specialist INR 2000K-3300KA/B | A/B Testing | API Integration | B testing | ExperimentationSenior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Senior-level Full TimeIndia9h ago
-
Data Integration Engineer INR 500K-1500KBatch Processing | Cause analysis | Data integration | Database Triggers | Database packagesMid-level Full TimeIndia9h ago