Python Developer
Chennai, Tamil Nadu, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build Spark code generation optimizers
- Build recursive parsers for JSON and XML
- Collaborate with data engineers on analytics applications
- Design and build Python code generation framework
- Design graph based recursive business rules metadata model
- Develop PySpark applications for batch and streaming
- Develop and execute data pipeline testing
- Develop technical documentation
- Generate PySpark runtime executable code from business rules
- Implement metadata driven code generation
- Maintain integration and regression testing framework in Jenkins
- Optimize Spark performance in Hadoop
- Optimize native Hadoop file formats and compression
- Orchestrate Hadoop pipeline execution
- Participate in agile development
- Validate business rules and policies
Perks/Benefits
- N/A
Skills/Tech-stack
Avro | Bitbucket | Compression codecs | Data Pipelines | Dataframes | Git | Graph Algorithms | HBase | Hadoop | Hive | JSON | Jenkins | Kafka | MongoDB | ORC | Pair RDD | Parquet | PySpark | Python | Spark Context | Spark Streaming | SparkSQL | XML | YARN
Roles
Developer | Python | Python Developer | Senior Spark Developer | Spark Developer
Related jobs
-
Senior-level Full TimeIN-MH-Pune13h ago
-
Oracle PL/SQL Developer INR 1200K-2400KAgile | Data Modeling | Database normalization | ETL | EXPLAIN ANALYZESenior-level Full TimeIN-AP-Hyderabad13h ago
-
Senior-level Full TimeBangalore, Karnataka, India15h ago
-
Java Developer INR 1500K-2700KAWS | Azure | CI/CD | Docker | GCPAgile working environment | Code reviews | Design discussionsSenior-level Full TimeBangalore, Karnataka, India15h ago
-
Senior-level Full TimeBangalore, Karnataka, India15h ago
-
Executive-level Full TimeBangalore, Karnataka, India15h ago
-
Senior-level Full TimePune, Maharashtra, India21h ago
-
App Service | Azure App | Azure App Service | Azure Blob | Azure Blob StorageSenior-level Full TimeKolkata DN 57, India1d ago
-
App Service | Azure App | Azure App Service | Azure Blob | Azure Blob StorageSenior-level Full TimeKolkata DN 57, India1d ago
-
AWS | AWS Glue | Amazon EMR | Amazon S3 | Apache AirflowSenior-level Full TimeMumbai Shivaji Park, India1d ago
-
Data Visualisation & BI Reporting INR 1400K-2500KDAX | Data Analysis | Data Blending | Data Cleansing | Data ModelingMid-level Full TimeBengaluru, Maruthi Onyx - TESCO TSA, …1d ago
-
Data Engineer INR 3000K-4000KApache Flink | Apache Kafka | Apache Spark | Azure Data | Azure Data FactoryBarrier free access | Canteen and café | Childcare | Coaching | Company doctorSenior-level Full TimeBengaluru, IN1d ago
-
Mid-level Full TimeLocation(s): Chennai, Tamil Nadu, India1d ago
-
LLM Model Developer INR 1500K-2500KData Preprocessing | Language Models | Language Processing | Large Language Models | Model EvaluationMid-level Full TimeBengaluru, BDC14A, India1d ago
-
AWS | Angular | Autogen | Azure | CI/CDSenior-level Full TimeHyderabad, TG, IN, 5000812d ago
-
Senior-level Full TimePrimary location: Gurgaon, Haryana2d ago
-
API Development | Deep learning | Embeddings | Langchain | LanggraphContinuous learning environment | Flexible schedule | Fully remote within IndiaSenior-level Full TimeIndia R2d ago
-
EY - GDS Consulting - AIA - Gen AI - Senior INR 3000K-5000KAWS | Azure | Azure DevOps | Batch Prediction | BedrockCoaching and mentoring | Continuous learning | Flexible work options | Inclusive cultureSenior-level Full TimeChennai, TN, IN, 6000323d ago
-
AWS | Anthropic | Azure | CI/CD | Cloud ComputingCollaborative team culture | Inclusive work environment | Learning opportunities | Professional developmentMid-level Full TimeRemote; Remote India R3d ago
-
Oracle PL/SQL PostgreSQL Developer INR 1200K-2400KAgile | ETL | EXPLAIN ANALYZE | EXplain | Execution PlansSenior-level Full TimeIN-AP-Hyderabad3d ago
-
Senior Software Engineer - Full Stack & GenAI INR 3264K-5876KAWS | Angular | CI/CD | Docker | Event DrivenHybrid workSenior-level Full TimeBengaluru, KA, India3d ago
-
Mid-level Full TimePune, Maharashtra, India3d ago
-
Databricks Developer INR 1500K-2400KACID | Batch Processing | CI/CD | Cluster management | Data IngestionWork from office 5 days per weekMid-level Full TimeGurugram, Haryana, India3d ago
-
Senior BI Developer, Data Management INR 1632K-3000KAzure Data | Azure Data Factory | Azure SQL | Azure Synapse | Azure Synapse AnalyticsMid-shift schedule | No travel requirementSenior-level Full TimeBangalore, India3d ago
-
Assistant Manager- Python Gen AI Engineer INR 1200K-2500KAI Agents | API Development | Agile | Containerization | Data PipelinesWork from client office 5 days per weekMid-level Full TimeBangalore, Karnataka, India3d ago