Python Developer
Chennai, Tamil Nadu, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build Spark code generation optimizers
- Build recursive parsers for JSON and XML
- Collaborate with data engineers on analytics applications
- Design and build Python code generation framework
- Design graph based recursive business rules metadata model
- Develop PySpark applications for batch and streaming
- Develop and execute data pipeline testing
- Develop technical documentation
- Generate PySpark runtime executable code from business rules
- Implement metadata driven code generation
- Maintain integration and regression testing framework in Jenkins
- Optimize Spark performance in Hadoop
- Optimize native Hadoop file formats and compression
- Orchestrate Hadoop pipeline execution
- Participate in agile development
- Validate business rules and policies
Perks/Benefits
- N/A
Skills/Tech-stack
Avro | Bitbucket | Compression codecs | Data Pipelines | Dataframes | Git | Graph Algorithms | HBase | Hadoop | Hive | JSON | Jenkins | Kafka | MongoDB | ORC | Pair RDD | Parquet | PySpark | Python | Spark Context | Spark Streaming | SparkSQL | XML | YARN
Roles
Developer | Python | Python Developer | Senior Spark Developer | Spark Developer
Related jobs
-
Senior-level Full Timecoimbatore, India20h ago
-
Python Engineer (AI/ML) INR 2500K-3500KCPU | Chroma | Cost Optimization | Data Preprocessing | DockerMid-level Full TimePune, MH, India21h ago
-
Senior-level Full TimePune City, India22h ago
-
Gen AI Developer INR 2000K-4500KData Engineering | Distributed Systems | GenAI | Language Models | Large Language ModelsSenior-level Full TimeIN-TN-Chennai23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Senior-level Full TimeIN-TN-Chennai23h ago
-
Mid-level Full TimeHyderabad, India1d ago
-
AWS | Azure | BigQuery | Bigtable | CassandraSenior-level Full TimePune, Maharashtra, India1d ago
-
Senior Data Developer INR 2000K-2800K21 CFR | 21 CFR Part 11 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeGurugram, HR, IN, 1220021d ago
-
Senior Developer Power BI INR 1500K-2500KAzure DevOps | CI/CD | Composite Models | DAX | Data ModelingSenior-level Full TimeGurugram, HR, IN, 1220021d ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4500KAPI Development | AWS | Autogen | Azure | Azure OpenAISenior-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeBangalore, KA, IN1d ago
-
Associate Software Developer INR 2000K-2800KApache Beam | Apache Flink | Apache Spark | Apache Spark Streaming | BackpressureMid-level Full TimeGCC, India1d ago
-
Python Engineer - AI/ML INR 3500K-5000KAPI Integration | Artificial Intelligence | Chroma | Data Engineering | Data IngestionEntry-level Full TimePLOT NO-1, S.NO. 77, India1d ago
-
Agile | Angular | Bash | CI/CD | Continuous integrationFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeMumbai Goregaon, India1d ago
-
Azure Data | Azure Data Factory | DAX | Data Factory | Data GatewaySenior-level Full TimeGurugram 10 C, India1d ago
-
Senior Fullstack Developer (Python+AI+React) (IR-528) INR 2000K-4800KAuthentication | Authorization | Background Jobs | Chunking | DockerAccident insurance | Flexible hours | Health insurance | Life insurance | Paid time offSenior-level Full TimeIndia - Remote R1d ago
-
ETL Tester INR 1632K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, India1d ago
-
Cognos Planning & Analytics Administrator INR 3000K-4200KCognos Planning Analytics | Cognos TM1 | DB2 | Data Warehousing | Database AdministrationCoaching | Flexible working hours | Health and wellness programs | Hybrid work environment | Professional Certification SupportSenior-level Full TimeKIN51438 Hyderabad (KIN51438) Gachibowli, India1d ago
-
Agile | Angular | Bash | CI/CD | DB2Senior-level Full TimeMumbai Goregaon, India1d ago
-
Mid-level Full TimeIndia - Bengaluru - Doddanekundi Industrial …1d ago
-
Data Engineer - Cognos - MS SSIS Developer and Admin INR 3000K-4000KAzure | Azure Data | Azure Data Factory | CI/CD | Data FactoryCertification support | Coaching | Hybrid work environment | Learning opportunities | MentorshipMid-level Full TimeKIN51438 Hyderabad (KIN51438) Gachibowli, India1d ago
-
Azure Data | Azure Data Factory | DAX | Data Factory | Data GatewaySenior-level Full TimeGurugram 10 C, India1d ago
-
Lead Tableau Developer INR 1500K-2500KAgile | Amazon Redshift | Amazon Web Services | Data Modeling | Data WarehousingSenior-level Full TimeIndia - Bengaluru - Doddanekundi Industrial …1d ago