Software Engineer II,Python, Spark
Mumbai, Maharashtra, India
INR 1500K-2200K (estimate) Mid-level Full Time
Tasks
- Analyze data patterns and drive improvements
- Apply Software Development Life Cycle toolchain for automation
- Configure tools to update logical or physical data models
- Design data pipelines and architectures
- Develop, test, and maintain data pipelines
- Implement data platforms on AWS
- Manage data security with IAM encryption KMS and secrets manager
- Perform performance tuning for Python and Spark
- Produce architecture and design artifacts
- Schedule batch processing with autosys or control m
- Support enterprise data controls review
- Use AI coding assist tools to improve code quality
- Use SQL and NoSQL databases for data storage and access
- Validate outputs using peer review and automated testing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS Glue Catalog | AWS KMS | AWS Lake Formation | AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Agile | Amazon Athena | Amazon EventBridge | Amazon Kinesis | Amazon MSK | Amazon S3 | Apache Airflow | Apache Avro | Apache Kafka | Apache Spark | Autosys | Batch Processing | CI/CD | Control-M | Data Modeling | Data Serialization | ELT | ETL | Encryption | Glue Catalog | IAM | Lake Formation | Linux | Multithreading | NoSQL | Pandas | Parquet | Performance Tuning | Python | Relational databases | SQL | Secrets Manager | Spark SQL | Spark Streaming | Step Functions | Unit Testing | Unix
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeIN-AP-Hyderabad6h ago
-
AI Engineer INR 1500K-3000KAzure Databricks | Data Engineering | Data engineering pipelines | Embeddings | Engineering PipelinesMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior Engineer Digital & AI Solutions INR 4000K-6000KAPI Development | Agent systems | CI/CD | Cloud Computing | ContainerizationFood allowance | Health insurance | Hybrid work | Internet allowance | Learning and development programsSenior-level Full TimeHyderabad, Telengana, India8h ago
-
Manager of Software Engineering-Java, Flink,Kafka INR 1500K-2200KAWS | Agile | Amazon EKS | Apache Flink | Apache KafkaMid-level Full TimeHyderabad, Telangana, India8h ago
-
Lead Software Engineer - Java/Python, AWS,LLM INR 3500K-5000KA/B | A/B Testing | AWS Lambda | Agentic AI | AgileSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Staff Engineer, Data Analytics Engineering INR 2500K-3500KAPIs | AWS Glue | AWS Lambda | AWS S3 | Amazon BedrockSenior-level Full TimeBengaluru, KA, India9h ago
-
Senior Associate - Data Science/Applied AI ML INR 1400K-2400KAnomaly Detection | Backtesting | Bias/fairness | CI/CD | ClassificationMid-level Full TimeMumbai, Maharashtra, India11h ago
-
Senior Associate - Data Science/Applied AI ML INR 1400K-2400KAnomaly Detection | Bias and fairness | CI/CD | Classification | ClusteringMid-level Full TimeMumbai, Maharashtra, India11h ago
-
Data Engineer (GCP) INR 1500K-2040KAPIs | Airflow | Authentication | Authorization | BigQueryAgile collaboration | Autonomy | Flexible environmentMid-level Full TimePune, Maharashtra, India12h ago
-
Senior-level Full Timetelengana, India12h ago
-
Associate Specialist - Cloud & Application Engineering INR 800K-1000KAWS | Azure | Cloud Data | Cloud Data Platforms | Cloud platformMid-level Full TimeMumbai, Maharashtra, India12h ago
-
Associate Principal Engineer, Data Engineer (Enterprise Data Architecture- Banking domain) INR 1500K-2500KArdoq | Cloud Data | Cloud Data Platforms | Collibra | Data ArchitectureMid-level Full TimeRemote, India R12h ago
-
Mid-level Full TimeBangalore, Karnataka, India12h ago
-
Product Manager (Vice President) - Fusion Data Platform INR 3000K-6000KAgent systems | Async Programming | Audit trails | Autogen | ChunkingExecutive-level Full TimeHyderabad, Telangana, India12h ago
-
Mid-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Software Engineer, Data Engineering INR 3000K-4000KAWS | Apache Airflow | Apache Spark | Data Modeling | Data PipelinesAccident insurance | Commuter benefits | Dental benefits | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India14h ago
-
Senior Machine Learning Engineer - Advertising Engineering INR 2520K-3880KAttribution Modeling | C++ | Classification | Data Lake | Data PipelinesFlexible remote work on Fridays | Health and wellness support | Hybrid work schedule | Paid time offSenior-level Full TimeBengaluru, India14h ago
-
Mid-level Full TimePune, Maharashtra, India16h ago
-
Technical specialist- Data Engineer, AS INR 2475K-3465KAgile | Airflow | Apache Beam | Apache Hadoop | Apache SparkAccident insurance | Best in class leave policy | Certification sponsorship | Childcare assistance reimbursement | Employee assistance programMid-level Full TimePune - Margarpatta, India18h ago
-
Technical specialist- Data Engineer, AS INR 2475K-3465KAgile | Airflow | Apache Beam | Apache Spark | Cause analysisAccident and term life insurance | Childcare assistance reimbursement | Employee assistance program | Flexible leave policy | Gender neutral parental leavesMid-level Full TimePune - Margarpatta, India18h ago
-
Data Platform Engineer INR 1000K-2000KAWS | Data Modeling | Data Warehouse | Data integration | ETLMid-level Full TimeBengaluru, BDC7A, India18h ago
-
Mid-level Full TimeBengaluru, BDC14A, India18h ago
-
Mid-level Full TimeKolkata, KDC1A, India18h ago
-
Mid-level Full TimeKolkata, KDC1A, India18h ago
-
Infra Tech Support Practitioner INR 1500K-2500KAKS | API Gateway | AWS | Ansible | Application Lifecycle ManagementMid-level Full TimeKolkata, KDC1A, India18h ago