Lead Software Engineer – Python, ETL, GLUE, Spark, AWS.
INR 2000K-2200K (estimate) Senior-level Full Time
Tasks
- Build and maintain data lakes and lakehouses
- Conduct architectural reviews
- Create infrastructure as code
- Design and implement ETL pipelines
- Develop production code
- Drive CI/CD pipelines
- Ensure security and compliance
- Implement data quality checks
- Mentor engineers and conduct code reviews
- Monitor performance and troubleshoot
- Optimize Spark jobs
- Orchestrate data workflows
- Perform data modeling
- Produce documentation and runbooks
- Review and debug code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CDK | AWS CloudWatch | AWS Glue | AWS IAM | AWS KMS | AWS Lake Formation | AWS Secrets | AWS Secrets Manager | AWS Step Functions | AWS Systems Manager | AWS Systems Manager Parameter Store | AWS systems | Amazon EMR | Amazon S3 | Amazon VPC | Apache Airflow | CI/CD | Data Modeling | Data Quality | Data Vault | Dimensional Modeling | Error Handling | Idempotency | Lake Formation | Lineage | Metadata Management | ORC | Observability | Parameter Store | Parquet | PySpark | Python | Retries | Schema evolution | Secrets Manager | Spark UI | Star Schema | Step Functions | Systems Manager Parameter Store | Terraform
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
Sr. Software Engineer (AI/ML) (PhD / Postdoc) INR 1500K-2400KCausal Inference | Deep learning | Generative AI | Language Processing | Machine LearningAccess to large clinical dataset | Collaboration with healthcare partners | Conference publication support | Research freedomSenior-level Full TimeHyderabad, India9h ago
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
AI | AWS | Agile | Ansible | AutosysSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
IT Data Engineer II INT INR 1800K-2500KApache Spark | Cloud Cost Optimization | Cloud platform | Cost Optimization | Data GovernanceMid-level Full TimeBangalore, India15h ago
-
Data Engineer - VOIS INR 2000K-2040KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerCollaborative environment | Flexible inclusive workplace | Learning opportunitiesMid-level Full TimePune, IN15h ago
-
AWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon S3 | Amazon Web ServicesEqual opportunity employer | Fast track growth opportunities | Great place to workSenior-level Full TimeHyderabad, Office Level 3 & 4, …15h ago
-
TTT-SAP-Python Gen AI-Tax Senior INR 2000K-4512KAI Core | AI Launchpad | API Management | CI/CD | Cloud ALMSenior-level Full TimeBengaluru, KA, IN, 56001615h ago
-
Entry-level Full TimeBangalore, India15h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
Deputy Manager, Global Platform Technology INR 1500K-2000KAgile | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBMid-level Full TimeChennai IMPT, India15h ago
-
Senior-level Full TimeIndia - Chennai15h ago
-
Data engineer (Azure Databricks) INR 1500K-2500KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeChennai, Tamil Nadu, India15h ago
-
Data Engineer INR 3000K-4000KAgile | Azure | Azure IAM | Azure Networking | Azure StorageBe Well programs | Certification support | Coaching | Continuous feedback | Hybrid workMid-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India15h ago
-
Data Engineering Lead - MSC INR 2520K-3380KAbinitio | Airflow | Azure Data | Azure Data Factory | Azure Data LakeRelocation supportSenior-level Full TimeBusiness Office (Joy House 2) - …15h ago
-
Associate Data Engineer INR 1500K-2000KAWS | CCPA | Data Architecture | Data Governance | Data ModelingMid-level Full TimeIndia - Hyderabad15h ago
-
Senior AI/ML Engineer INR 2500K-5000KAI Document Intelligence | AI Services | API Design | Agent Orchestration | Agent systemsSenior-level Full TimeBangalore - RGA Tech Park, India15h ago
-
Software Engineering LMTS- ML Engineer INR 2500K-4500KEmbeddings | Fine Tuning | LLM | Machine Learning | Machine Learning PipelinesSenior-level Full TimeIndia - Bangalore15h ago
-
Senior SQL Developer + SSIS + POWER BI INR 3000K-4000KAgile Scrum | BI Desktop | Composite Models | DAX | Data ModelingSenior-level Full TimeMumbai, India15h ago
-
Senior Manager, Biostatistical Programming INR 2535K-4144KAutomation | Clinical trials | Compliance | Data Quality | Offshore Team ManagementCareer development | Health benefits | Inclusive culture | Total rewards | Work-life balanceSenior-level Full TimeIndia - Hyderabad15h ago
-
Associate Database Reliability Engineer INR 1200K-2500KBash | CentOS | Cloud infrastructure | DNS | DRSMid-level Full TimePune, India15h ago
-
Software Development Engineer 1 INR 2200K-4200KAI Agents | AWS | Azure | CI/CD | DockerContinuous learning | Flexible experimentation | Innovation culture | Mentorship | Open collaborationNone Full TimeAPAC - India - Bengaluru - …15h ago
-
Software Development Engineer 4 INR 2500K-4500KAWS EMR | Airflow | Apache Spark | Data Ingestion | Data LakeSenior-level Full TimeNoida, India R15h ago
-
Entry-level Full TimeBangalore, India15h ago
-
IT Data Engineer II INT INR 1800K-2500KApache Spark | Cloud platform | Dashboards | Data Governance | Data ModelingMid-level Full TimeBangalore, India15h ago