Lead Software Engineer – Python, ETL, GLUE, Spark, AWS.
INR 2000K-2200K (estimate) Senior-level Full Time
Tasks
- Build and maintain data lakes and lakehouses
- Conduct architectural reviews
- Create infrastructure as code
- Design and implement ETL pipelines
- Develop production code
- Drive CI/CD pipelines
- Ensure security and compliance
- Implement data quality checks
- Mentor engineers and conduct code reviews
- Monitor performance and troubleshoot
- Optimize Spark jobs
- Orchestrate data workflows
- Perform data modeling
- Produce documentation and runbooks
- Review and debug code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CDK | AWS CloudWatch | AWS Glue | AWS IAM | AWS KMS | AWS Lake Formation | AWS Secrets | AWS Secrets Manager | AWS Step Functions | AWS Systems Manager | AWS Systems Manager Parameter Store | AWS systems | Amazon EMR | Amazon S3 | Amazon VPC | Apache Airflow | CI/CD | Data Modeling | Data Quality | Data Vault | Dimensional Modeling | Error Handling | Idempotency | Lake Formation | Lineage | Metadata Management | ORC | Observability | Parameter Store | Parquet | PySpark | Python | Retries | Schema evolution | Secrets Manager | Spark UI | Star Schema | Step Functions | Systems Manager Parameter Store | Terraform
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
Senior-level Full TimeHyderabad, India5h ago
-
Senior-level Full TimeHyderabad, India5h ago
-
Mid-level Full TimeMaharashtra, Pune, India5h ago
-
A/B | A/B Testing | Allocation Optimization | B testing | BacktestingFlexible hours | Remote workSenior-level ContractNoida, India5h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Cloud Computing | Data Modeling | Git | MicroservicesEducation budget | Local compliance support | Local connection | Periodic meet ups | Personal growth budgetSenior-level Full TimeHyderabad, India5h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Clean Code | Cloud Computing | Data Modeling | GitEducation budget | Local compliance support | Periodic team meetups | Professional development budget | Remote workSenior-level Full TimeCoimbatore South, India5h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KCI/CD | Docker | GitHub | Java | KubernetesEducation budget | Local team meetups | Professional development support | Remote work | Wellness supportSenior-level Full TimeGurgaon Kty., India5h ago
-
Lead Consultant - Level 2 Storage & Backup Engineer INR 2500K-4144KAWS | Automation | Azure | Change Management | Cyber ResilienceSenior-level Full TimeIndia-Hyderabad6h ago
-
Senior Data Engineer INR 2000K-2040KAWS | Automation | Data Warehousing | Databricks | Development Life CycleSenior-level Full TimeIN-MH-Mumbai6h ago
-
Mid-level Full TimeIN-TN-Chennai6h ago
-
Enablement Manager, Associate INR 1524K-2100KAWS | Azure | CI/CD | Cloud platform | Computer VisionInclusive work environment | Learning opportunities | State-of-the-art computing resourcesMid-level Full TimeHyderabad, Telangana, India6h ago
-
Data Engineer Manager INR 1500K-2000KAPI Development | API Integration | API Publishing | AWS | Apache SparkHybrid workMid-level Full TimeBengaluru, INDIA, India7h ago
-
Software Engineer III INR 2486K-3000KAI Gateways | Alerting | Amazon Elastic Container Service | Automated rollback | CI/CDSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Mid-level Full TimeBangalore, Karnataka, India7h ago
-
Mid-level Full TimeBangalore, Karnataka, India7h ago
-
Mid-level Full TimeBangalore, Karnataka, India7h ago
-
Tech Lead .Net & React full stack – AI Enablement INR 2500K-4500K.NET | C# | CI/CD | Context window | Contract testingSenior-level Full TimeHyderabad, India7h ago
-
Mid-level Full TimeBangalore, Karnataka, India7h ago
-
Sr Data Engineers - AI/ML - Chennai INR 2500K-4500KAPI Security | Agent systems | Asynchronous programming | CI/CD | Docker401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeIndia8h ago
-
Infrastructure Engineer III- Cloud Database Administrator (DBA) INR 2486K-3200KAWS DMS | AWS EC2 | AWS ECS | AWS EKS | AWS RDSSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior Data Engineer INR 2520K-3380KAmazon Web Services | Apache Airflow | Azure | Bash | CI/CDHybrid work environmentSenior-level Full TimeBangalore, INDIA, India8h ago
-
Software Engineering INR 1500K-2000KAI Driven | AI-driven development | Apache Spark | C# | C++On-call support rotationMid-level Full TimeBengaluru, KA, IN9h ago
-
AI ML Data Engineer for ADAS Sr Full Stack Developer INR 2500K-2800KAPIs | Apache | Apache JMeter | Azure | CI/CDSenior-level Full Timebangalore, India9h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Senior Database Administrator INR 2520K-3380KComputer Networking | DNS | Database Reliability | Database performance | FirewallsFlexible Working ProgramSenior-level Full TimeIndia9h ago