Lead Data Engineer (AWS Cloud, Python, Distributed Data Processing)
IN - BENGALURU PRIMECO UNION CITY, India
INR 1850K-2400K (estimate) Senior-level Full Time
Tasks
- Build cloud data solutions for storage processing orchestration and analytics
- Collaborate with stakeholders to translate requirements into data solutions
- Design build and maintain scalable production data pipelines
- Design distributed processing data architectures
- Develop and optimize ETL/ELT workflows
- Diagnose and resolve data issues for performance data quality and reliability
- Drive code and architecture reviews
- Implement and evolve data models
- Lead hands on development technical design and code ownership
- Mentor data engineers in Python distributed data processing SQL and cloud practices
- Modernize legacy data platforms by refactoring and migrating
- Optimize cloud data workloads for scalability performance and cost
- Support and evolve roadmap for data platform modernization and new data products
- Write and maintain infrastructure as code for data platform resources
Perks/Benefits
Skills/Tech-stack
AWS | Data Governance | Data Modeling | Data Processing | Data Warehousing | Distributed Computing | ELT | ETL | Infrastructure as Code | Performance Tuning | Python | Query Optimization | Relational databases | SQL | Streaming Data | Streaming data processing | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KCI/CD | Docker | GitHub | Incident Management | JavaEducation budget | Local team meetups | Professional growth budget | Remote work | Structured secure work environmentSenior-level Full TimeNoida, India2h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Data Modeling | Git | Microservices | PytestLocal legal compliance | Periodic team meetups | Remote workSenior-level Full TimeTrivandrum, India2h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Clean Code | Data Modeling | Git | MicroservicesEducation support | Innovative projects | Legal compliance in India | Local team meetups | Professional development budgetSenior-level Full TimeChennai, India2h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KAI Agents | AI Assisted Development | CI/CD | Docker | GitHub ActionsEducation budget | Innovative projects | Legal Compliance Support | Local team meetups | Personal growth budgetSenior-level Full TimeKochi, India2h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Cloud Native | Cloud native design | Data Modeling | Engineering PracticesEducation budget | Local compliance | Periodic team meetups | Personal growth budget | Remote workSenior-level Full TimeKochi, India2h ago
-
Cloud deployment | FastAPI | GenAI | PostgreSQL | Power BIMid-level Full TimeHyderabad, India3h ago
-
Lead Consultant - Site Reliability Engineers/L2 INR 2535K-4225KAWS | Angular | Azure | C# | Chaos EngineeringSenior-level Full TimeIndia-Bangalore3h ago
-
Pyspark Data Engineer INR 1200K-2000KAgile | Apache Spark | Data Governance | Data Lake | Data ModelingSenior-level Full TimeIN-KA-Bangalore4h ago
-
Senior-level Full TimeIN-AP-Hyderabad4h ago
-
Gen AI - Consultant INR 2800K-4225KAPI Development | AWS SageMaker | AgentOps | Apache Airflow | Apache SparkAccess to AI research labs | Certifications | Cloud innovation platforms | Lead POCs | Work on next generation AI platformsSenior-level Full TimeBangalore, Karnataka, India5h ago
-
Azure Data Engineer - AM- MFT KGS CH INR 2000K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India5h ago
-
Azure Data Engineer - Senior- MFT KGS CH INR 2000K-2000KAccess Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India5h ago
-
Azure Data Engineer - AM - MFT KGS CH INR 2000K-2000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, Karnataka, India5h ago
-
AWS Data Engineering - Consultant INR 1200K-1500KAWS CloudFormation | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaMid-level Full TimeBangalore, Karnataka, India5h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-3000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India5h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-3000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India5h ago
-
AWS Data Engineering - Consultant INR 1200K-1500KAWS CloudFormation | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaMid-level Full TimeBangalore, Karnataka, India5h ago
-
Senior Software Engineer, Google Cloud Storage INR 2500K-3500KBenchmarking | C++ | Connectors | Debugging | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Senior BI Engineer #3033 INR 800K-1500KCalculated Fields | DBT | Dashboard performance | Dashboard performance tuning | Data LineageSenior-level Full TimeChennai, India7h ago
-
Senior AI/ML Engineer I INR 2500K-4500KAzure | C++ | Dataset Processing | Deep learning | Generative AICareer advancement programs | Corporate National Pension Scheme | Dental insurance | Education reimbursement programs | Employee assistance programSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Senior Software Engineer, Data Science INR 3125K-3880KA/B | A/B Testing | B testing | Causal analysis | D3Senior-level Full TimeBengaluru, KA, India8h ago
-
Staff Software Engineer, Data Science INR 2520K-3380KApache Spark | D3 | Data Governance | Data Modeling | Data VisualizationSenior-level Full TimeBengaluru, KA, India8h ago
-
Software Engineer III - Java & Kafka Developer INR 2500K-4144KAWS | ActiveMQ | Agile | Apache Camel | CucumberSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Staff Software Engineer, Machine Learning INR 2520K-3880KA/B | A/B Testing | Alerting | B testing | BackpressureEqual opportunity workplace | Health and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India9h ago
-
Sr. Staff Software Engineer, Machine Learning INR 3200K-4725KC++ | Data Pipelines | Deep learning | Experimentation | Generative AIHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India9h ago