Lead Data Engineer (AWS Cloud, Python, Distributed Data Processing)
IN - BENGALURU PRIMECO UNION CITY, India
INR 1850K-2400K (estimate) Senior-level Full Time
Tasks
- Build cloud data solutions for storage processing orchestration and analytics
- Collaborate with stakeholders to translate requirements into data solutions
- Design build and maintain scalable production data pipelines
- Design distributed processing data architectures
- Develop and optimize ETL/ELT workflows
- Diagnose and resolve data issues for performance data quality and reliability
- Drive code and architecture reviews
- Implement and evolve data models
- Lead hands on development technical design and code ownership
- Mentor data engineers in Python distributed data processing SQL and cloud practices
- Modernize legacy data platforms by refactoring and migrating
- Optimize cloud data workloads for scalability performance and cost
- Support and evolve roadmap for data platform modernization and new data products
- Write and maintain infrastructure as code for data platform resources
Perks/Benefits
Skills/Tech-stack
AWS | Data Governance | Data Modeling | Data Processing | Data Warehousing | Distributed Computing | ELT | ETL | Infrastructure as Code | Performance Tuning | Python | Query Optimization | Relational databases | SQL | Streaming Data | Streaming data processing | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Software Engineer, Google Cloud Storage INR 2500K-3500KBenchmarking | C++ | Connectors | Debugging | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India4h ago
-
Senior AI/ML Engineer I INR 2500K-4500KAzure | C++ | Dataset Processing | Deep learning | Generative AICareer advancement programs | Corporate National Pension Scheme | Dental insurance | Education reimbursement programs | Employee assistance programSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Staff Software Engineer, Machine Learning INR 2520K-3880KA/B | A/B Testing | Alerting | B testing | BackpressureEqual opportunity workplace | Health and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India8h ago
-
Sr. Staff Software Engineer, Machine Learning INR 3200K-4725KC++ | Data Pipelines | Deep learning | Experimentation | Generative AIHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India8h ago
-
Principal Staff Software Engineer, Systems Infrastructure INR 2100K-4500KAPI Design | Apache Hadoop | Apache Kafka | Apache Spark | Big DataHealth and wellness programs | Time away from workExecutive-level Full TimeBengaluru, KA, India8h ago
-
Principal Staff Software Engineer, AI Infrastructure INR 1800K-5800KApache Kafka | C++ | Compliance | Data Modeling | Distributed SystemsHealth and wellness programs | Hybrid work option | Time away from workExecutive-level Full TimeBengaluru, KA, India8h ago
-
Principal Staff Software Engineer, Machine Learning INR 1800K-4000KA/B | A/B Testing | B testing | Backpressure Control | CachingHealth and wellness programs | Time awayExecutive-level Full TimeBengaluru, KA, India8h ago
-
Data Scientist I INR 2520K-4500KAWS | Amazon Bedrock | Amazon SageMaker | Autogen | BERTCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600669h ago
-
Technical Anchor INR 2500K-3000KASR | AWS | Adobe Experience | Adobe Experience Manager | Amazon LexAgile team collaboration | Off-hours support | On-call rotational support | Weekend support rotational basisSenior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Senior-level Full TimePune, India10h ago
-
Senior-level Full TimeBangalore, INDIA R15h ago
-
AI Solutions Architect INR 2500K-4500KAWS | Convolutional Neural Networks | Data Governance | Distributed Systems | DockerSenior-level Full TimeIndia - Remote R15h ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R15h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India15h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India15h ago
-
EY - GDS Consulting - AI And DATA -Azure Databricks - Senior INR 2040K-2400KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCoaching and feedback | Flexible working arrangements | Professional development opportunitiesSenior-level Full TimeBengaluru, KA, IN, 56001615h ago
-
Senior-level Full TimePune, IN15h ago
-
Fraud Data Engineer, Assistant Vice President INR 600K-2000KAgile | Big Data | Confluence | Data Governance | Data QualityConfidential counseling | Employee Learning and Development | Paid parental leave | Paid time off | Telehealth accessExecutive-level Full TimeG-BLOCK, BANDRA-KURLA COMPLEX BANDRA EAST MUMBAI, …15h ago
-
Backend Engineer INR 2200K-3500KAKS | API documentation | Alerting | Asynchronous programming | AzureSenior-level Full TimeIND Bengaluru - Technology Campus, India15h ago
-
Lead - Data Analytics and Insights INR 2100K-2700KData Analysis | Data Mining | Decision Trees | Exploratory Data Analysis | Gradient boostingSenior-level Full TimeBlock 1 DT, Chennai India15h ago
-
Senior-level Full TimeGurugram, India22h ago
-
Mid-level Full TimeGurugram, India22h ago
-
Software Engineer III - Data INR 2520K-3380KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureERG events | Equipment provided | Health coverage | Learning and development | Paid HolidaysSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Senior Data & Analytics Systems Engineer INR 2520K-3380KApache Airflow | Apache Spark | Cloud Functions | Cloud Storage | Cloud platformSenior-level Full TimeGurugram, India23h ago
-
Mid-level Full TimeGurugram, India1d ago