Senior Lead Data Engineer (Pyspark, ETL, Redshift, AWS, Data warehousing)
IND - Karnataka - Bengaluru - North, India
INR 2400K-4000K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Create technical documentation
- Define source target mapping
- Design data warehouse pipelines
- Ensure data quality
- Evaluate data access control
- Implement data management strategies
- Lead data engineering projects
- Manage analytics platforms
- Provide consulting and data pipeline standards
- Translate data product design requirements
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Ab Initio | Access Control | Amazon EMR | Amazon RDS | Amazon Redshift | Cause analysis | Data Modeling | Data Quality | Data Warehousing | Data pipeline | Database tuning | Databricks | Dimensional Modeling | ERD | ETL | Flink | Performance Tuning | PostgreSQL | PySpark | Python | Root Cause Analysis | Root cause | SDLC | SQL | Snowflake | Spark Streaming | Storm
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Senior DevOps Engineer INR 2000K-4000KAKS | Amazon Aurora | Amazon EMR | Amazon Redshift | Amazon S3Senior-level Full TimeBangalore, India9h ago
-
Technology Leader-Data Engineering-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 2000K-2600KAPI | CI/CD | Java | Jira | LinuxSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior-level Full TimeIN-MH-Pune10h ago
-
Deputy Manager-Data Engineering INR 1500K-2500KAmazon Web Services | Azure | CI/CD | Cloud platform | ContainerizationMid-level Full TimeNoida, UP, India11h ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-3500KAI Foundry | Access Management | Active Directory | Agent Builder | Agent OrchestrationC level presentations | Client advisory | Mentoring junior resources | Professional developmentSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Data Engineer - Senior INR 2000K-2800KAnomaly Detection | Apache Hive | Apache Kafka | Application Insights | AzureSenior-level Full TimePune, Maharashtra, India13h ago
-
AWS Data Engineer INR 1500K-2000KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeIndia13h ago
-
Senior-level Full TimePune, Maharashtra, India13h ago
-
Agile | Apache Spark | Data Architecture | Data Catalog | Data GovernanceSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Azure Data Engineer - Assistant Manager INR 1500K-2000KAnalysis Services | Apache Spark | Azure Analysis | Azure Analysis Services | Azure CosmosMid-level Full TimeBangalore, Karnataka, India13h ago
-
SAP Gen AI Developer ACON US Inv INR 1317K-2000KAI Core | AI Launchpad | Business Technology Platform | DevOps | DockerMid-level Full TimeBangalore, Karnataka, India13h ago
-
Azure Databricks INR 2400K-3900KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksClient Customer Interactions | Health insurance | Learning aids | Meal vouchers | Unlimited growth potentialSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Senior Research Engineer - Applied AI/ML INR 2000K-4170KA/B | A/B Testing | AWS | Amazon SageMaker | Apache AirflowHybrid workSenior-level Full TimeGurugram, India15h ago
-
Senior-level Full TimeHyderabad, India15h ago
-
Applied AI /ML INR 950K-1250KAlgorithms | Amazon Web Services | Azure | Computer Vision | Data MiningMid-level Full TimeHyderabad, Telangana, India15h ago
-
Lead Assistant Manager INR 2000K-3000KANSI SQL | Agile | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimePune, Maharashtra, India15h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3000KAnthropic API | Azure OpenAI | CI/CD | Code Analysis | CypressHybrid work modelMid-level Full TimePune, Maharashtra, India16h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS Athena | AWS Data | AWS Data Pipeline | AWS Glue | AWS LambdaCorporate social responsibility programs | Maternity leave | Networking opportunities | Paternity leave | Product and service discountsMid-level Full TimeBangalore, Karnataka, India16h ago
-
AI Engineer INR 1800K-3000KAPI Integration | Azure | Azure OpenAI | Chroma | DockerFast-learning culture | Flexible locationMid-level Full TimeNavi Mumbai, Maharashtra, India16h ago
-
Genetics Data Engineer INR 1500K-2500KAWS | Azure | BGEN | Bcftools | Biobank trusted research environmentsMid-level Full TimeBangalore, Karnataka, IN, 56003716h ago
-
Azure Data Engineer_Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeHyderabad, HYDERABAD, India16h ago
-
Lead Software Engineer - Applied AI Engineer (Agentic/ Gen AI) INR 2000K-3500KAPI Design | AWS | Accuracy Monitoring | Agentic architecture | CI/CDSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Java Spark Engineer INR 2000K-3500KAWS | Apache Spark | Azure | CI/CD | Cloud platformAgile team culture | Career growth opportunitiesSenior-level Full TimeIndia - Bengaluru17h ago
-
AI Engineer - Tieto Tech Consulting (m/f/d) INR 2200K-4200KAI Builder | AI Search | AI Solution | AI solution testing | Agent OrchestrationHybrid work model | Open culture | Professional growth | Work-life balanceMid-level Full TimeBangalore, India17h ago
-
Lead Software Engineer - Applied AI Engineer (Agentic/ Gen AI) INR 1800K-3200KAWS | Agent systems | CI/CD | Embeddings | FaissSenior-level Full TimeMumbai, Maharashtra, India17h ago