Lead Data Engineer
Tasks
- Build and maintain CI CD pipelines and automation frameworks
- Build scalable data pipelines and analytics frameworks
- Configure governed access using RBAC and service principals
- Design and develop cloud native data and business intelligence solutions
- Ensure interoperability across compute engines and cloud providers
- Implement infrastructure as code for data platform provisioning
- Implement multi cloud architecture across AWS and Azure
- Integrate Databricks Snowflake and cloud services
- Lead technical design and mentor engineers
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | AWS Glue | AWS IAM | AWS S3 | Access Control | Amazon EMR | Apache Iceberg | Automation | Azure AKS | Azure Databricks | CI/CD | Cloud Architecture | Cost Optimization | Data Access Control | Data Governance | Data Processing | Data access | Databricks | Delta Lake | Distributed Systems | FinOps | Infrastructure as Code | Multi-cloud | Multi-cloud architecture | Platform Observability | RBAC | Scalable Architecture | Service principals | Snowflake | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Mid-level Full TimeKarnataka, Bengaluru, India3h ago
-
Expert Data Engineer (Databricks) INR 1500K-2400KAPI Design | API Key | AWS Glue | AWS IAM | AWS LambdaSenior-level Full TimeMaharashtra, Pune, India3h ago
-
Senior Data Engineer (Databricks) INR 2000K-2800KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Senior-level Full TimeMaharashtra, Pune, India3h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Local connection | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeMumbai, India4h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureGrowth education budget | Local compliance in India | Remote work | Team meet-ups | Wellness budgetSenior-level Full TimeBangalore North, India4h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Spark | CI/CD | Change Data CaptureBudgets for personal growth education and wellness | Legal presence in India | Local connection | Periodic meet ups | Remote workSenior-level Full TimePune City, India4h ago
-
Techno Functional Data & Analytics Lead INR 1500K-2600KAI | AWS | Business Intelligence | Cloud platform | Customer SegmentationHybrid work model | Open to relocationSenior-level Full TimePerungudi, India4h ago
-
AWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileHybrid work modelSenior-level ContractShaikpet, India5h ago
-
Data Engineer INR 1500K-2500KAWS Glue | AWS Step Functions | Amazon Athena | Amazon Kinesis | Amazon Web ServicesSenior-level Full TimeIN-MH-Pune5h ago
-
Software Engineer - ML Ops DevOps INR 2500K-3465KAWS | Argo CD | Azure | CI/CD | Data PipelinesCollaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Advanced Engineer - Embedded C++ Linux INR 1236K-1854KASPICE | CI/CD | Cloud Computing | Communications | Configuration ManagementEmployee discounts | Employee recognition rewards | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Senior Data Engineer - Big Data & Automation INR 1500K-2500KAgile | Ansible | Apache Hive | Apache Spark | ArgoCDFlexible work policy | Work from homeSenior-level Full TimeIndia8h ago
-
AI Senior Software Engineer INR 1800K-3300KAgent collaboration | Agents SDK | Autogen | CI/CD | EmbeddingsInclusive work environmentSenior-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Lead Database Engineer INR 1800K-3000KASH | AWR | AWS CloudWatch | AWS RDS | Access GovernanceHealth and life insurance | Hybrid schedule | Paid time off | Pension and retirement benefits | Professional development supportSenior-level Full TimeHyderabad, India R8h ago
-
Senior Data Engineer - ETL Framework INR 1500K-2500KApache Doris | Apache Hive | Apache Iceberg | Apache Spark | Apache TezFlexible work policy | Work from homeSenior-level Full TimeIndia8h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India10h ago
-
Lead Software Engineer - Java/Python, AWS, Spark INR 1500K-3000KAWS | AWS CloudFormation | AWS Step Functions | Airflow | Amazon S3Senior-level Full TimePune, Maharashtra, India10h ago
-
Consultant INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India10h ago
-
Executive-KDNI - Data & Analytics INR 1500K-5199KAWS | Azure | Dashboarding | Data Governance | Data ModelingExecutive-level Full TimeGurgaon, Haryana, India11h ago
-
Senior Data Engineer – Snowflake Migration Lead INR 1500K-2800KAmazon S3 | Apache Airflow | Azure Data | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeGurugram, Haryana, India11h ago
-
Analytics Engineer - SQL & Data Visualization INR 1500K-2500KAgile | Cloud Data | Cloud Data Warehouse | Data Interpretation | Data ModelingMid-level Full TimeBengaluru, KA, India11h ago
-
Head of Data Operations INR 1500K-5199KAWS Glue | Amazon Redshift | Amazon S3 | Automation | Data StandardizationCollaborative culture | Multicultural team | Professional development programs | Remote workExecutive-level Full TimeIndia R11h ago
-
Head of Data Operations INR 1500K-5199KAWS Glue | Amazon Redshift | Amazon S3 | Data Modeling | LookMLLeadership development programs | Learning and development programs | Multicultural team environment | Professional growth | Remote workExecutive-level Full TimeIndia R11h ago
-
Manager Software Engineer - RLE INR 1800K-2500KAmazon Web Services | Applied AI | Backend architecture | CI/CD | Cloud platformEquity grant | Food Credit | Housing bonus | Medical insurance | Performance bonusMid-level Full TimeIndia12h ago