Lead Data Engineer
Tasks
- Build and maintain CI CD pipelines and automation frameworks
- Build scalable data pipelines and analytics frameworks
- Configure governed access using RBAC and service principals
- Design and develop cloud native data and business intelligence solutions
- Ensure interoperability across compute engines and cloud providers
- Implement infrastructure as code for data platform provisioning
- Implement multi cloud architecture across AWS and Azure
- Integrate Databricks Snowflake and cloud services
- Lead technical design and mentor engineers
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | AWS Glue | AWS IAM | AWS S3 | Access Control | Amazon EMR | Apache Iceberg | Automation | Azure AKS | Azure Databricks | CI/CD | Cloud Architecture | Cost Optimization | Data Access Control | Data Governance | Data Processing | Data access | Databricks | Delta Lake | Distributed Systems | FinOps | Infrastructure as Code | Multi-cloud | Multi-cloud architecture | Platform Observability | RBAC | Scalable Architecture | Service principals | Snowflake | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior-level Full TimePune, India4h ago
-
AWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamFree games | Hybrid work | Learning and growth opportunities | Medical insurance | Mental health supportEntry-level Full Time地点：Hyderabad, Telangana, India8h ago
-
Senior-level Full TimeIN-AP-Hyderabad8h ago
-
Senior-level Full TimeIN-KA-Bangalore8h ago
-
Senior-level Full TimeIN-TN-Chennai8h ago
-
Mid-level Full TimeLocations: Hyderabad, Telangana, India8h ago
-
AWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache AirflowCareer growth opportunities | Complimentary games | Family leave | Healthcare coverage | Mental wellbeing supportEntry-level Full TimeLocations: Hyderabad, Telangana, India8h ago
-
GBM - Public Dept-Bengaluru-Associate-Quantitative Engineering INR 1200K-2200KAutomation | C++ | Derivatives pricing | Equity Derivatives | Equity swapsMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Associate Distinguished Engineer (Data Governance Framework, Data Catalog Implementation) INR 1300K-2000KBusiness glossary | Compliance | Data Architecture | Data Cataloging | Data ClassificationAwareness sessions | Continuous learning opportunities | Training programsMid-level Full TimeRemote, India R9h ago
-
Staff Software Engineer, AI/ML and Moma Agentic INR 2500K-5000KArtificial Intelligence | C# | C++ | Database technologies | Distributed SystemsMentorshipSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Senior Staff Software Engineer, Google Cloud Storage INR 3200K-4000KArtificial Intelligence | Benchmarking | C++ | Cloud Storage | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Apache Spark | Azure | Cloud Computing | Cloud platformSenior-level Full TimeNoida, Uttar Pradesh, India10h ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Apache NiFi | Audit Logging | BigQueryFlexible working | Opportunities for professional developmentSenior-level Full TimePune, Maharashtra, India R10h ago
-
Senior Manager of Software Engineering Analytics Platform INR 3000K-5000KAgile | Artificial Intelligence | CI/CD | Cloud Native | DatabricksSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Senior Software Engineer INR 2475K-5000K.NET | Agile | Artificial Intelligence | Azure Functions | Cloud servicesSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad11h ago
-
Senior-level Full TimeHyderabad, TS, India11h ago
-
Software Engineer III - Python, AI ML, Cloud INR 3500K-5500KAgentic Frameworks | Amazon Web Services | Apache Airflow | Automated testing | AzureSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Senior-level Full TimeHyderabad, Telangana, India12h ago
-
Mid-level Full TimeGurgaon, Haryana, India13h ago
-
Software Engineer II - UI + Python Developer + AI / ML INR 2500K-4000KAWS | Agile | CI/CD | CSS | HTMLMid-level Full TimeMumbai, Maharashtra, India13h ago
-
Data Engineer Advisor INR 3200K-4200KAlerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, TG, IN14h ago
-
Associate Distinguished Engineer (Agentic AI Architect) INR 1500K-3000KAI Governance | AI architecture | AI orchestration | APIs | AWSMid-level Full TimeIndia, India14h ago
-
Senior-level Full Timecoimbatore, India15h ago
-
Senior-level Full Timebangalore, India15h ago
-
Senior-level Full TimeMumbai, Maharashtra, India15h ago