Lead Data Engineer
Tasks
- Build and maintain CI CD pipelines and automation frameworks
- Build scalable data pipelines and analytics frameworks
- Configure governed access using RBAC and service principals
- Design and develop cloud native data and business intelligence solutions
- Ensure interoperability across compute engines and cloud providers
- Implement infrastructure as code for data platform provisioning
- Implement multi cloud architecture across AWS and Azure
- Integrate Databricks Snowflake and cloud services
- Lead technical design and mentor engineers
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | AWS Glue | AWS IAM | AWS S3 | Access Control | Amazon EMR | Apache Iceberg | Automation | Azure AKS | Azure Databricks | CI/CD | Cloud Architecture | Cost Optimization | Data Access Control | Data Governance | Data Processing | Data access | Databricks | Delta Lake | Distributed Systems | FinOps | Infrastructure as Code | Multi-cloud | Multi-cloud architecture | Platform Observability | RBAC | Scalable Architecture | Service principals | Snowflake | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AWS | Airflow | DBT | Fine Tuning | Language ModelsBonuses | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, India R9h ago
-
AI/ML engineer - Associate Research Scientist INR 1500K-2500KAIOps | API Development | AWS | Anomaly Detection | AutomationContinuous learning and professional development | Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India9h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 4110139h ago
-
Efs Fcrm 169474 INR 1500K-2400KApache Spark | Azure DevOps | CI/CD | Data Partitioning | Data WarehousingMid-level Full TimeHyderabad, IND-TG, India10h ago
-
Lead Data Analyst – Business & Process INR 1800K-2700KAnalytics Platforms | Budgeting | CRM | Dashboarding | DashboardsCareer growth support | Joining support | Learning and development opportunities | Life Coverage | Maternity and paternity benefitsExecutive-level Full TimeHyderabad, TS, India12h ago
-
Senior Database Engineer - #3190 (Remote) INR 1500K-2700KAWS IAM | AWS KMS | AWS RDS | Amazon Aurora | BashOn-call rotation | Remote workSenior-level Full TimeChennai, India R13h ago
-
Software Engineer SRE (Site Reliability Engineer) INR 1600K-3000KAWS | Ansible | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, India Office (BANGALORE) R13h ago
-
Knowledge Graph Engineering Lead INR 3500K-5000KAgile | Amazon Neptune | CI/CD | Data Governance | Data LineageFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R14h ago
-
Mid-level Full TimeIN-TN-Chennai14h ago
-
Senior-level Full TimeIN-MH-Pune14h ago
-
Snr AI INR 2500K-5000KAI Search | Amazon SageMaker | Azure AI | Azure AI Search | Azure Machine LearningSenior-level Full TimeIN-HR-Gurgaon14h ago
-
GCP BigQuery,DevOps,Credit Card Domain/Associate Director, Data and Analytics Specialist INR 650K-900KApache Airflow | Apache Kafka | BigQuery | CI/CD | Cloud ComposerMid-level Full TimeHyderabad, Telangana, India R15h ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseSenior-level Full TimePune, Maharashtra, India16h ago
-
Lead Software Engineer - Python Full Stack, AI/ML INR 4000K-5000KAWS | Agile | Angular | Application Resiliency | Automated testingSenior-level Full TimeMumbai, Maharashtra, India16h ago
-
Senior-level Full Timecoimbatore, India16h ago
-
Digital Marketing Analyst INR 2500K-3380KAWS | Azure | Cloud platform | Customer Analytics | Data GovernanceSenior-level Full TimeChennai, Tamil Nadu, India17h ago
-
Senior Staff Engineer, Data Migration Lead INR 3000K-4000KAccess Control | Audit Trail | Cutover planning | Data Governance | Data ManagementSenior-level Full TimeRemote, India R17h ago
-
Senior-level Full TimeMumbai, Maharashtra, India18h ago
-
Data Analyst Customer Success Engineer INR 2500K-4064KA/B | A/B Testing | AI workflows | API Integration | AmplitudeClient Customer Interactions | Health insurance | Learning aids | Meal vouchersSenior-level Full TimeHYDERABAD, Telangana, India18h ago
-
AI Platform Engineer INR 3700K-5500KAPI Design | Agent Orchestration | Agent systems | Artificial Intelligence | CI/CDSenior-level Full TimeMumbai, India19h ago
-
Senior-level Full TimeMumbai, India19h ago
-
Software Engineer III - Python Developer + AWS + LLM / Gen AI INR 3500K-5000KAWS | Agile | Azure | CI/CD | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Software Engineering - Data, Lakehouse and AI Data Platform Engineer-Hyderabad-Associate INR 1500K-2500KApache Iceberg | Apache Spark | Avro | CI/CD | Cause analysisMid-level Full TimeHyderabad, Telangana, India20h ago
-
Agentic/AI engineers with Claude/code/LLM skills1 INR 3000K-5000KAWS | Agentic Workflows | Azure | CI/CD | ChromaSenior-level Full TimeNoida, Uttar Pradesh, India20h ago
-
Senior Data Engineer INR 3000K-4000KCI/CD | Cloud Storage | Column-Level Security | DBT | Data GovernanceHybrid work environment | Mentorship and growth opportunitiesSenior-level Full TimeChennai, India21h ago