Lead Data Engineer / Data Architect
Tasks
- Build reusable data engineering frameworks
- Build scalable data pipelines
- Create data contracts
- Define data product standards
- Define enterprise data platform architecture
- Design data models
- Develop data platform capabilities for analytics
- Develop reference implementations
- Enable AI ML readiness
- Ensure security, privacy, and regulatory compliance
- Establish lakehouse standards
- Implement governance metadata and lineage
- Lead architecture governance
- Lead code reviews
- Lead design reviews
- Own enterprise data product lifecycle
- Partner with business stakeholders to deliver solutions
- Provide technical leadership and mentoring
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Asset bundles | Azure Bicep | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Monitor | CI/CD | Data Lake Storage Gen2 | Data Modeling | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | Entra ID | Infrastructure as Code | Key Vault | Log Analytics | Medallion Architecture | Microsoft Entra | Microsoft Entra ID | Microsoft Purview | Python | SQL | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Architect | Data Architect | Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior-level Full TimeBengaluru, KA, India7h ago
-
CDP Specialist (Treasure Data) INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | Big Data | CassandraMid-level Full TimeIN-KA-Bangalore9h ago
-
Data Engineer - AIML Data modeling INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | ElasticsearchMid-level Full TimeIN-AP-Hyderabad9h ago
-
Data Engineering - AIML Data Modeling - SSE INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | Dependency InjectionMid-level Full TimeIN-AP-Hyderabad9h ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India10h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India10h ago
-
AI Software Engineer INR 1500K-2500KAPI Development | AWS | Access Control | Agentic patterns | AuditabilityCompany bonus/profit share | Flexible work arrangements | Long service awards | Medical benefits | Mobile Phone ReimbursementMid-level Full TimeChennai, India10h ago
-
Accelerator hardware | C++ | Compiler Internals | Compiler optimization | Custom KernelsSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Data Engineer - Delivery INR 3000K-3900KAnalytics services | App Service | Azure Analytics | Azure Analytics Services | Azure AppSenior-level Full TimePune, MH, India11h ago
-
Team Member - IP, CE Data & Conv Core INR 2000K-2500KGenerative AI | HTML | Jira | Power BI | PythonSenior-level Full TimeNavi Mumbai, Maharashtra, India11h ago
-
AVP - QA Automation Engineer - IB Tech & CRM/ Analytics INR 3000K-4000KAWS | AWS Lambda | AWS RDS | Amazon Redshift | Amazon S3Executive-level Full TimePune, India12h ago
-
Product Engineering Specialist INR 2500K-5000KAI Foundry | AI Governance | AI Solution | AI Solution Architecture | AI platformsSenior-level Full TimePune, Maharashtra, India12h ago
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Senior-level Full TimeMumbai, India13h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R14h ago
-
Applied AI ML Associate Senior INR 1200K-2500KAI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India14h ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN15h ago
-
DE&A - Core - Cloud Data Engineering - AWS Data Engineering INR 3000K-4000KAWS | AWS Data | AWS Data Governance | AWS EC2 | Data GovernanceSenior-level Full TimePune, Maharashtra, India15h ago
-
Senior-level Full TimeBengaluru, Karnataka, India15h ago
-
Dir, Machine Learning Engrg Mgmt INR 3242K-4200KAlgorithms | Code optimization | Design Patterns | Java | Machine LearningFlexible work options | In-office work options | Remote work optionsSenior-level Full TimeHyderabad, India16h ago
-
Apprentice INR 300K-400KAPI | Automation | Data Quality | Generative AI | Language ModelsCareer development opportunities | Structured trainingEntry-level Apprenticeship Full TimeGurugram, HR, India16h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India16h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R17h ago
-
Platform Architecture System INR 2000K-5000KAgent systems | Agentforce | Apex | Data Ingestion | Data ModelingSenior-level Full TimePune, Maharashtra, India17h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN22h ago