Lead Data Engineer / Data Architect
Tasks
- Build reusable data engineering frameworks
- Build scalable data pipelines
- Create data contracts
- Define data product standards
- Define enterprise data platform architecture
- Design data models
- Develop data platform capabilities for analytics
- Develop reference implementations
- Enable AI ML readiness
- Ensure security, privacy, and regulatory compliance
- Establish lakehouse standards
- Implement governance metadata and lineage
- Lead architecture governance
- Lead code reviews
- Lead design reviews
- Own enterprise data product lifecycle
- Partner with business stakeholders to deliver solutions
- Provide technical leadership and mentoring
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Asset bundles | Azure Bicep | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Key Vault | Azure Monitor | CI/CD | Data Lake Storage Gen2 | Data Modeling | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | Entra ID | Infrastructure as Code | Key Vault | Log Analytics | Medallion Architecture | Microsoft Entra | Microsoft Entra ID | Microsoft Purview | Python | SQL | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Architect | Data Architect | Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
GCP Data Engineer INR 1500K-2000KAnsible | Cloud Bigtable | Cloud SQL | Cloud Spanner | Cloud platformProfessional growthMid-level Full TimeBengaluru, Pune4h ago
-
AI Specialist (Technical) INR 1860K-3465KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeGurugram, HR, IN5h ago
-
Senior Robotics Engineer INR 1753K-2372KC++ | Java | Localization and mapping | MATLAB | Machine LearningFull Time Office Project Work | Relocation not provided | Travel for deployment and commissioningSenior-level Full TimeChennai, TN, IN5h ago
-
AI Specialist (ML & LLM) INR 2400K-4000KAI Search | Azure AI | Azure AI Search | Azure Functions | Azure Machine LearningMid-level Full TimeGurugram, HR, IN5h ago
-
AI Deployment Engineer INR 2000K-4800KCloud Architecture | Enterprise Architecture | Generative AI | JavaScript | Machine LearningHybrid work model | Relocation assistanceSenior-level Full TimeDelhi, India6h ago
-
AWS | AWS Machine Learning | Agent systems | Angular | AutogenSenior-level Full TimeChennai, TN, IN, 60003210h ago
-
AI Engineering INR 3584K-5000KAgentic Workflows | Audit Logging | Authentication | Authorization | CI/CDSenior-level Full TimeBangalore, KA, IN10h ago
-
Principal Engineer - - Generative AI Data & Analytics INR 3700K-4800KAI Observability | AIOps | Azure Data | Azure Data Engineer | Batch ProcessingSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India10h ago
-
Sr. Power BI Engineer - (SSRS & PySpark) INR 1632K-2500KPower BI | PySpark | SQL | SQL Server | SSRSSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Mid-level Full TimeBlock 1 DT, Chennai India10h ago
-
EY - GDS Consulting - AI And DATA - Snowflake plus AWS - Manager INR 1500K-2600KAI Engineering | API Integration | AWS Data | AWS Data Engineering | Amazon AthenaClient impact | Flexible Work N/A | Global career support | Inclusive culture | MentoringMid-level Full TimeKolkata, WB, IN, 70009110h ago
-
Senior-level Full TimeChennai, IN10h ago
-
Senior Data Engineer INR 3600K-4995KAmazon Redshift | Amazon Web Services | Apache Airflow | Batch Processing | DBTSenior-level Full TimeIndia R15h ago
-
Data Science Manager INR 1500K-2100KAWS | Adversarial Networks | Attribution Modeling | Azure | Cloud ComputingMid-level Full TimePune1d ago
-
Senior GIS Enginer INR 900K-2500KAPI Integration | ArcGIS | Coordinate systems | Data Transformation | Data cleaningSenior-level Full TimeHyderabad, TS, IN / Hyderabad, Telangana, …1d ago
-
Test Lead - Data Automation INR 1500K-2500KCase design | ETL | Manual Testing | Python | Regression testingSenior-level Full TimeIndia1d ago
-
Staff Engineer (Snowflake, Apache Kafka, Oracle, AWS Lambda) INR 1500K-2500KAWS EC2 | AWS IAM | AWS Lambda | AWS VPC | Access ManagementSenior-level Full TimeGurugram, India1d ago
-
Staff Engineer (Datadog Engineer) INR 2000K-4000KAmazon Web Services | Application Performance Monitoring | Application performance | Automation | Azure DevOpsSenior-level Full TimeHyderabad, India2d ago
-
Staff Engineer (AI Security and DevSecOps ) INR 2500K-5000KAI RMF | AWS | AWS Secrets | AWS Secrets Manager | Abuse detectionSenior-level Full TimeHyderabad, India2d ago
-
Senior Software Engineer (Universal Robots, Bangalore - India) INR 2475K-3500KAgile | C++ | CI/CD | Clean Code | Code reviewExposure to Cutting Edge Robotics Technology | Flexible working conditions | Health insurance | Inclusive work environment | Professional development opportunitiesSenior-level Full TimeBangalore, IN2d ago
-
Senior Software Engineer, Machine Learning INR 3264K-5400KA/B | A/B Testing | Aerospike | B testing | Bayesian analysisCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Flexible remote workSenior-level Full TimeBengaluru, India2d ago
-
Senior Software Engineer (Data Platform) INR 2475K-3500KAWS | Airflow | Apache Flink | Apache Hadoop | Apache HiveCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Healthcare benefitsSenior-level Full TimeBengaluru, India2d ago
-
Senior Cloud Storage Engineer – NetApp CVO on GCP, AVP INR 2755K-3500KAutomation | CI/CD | Cloud Security | Cloud platform | Cloud volumes ONTAPAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Employee assistance program | Gender neutral parental leaveSenior-level Full TimePune - Business Bay, India2d ago
-
Mid-level Full TimePune, India2d ago
-
Senior Software Engineer INR 2000K-2700KAgile | Cloud services | Code review | Data Modeling | Data WarehousingSenior-level Full TimePune, India2d ago