Data Engineering Architect
Tasks
- Contribute to disaster recovery and failover planning
- Create Kubernetes deployment artifacts
- Create operational runbooks and on call readiness
- Define Docker containerization standards
- Define data contracts and domain data products
- Design Medallion data layers
- Design data ingestion patterns to SQL Server and Snowflake
- Develop dbt models and transformations
- Enhance ingestion and processing platform with robust configuration management
- Ensure lineage and reuse across teams
- Establish production observability logging metrics alerting
- Implement data modeling standards
- Implement incremental loading and CDC
- Implement security practices secrets management encryption
- Mentor engineers and lead knowledge transfer through documentation and code reviews
- Migrate VM workloads to Kubernetes
- Optimize container images and security best practices
- Own and evolve Snowflake target state data architecture
- Produce technical designs and architecture diagrams
- Review and document current architecture
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Azure Monitor | CDC | CI/CD | Cause analysis | DBT | Data Contracts | Data Modeling | Data Vault | Dimensional Modeling | Disaster Recovery | Docker | Encryption | Failover | Grafana | Helm | Helm Charts | Incremental loading | Kubernetes | Linux | Logging | Medallion | Metrics | Normalized modeling | Observability | Python | REST APIs | Root Cause Analysis | Root cause | SCD Type-2 | SOAP | SQL | SQL Server | Secrets management | SnapLogic | Snowflake | Technical documentation | Type 2)
Education
N/A
Related jobs
-
Mid-level Full TimeMumbai, Maharashtra, India18h ago
-
Associate Director- AI Engineer - Solution Architect INR 1800K-2500KAI Governance | Agent systems | App Service | Azure | Azure AppMid-level Full TimeBangalore, Karnataka, India22h ago
-
Senior-level Full TimeMumbai, Maharashtra, India1d ago
-
EY - GDS Consulting - AI And DATA -Snowflake Architect -Manager INR 3000K-4000KAgile | Batch Processing | Cloud Data | Cloud Data Warehouse | DBTCareer development | Coaching and feedback | Flexible work arrangementSenior-level Full TimeHyderabad, TG, IN, 5000811d ago
-
Amazon Redshift | Apache Airflow | Application Programming | Application Programming Interfaces | AzureSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Solutions Architect - Gen AI INR 2500K-5000KAgentic AI | BERT | Distributed Computing | Docker | Fine TuningSenior-level Full TimeIndia, Bengaluru1d ago
-
Associate Architect - Machine Learning Engineer INR 1800K-3000KAI Evaluation | Agentic AI | Benchmarking | Cloud Native | ContainerizationMid-level Full TimeIN KA Bengaluru, India1d ago
-
Data Architect, Master Data Management INR 2100K-2600KAPI Integration | Alation | Batch Processing | Cloud Data | Cloud Data ArchitectureFlexible work-life balance | Headspace app access | Hybrid work model | Mental health days | Retirement savingsSenior-level Full TimeIndia, Bengaluru, Karnataka R1d ago
-
Lead, Big Data Analytics & Engineering INR 3000K-4000KAWS | Apache Airflow | Apache NiFi | Azure | Azure DataSenior-level Full TimePune, India1d ago
-
AI Architect – Lilly Medicine Foundry (R5-6) INR 2486K-4500KA/B | A/B Testing | AWS | Artificial Intelligence | Audit LoggingSenior-level Full TimeIN: Lilly Hyderabad, India1d ago
-
Lead Data Architect - Databricks INR 1500K-2000KCloud Computing | Compliance | Data Architecture | Data Governance | Data ModelingSenior-level Full TimeIndia - Mumbai - Vikhroli East1d ago
-
Lead Data Architect - Snowflake INR 1500K-2040KData Architecture | Data Governance | Data Privacy | Data Quality | Data SecuritySenior-level Full TimeIndia - Mumbai - Vikhroli East1d ago
-
Senior Data Architect - Data Modeller INR 2520K-3380KCloud Computing | Data Architecture | Data Governance | Data Modeling | Data PrivacySenior-level Full TimeIndia - Mumbai - Vikhroli East1d ago
-
VP, AI Data Architect (L12) INR 3000K-4000KA/B | A/B Testing | AWS Glue | AWS Glue Data Catalog | AWS IAMSenior-level Full TimeHyderabad IN, India1d ago
-
API Design | AWS | Apache Spark | Auditability | AzureAccident insurance | Best in class leave policy | Certification sponsorship | Childcare assistance reimbursement | Employee assistance programSenior-level Full TimePune - Business Bay, India1d ago
-
Apache Airflow | Apache Spark | Azure Databricks | BigQuery | CI/CDFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India1d ago
-
Apache Airflow | Azure Databricks | BigQuery | CI/CD | Cloud ComposerFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeBengaluru Millenia, India1d ago
-
IN-Senior Associate_ Databricks Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2400K-3880KAuto Loader | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBengaluru Millenia, India1d ago
-
Apache Airflow | Apache Spark | Azure | BigQuery | Cloud ComposerFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India1d ago
-
Digital Next IA :: Manager - Gen AI INR 1800K-2500KAWS | AWS Bedrock | Agile | Azure | Azure OpenAIMid-level Full TimePune, Maharashtra, India1d ago
-
Data Engineer Architect. INR 1500K-2400KAPI Development | AWS | Agentic Engineering | Database optimization | FastAPISenior-level Full TimeIN-MH-Pune1d ago
-
AI Solutions Architect INR 3000K-5000KAPI Integration | Agentic AI | Enterprise Integration | LLM orchestration | Language ModelsSenior-level Full TimeNoida, Uttar Pradesh1d ago
-
Senior-level Full TimeGurugram, Haryana, India1d ago
-
Manager INR 1500K-2000KApache Airflow | Data Governance | Data Modeling | Data Quality | DatabricksMid-level Full TimeGurugram, Haryana, India1d ago
-
AI/ML | AWS | Azure | Azure Data | Azure Data FactoryFlexible working hours | Remote WorkingSenior-level Full TimeIndia R1d ago