Data Engineering Architect
Tasks
- Contribute to disaster recovery and failover planning
- Create Kubernetes deployment artifacts
- Create operational runbooks and on call readiness
- Define Docker containerization standards
- Define data contracts and domain data products
- Design Medallion data layers
- Design data ingestion patterns to SQL Server and Snowflake
- Develop dbt models and transformations
- Enhance ingestion and processing platform with robust configuration management
- Ensure lineage and reuse across teams
- Establish production observability logging metrics alerting
- Implement data modeling standards
- Implement incremental loading and CDC
- Implement security practices secrets management encryption
- Mentor engineers and lead knowledge transfer through documentation and code reviews
- Migrate VM workloads to Kubernetes
- Optimize container images and security best practices
- Own and evolve Snowflake target state data architecture
- Produce technical designs and architecture diagrams
- Review and document current architecture
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Azure Monitor | CDC | CI/CD | Cause analysis | DBT | Data Contracts | Data Modeling | Data Vault | Dimensional Modeling | Disaster Recovery | Docker | Encryption | Failover | Grafana | Helm | Helm Charts | Incremental loading | Kubernetes | Linux | Logging | Medallion | Metrics | Normalized modeling | Observability | Python | REST APIs | Root Cause Analysis | Root cause | SCD Type-2 | SOAP | SQL | SQL Server | Secrets management | SnapLogic | Snowflake | Technical documentation | Type 2)
Education
N/A
Related jobs
-
GCP & Databricks Manager INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud DataflowMid-level Full TimeBangalore, Karnataka, India7h ago
-
Senior-level Full TimeBengaluru, IN, 5601038h ago
-
Staff Engineer, Data Analytics Engineering INR 3000K-3380KAI Engineering | AWS | Azure | Azure Data | Azure Data LakeSenior-level Full TimeBengaluru, KA, India8h ago
-
Principal Engineer, Data Analytics Engineering INR 2500K-3900KAI Governance | API | Agent Orchestration | Agentic Workflows | ComplianceSenior-level Full TimeBengaluru, KA, India8h ago
-
Lead Engineer Data INR 2156K-2400KAgile methodology | Automation | Azure | Azure Data | Azure Data FactoryFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India17h ago
-
AI & Cloud Solutions Architect with Generative AI, MLOps, and Enterprise Architecture INR 2500K-4500KAWS | Agile | Archimate | Azure | CCPAFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India17h ago
-
AI and Cloud Solutions Architect with Generative AI, MLOps, and Enterprise Architecture INR 2500K-4500KAWS | Agile | Azure | CCPA | CI/CDFlexible work arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India17h ago
-
Sr. Staff, Data Science & Applied AI INR 2000K-5000KAWS | Agentic AI | Bedrock | CI/CD | ComplianceSenior-level Full TimeHyderabad, Office Level 3 & 4, …17h ago
-
Data Science Architect – Data Center AI Operations INR 2000K-2600KAIOps | Amazon SageMaker | Anomaly Detection | Azure Machine Learning | Cloud MLSenior-level Full TimeMaharashtra, Pune, India1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
BigQuery | Clustering | Data Governance | Data Modeling | Data VisualizationCollaborative team environment | Flexible schedules | Mission-driven work | Professional growth opportunities | Remote work flexibilitySenior-level Full TimeIndia1d ago
-
AWS | Application Design Patterns | Application design | Cloud Native | Data EngineeringSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
5068082-Manager INR 1500K-2000KAWS | Amazon Redshift | Azure | Azure Synapse | Cloud MigrationDynamic and inclusive work environment | Flexible work arrangements | Professional growth and developmentMid-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Data Science Engineer INR 1500K-2000KAgile | Apache Airflow | Automated testing | Azure | Cloud platformAnnual leave | Casual leave | Public holidays | Sick leaveMid-level Full TimeGurugram, India1d ago
-
Manager-KDNI MLOps Architect (Multi-Cloud) INR 2500K-3500KAWS | Azure | CI/CD | Cloud Architecture | Cloud platformSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Snowflake Solutions Architect INR 300K-400KAWS | Access Control | Azure | Cloud Architecture | Data GovernanceSenior-level Full TimePune, IN1d ago
-
AI Architect INR 2500K-4500KAWS | Azure | Cloud platform | Computer Vision | Deep learningFlexible work arrangements | Professional growth opportunitiesSenior-level Full TimeGurgaon, Haryana1d ago
-
Architect- Embedded Development/ AI and Robotics & Edge AI INR 2800K-4110KC# | C++ | CPU | Cross-compilation | DDSAccess to fitness clubs | Creche facility for working parents | Employee assistance program | Food and beverage vouchers | Health insuranceSenior-level Full TimeIND - India Tech Center1d ago
-
IN_Associate_AI Engineer_D&A_Advisory_Bangalore INR 2500K-4500KAWS | Amazon Aurora | Amazon RDS | Amazon SageMaker | AzureSenior-level Full TimeBengaluru Millenia, India1d ago
-
Manager, Data Engineer INR 950K-1250KCode review | Columnstore Indexes | Data Validation | Data pipeline | ETLMid-level Full TimePune, India1d ago
-
Data Engineering Lead Analyst - HIH - Evernorth INR 1200K-2000KAWS | Alation | Apache Airflow | Apache Spark | AuroraSenior-level Full TimeHIH - Hyderabad, India1d ago
-
Software Engineering Senior Analyst INR 2000K-3440KAPI Gateway | AWS | AWS Bedrock | AWS Glue | AgileSenior-level Full TimeIND Bengaluru, India1d ago
-
VP Lending Data Engineering & Analytics Technology INR 1500K-6000KAgile | Cassandra | Data Governance | Data Lineage | Data ModelingExecutive-level Full Time1/124, SHIVAJI GARDENS, MOONLI, India1d ago
-
AI & ML Architect INR 2500K-4200KAI Foundry | AI Search | Apache Spark | Azure AI | Azure AI Foundry401k matching | Dental insurance | Development and career opportunities | Health insurance | Recognition and rewardsSenior-level Full TimeIN Pune Pentagon Tower, India1d ago
-
IN_Associate_AI Engineer_D&A_Advisory_Bangalore INR 2500K-4500KAWS | AWS Bedrock | Amazon Aurora | Amazon RDS | Amazon SageMakerSenior-level Full TimeBengaluru Millenia, India1d ago