Data Engineering Architect
Tasks
- Contribute to disaster recovery and failover planning
- Create Kubernetes deployment artifacts
- Create operational runbooks and on call readiness
- Define Docker containerization standards
- Define data contracts and domain data products
- Design Medallion data layers
- Design data ingestion patterns to SQL Server and Snowflake
- Develop dbt models and transformations
- Enhance ingestion and processing platform with robust configuration management
- Ensure lineage and reuse across teams
- Establish production observability logging metrics alerting
- Implement data modeling standards
- Implement incremental loading and CDC
- Implement security practices secrets management encryption
- Mentor engineers and lead knowledge transfer through documentation and code reviews
- Migrate VM workloads to Kubernetes
- Optimize container images and security best practices
- Own and evolve Snowflake target state data architecture
- Produce technical designs and architecture diagrams
- Review and document current architecture
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Azure Monitor | CDC | CI/CD | Cause analysis | DBT | Data Contracts | Data Modeling | Data Vault | Dimensional Modeling | Disaster Recovery | Docker | Encryption | Failover | Grafana | Helm | Helm Charts | Incremental loading | Kubernetes | Linux | Logging | Medallion | Metrics | Normalized modeling | Observability | Python | REST APIs | Root Cause Analysis | Root cause | SCD Type-2 | SOAP | SQL | SQL Server | Secrets management | SnapLogic | Snowflake | Technical documentation | Type 2)
Education
N/A
Related jobs
-
Senior-level Full TimeHyderabad, India7h ago
-
Computer Scientist 2 ( Data Engineering + AI ) INR 2475K-3465KAWS | Apache Spark | Azure | CI/CD | DatabricksSenior-level Full TimeNoida, India R9h ago
-
Senior-level Full TimeIN-KA-Bangalore20h ago
-
DevOps Engineer INR 1500K-2500KAgile | Amazon Web Services | BI dashboarding | CI/CD | Cloud platformInternational collaboration | Occasional travel to EuropeMid-level Full TimePune, MH, India22h ago
-
Specialist - Data Engineering-Data Engineering INR 180K-200KAWS | Apache Kafka | Apache Spark | Data Modeling | Data QualityEntry-level Full TimeMumbai, Maharashtra, India22h ago
-
Senior Solutions Architect INR 3000K-4000KBackup and Recovery | C# | C++ | Cloud Native | Database performanceSenior-level Full TimeIndia23h ago
-
Data Analytics & Data Engineering Vice President INR 2000K-5800KAccess Control | Agile | Alteryx | Cloud Computing | ConfluenceExecutive-level Full TimeIndia1d ago
-
Solutions Architect: Data & AI - Public Sector INR 3000K-4000KAWS | Apache Spark | Azure | Big Data | CassandraSenior-level Full TimeDelhi, India1d ago
-
AWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseHybrid scheduleSenior-level Full TimeIND - Pune, Kalyani Nagar, India R1d ago
-
Principal Engineer - Java with Gen AI INR 2000K-3465KAgent Frameworks | Azure | Cloud Native | Concurrency | EmbeddingsSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Executive-level Full TimePune, Gera Commerzone SEZ, India1d ago
-
GRC Data Analyst Manager INR 945K-1500KAlerting | Automation | Cause analysis | Data Modeling | Data MonitoringMid-level Full TimeINDJZ03 - Pune - Weikfield IT …1d ago
-
Associate Director–Data Lake Operations INR 1500K-2700KADaM | AWS | Apache Spark | Big Data | CDISCMid-level Full TimeHyderabad, India1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
Data & AI Engineering Specialist INR 1000K-1820KAPI | Access Control | Amazon Web Services | Apache Airflow | Apache SparkHealthcare benefits | Hybrid work | Parental leave | Wellness programsMid-level Full TimeHyderabad, India1d ago
-
Manager - Data Science INR 1500K-3000KAirflow | CI | CI/CD | Dagster | Data QualityFlexible work options | Hybrid work environment | Professional development opportunities | Supportive leadersMid-level Full TimePune - Panchshil, India R1d ago
-
AI Solution Leader INR 2000K-3500KAPIs | Artificial Intelligence | CI/CD | CRM | Cloud ComputingCareer growth and professional development | Hybrid work flexibility | Training and certification supportSenior-level Full TimeHyderabad, IN1d ago
-
Global Data Science Architect INR 2000K-3300KAWS | Azure | Data Governance | Docker | GCPOnsite work schedule | Relocation support | Visa sponsorship not availableSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Sr. Delivery Solutions Architect INR 3000K-3900KData Architecture | Data and AI | Distributed Systems | Executive Communication | Program ManagementHybrid work | Travel 30 percentSenior-level Full TimeBengaluru, India1d ago
-
Sr. Delivery Solutions Architect INR 3000K-3900KData Architecture | Distributed Systems | Pre-sales | Program Management | Project ManagementHybrid work | Travel up to 30 percentSenior-level Full TimeMumbai, India1d ago
-
Assistant Manager-GDC INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeHyderabad, Telangana, India2d ago
-
AWS | Airflow | Azure | CI/CD | DBTSenior-level Full TimeBengaluru, KA, India2d ago
-
API Management | Azure Data | Azure Data Factory | Cloud Computing | Data FactoryInclusive collaborative global work environment | Remote friendly work arrangementsExecutive-level Full TimeIndia2d ago
-
Solution Architect (AWS, AI, Python) INR 3349K-5000KAI Agents | API Gateway | AWS | AWS CDK | AWS GlueDEI focus | Development opportunities | Reward and recognition | Volunteering opportunities | WellnessSenior-level Full TimeHyderabad, India2d ago
-
Senior AI Engineer – GIS Solutions (India) (Remote) INR 1800K-2800KAPI first | API-first design | AWS | ArcGIS Enterprise | ArcGIS JS APISenior-level Full TimeMaharashtra, Pune, India R2d ago