Senior Technical Architect, Data Engineering
Tasks
- Build data pipelines on Snowflake
- Create repeatable ETL processes and documentation
- Design and implement data ingestion and transformation pipelines using Apache NiFi
- Design lakehouse architectures using Iceberg
- Design streaming data ingestion and processing
- Develop testing strategy and plan
- Lead cloud migrations onto Snowflake
- Optimize Snowflake for performance and cost
- Outline Spark Scala and Cloudera environment architecture
- Run workshops and design sessions with stakeholders
- Troubleshoot migration and implementation issues
Perks/Benefits
Skills/Tech-stack
Apache Hudi | Apache Iceberg | Apache NiFi | Apache Spark | Data Warehousing | Delta Lake | HBase | Kafka | Lakehouse Architecture | ML Ops | Machine Learning | Prompt engineering | PySpark | Python | REST API | Scala | Shell Scripting | Spark Streaming | Streaming Data
Education
Related jobs
-
AI Architect INR 3000K-5000KAPIs | Artificial Intelligence | Cloud Computing | Data Management | Data integrationSenior-level Full TimeMumbai (ex Bombay), IN13h ago
-
Architect INR 2000K-5000KAzure Cognitive | Azure Cognitive Search | Azure Form Recognizer | Azure OpenAI | Azure SQLSenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN13h ago
-
Staff Solutions Architect - AI/ML INR 3000K-4580KAI Governance | APIs | AWS | Azure | Computer VisionSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
Data Analyst - Data Architect with SAP SD / OTC (Snowflake, DBT) INR 2000K-2500KBusiness Intelligence | DBT | Data Integrity | Data Quality | Data VisualizationSenior-level Full TimeBangalore - Karnataka - India23h ago
-
Senior Specialist - AI Strategy (Mobility) INR 3000K-5000KAgentic AI | Agile delivery | Anomaly Detection | Artificial Intelligence | Cloud ArchitectureSenior-level Full TimePune, Maharashtra, IND, 411013 R1d ago
-
Data Ontology Architect INR 2500K-4500KAccess Control | Amazon Neptune | Amazon Redshift | Apache Airflow | Apache SparkSenior-level Full TimeGurugram, Haryana, India1d ago
-
Power Platform AI-Architect INR 2500K-5000KAI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI SearchSenior-level Full TimeINDIA - MUMBAI - BIRLASOFT OFFICE, …1d ago
-
Lead AI Architect INR 2500K-5000KAPI Architecture | Agent systems | Autogen | Azure | CI/CDHybrid work | Mentorship opportunities | Technical leadershipSenior-level Full TimeDGS India - Mumbai - Thane …1d ago
-
Custom Software Engineer INR 2500K-5000KAI Foundry | AI Governance | AI Services | AI architecture | Agent systemsSenior-level Full TimeBengaluru, BDC7A, India1d ago
-
Senior Data Architect INR 250KAnalysis Services | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsCollaborative community | Inclusive culture | Learning platform access | Mentorship | Professional certifications accessSenior-level Full TimePune, IN1d ago
-
Data Engineer Architect INR 250KAWS | Access Control | Apache Spark | Azure | Cloud platformElder care | Flexible work hours | Health checks | Hybrid work model | Insurance with top-upsSenior-level Full TimeBangalore, IN1d ago
-
Amazon Web Services | Automation | Azure | CI/CD | Cloud platformAccess to digital learning platform | Elder care | Flexible work hours | Health checks | Hybrid work modelSenior-level Full TimeBangalore, IN1d ago
-
Data Architect Sr. Advisor INR 2520K-3380KAI Studio | Azure AI | Azure AI Studio | Azure Cosmos | Azure Cosmos DBSenior-level Full TimeNoida, UP, IN2d ago
-
Agentic AI Architect (m/f/d) INR 2500K-5000KAI Foundry | Autogen | Azure AI | Azure AI Foundry | Azure FunctionsCareer development | Flexible working models | Inclusive work environment | International networkingSenior-level Full TimeHyderabad, IN3d ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2000K-3500KActive Directory | Authentication | Authorization | Azure Active Directory | Azure DatabricksCareer development | Flexible working models | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN3d ago
-
Agile methodologies | Apache Kafka | Azure Architecture | Azure Cognitive | Azure Cognitive ServicesCareer development opportunities | Coaching and feedback | Flexible work arrangementsSenior-level Full TimeKolkata, WB, IN, 7000913d ago
-
Lead Application & Product Architect INR 2500K-5000KAI Governance | API Integration | Agent Orchestration | Agent systems | Azure AISenior-level Full TimeIND-Pune-Smartworks, India3d ago
-
Large Language Model Architect INR 2500K-5000KAPI Integration | Agents SDK | CI/CD | Cloud deployment | ContainersSenior-level Full TimeBengaluru, BDC14A, India3d ago
-
Enterprise AI Architect INR 4000K-5500KAI Governance | AWS Bedrock | Access Management | Architecture Decision | Architecture Decision RecordsSenior-level Full TimeBangalore, India4d ago
-
Lead Software Engineer - Lead Data Architect INR 3000K-5000KAWS | CI/CD | Cassandra | Data Governance | Data LineageSenior-level Full TimeMumbai, Maharashtra, India4d ago
-
Azure DB Architect - Migration - R01531206 INR 2000K-2800KAzure | Azure Kubernetes | Azure Kubernetes Service | Backup/Restore | BashSenior-level Full TimeBangalore, Karnataka, India4d ago
-
Sr. Data Architect (Databricks) INR 1500K-2500KAWS | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeGDC Financial District, India4d ago
-
Speech Architect INR 2500K-5000KAgile | Android Automotive | Android Automotive OS | Automatic Speech Recognition | Automotive OSSenior-level Full TimeBangalore, IN4d ago
-
AI Solutions Architect (Presales & Delivery)-BK INR 2500K-5000K.NET | AI Agents | AI Foundry | AWS | AWS BedrockSenior-level Full TimeBengaluru, Karnataka, India4d ago
-
AI Solutions Architect (Presales & Delivery) INR 2500K-5000K.NET | AI Agents | AI Foundry | API Integration | AWS BedrockSenior-level Full TimeBengaluru, Karnataka, India4d ago