Senior Technical Architect, Data Engineering
Tasks
- Build data pipelines on Snowflake
- Create repeatable ETL processes and documentation
- Design and implement data ingestion and transformation pipelines using Apache NiFi
- Design lakehouse architectures using Iceberg
- Design streaming data ingestion and processing
- Develop testing strategy and plan
- Lead cloud migrations onto Snowflake
- Optimize Snowflake for performance and cost
- Outline Spark Scala and Cloudera environment architecture
- Run workshops and design sessions with stakeholders
- Troubleshoot migration and implementation issues
Perks/Benefits
Skills/Tech-stack
Apache Hudi | Apache Iceberg | Apache NiFi | Apache Spark | Data Warehousing | Delta Lake | HBase | Kafka | Lakehouse Architecture | ML Ops | Machine Learning | Prompt engineering | PySpark | Python | REST API | Scala | Shell Scripting | Spark Streaming | Streaming Data
Education
Related jobs
-
Senior Data Architect INR 1500K-2500KAI/ML | AWS | AWS Certified | AWS Certified Data Analytics | AWS Certified Data Analytics Specialty401k | Café | Fitness Center | Health insurance | Recreational facilitiesSenior-level Full TimeBengaluru, KA, India6h ago
-
Data Architect & Delivery Lead INR 3600K-5400KAgile | Airflow | Batch Architecture | BigQuery | Canonical ModelingHybrid workSenior-level Full TimeHyderabad, India R2d ago
-
Senior-level Full TimeNoida,Uttar Pradesh,India3d ago
-
Solutions Architect INR 3000K-4000KADLS | AWS | AWS Data | AWS Data Migration | AWS Data Migration ServicesMentoring and coaching | Ownership culture | Professional development training and mentoring | Remote-first cultureSenior-level Full TimeIndia - Remote R3d ago
-
Senior-level Full TimeIndia, Telangana, Hyderabad; India, Karnataka, Bangalore; …3d ago
-
Principal Digital Architect INR 2500K-5000KAgentic architecture | Artificial Intelligence | CI/CD | Cloud Computing | Data ArchitectureOnsite work 5 days a week | Relocation availableSenior-level Full TimeChennai, Tamil Nadu, India3d ago
-
Senior Staff Solution Architect - AI & Cloud INR 3000K-5000KAWS | AWS CDK | AWS CloudFormation | AWS Glue | AWS Step FunctionsSenior-level Full TimeIND19-01-Bengaluru-EPIP 122 (Phase II), India R3d ago
-
AI Architect - Modern AI Applications INR 3000K-4680KAgent Orchestration | Agent communication | Agent to Agent | Agent-to-Agent Communication | Agentic AISenior-level Full TimeIN, BANGALORE, India3d ago
-
Snowflake Data Lead INR 4000K-4720KAWS | Agile | Analytical Functions | CI/CD | DBTFlexible work arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimePune - Client Location, India3d ago
-
Senior-level Full TimeBangalore, KA, IN R3d ago
-
Databricks - Principal Data Engineer INR 2400K-4200KAWS | Access Control | Apache Kafka | Attribute modeling | AzureSenior-level Full TimeHyderabad, TG, IN R3d ago
-
Principal Digital Architect - Generative AI INR 2500K-5000KAgentic Architectures | CI/CD | Cloud Computing | Data Architecture | Distributed SystemsOnsite work five days per week | Relocation assistanceSenior-level Full TimeBangalore, Karnataka, India3d ago
-
GenAI LLM Python/Senior Associate Director, Software Engineering INR 2000K-4000KAPI Development | AWS | Agent systems | Agentic Workflows | AzureFlexible working | Professional developmentMid-level Full TimePune, Maharashtra, India R3d ago
-
AI Ready | AI Ready Data Platform | AI-Ready Data | Data Architecture | Data GovernanceCompany-sponsored team events | Flexible time off | In-office work | Wellness resourcesSenior-level Full TimeBangalore, India4d ago
-
Data Architect II INR 2000K-4000KAnalytical processing | Cassandra | Compliance | DB2 | Data GovernanceSenior-level Full TimeGurugram, HR, India4d ago
-
Solutions Architect INR 2000K-3000KAWS | Airflow | Apache Kafka | Apache Spark | AzureBroadband reimbursement | Continuous learning opportunities | Medical insurance | Paid certifications | Personal accident insuranceSenior-level Full TimeBangalore4d ago
-
Senior Manager- AI Engineering INR 2500K-4580KAWS | Async Processing | Automated testing | CI/CD | Container OrchestrationSenior-level Full TimeBengaluru Office, India4d ago
-
Senior-level Full TimePune, India4d ago
-
Senior Data Architect – Agentic AI Solutions INR 2500K-4800KAWS | Azure | Context Layer | Data Architecture | Data GovernanceSenior-level Full TimeECP01 - E City Park, (ECP01), …4d ago
-
ServiceNow Data Architect - Vice President INR 1647K-2500KAutomation | BI platforms | CMDB | CSDM | Cloud ArchitectureEducational support | Employee networks | Flexible work programs | Matching gift programs | Medical insuranceSenior-level Full TimeBangalore, India4d ago
-
Senior Data Architect – Agentic AI Solutions INR 2500K-4800KAI Solution | AI solution design | Azure | Context Layer | Data ArchitectureSenior-level Full TimeECP01 - E City Park, (ECP01), …4d ago
-
Senior-level Full TimePune, Gera Commerzone SEZ, India4d ago
-
ESI Central BI 169577 INR 1971K-3000KActive Directory | Agile | Azure Active Directory | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, IND-TG, India4d ago
-
Senior AI Architect INR 2000K-5000K.NET | AI Foundry | AI Governance | AI Security | API IntegrationSenior-level Full TimeChennai, India5d ago
-
Solutions Architect - Core FSI INR 2000K-2800KAWS | Apache Spark | Azure | Big Data | CassandraHybrid work | Travel for customer visitsSenior-level Full TimeMumbai, India5d ago