Senior Technical Architect, Data Engineering
Tasks
- Build data pipelines on Snowflake
- Create repeatable ETL processes and documentation
- Design and implement data ingestion and transformation pipelines using Apache NiFi
- Design lakehouse architectures using Iceberg
- Design streaming data ingestion and processing
- Develop testing strategy and plan
- Lead cloud migrations onto Snowflake
- Optimize Snowflake for performance and cost
- Outline Spark Scala and Cloudera environment architecture
- Run workshops and design sessions with stakeholders
- Troubleshoot migration and implementation issues
Perks/Benefits
Skills/Tech-stack
Apache Hudi | Apache Iceberg | Apache NiFi | Apache Spark | Data Warehousing | Delta Lake | HBase | Kafka | Lakehouse Architecture | ML Ops | Machine Learning | Prompt engineering | PySpark | Python | REST API | Scala | Shell Scripting | Spark Streaming | Streaming Data
Education
Related jobs
-
Solution Architect_Data Science INR 3500K-5000KAI Search | API Management | Access Management | Agentic AI | AutogenSenior-level Full TimeHyderabad, IN, 50008110h ago
-
Data Architect INR 1500K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full TimeBengaluru, KA, India10h ago
-
Field CTO – Analytics & AI (India, Remote) INR 3000K-4000KAgentic Workloads | Architecture Design | Data Warehousing | Data platform | EmbeddingsHealth and wellness resources | Remote work | Wellness Fridays | Wellness programSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India; … R11h ago
-
Senior-level Full TimeBangalore, India R15h ago
-
Technical Architect - (Java,AWS) INR 3740K-6500KAWS | AWS Lambda | AWS Step Functions | Amazon ECS | Amazon EKSFamily wellbeing benefits | Health insurance | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India1d ago
-
Knowledge Graph Engineering Lead INR 3500K-5000KAgile | Amazon Neptune | CI/CD | Data Governance | Data LineageFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
Senior / Principal Technical Architect, AI/ML INR 1500K-3000KAWS | Azure | ETL | Feature Engineering | GCPSenior-level Full TimeIN-Pune1d ago
-
AI Solution Architect INR 4000K-6000KAI Ops | API Integration | Access Management | Agent Ops | Agent evaluationEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Vacation and holiday leaveSenior-level Full TimePUNE, MAHARASHTRA, India1d ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN1d ago
-
Apache Spark | Apache Spark Structured Streaming | Azure Data | Azure Data Factory | Azure Data LakeCollaborative international team setup | Continuous learning and upskilling | Fully remote workSenior-level Full TimeIndia R1d ago
-
Amazon Web Services | Analytics Cloud | Apache Hadoop | Apache Spark | Big DataSenior-level Full TimeBangalore, IN, 5600661d ago
-
EY - GDS Consulting - AI And DATA -AI Architect - Manager INR 4000K-5449KAI Foundry | AWS Bedrock | Access Control | Agentic AI | Artificial IntelligenceCareer development | Coaching | Feedback | Flexible work arrangements | Training opportunitiesSenior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Technical Architect - Azure/AWS + Snowflake Job INR 1500K-2500KAWS | Agile | Apache Spark | Azure Data | Azure Data FactoryAgile work environment | Flexible work arrangements | Learning and developmentSenior-level Full TimeHyderabad, IN1d ago
-
IN-Manager_ Data Architect_D&A_Advisory_PAN India INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Kafka | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Lead AI Platform & Automation Engineer - GCP, Vertex AI, IBM Watsonx, MLFlow, Terraform INR 2500K-5000KC++ | CI/CD | Cloud Security | Cloud platform | Computer VisionSenior-level Full TimeIN - TDC 1 (IN110), India1d ago
-
Architect - python, nodejs, AI/ML INR 3584K-6000KAKS | Asynchronous Communication | Azure | Azure Monitor | CI/CDSenior-level Full TimePrimary location: Noida, Uttar Pradesh1d ago
-
Deep Learning Performance Architect INR 2500K-5000KArchitecture simulation | C# | C++ | Debugging | GPU ComputingSenior-level Full TimeIndia, Bengaluru1d ago
-
Tech Lead - Data Solutions & Data Products INR 2000K-2700KAWS | Access Control | Alerting | Batch Processing | CI/CDEmployee assistance programme | Flexible schedule | Health insurance | Parental leave | Professional developmentSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …1d ago
-
Sr. Dir , Data and analytics Architecture INR 3000K-4000KAPI Design | AWS | Architecture Frameworks | Architecture governance | DBTSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …1d ago
-
Architect - Machine Learning (MLOps Specialist) INR 4000K-5500KAPI Gateway | AWS | AWS Lambda | Airflow | Amazon APISenior-level Full TimeIN KA Bengaluru, India1d ago
-
AWS Data Architect INR 1500K-2700KAWS Glue | AWS Lambda | Amazon EMR | Amazon RDS | Amazon RedshiftSenior-level Full TimeBengaluru, India2d ago
-
Senior AI/ML Engineer (Gen AI Specialist) INR 3000K-5500KAI Foundry | AI Observability | API Integration | AWS Bedrock | Agentic AICareer development opportunities | Comprehensive benefits | Inclusion | MentorshipSenior-level Full TimePrimary location: Bengaluru, Karnataka2d ago
-
Senior AI Solution Architect INR 2500K-5000KAgent Orchestration | Agent systems | Agentic AI | Amazon Web Services | Bias detectionSenior-level Full TimeBengaluru, Karnataka, IND3d ago
-
Agentic Data Delivery Lead INR 3000K-5000KAI Governance | AWS | Access Control | Agent systems | Apache HadoopSenior-level Full TimePune, Maharashtra, India4d ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R4d ago