Bigdata Architect

Maharashtra, Pune, India

⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️

Codvo.ai

Codvo AI delivers strategic enterprise solutions that transform your data into measurable value. We help businesses accelerate growth through custom AI implementations that adapt and scale with your needs.

View all jobs at Codvo.ai

Apply now Apply later

Job Title: Big Data Architect / Databricks Architect
Company Overview: At Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day. We continue to expand our digital strategy, design, architecture, and product management capabilities to offer expertise, outside-the-box thinking, and measurable results.
 The RoleWe are seeking an experienced Big Data Architect with a specialization in Databricks to design the sophisticated data solutions that drive business value for our enterprise clients and power our internal AI products. You will be responsible for architecting scalable, high-performance data lakehouse platforms and end-to-end data pipelines. You will be the go-to expert for modern data architecture in a cloud-first world.Key Responsibilities
  • Architectural Design: Design and document robust, end-to-end big data solutions on cloud platforms (AWS, Azure, GCP), with a strong focus on the Databricks Lakehouse Platform.
  • Technical Leadership: Provide technical guidance and oversight to data engineering teams on best practices for data ingestion (batch and streaming), transformation (ETL/ELT), and processing using Spark.
  • Data Modeling & Governance: Design and implement effective data models (e.g., Star Schema, Data Vault) and establish data governance policies for data quality, security, and compliance within the lakehouse.
  • Technology Selection & Evaluation: Evaluate and recommend appropriate data technologies, tools, and frameworks (e.g., workflow orchestrators, data quality tools) to meet project requirements.
  • Stakeholder Collaboration: Work closely with business analysts, data scientists, and client stakeholders to translate complex business requirements into tangible technical architecture.
  • Proof of Concepts: Lead and build Proof of Concepts (PoCs) to validate architectural approaches and new technologies in the big data and AI space.
Required Qualifications & Skills
  • Experience: 10+ years of experience in data engineering, data warehousing, or software engineering, with at least 4+ years in a dedicated Data Architect role.
  • Core Technology Expertise: Deep, hands-on architectural and implementation expertise with Apache Spark and the Databricks platform (including Delta Lake, Unity Catalog, and Structured Streaming) is mandatory.
  • Cloud Proficiency: Proven experience architecting and deploying data solutions on at least one major cloud provider (AWS, Azure, or GCP). Deep familiarity with cloud storage (S3, ADLS Gen2) and data services (Glue, Azure Data Factory) is required.
  • Programming & SQL: Strong proficiency in Python or Scala for data processing and expert-level SQL skills.
  • AI/ML Acumen: Strong understanding of modern AI concepts, including Large Language Models (LLMs), Retrieval Augmented Generation (RAG), and agentic architectures. Experience designing systems that incorporate AI/ML is crucial.
  • Data Concepts: In-depth knowledge of data warehousing concepts, data lake architecture, and modern Lakehouse patterns.
Location - Remote(India)Time- 2:30-11:30PM
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Architecture AWS Azure Big Data Databricks Data governance Data pipelines Data quality Data Warehousing ELT Engineering ETL GCP LLMs Machine Learning Pipelines Python RAG Scala Security Spark SQL Streaming

Perks/benefits: Startup environment

Region: Asia/Pacific
Country: India

More jobs like this