Data Architect
Bengaluru, BDC6F, India
INR 2400K-3000K (estimate) Senior-level Full Time
Tasks
- Build Python and PySpark data transformation and validation
- Build secure observable DLT pipelines with expectations and medallion layering
- Configure Unity Catalog for access control audit logging and masking
- Create SQL dashboards for KPIs and pipeline health
- Create modular Databricks functions for transformation PII masking and validation
- Define data requirements and structure for applications
- Develop ETL ELT pipelines with Databricks technologies
- Implement ingestion patterns with Auto Loader checkpointing and schema evolution
- Integrate data access across domains and workspaces with lineage tracking
- Model and design application data structure storage and integration
- Package and deploy pipelines with Databricks Asset Bundles and CI CD
- Prepare Gen AI compatible datasets with vector embeddings and feature store
- Troubleshoot and optimize Databricks jobs for performance cost and SLA
- Use Power BI Tableau or Looker with Databricks via ODBC and JDBC
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Asset bundles | Auto Loader | Azure | CI/CD | Cloud Data | Cloud Data Engineering | DBT | DLT | DLT Expectations | Data Engineering | Data Modeling | Data Warehousing | Data orchestration | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Vector Search | Delta Lake | Delta Sharing | Feature Store | GCP | GitHub | GitLab | JDBC | Looker | MLflow | ODBC | PII masking | Performance optimization | Photon | Power BI | PySpark | Python | SQL | Serverless computing | Tableau | Unity Catalog | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Technical Architect - (Java,AWS) INR 3740K-6500KAWS | AWS Lambda | AWS Step Functions | Amazon ECS | Amazon EKSFamily wellbeing benefits | Health insurance | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India18h ago
-
Knowledge Graph Engineering Lead INR 3500K-5000KAgile | Amazon Neptune | CI/CD | Data Governance | Data LineageFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R19h ago
-
AI Solution Architect INR 4000K-6000KAI Ops | API Integration | Access Management | Agent Ops | Agent evaluationEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Vacation and holiday leaveSenior-level Full TimePUNE, MAHARASHTRA, India1d ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN1d ago
-
Amazon Web Services | Analytics Cloud | Apache Hadoop | Apache Spark | Big DataSenior-level Full TimeBangalore, IN, 5600661d ago
-
EY - GDS Consulting - AI And DATA -AI Architect - Manager INR 4000K-5449KAI Foundry | AWS Bedrock | Access Control | Agentic AI | Artificial IntelligenceCareer development | Coaching | Feedback | Flexible work arrangements | Training opportunitiesSenior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Technical Architect - Azure/AWS + Snowflake Job INR 1500K-2500KAWS | Agile | Apache Spark | Azure Data | Azure Data FactoryAgile work environment | Flexible work arrangements | Learning and developmentSenior-level Full TimeHyderabad, IN1d ago
-
IN-Manager_ Data Architect_D&A_Advisory_PAN India INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Kafka | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Vice President - Data Architect INR 3000K-4000KData Architecture | Data Dictionary | Data Flow | Data Glossary | Data GovernanceSenior-level Full TimePune, Gera Commerzone SEZ, India1d ago
-
Lead AI Platform & Automation Engineer - GCP, Vertex AI, IBM Watsonx, MLFlow, Terraform INR 2500K-5000KC++ | CI/CD | Cloud Security | Cloud platform | Computer VisionSenior-level Full TimeIN - TDC 1 (IN110), India1d ago
-
Architect - python, nodejs, AI/ML INR 3584K-6000KAKS | Asynchronous Communication | Azure | Azure Monitor | CI/CDSenior-level Full TimePrimary location: Noida, Uttar Pradesh1d ago
-
Deep Learning Performance Architect INR 2500K-5000KArchitecture simulation | C# | C++ | Debugging | GPU ComputingSenior-level Full TimeIndia, Bengaluru1d ago
-
Tech Lead - Data Solutions & Data Products INR 2000K-2700KAWS | Access Control | Alerting | Batch Processing | CI/CDEmployee assistance programme | Flexible schedule | Health insurance | Parental leave | Professional developmentSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …1d ago
-
Sr. Dir , Data and analytics Architecture INR 3000K-4000KAPI Design | AWS | Architecture Frameworks | Architecture governance | DBTSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …1d ago
-
AWS Data Architect INR 1500K-2700KAWS Glue | AWS Lambda | Amazon EMR | Amazon RDS | Amazon RedshiftSenior-level Full TimeBengaluru, India2d ago
-
Architect (Java, Kubernetes, AWS, Gen AI, Agentic AI) INR 3715K-5449KAPI Gateway | Advanced Analytics | AgenticAI | Amazon Web Services | Big DataFlexible work environment | Internal mobility | Volunteering opportunities | Well-being focus | Work-life balanceSenior-level Full TimeKA Bangalore, India3d ago
-
Agentic Data Delivery Lead INR 3000K-5000KAI Governance | AWS | Access Control | Agent systems | Apache HadoopSenior-level Full TimePune, Maharashtra, India3d ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R3d ago
-
Senior-level Full TimePune, MH, India4d ago
-
Mid-level Full TimeHyderabad, Telangana, India4d ago
-
Director-GTS - Build AI INR 1500K-6000KAWS | Adversarial Networks | Apache Kafka | Autogen | Autoregressive modelsExecutive-level Full TimeHyderabad, Telangana, India4d ago
-
Mid-level Full TimeHyderabad, Telangana, India4d ago
-
IN_Senior Manager_Enterprise AI Architect – GenAI & Agentic AI_Digital Integration_Advisory_Chennai INR 2000K-4800KAI Governance | AIOps | Autogen | Azure AI | Azure OpenAIFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeChennai - Menon Eternity, India4d ago
-
AWS Bedrock | AWS DynamoDB | Amazon Aurora | Amazon RDS | Amazon SageMakerSenior-level Full TimeBengaluru Millenia, India4d ago
-
AWS Bedrock | AWS Machine Learning | AWS Machine Learning Specialty | AWS Professional Solution Architect | Amazon RDSFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India4d ago