Data Architect
Bengaluru, BDC6F, India
INR 2400K-3000K (estimate) Senior-level Full Time
Tasks
- Build ELT pipelines
- Build ETL pipelines
- Build SQL dashboards for KPIs
- Build secure DLT pipelines
- Configure data catalog and schemas
- Define data requirements
- Deploy pipelines using CI/CD
- Design data integration
- Design data storage architecture
- Develop data transformations
- Enable audit logging
- Enable data lineage tracking
- Ensure cost efficiency and SLA reliability
- Implement PII masking
- Implement data validation logic
- Implement ingestion patterns with Auto Loader
- Implement medallion layering
- Index with vector search
- Integrate reporting with Looker
- Integrate reporting with Power BI
- Integrate reporting with Tableau
- Manage vector embeddings
- Model data structures
- Package pipelines with asset bundles
- Prepare Gen AI compatible datasets
- Set up access controls
- Troubleshoot and optimize jobs
- Tune performance using Photon engine
- Use feature store
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Apache Kafka | Asset bundles | Auto Loader | Azure | CI/CD | DLT | DLT Expectations | Data Modeling | Data Warehousing | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Vector Search | Delta Lake | Delta Sharing | Feature Store | GCP | GitHub | GitHub Actions | GitLab | GitLab CI | Hadoop | Hive | JDBC | Looker | MLflow | ODBC | Performance optimization | Photon | Power BI | PySpark | Python | SQL | Serverless computing | Spark | Tableau | Unity Catalog | Unity Catalog External Locations | Unity Catalog Volumes | Vector Search
Education
N/A
Roles
Related jobs
-
AI Software Architect INR 3000K-5000KAI Search | Agentic AI | Azure | Azure AI | Azure AI SearchCareer development | Hybrid working | Professional mentorshipSenior-level Full TimeBengaluru, KA, India16h ago
-
Senior-level Full TimePune, Maharashtra, India22h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeIndia1d ago
-
Senior Data Architect INR 1500K-2500KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru, India1d ago
-
Solution Architect_Data Science INR 3500K-5000KAI Search | API Management | Access Management | Agentic AI | AutogenSenior-level Full TimeHyderabad, IN, 5000811d ago
-
Data Architect INR 1500K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full TimeBengaluru, KA, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Field CTO – Analytics & AI (India, Remote) INR 3000K-4000KAgentic Workloads | Architecture Design | Data Warehousing | Data platform | EmbeddingsHealth and wellness resources | Remote work | Wellness Fridays | Wellness programSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India; … R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Data Architect INR 1500K-2400KCloud Data | Cloud Data Platforms | Data Architecture | Data Modeling | Data WarehouseSenior-level Full TimeChennai, CDC5A, India1d ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Dataverse | Azure FunctionsSenior-level Full TimePune, India1d ago
-
Senior-level Full TimeHyderabad, Telangana, India1d ago
-
Architect/Lead Architect INR 3500K-4500KAPI Integration | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeBengaluru, India1d ago
-
API Development | API Management | Azure API | Azure API Management | Azure CognitiveFlexibility programs | Inclusive benefits | Mentorship | Training workshops | Wellbeing supportSenior-level Full TimePune, India1d ago
-
AI Safety | AI Search | AWS Bedrock | Agentic AI | Anthropic ClaudeSenior-level Full TimeHyderabad, India1d ago
-
Lead Digital Architect INR 1500K-3000KAI | API Gateway | AWS | AWS RDS | AWS RDS PostgreSQLEqual opportunity employer | Onsite work 5 days per week | Relocation supportSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Automation and AI Solutions Lead INR 3000K-4000KAWS AgentCore | AWS Bedrock | Amazon S3 | CI/CD | ClaudeEmployee incentive programs | Flexible vacation | Headspace access | Hybrid work model | Mental health daysSenior-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
Technical Architect - (Java,AWS) INR 3740K-6500KAWS | AWS Lambda | AWS Step Functions | Amazon ECS | Amazon EKSFamily wellbeing benefits | Health insurance | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India1d ago
-
Solution Architect – Data & AI Solutions INR 3000K-5000KABAC | API Gateway | AWS Glue | AWS Lake Formation | Amazon RedshiftSenior-level Full TimeIndia1d ago
-
Knowledge Graph Engineering Lead INR 3500K-5000KAgile | Amazon Neptune | CI/CD | Data Governance | Data LineageFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
Senior Technical Architect, Data Engineering INR 1500K-2500KApache Hudi | Apache Iceberg | Apache NiFi | Apache Spark | Data WarehousingKnowledge transfer support | Travel opportunities | Workshops with customersSenior-level Full TimeIN-Pune1d ago
-
Senior / Principal Technical Architect, AI/ML INR 1500K-3000KAWS | Azure | ETL | Feature Engineering | GCPSenior-level Full TimeIN-Pune1d ago
-
AI Solution Architect INR 4000K-6000KAI Ops | API Integration | Access Management | Agent Ops | Agent evaluationEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Vacation and holiday leaveSenior-level Full TimePUNE, MAHARASHTRA, India2d ago
-
Salesforce Power BI / Databricks Architect (m/f/d) INR 2500K-4000KAI Models | APIs | Active Directory | Authentication | AuthorizationSenior-level Full TimeHyderabad, IN2d ago
-
Apache Spark | Apache Spark Structured Streaming | Azure Data | Azure Data Factory | Azure Data LakeCollaborative international team setup | Continuous learning and upskilling | Fully remote workSenior-level Full TimeIndia R2d ago