Data Architect
Tasks
- Architect ingestion frameworks
- Build ETL ETL ELT pipelines
- Collaborate with data consumers
- Define data modeling standards
- Define data quality rules
- Deploy infrastructure as code with Terraform
- Design Lakehouse architecture
- Enforce data governance and compliance
- Establish CI CD for data pipelines
- Implement Delta Live Tables
- Implement Unity Catalog
- Maintain data engineering best practices and documentation
- Manage Databricks workspace configuration
- Monitor platform health SLAs and cost
- Optimize Spark jobs
- Own schema evolution strategy
- Provide code review and architectural guidance
Perks/Benefits
- Career progression
- Health & wellness benefits
- Hybrid working
- Retirement benefits
- Training budget for Databricks certification
Skills/Tech-stack
AWS Glue | Amazon S3 | Apache Spark | Asset bundles | Azure ADF | Azure ADLS | Azure DevOps | CI/CD | Caching | Cloud Storage | Cluster Sizing | Data Modeling | Data Vault | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | Delta Lake Time Travel | Delta Live Tables | Delta Live) | Dimensional Modeling | Git | GitHub Actions | Google BigQuery | Google Cloud | Google Cloud Storage | Great Expectations | Infrastructure as Code | Integration Testing | JDBC | Kafka | Medallion Architecture | Partitioning | PySpark | REST APIs | SQL | Schema evolution | Spark SQL | Structured Data Modeling | Structured Streaming | Structured data | Terraform | Test automation | Time Travel | Unit Testing | Unity Catalog | Z-Order | “as-code”
Education
N/A
Roles
Related jobs
-
Data Quality Analyst ( ETL/Data Warehouse ) INR 800K-1600KAgile | Anomaly Detection | Azure Data | Azure Data Factory | CI/CDMid-level Full TimeHome - India (HOMEIND)12h ago
-
Senior Data Engineer - Full Stack (US, Remote) INR 2000K-3000KAPI | AWS | CI/CD | CLI | Data GovernanceCollaborative team | Developer productivity focus | Remote workSenior-level Full TimeMaharashtra, Pune, India R12h ago
-
AWS Cloud Engineer INR 1500K-3000KAWS CloudFormation | AWS Fargate | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeBangalore, India12h ago
-
Senior-level Full TimeBangalore, India12h ago
-
Architect (ATC) INR 1500K-3500KAutomation | Backup Restore Validation | Backup/Restore | CI/CD | Cause analysisSenior-level Full TimeIN-MH-Pune13h ago
-
Senior-level Full TimeIN-KA-Bangalore13h ago
-
Senior-level Full TimeIN-AP-Hyderabad13h ago
-
Gen AI INR 2000K-3300KAI Studio | Azure AI | Azure AI Studio | Azure Cognitive | Azure Cognitive SearchMid-level Full TimeIN-AP-Hyderabad13h ago
-
Senior-level Full TimeKolkata,West Bengal,India16h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India18h ago
-
Mid-level Full TimeHyderabad, IN18h ago
-
Lead Software Engineer (Cloud Native | Microservices | AWS) INR 3000K-4000K.NET | API | AWS | AWS CDK | Behavior-Driven DevelopmentEnhanced medical benefits | Hybrid work | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India18h ago
-
GenAI Engineer - Database INR 2000K-3465KData Governance | Data Privacy | Data Security | Embeddings | Graph AlgorithmsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India20h ago
-
Architect Data Products(M/F/D) INR 2400K-4000KAPIs | Automation | Azure | Azure Data | Azure Data FactoryCareer development | Flexible working hours | Inclusive work environment | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN20h ago
-
Cloud Data Engineer(M/F/D) INR 1500K-2000KAPIs | Agile | Automation | Azure | Azure DataCareer development | Flexible working models | International networking | Learning opportunitiesMid-level Full TimeHyderabad, IN20h ago
-
Senior-level Full TimeBangalore, India20h ago
-
Sr Lead Software Engineer INR 3000K-5000KAI assisted code | AI-assisted code review | AI-assisted refactoring | API Versioning | AWSSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Senior-level Full TimeBangalore,Karnataka,India23h ago
-
Amazon Web Services | Apache Airflow | Apache Hadoop | Azure Data | Azure Data FactoryFlexible work arrangements | Mentorship | Wellbeing supportSenior-level Full TimeChennai - Menon Eternity, India1d ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Databricks | Azure FunctionsSenior-level Full TimeAiroli, India1d ago
-
Data Engineer (Audience Intelligence) INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsMid-level Full TimeHyderabad, Telangana, India1d ago
-
Embedded SW Engineer- AS Core INR 1800K-3000KASPICE | AUTOSAR | Automotive communication | CAN | Code reviewMid-level Full TimeIND - India Tech Center1d ago
-
Python Gen AI consultant INR 3000K-4000KAutogen | Automated testing | CI/CD | Cloud platform | Crew AIMid-level Full Timebangalore, KA, IN1d ago
-
Mid-level Full TimeBangalore, KA, IN1d ago
-
Sr Technical Consultant-Cloud - Java,Microservices,Kafka,Nosql INR 2200K-3500KAKS | ARM Templates | Active Directory | Apache Spark | AzureSenior-level Full TimeBangalore, India1d ago