Data Architect
Tasks
- Architect ingestion frameworks
- Build ETL ETL ELT pipelines
- Collaborate with data consumers
- Define data modeling standards
- Define data quality rules
- Deploy infrastructure as code with Terraform
- Design Lakehouse architecture
- Enforce data governance and compliance
- Establish CI CD for data pipelines
- Implement Delta Live Tables
- Implement Unity Catalog
- Maintain data engineering best practices and documentation
- Manage Databricks workspace configuration
- Monitor platform health SLAs and cost
- Optimize Spark jobs
- Own schema evolution strategy
- Provide code review and architectural guidance
Perks/Benefits
- Career progression
- Health & wellness benefits
- Hybrid working
- Retirement benefits
- Training budget for Databricks certification
Skills/Tech-stack
AWS Glue | Amazon S3 | Apache Spark | Asset bundles | Azure ADF | Azure ADLS | Azure DevOps | CI/CD | Caching | Cloud Storage | Cluster Sizing | Data Modeling | Data Vault | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | Delta Lake Time Travel | Delta Live Tables | Delta Live) | Dimensional Modeling | Git | GitHub Actions | Google BigQuery | Google Cloud | Google Cloud Storage | Great Expectations | Infrastructure as Code | Integration Testing | JDBC | Kafka | Medallion Architecture | Partitioning | PySpark | REST APIs | SQL | Schema evolution | Spark SQL | Structured Data Modeling | Structured Streaming | Structured data | Terraform | Test automation | Time Travel | Unit Testing | Unity Catalog | Z-Order | “as-code”
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeIndia2h ago
-
Senior-level Full TimeIN-TN-Chennai3h ago
-
Senior-level Full TimeIN-AP-Hyderabad3h ago
-
Senior-level Full TimeIN-AP-Hyderabad3h ago
-
Senior-level Full TimeIN-AP-Hyderabad3h ago
-
Senior-level Full TimeIndia5h ago
-
Data and Analytics Lead, Google Cloud INR 1500K-3000KBigQuery | Cloud Migration | Data Modeling | Data Transformation | Database ManagementSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India5h ago
-
Partner Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-4000KAPIs | Agent systems | Artificial Intelligence | Cloud platform | Data PipelinesSenior-level Full TimeMumbai, Maharashtra, India5h ago
-
Senior-level Full TimeBengaluru, Karnataka, India5h ago
-
CCB Risk Strategic Analytics – GenAI INR 1960K-2800KAgentic AI | Control processes | Credit Risk | Data Analysis | Data EngineeringSenior-level Full TimeMumbai, Maharashtra, India5h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2500KAWS Glue | AWS Lambda | Airflow | Amazon Athena | Amazon EC2Mid-level Full TimeBangalore, Karnataka, India6h ago
-
Senior-level Full TimeBengaluru, Karnataka, India6h ago
-
Senior Expert INR 3000K-3880KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India7h ago
-
AES - DE - Generative AI Prompt Engineers INR 3000K-4000KCI/CD | Code Analysis | Cypress | DeepEval | DockerSenior-level Full TimePune, Maharashtra, India7h ago
-
Senior Data Engineer INR 2000K-3000KAPI Design | Apache Kafka | Apache Spark | Automated testing | CI/CDSenior-level Full TimeBengaluru, KA, India7h ago
-
Senior Software Engineer 7+ years (Must have- Python, FastAPI (or Flask/Django), Langchain, Mongodb, RestAPI) INR 1960K-2829KAnthropic | Azure OpenAI | CI/CD | Cohere | DjangoEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India7h ago
-
Expert, Analytics Engineering INR 2520K-3880KAWS | Airflow | CI/CD | Cognitive Computing | DBTRelocation assistanceSenior-level Full TimeMumbai, MH, IN8h ago
-
Associate Process Manager INR 800K-1800KBigQueryML | CRM Analytics | Customer Segmentation | Dashboarding | Data ModelingAPAC shift workMid-level Full TimeMumbai, Maharashtra, India8h ago
-
AWS | Alerting | Audit Logging | Azure | CI/CDWork from OfficeSenior-level Full TimePune, MH, India8h ago
-
AES - DE - Generative AI Prompt Engineers INR 2800K-4000KAgent Orchestration | Autogen | Azure DevOps | Azure OpenAI | C SharpSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Senior-level Full TimeChennai, TN, India11h ago
-
Senior Software Engineer I INR 2500K-3500KAPI Design | Agile Development | Airflow | Alerting | Apache SparkCareer growth opportunities | Health and wellness support | Learning opportunities | Mentoring opportunitiesSenior-level Full TimeChennai, TN, India11h ago
-
KGS - AWS DevOps - Consultant - Bangalore INR 2125K-3500KAWS | Alerting | Ansible | Artifactory | BitbucketSenior-level Full TimeBangalore, Karnataka, India11h ago
-
Sr. Data Engineer INR 3000K-4000KApache Airflow | Apache Kafka | Apache Spark | Big Data | BigQuerySenior-level Full TimeGurgaon, Haryana, India12h ago
-
Senior Data Engineer - Privacy INR 2800K-4000KAWS | Apache Airflow | Apache Spark | CCPA | Data ModelingCommuter benefits | Financial wellness support | Hybrid work flexibility | Mental health support | Retirement planSenior-level Full TimeBengaluru, India12h ago