Data platform architect
Tasks
- Build and maintain ETL ELT pipelines with Azure Data Factory
- Create architecture documentation and technical design standards
- Define data lake lakehouse and data warehouse architecture patterns
- Design and implement scalable data platform architectures on Microsoft Azure
- Develop and optimize data processing frameworks with Databricks Spark SQL PySpark and Python
- Establish data platform best practices for deployment monitoring security and performance
- Implement data ingestion transformation orchestration and publishing processes
- Lead design and implementation of Databricks based data platforms
- Optimize data pipelines and Spark workloads for performance reliability and cost
- Provide technical guidance for modern data platform practices
- Support data governance access control data quality metadata management and security
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Spark | Auto Loader | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Event | Azure Event Hubs | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Governance | Data Lake Storage | Data Quality | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Event Hubs | Git | Infrastructure as Code | Key Vault | Lakehouse | Metadata Management | Microsoft Azure | Microsoft Azure Data | Microsoft Azure Data Factory | PySpark | Python | Spark SQL | Synapse Analytics | Terraform | Unity Catalog | “as-code”
Education
N/A
Roles
Architect | Data Engineer | Data Platform | Data Platform Architect | Engineer | Platform Architect
Related jobs
-
Principal Software Engineer - Apple Data Platform CNY 435K-510KAWS | Airflow | Alibaba Cloud | Automation | C++Senior-level Full TimeShanghai1d ago
-
Cloud & Data Engineer II CNY 435K-510KAWS | CI/CD | Container Security | Data Modeling | Data WarehousingSenior-level Full TimeBeijing, Beijing, CN1d ago
-
AWS | Access Management | Agent systems | Agentic Workflows | AuditabilityMid-level Full TimeShenzhen, Guangdong, China R1d ago
-
AWS | Agent Orchestration | Agent systems | Azure | Cloud platformMid-level Full TimeShenzhen, Guangdong, China R1d ago
-
ANSYS | APDL | Analysis of Variance | C# | Design of ExperimentsNone Full TimeWuhan, Hubei, China1d ago
-
AWS | Access Management | Agentic Workflows | Auditability | AzureMid-level Full TimeShenzhen, GD, CN, 5180101d ago
-
APIs | AWS | Accuracy Optimization | Agent Orchestration | Agent systemsMid-level Full TimeShenzhen, GD, CN, 5180101d ago
-
Data Analytics - Support - AM CNY 336K-420KLanguage Models | Language Processing | Large Language Models | Natural Language | Natural Language ProcessingCommunity initiatives | Flexible benefits | Professional development | Wellbeing supportEntry-level Full TimeCHN-Chengdu Branch, China1d ago
-
Deep Learning Solution Architect - Agentic Performance CNY 360K-600KAI Agents | Agentic Inference | Cluster management | Distributed Training | Distributed inferenceSenior-level Full TimeChina, Beijing1d ago
-
Senior Deep Learning Solution Architect CNY 160K-240KAccelerated computing | C plus plus | Computer Architecture | Data Structures | Distributed TrainingSenior-level Full TimeChina, Beijing1d ago
-
Senior-level Full TimeChina, Shanghai1d ago
-
Senior Deep Learning Solution Architect CNY 160K-240KAccelerated computing | C++ | CPU | Computer Architecture | Computer SystemsSenior-level Full TimeChina, Beijing1d ago
-
Solutions Architect - Financial Services CNY 360K-500KAgentic AI | Algorithm Trading | C# | C++ | CUDASenior-level Full TimeChina, Beijing1d ago
-
Senior-level Full TimeChina, Beijing1d ago
-
AI Infra工程师-算法研发方向 CNY 180K-300KC plus plus | CI/CD | CUDA | Data parallelism | Deep learningEngineering Training | MentorshipMid-level Full Time北京、上海1d ago
-
Entry-level Full Time InternshipShenzhen, Changsha1d ago
-
Entry-level Full Time InternshipChangsha, Shenzhen1d ago
-
Ai全栈工程师(25/26届) CNY 96K-120KAI integration | API Development | Full Stack | Full-Stack Development | GoLearning opportunities | MentorshipEntry-level Full Time InternshipShenzhen, Changsha1d ago
-
API Integration | Agent Design | Agent evaluation | Context engineering | Data EngineeringEntry-level Full Time InternshipShenzhen1d ago
-
AI Software Development Eng. CNY 74K-100KCUDA | Data parallelism | Debugging | DeepSpeed | Distributed TrainingEntry-level Full TimeCN,Shanghai WFOE2d ago
-
Big Data Engineer CNY 156K-240KAgile | Amazon EMR | Amazon S3 | Apache Airflow | Apache HadoopClubs and communities | Employee learning and development opportunities | Gym classes | On-site mealsSenior-level Full TimeWuxi, CN2d ago
-
Agentic AI Engineer, AVP CNY 300K-420KAWS | AWS Bedrock | Access Management | Agent collaboration | Agentic AIExecutive-level Full TimeHangzhou, China2d ago
-
Executive-level Full TimeHangzhou, China2d ago
-
Applied AI Engineer - Silicon Co-Design Group CNY 300K-420KATE | Artificial Intelligence | Autogen | Automation | C#Mid-level Full TimeChina, Shanghai2d ago
-
Entry-level Full TimeWuxi, Jiangsu, China2d ago