System Analyst/Technical Architect: Databricks with Pyspark/Python
Tasks
- Build reporting and analytics solutions
- Collaborate with business users and developers
- Convert SQL stored procedures to PySpark DataFrames
- Design and develop SQL Server stored procedures, functions, views, triggers
- Design data warehouse technical architecture
- Develop ETL/ELT pipelines
- Develop PySpark transformations for ETL
- Document ETL processes with diagrams
- Implement Azure Data Factory pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Spark | Azure Data | Azure Data Factory | Data Factory | Databricks | Dataframes | ELT | ETL | HDFS | PySpark | Python | SQL | SQL Server
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Azure Blob | Azure Blob Storage | Azure Cognitive | Azure Cognitive Search | Azure Cognitive ServicesHybrid work | Permanent employmentSenior-level Full TimeColombo, WP, Sri Lanka6d ago
-
CPL | CRM | CTR | Conversions | Dashboard DevelopmentIn person training during first 90 days | Remote workSenior-level Contract Full TimeSri Lanka - Remote R6d ago
-
API | AWS | AWS Lambda | Amazon EC2 | Amazon ECSMentorship | Paid internship | Paid sick timeEntry-level Full Time InternshipColombo, Western, Sri Lanka8d ago
-
Anomaly investigation | BigQuery | Cause analysis | Dashboard Development | Data ModelingMid-level Full TimeColombo8d ago
-
Senior-level Full TimeLK-1-Colombo10d ago
-
Acceptance Testing | Anomaly Detection | Data Analysis | Data Anomaly Detection | Data QualityCertification funding | International exposure | Medical insurance | Open work culture | TrainingMid-level Full TimeColombo, Western Province, Sri Lanka - … R11d ago
-
Entry-level Full Time InternshipSri Lanka15d ago