System Analyst/Technical Architect: Databricks with Pyspark/Python
Tasks
- Build reporting and analytics solutions
- Collaborate with business users and developers
- Convert SQL stored procedures to PySpark DataFrames
- Design and develop SQL Server stored procedures, functions, views, triggers
- Design data warehouse technical architecture
- Develop ETL/ELT pipelines
- Develop PySpark transformations for ETL
- Document ETL processes with diagrams
- Implement Azure Data Factory pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Spark | Azure Data | Azure Data Factory | Data Factory | Databricks | Dataframes | ELT | ETL | HDFS | PySpark | Python | SQL | SQL Server
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior-level Full TimeLK-1-Colombo8h ago
-
Business Intelligence | Business Objects | Capital Markets | Capital Markets Analysis | Data AnalysisHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeColombo, Sri Lanka1d ago
-
Acceptance Testing | Bill auditing | Data Analysis | Data Auditing | Data ManagementInternational exposure | Medical and insurance eligibility | Open work culture | Recognition and appreciation | Recreational activities and eventsMid-level Full TimeColombo, Western Province, Sri Lanka - … R5d ago
-
Anaplan | Budgeting | Data Visualization | Financial Modeling | Financial analyticsCareer development | In person training during first 90 days | Mentorship | Remote workSenior-level Contract Full TimeSri Lanka - Remote R9d ago
-
Azure Blob | Azure Blob Storage | Azure Cognitive | Azure Cognitive Search | Azure Cognitive ServicesHybrid work | Permanent employmentSenior-level Full TimeColombo, WP, Sri Lanka26d ago
-
CPL | CRM | CTR | Conversions | Dashboard DevelopmentIn person training during first 90 days | Remote workSenior-level Contract Full TimeSri Lanka - Remote R26d ago
-
Senior-level Full TimeLK-1-Colombo30d ago