Data Platform Owner

Tasks

• Administer Databricks Delta Lake
• Administer Databricks clusters
• Administer Databricks jobs
• Administer Databricks workspace
• Automate data pipeline workflows
• Design data ingestion standards
• Document data pipelines
• Document dataset lineage
• Establish data lineage frameworks
• Establish platform engineering best practices
• Evaluate data sources quality and attribution
• Gather requirements for production solutions
• Identify data solutions with stakeholders
• Implement data collection and management techniques
• Implement data ingestion solutions
• Implement metadata management
• Maintain data cataloging
• Maintain data serving platforms
• Maintain data transformation pipelines
• Manage AWS cloud services
• Manage IAM
• Manage data access controls
• Manage data auditing
• Manage data security encryption
• Monitor data pipeline reliability
• Optimize Databricks costs
• Optimize cloud costs
• Oversee data pipeline performance
• Provide status updates to management
• Recruit and train team members
• Serve as liaison between data engineering and business units
• Set departmental objectives
• Set team priorities
• Support data governance frameworks
• Troubleshoot cloud data issues
• Tune Delta Lake performance

Perks/Benefits

• Annual bonus plan
• Group life insurance
• Holiday allowance
• Hybrid work
• Lunch vouchers
• MyBenefit Cafeteria Platform
• Paid lunch break
• Private medical care
• Tax deductible costs

Skills/Tech-stack

AWS | AWS Glue | AWS Lambda | AWS VPC | Access Control | Agile | Amazon EC2 | Amazon S3 | Apache Airflow | Apache Hadoop | Apache Spark | Audit Logging | Automation | C# | CI/CD | Data Catalog | Data Denormalization | Data Lineage | Data Modeling | Data Normalization | Data Processing | Data Quality | Data Transformation | Data Warehousing | Data cleaning | Data integration | Databricks | Delta Lake | DevOps | Encryption | Event Streaming | Hadoop | IAM | Infrastructure as Code | Inmon | Java | Kimball | Metadata Management | Microservices | Monitoring | Oracle | Oracle SQL | PLSQL | Python | REST API | SQL | SQL Server | Scala | Scalable systems | Secure Data | Secure data processing | Streaming Data | TSQL | Terraform | Troubleshooting | Unity Catalog | “as-code”