Databricks Reporting Architect
Tasks
- Build PySpark and Spark SQL transformations
- Build monitoring and validation frameworks
- Build self service dashboards and reports
- Coordinate OData and API based integrations
- Create data quality validation pipelines with Delta Live Tables
- Design SAP to Databricks data flow
- Design physical dimensional star schema models
- Develop Gold consumption and reporting layer
- Enforce schema and incremental processing
- Evaluate Databricks MLflow and AutoML capabilities
- Implement Delta Lake ACID data storage
- Implement Medallion Architecture pipelines
- Implement Unity Catalog data governance
- Implement Z Ordering partitioning and liquid clustering
- Leverage AI coding tools for development
- Optimize Delta Lake storage for query performance
- Perform root cause analysis for data discrepancies
- Set up data lineage access control and auditing
- Support SAP and middleware integration pipelines
- Support testing validation and deployment
Perks/Benefits
- 401k
- Dental plans
- Employee assistance program
- Life insurance
- Medical plans
- Paid Company Holidays
- Paid time off
- Parental leave
- Tuition reimbursement
- Vision plan
Skills/Tech-stack
ACID | API Integration | Analytics Cloud | Apache Spark | Automl | Column-Level Security | Data Governance | Data Lineage | Data Quality | Databricks | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Incremental processing | Liquid clustering | Machine Learningflow | OData | Partitioning | Power BI | PySpark | Python | Row Level Security | SAP Analytics | SAP Analytics Cloud | SQL | Schema Enforcement | Star Schema | Tableau | Time Travel | Unity Catalog | Z-ordering
Education
N/A
Related jobs
-
AI Solution Architect USD 38KArtificial Intelligence | Deep learning | Language Processing | MLOps | Machine LearningSenior-level Full TimeMorrisville, North Carolina, États-Unis d’Amérique22h ago
-
Data Architect USD 145K-180KAWS Glue | AWS Lambda | AWS Redshift | AWS S3 | Azure DevOpsDental insurance | Disability insurance | Educational assistance | Flexible spending account | Health savings accountSenior-level Full TimeHouston, Texas | Tulsa, Oklahoma | …23h ago
-
Apache Spark | Azure | Azure Data | Azure Data Lake | Azure Data Lake StorageHands-on project experience | Mentorship from engineers | Onsite work 5 days per week | Team collaborationEntry-level Full TimeIrvine, CA, US1d ago
-
Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsLearning opportunities | Mentorship | On site work 5 days per week | Team collaborationEntry-level Full TimeIrvine, CA, US1d ago
-
Director Data Engineering USD 178K-255KARM | Agile | Amazon Web Services | Azure Data | Azure Data Factory401k match | Company paid life insurance | Employee assistance program | Health, dental, and vision insurance | Paid time offExecutive-level Full TimeLeawood, KS, US1d ago
-
Benchmarking | C plus plus | CUDA | Computational Engineering | Distributed Computing401k match | Generous paid time off | Medical, dental & vision coverage | Stock options | WFH Hardware ReimbursementSenior-level Full TimeSunnyvale, CA R1d ago
-
Practice Director | AI Solutions USD 230K-250KAI RMF | Agentic AI | Cloud Native | Data Architecture | Data GovernanceExecutive-level Full TimeIrvine, CA, United States1d ago
-
AI Architect USD 120K-197KAI orchestration | Automation | Cloud Computing | Data Governance | Distributed SystemsWeekly earned wage access optionSenior-level Full TimeDurant, OK, United States R1d ago
-
AI Security Architect USD 200K-220KAI Governance | AI Security | AI/ML | AI/ML Security | AWS401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractBolingbrook, Illinois, USA R1d ago
-
Director, Data Engineering USD 195K-220KAgile | Airflow | Amazon Web Services | Analysis Services | Apache Hive401k match | Bonus opportunity | Dental insurance | Direct Deposit | Employee assistance programExecutive-level Full TimePennsauken, NJ 08109 | 39.950866919 | … R1d ago
-
Senior Manager, Data Engineering USD 104K-123KAgile | Azure DevOps | Business Intelligence | CI/CD | Cause analysisSenior-level Full TimeN/A, N/A, United States R1d ago
-
Solution Architect USD 120K-150KAccess Control | Automated Deployment | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeOhio, OH, US1d ago
-
Applied AI Architect, Startups USD 240K-315KAI architecture | Context engineering | Integration Patterns | LLM Evaluation | Language ModelsFlexible working hours | Generous vacation | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R1d ago
-
Director, Data Engineering (Google Cloud Platform) USD 180K-220KAgent platform | Apache Beam | BigQuery | BigQuery ML | CI/CDFinancial benefits | Income protection benefits | Medical/Dental/Vision insurance | Paid time off | Tax-advantaged health care accountsExecutive-level Full TimeAustin, TX1d ago
-
Enterprise Data Architect (Governance) USD 150K-175KAgile | Alation | Atlan | Business glossary | Change Management401k matching | Dental insurance | Flexible spending accounts | Health insurance | Paid HolidaysSenior-level Full TimeWashington, DC, US1d ago
-
Access Control | Access Management | Data Access Management | Data Catalog | Data ComplianceMid-level Full TimePrinceton, New Jersey1d ago
-
Cloud Data Architect (Snowflake), SME USD 150K-180KAPIs | Access Control | Access Management | Apache Airflow | Cost Optimization401k matching | Dental insurance | Flexible spending accounts | Flexible work schedule | Health insuranceSenior-level Full TimeWashington, DC, US1d ago
-
Senior-level Full TimeMiami, United States R1d ago
-
Data Engineering Consultant USD 401KAWS | Apache Airflow | Azure | Azure Data | Azure Data Factory401k Retirement Plan Employer Match | Dental insurance | Disability coverage | Flexible holiday schedule | Health insuranceMid-level Full TimeBedminster, United States2d ago
-
Manager, Technical Solutions, Cloud Applied AI USD 233K-324KAgentic AI | C++ | Cloud Architecture | Cloud platform | Conversational AISenior-level Full TimeWaterloo, ON, Canada; Kirkland, WA, USA2d ago
-
Data Architect Stf - E4 USD 150K-280KData Architecture | Data Governance | Data Modeling | Data integration | Database optimization401k match | Dental insurance | Education assistance | Flexible work arrangements and schedules | HolidaysSenior-level Full TimeVirtual Two, CO, US2d ago
-
Lead Solutions Engineer, Pre-Sales USD 180K-247KAgentic AI | Analytics | BI | Data Governance | Data ModelingPriority evaluation by location | Remote work | Travel to client sitesSenior-level Full TimeUnited States - Remote R2d ago
-
Data Solution Architect USD 140K-180KAWS | AWS Glue | Agile | Amazon EC2 | Amazon RDSFederal contracting environment | On camera interview and assessment | Public Trust eligibilitySenior-level Full TimeMcLean, VA, United States2d ago
-
Technology 2027 Intern - Data Engineering USD 52K-89KData Analysis | Data Architecture | Data Pipelines | Data integration | Database systemsOn site work collaborationEntry-level Full Time InternshipAustin, TX, United States2d ago
-
Manager, Data Engineering USD 200K-335KApache Airflow | Apache NiFi | Apache Spark | BigQuery | Cloud platformSenior-level Full TimeUS - San Francisco R2d ago