Databricks Solution Architect
Tasks
- Architect enterprise lakehouse on Databricks
- Build and scale data ecosystem
- Define platform standards for data modeling and CI CD
- Design batch and streaming data pipelines
- Implement data governance with Unity Catalog
- Manage cloud infrastructure for data platform
- Mentor data engineers and lead code reviews
- Operationalize ML models on Databricks
- Optimize Spark workloads for performance and cost
- Translate business requirements into data platform roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | AWS | Autoscaling | Azure | CI/CD | Caching | Data Lineage | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Encrypted data | Feature Store | GCP | GCS | Git | IAM | ML Model Serving | MLflow | Medallion Architecture | Model Serving | Networking | Observability | PII handling | Partitioning | Photon | PySpark | Query Tuning | S3 | Spark SQL | Structured Streaming | Terraform | Unity Catalog | Z-Order | ZORDER
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R3d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R17d ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R10h ago
-
Senior Staff Generative AI Scientist USD 185K-210KAWS | Apache Spark | Artificial Intelligence | Azure | Cloud platform401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Senior Data Solutions Lead USD 175K-200KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkDHS Public Trust suitability determination | Remote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Principal Data Engineer USD 180K-220KAWS | Apache Airflow | Artificial Intelligence | CI/CD | Confluence401k | Autonomy | Company paid life insurance | Disability coverage | FSASenior-level Full TimeRemote - US, Canada and Poland R2d ago
-
Head of Data USD 193K-230KAPI Integration | BigQuery | CDC | Cloud Storage | DBTEquity compensation | Quarterly visits to center | Relocation benefits | Remote workExecutive-level Full TimeLos Angeles or San Francisco; Remote … R2d ago
-
API Design | Agent Optimization | Agent systems | Atomic operations | Caching401k plan | Calm app access | Disability insurance | In Home Office Setup Support | Internet stipendSenior-level Full TimeUnited States and Canada - Remote … R2d ago
-
Lead Data Engineer USD 160K-193KAmazon Redshift | CI/CD | DBT | ELT | ETL401k match | Adoption benefits | Employee resource groups | Flexible time off | Health insuranceSenior-level Full TimeDeerfield, IL, United States R2d ago
-
Senior Director, Data Platform USD 234K-280KAccess Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageBenefits | Bonus | Hybrid work remote flexibility | LTISenior-level Full TimeAtlanta; Boston; Charlotte; Chicago; Dallas; Los … R2d ago
-
Senior Data Engineer II USD 134K-203KAPI Gateway | API Management | AWS | AWS API | AWS API GatewayHealth insurance | Health leave | Parental leave | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - US R2d ago
-
Forward Deployed ML/AI Engineer USD 167K-200KAWS | Azure | CI/CD | Databricks | DockerAnnual company retreat | Company winter break | Education bonus | High-performance culture | Optional in person events and meetupsSenior-level Full TimeUnited States R2d ago
-
Senior Software Engineer, Marketplace Optimization USD 166K-230KAPI Design | AWS | Cloud Native | Distributed Systems | Event Driven401k | Dental insurance | Disability insurance | Employee assistance program | Employee stock purchase planSenior-level Full TimeUnited States | Remote R2d ago
-
Senior Analytics Engineer USD 135K-225KAirflow | CI/CD | DBT | Data Modeling | Data TransformationFlexible time off | Health, dental, and vision insurance | LinkedIn Learning access | Paid Holidays | Paid parental leaveSenior-level Full TimeUnited States (Remote) R2d ago
-
Software Engineer II, Fulfillment USD 106K-142KA/B | A/B Testing | AWS | B testing | CI/CD401k match | Education stipend | Employer-paid health insurance | Flexible time off | IKEA discountsSenior-level Full TimeSan Francisco, California, United States R2d ago
-
Web Data Engineer USD 110K-130KAWS | Apache Airflow | Azure | DBT | Google Cloud401k | Expense reimbursement | Insurance benefits | Paid time off | Remote workSenior-level Full TimeRemote, USA, United States R2d ago
-
Alerting | Buildkite | CI/CD | Cause analysis | Cross Database GrantsDental coverage | Employee stock purchase plan | Flexible spending account | Health coverage | Remote workSenior-level Full TimeRemote Canada R2d ago
-
Alerting | BigQuery | Buildkite | CI/CD | Container OrchestrationDental and vision coverage | ESPP | Employee stock purchase plan | Flexible spending wallets | Health care coverageSenior-level Full TimeRemote US R2d ago
-
Senior DevOps Engineer - Storage Platforms USD 90K-252KAlerting | Ansible | Backup Rubrik | Backup Technologies | Bash401k matching | Basic life insurance | Company-Paid Holidays | Employee stock purchase plan | Health, dental and vision coverageSenior-level Full TimeUnited States (Remote) R2d ago
-
Principal Architect – Data & AI Solutions USD 168K-500KAzure | Azure AI | Azure Synapse | Data Architecture | Data Engineering401k match | Dental insurance | Dependent care FSA | Disability insurance | Employee assistance programSenior-level Full TimeRemote - US R2d ago
-
AWS | AWS CloudFormation | AWS CloudTrail | AWS Lambda | AWS SecretsEqual opportunity employment | Remote workSenior-level Full TimePhoenix, AZ, United States R3d ago
-
Senior Data Engineer USD 110K-115KAWS Glue | AWS Lambda | Access Control | Agile | Amazon KinesisFully remoteSenior-level Full TimeUnited States R3d ago
-
Principal AI Engineer USD 167K-250KAzure | CI/CD | Context Management | Docker | Embedding401k employer matching | Charitable matching program | Community outreach groups | Dental insurance | Flexible paid time offSenior-level Full TimeGilbert, AZ, US R3d ago
-
Data Architect USD 145K-200KAPIs | Agile | Amazon Redshift | Azure | Azure Data401k matching | Charitable matching | Community outreach groups | Dental insurance | Flexible paid time offSenior-level Full TimeLeawood, KS, US R3d ago
-
AI Engineer USD 125K-171KAngular | Apache Kafka | Azure | CI/CD | Context Management401k matching | Charitable matching program | Dental insurance | Life insurance | Medical insuranceMid-level Full TimeLeawood, KS, US R3d ago