Databricks Solution Architect
Tasks
- Architect enterprise lakehouse on Databricks
- Build and scale data ecosystem
- Define platform standards for data modeling and CI CD
- Design batch and streaming data pipelines
- Implement data governance with Unity Catalog
- Manage cloud infrastructure for data platform
- Mentor data engineers and lead code reviews
- Operationalize ML models on Databricks
- Optimize Spark workloads for performance and cost
- Translate business requirements into data platform roadmap
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | AWS | Autoscaling | Azure | CI/CD | Caching | Data Lineage | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Encrypted data | Feature Store | GCP | GCS | Git | IAM | ML Model Serving | MLflow | Medallion Architecture | Model Serving | Networking | Observability | PII handling | Partitioning | Photon | PySpark | Query Tuning | S3 | Spark SQL | Structured Streaming | Terraform | Unity Catalog | Z-Order | ZORDER
Education
N/A
Related jobs
-
Senior-level Full TimeUnited States R7h ago
-
Senior-level Full TimeUnited States R7h ago
-
Mid-level Full TimeVancouver, Canada R17h ago
-
AI Engineer CAD 145K-172KA/B | A/B Testing | API Development | API Integration | B testingCareer growth opportunities | Comprehensive benefits | Hybrid schedule | Inclusive office environment | Robust training programMid-level Full TimeKitchener, Canada R17h ago
-
FDE Data Engineer- Space USD 123K-166KABAC | Apache Airflow | Apache Flink | Apache Hudi | Apache IcebergHealth benefits | Remote work | Travel for site workMid-level Full TimeUnited States - Remote R18h ago
-
Senior FDE Data Engineer USD 148K-201KABAC | Airflow | Apache Iceberg | Apache Kafka | Argo WorkflowsCompany paid premiums | Health savings account | Medical/Dental/Vision | Remote work | Travel to classified sitesSenior-level Full TimeUnited States - Remote R18h ago
-
Data Architect (Remote) USD 160K-172KData Architecture | Data Documentation | Data Governance | Data Modeling | Data Quality401k match | Disability coverage | Healthcare coverage | Life insurance | Paid parental leaveSenior-level Full TimeBoston, Massachusetts, United States; New York, … R20h ago
-
Data Architect (Remote) USD 148K-159KData Documentation | Data Governance | Data Lineage | Data Modeling | Data Quality401k match | Healthcare coverage | Life and disability coverage | Paid parental leave | Paid sick leaveSenior-level Full TimeAtlanta, Georgia, United States; Chicago, Illinois, … R20h ago
-
AI Observability | AWS | Azure | CI/CD | Cost ControlCareer advancement | Fully remote work | Professional development opportunities | Work-life balanceSenior-level Full TimeCanada R20h ago
-
Solutions Architect 4 USD 180K-247KADLS | Access auditing | Agent systems | BI reporting | CDC100% remote | Health & safety training | Medical monitoring | Well-being programsSenior-level Full TimeLos Alamos, NM, United States R1d ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic Frameworks | Auditability | CI/CD | Cloud Native401-k match | Dental insurance | Expense Reimbursement for Home Office | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R1d ago
-
Senior Analytics Engineer USD 159K-200KAWS | Airflow | DBT | Dagster | Data ObservabilityAutonomy | Fully remote | High-impact work | Use of AI toolsSenior-level Full TimeRemote US R1d ago
-
Software Engineer II - Data Platform CAD 103K-129KAirflow | Artificial Intelligence | BigQuery | DBT | DockerDental coverage | LinkedIn Learning access | Medical coverage | Paid Company Holidays | Paid sick leaveMid-level Full TimeCanada (Remote) R1d ago
-
Senior-level Full TimeSan Jose, United States R1d ago
-
Lead Data Engineer USD 188K-230KAirflow | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataDomestic travel up to 5 percent | Relocation not authorized | Remote workSenior-level Full TimeRemote - Minnesota, United States R1d ago
-
Senior Machine Learning Operations Engineer USD 166K-208KAlerting | CI/CD | Canary Deployment | Champion Challenger | Drift DetectionSenior-level Full TimeSan Francisco, CA, New York, NY, … R1d ago
-
Staff Analytics Engineer USD 109K-125KAmazon Redshift | Automated testing | BigQuery | CI/CD | Cloud Data401k plan | Coaching | Flexible spending account | Flexible vacation policy | Healthcare coverageSenior-level Full TimeUnited States R1d ago
-
AI Engineer USD 99K-163KAPI Integration | AWS | Amazon Bedrock | Data Analysis | Embeddings401k match | Dental insurance | Disability insurance | Hybrid work model | Life insuranceMid-level Full TimeRemote, United States R1d ago
-
Senior-level Full TimeUnited States (Remote) R1d ago
-
Forward Deployed AI Product Engineer USD 167K-200KAI Evaluation | AI guardrails | CI/CD | Data Pipelines | Data TransformationOn site client collaboration | Remote work | Travel opportunitiesSenior-level Full TimeUS-Remote R1d ago
-
Sr. Software Engineer - Engineering Enablement USD 150K-190KAWS | Agent Orchestration | Automated testing | Azure | CI/CDDocumentation and onboarding support | Office hoursSenior-level Full TimeUS Remote R1d ago
-
Staff Backend AI Engineer, Remote USD 140K-209KAPI Gateway | AWS | AWS Cloud | AWS Cloud Development Kit | AWS Lambda401k matching | Dental insurance | Flexible time off | Health insurance | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
Staff AI Architect, Remote USD 153K-222KAPI Gateway | AWS | AWS CDK | AWS Secrets | AWS Secrets Manager401k matching | Flexible time off | Medical/Dental/Vision insurance | Paid Holidays | Remote work flexibilitySenior-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
A/B | A/B Testing | AWS | Apache Kafka | B testingDental insurance | Equity | Medical insurance | Remote work environment | Vision insuranceSenior-level Full TimeRemote, USA; Remote, Canada R1d ago
-
Data Engineer USD 74K-133KAgile | Airflow | BigQuery | Cloud Composer | Cloud Storage401k retirement plan | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R1d ago