Solutions Architect - Databricks
Tasks
- Build data models and data marts
- Build data pipelines with Databricks
- Collaborate with analytics BI data science and cloud teams
- Conduct code reviews and enforce best practices
- Create reusable frameworks and patterns
- Define data platform strategy
- Deliver end to end solution architecture to production
- Design scalable, secure data architectures
- Develop ETL/ELT pipelines
- Ensure data quality, observability, and monitoring
- Establish Databricks Lakehouse architecture
- Implement CDC and incremental processing
- Implement Medallion Architecture layers
- Lead data engineering teams
- Manage stakeholder communication and provide technical thought leadership
- Optimize performance and query execution
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | CDC | Data Modeling | Data Quality | Data Warehousing | Databricks | Dimensional Modeling | Distributed Systems | ELT | ETL | Incremental processing | Kafka | Medallion Architecture | OLAP | OLTP | Observability | Performance Tuning | PySpark | Python | Query Optimization | SQL | Spark
Education
N/A
Roles
Architect | Data Architect | Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Solutions Architect
Related jobs
-
Capacity Analysis | Cloud Computing | Continuous Improvement | Data Visualization | Data Warehousing401k | Dental insurance | Discounts | Health insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States6h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R12h ago
-
Data Architecture SME USD 95K-109KArchitecture Framework | Archive Recovery | BPMN | DODAF | Data Warehousing401k plan with company matching | Bereavement | Employee assistance program | Health and Dental and Vision Care | HolidaysSenior-level Full TimeScott Air Force Base, IL, United …12h ago
-
Sr AI Engineer USD 84K-105KC# | Deep learning | Digital Signal | Digital Signal Processing | Edge ComputingAccidental death and dismemberment | Commuter benefits | Dental insurance | Flexible spending account | Health savings accountSenior-level Full TimeColumbia, MARYLAND, United States12h ago
-
Data Governance Lead (Master Data Domain) USD 170K-253KApproval Workflow | Attribute management | Change Control | Cloud Data | Cloud Data IntegrationSenior-level Full TimeRTP, North Carolina, USA Office (NOCAROLINA)13h ago
-
Lead Fraud Data Scientist USD 164K-230KA/B | A/B Testing | AWS | Azure | B testingDental insurance | Health insurance | Hybrid work option | Performance bonus | Remote workSenior-level Full TimeNew York, San Francisco, Miami R13h ago
-
Applied Research Scientist / Engineer USD 175K-250KData Curation | Deep learning | Diffusion Models | Distributed Training | Domain AdaptationMid-level Full TimeNew York, NY, SF Bay Area, …14h ago
-
AI Engineer (GenAI & Integration) USD 130K-181KAI Agents | AI Governance | API Integration | Automation workflows | DeploymentMid-level Full TimeCenter, Center District, IL14h ago
-
Data Engineer USD 105K-130KAPIs | Data Governance | Data Modeling | Data Monitoring | Data Quality401k employer matching | Childcare reimbursement | Company events social hours | Company paid parking or MTS pass | Fertility treatment coverageSenior-level Full TimeSan Diego, CA, United States15h ago
-
Senior Software Engineer - San Francisco (Onsite) USD 130K-220KAWS | Amazon EMR | Amazon S3 | Apache Flink | Apache SparkFast-paced startup environment | Onsite work environment | Rapid hiring process feedback | Relocation supportSenior-level Full TimeSan Francisco, CA, US15h ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 6+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 136K-140KArtificial Intelligence | Confluence | Jira | LLM | Machine Learning401k retirement plan | Dental insurance | Life insurance | Medical insurance | Paid time offMid-level Full TimeFort George G Meade, United States15h ago
-
Senior-level Full TimeCedar Falls, IA, US15h ago
-
Lead Data Engineer – Snowflake USD 170K-216KAmazon S3 | Apache Airflow | Azure Data | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeUnited States16h ago
-
Software Engineer 2/3-BY-SIG-02 USD 78K-250KAccumulo | BSON | Bigtable | Docker | HBase401k match | Diverse inclusive workplace | Employee referral programs | Flexible work arrangements | Mental health supportSenior-level Full TimeHanover, MD16h ago
-
IT Data Engineer USD 60K-65KANSI X12 | AWS | Azure | Azure Data | Azure Data Factory401k retirement plan | Disability coverage | Employee assistance program | Flexible spending account | Medical/Dental/Vision insuranceMid-level Full TimeUS - Remote R17h ago
-
Data Engineer III USD 134K-161KAccess Control | Analytics Cloud | Data Governance | Data Marts | Data Quality401k | Adoption Assistance | Dental insurance | Education reimbursement | FSASenior-level Full TimeIrvine, CA17h ago
-
Databricks Data Engineering Manager USD 151K-252KAgent Bricks | Business Intelligence | Data Architecture | Data Governance | DatabricksTravel up to 25 percent | US government security clearance processMid-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …17h ago
-
GenAI Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Analysis | Data Pipelines | DockerProfessional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States17h ago
-
Generative AI Engineer III USD 110K-218KArtificial Intelligence | Data Analysis | Data Pipelines | Docker | KubernetesDiscretionary annual incentive program | Mentorship | Professional developmentSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …17h ago
-
Lead Generative AI Data Engineer III USD 159K-265KArtificial Intelligence | Data Pipelines | Docker | Generative AI | KubernetesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …17h ago
-
Lead Generative AI Data Engineer III USD 159K-265KArtificial Intelligence | Data Pipelines | Generative AI | Language Models | Language ProcessingSenior-level Full TimeAtlanta, Georgia, United States; New York, …17h ago
-
Generative AI Data Engineer III USD 131K-218KAlgorithm Development | Artificial Intelligence | Data Analysis | Data Modeling | Data PipelinesMentorship | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; New York, …17h ago
-
Sr. Data Engineer - Data Engineer III USD 125K-198KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon RedshiftSenior-level Full TimePhiladelphia, Pennsylvania, United States17h ago
-
Integration Engineer II - AI and Python Developer USD 86K-170KAI Ops | AWS Bedrock | Azure | CI/CD | Fine TuningAgile team collaboration | Mentorship | Professional developmentMid-level Full TimeAtlanta, Georgia, United States; Baltimore, Maryland, …17h ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic AI | Auditability | CI/CD | Cloud platform401k | Dental insurance | Expense reimbursement for internet costs | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R17h ago