Databricks Solution Architect
United States
Ness Digital Engineering
Ness is a digital engineering company providing advisory & scaled services for digital business transformation, leveraging digital transformation technologies.- Lead the architecture, design, and delivery of modern data platforms on Databricks, from concept to deployment
- Guide clients through large-scale migrations from legacy technologies like Hadoop, traditional ETL stacks, or on-prem Spark to cloud-native Lakehouse solutions
- Build scalable, high-performing data pipelines using Delta Lake, Unity Catalog, and Delta Live Tables
- Work closely with both technical and business stakeholders to uncover challenges and deliver solutions that drive real impact
- Connect Databricks into the broader enterprise tech stack — cloud storage, BI platforms, identity & access, governance tools, and more
- Stay ahead of the curve on the latest features and best practices from Databricks, ensuring that what we deliver is always state-of-the-art
- Contribute to client solutioning and RFPs, helping shape winning proposals
- Design frameworks, accelerators, and joint go-to-market solutions with partners like Databricks and Snowflake
- Mentor and grow the next generation of Databricks leaders in our organization
- Be a strategic advisor to our clients — not just building systems, but helping them unlock business value through data
- 20+ years of experience across data engineering, architecture, and analytics
- 5+ years of hands-on experience with Databricks in complex enterprise environments
- Databricks Professional Certification (or equivalent practical expertise)
- Proven success leading migrations to modern data platforms in the cloud
- Deep knowledge of Delta Lake, Apache Spark (PySpark/Scala), Unity Catalog, and MLflow
- Practical experience working with AWS, Azure, or GCP
- Strong understanding of data governance, security, CI/CD, and performance optimization in modern data environments
- Experience with data ingestion tools like Fivetran, Matillion, or Informatica; and orchestration with Airflow, dbt, or similar
- Excellent communication and stakeholder engagement skills — able to navigate both the boardroom and the build room
- Comfortable collaborating across onshore, nearshore, and offshore delivery models
- Experience with AI/ML workloads and serving models within Databricks
- A background in consulting or customer-facing solution roles
- Access to trainings, conferences, and certifications for self-development
- Skilled and team player colleagues
- Increased vacation days based on tenure in Ness and Floating holidays
- Medical insurance
- Attractive compensation scheme and referral bonuses
Let’s meet and you may just be the right candidate for one of our roles
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture AWS Azure CI/CD Consulting Databricks Data governance Data pipelines dbt Engineering ETL FiveTran GCP Hadoop Informatica Machine Learning Matillion MLFlow Pipelines PySpark Scala Security Snowflake Spark
Perks/benefits: Career development Conferences Salary bonus
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.