Senior Data Engineer

Swiftly is a retail digital technology startup founded in 2018 and headquartered in the Bay Area. We empower regional and independent grocers to compete in a digital-first world by providing best-in-class app, web, loyalty, and e-commerce solutions—without SaaS fees. Instead, Swiftly drives revenue through its retail media network, sharing profits with retailer partners.With 70+ retailer banners and Series C funding, Swiftly is the first in the industry to seamlessly connect digital and in-store shopping. Our AI-powered platform helps retailers build strong digital relationships, while our solutions—Audience Optimizer™, Alcohol Cashback, and Offsite Campaigns—drive shopper engagement and brand success.
Our mission: Enable brick-and-mortar retailers to thrive in a digital world.
Position Summary: Swiftly is searching for a Senior Data Engineer to join their high functioning team. This role will help scale our Retailer Platform that spans multiple technologies using Azure, Databricks, and API development. The platform is an end-to-end system that ingests retailers' raw data and serves it to multiple teams downstream, including the live, production mobile applications. This is a full time contract role.   We use Deel as contract of record.

Responsibilities Include:

• Architect and implement scalable data pipelines using Databricks, Apache Spark, and Delta Lake 
• Design and optimize data models and lakehouse architectures for performance and reliability 
• Lead the development of ETL/ELT workflows in collaboration with data analysts, scientists, and stakeholders 
• Ensure data quality, governance, and security best practices across the data ecosystem 
• Partner with cross-functional teams to understand data needs and deliver effective solutions 
• Other related duties as assigned

Required Qualifications:

• 5+ years of data engineering experience, with 3+ years of hands-on experience in Databricks
• Expert in PySpark, SQL, and modern data lake/lakehouse concepts
• Strong understanding of cloud platforms (AWS, Azure, or GCP)
• Experience with Delta Lake, Unity Catalog, and CI/CD pipelines for data
• Proven ability to lead complex data initiatives from design to delivery
• Experience with Medallion Architecture

Preferred Qualifications:

• Experience with MLflow, Data Governance frameworks, and streaming data (Structured Streaming, Kafka) a plus
• Experience with Databricks Workflows and Postgres

#LI-Remote
Working For SwiftlyWe are working on a set of problems that require the best in the industry to get right. Our employees are the pillars of the future of the company and they are treated and compensated as such. We're a growing team of experienced industry professionals building an organization that can solve tough problems and values a collaborative environment. 
Every Swiftly employee: -Has demonstrated the ability to work collaboratively in an ambiguous, fast-paced environment -Takes ownership of their domain from the ground up, from inception through deployment to customers -Leaves their ego at the door and ensures the best idea leaves the room -Is always experimenting with new technologies and learning new skillsets 
If you've ever wanted to work on a project that blends a gorgeous consumer experience, sophisticated logistics, and scale that rivals the largest technology players, Swiftly is the place for you. 
Equal Opportunity Employer Swiftly is an Equal Employment Opportunity and Affirmative Action Employer.  Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status.  Swiftly will make reasonable accommodations in compliance with the Americans with Disabilities Act of 1990. Reasonable accommodations are available for qualified individuals with disabilities throughout the subsequent application process.