Databricks Engineer

OneMagnify is a global performance marketing organization working at the intersection of brand marketing, technology, and analytics. The Company’s core offerings accelerate business, amplify real-time results, and help set their clients apart from their competitors. OneMagnify partners with clients to design, implement and manage marketing and brand strategies using analytical and predictive data models that provide valuable customer insights to drive higher levels of sales conversion.

OneMagnify’s commitment to employee growth and development extends far beyond typical approaches. We take great pride in fostering an environment where each of our 700+ colleagues can thrive and achieve their personal best. OneMagnify has been recognized as a Top Workplace, Best Workplace and Cool Workplace in the United States for 10 consecutive years and recently was recognized as a Top Workplace in India.

The Data Engineering team is a dynamic group that is dedicated to transforming raw data into actionable insights. As a Databricks Engineer, you will architect, build, and maintain our data infrastructure on the Databricks Lakehouse Platform. You will collaborate with data scientists, analysts, and engineers to deliver world-class data solutions that drive our business forward.

About You:

• Eager to address complex technical challenges with a strong engineering approach.
• Outstanding execution and care for delivering robust and efficient data solutions.
• A deep understanding of cloud-based data technologies and standard methodologies for data engineering.
• Ability to develop and implement scalable data models and data warehousing solutions using Databricks.

What you’ll do:

• Architect, develop, and deploy scalable and reliable data infrastructure and pipelines using Databricks and Spark.
• Design and implement data models and data warehousing solutions with a focus on performance and scalability.
• Optimize data processing frameworks and infrastructure for maximum efficiency and cost-effectiveness.
• Collaborate with data scientists and analysts to understand their data needs and engineer solutions.
• Implement robust data quality frameworks, monitoring systems, and alerting mechanisms.
• Design, build, and maintain efficient ETL/ELT processes.
• Integrate Databricks with various data sources, systems, and APIs.
• Contribute to the definition and implementation of data governance, security, and compliance policies.
• Stay current with the latest advancements in Databricks, cloud data engineering standard methodologies, and related technologies.

What you’ll need:

• Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
• 5+ years of experience in data engineering or a similar role with a strong emphasis on building and maintaining data infrastructure.
• Deep understanding and practical experience with the Databricks Lakehouse Platform and its core engineering aspects.
• Expert-level proficiency in working with big data processing frameworks, particularly Apache Spark.
• Strong hands-on experience with programming languages such as Python (PySpark) and/or Scala.
• Solid experience with SQL and data warehousing principles, including schema design and performance tuning.
• Proven experience with cloud platforms such as AWS, Azure, or GCP.
• Comprehensive understanding of data modeling, ETL/ELT architecture, and data quality engineering principles.
• Excellent problem-solving, analytical, and debugging skills.
• Strong communication and collaboration skills, with the ability to explain technical concepts to both technical and non-technical audiences.

Benefits

We offer a comprehensive benefits package including Medical Insurance, PF, Gratuity, paid holidays, and more.

About us

Whether it’s awareness, advocacy, engagement, or efficacy, we move brands forward with work that connects with audiences and delivers results. Through meaningful analytics, engaging communications and innovative technology solutions, we help clients tackle their most ambitious projects and overcome their biggest challenges.

We are an equal opportunity employer

We believe that Innovative ideas and solutions start with unique perspectives. That’s why we’re committed to providing every employee a workplace that’s free of discrimination and intolerance. We’re proud to be an equal opportunity employer and actively search for like-minded people to join our team