Data Engineer
Dearborn, United States
OneMagnify
OneMagnify is a global performance marketing organization working at the intersection of brand marketing, technology, and analytics. The Company’s core offerings accelerate business, amplify real-time results, and help set their clients apart from their competitors. OneMagnify partners with clients to design, implement and manage marketing and brand strategies using analytical and predictive data models that provide valuable customer insights to drive higher levels of sales conversion.
OneMagnify’s commitment to employee growth and development extends far beyond typical approaches. We take great pride in fostering an environment where each of our 700+ colleagues can thrive and achieve their personal best. OneMagnify has been recognized as a Top Workplace, Best Workplace and Cool Workplace in the United States for 10 consecutive years and recently was recognized as a Top Workplace in India.
About You:
The Data Engineer will collaborate directly and continuously with Product Managers, Product Owners, Software Engineers, Data Engineers, down-stream business and analytics users, as well as Subject-Matter Experts. Experience with large-scale solutions and operationalization of data warehouses, data lakes, and analytics platforms on GCP is needed. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to craft the right solutions with an appropriate combination of GCP and 3rd party technologies for deploying on the GCP cloud.
What You'll Do:
- Work as part of an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment of Data Platform Implement methods for automation of all parts of the pipeline to minimize labor in development and production.
- Provide curated data solutions and products in support and implementation of a corporate dashboard
- Identify, develop, evaluate, and summarize Proof of Concepts to prove solutions
- Test and compare competing solutions and report a point of view on the best solution
- Ensure data quality, maintain profiles of data products, monitor system performance
- Design and build production data engineering solutions to deliver our pipeline patterns using Google Cloud Platform (GCP) Services
- Work within GCP environment. Tools used include BigQuery, VS Code, GitHub, Python, Cloud SQL, Spanner, Kubernetes, Apigee, Astronomer, Apache Airflow, Cloud Run, DataFlow (Apache Beam), Terraform and Tekton
- As the SME on your data products, collaborate with and provide on-going support to Business, analytic teams and users
What You'll Need:
- Experience in data engineering pipelines/ building data warehouse systems with the ability to understand ETL principles and write complex SQL queries - 3 Years
- GCP experience working in GCP-based Big Data deployments (Batch/Real-Time) leveraging Big Query, Google Cloud Storage, PubSub, Data Fusion, Dataflow, Spanner, Kubernetes, Apigee - 1 Year
- Experience and expertise in VS Code, GitHub and Terraform to deploy data solutions and products via DAGs with Astronomer, Apache Airflow
- Experience with Python in relation to code as infrastructure
- GCP Certification Preferred - Professional Data Engineer or Associate Cloud Engineer
- Ability to provide analytic and creative solutions to business problems by deep-dives into data
- Experience in Qlik Sense and Looker preferred but not required
Benefits
We offer a comprehensive benefits package including medical, dental, 401(k), paid holidays, vacations, and more.
About us
Whether it’s awareness, advocacy, engagement, or efficacy, we move brands forward with work that connects with audiences and delivers results. Through meaningful analytics, engaging communications, and innovative technology solutions, we help clients tackle their most ambitious projects and overcome their biggest challenges.
We are an equal opportunity employer
We believe that innovative ideas and solutions start with unique perspectives. That’s why we’re committed to providing every employee a workplace that’s free of discrimination and intolerance.We’re proud to be an equal opportunity employer and actively search for like-minded people to join our team.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform job functions, and to receive benefits and privileges of employment. Please contact us to request accommodation.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Big Data BigQuery Dataflow Data quality Data warehouse Engineering ETL GCP GitHub Google Cloud Kubernetes Looker Pipelines Python Qlik SQL Terraform
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.