Lead Data Engineer - R01548769

Alpharetta, Georgia, United States

Brillio

From data ingestion and transformation to advanced analytics and visualization, we provide end-to-end solutions to help you drive business growth.

View all jobs at Brillio

Apply now Apply later

About Brillio:
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction. Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.
Lead Data Engineer

Primary Skills

  • Data Modelling Fundamentals, Data Warehousing, ETL Fundamentals, Modern Data Platform Fundamentals, PLSQL, T-SQL, Stored Procedures, Python, Snowflake Data Exchange, Snowpipe, SnowSQL, SQL, SQL (Basic + Advanced), Time Travel and Fail Safe, Zero Copy Cloning

Secondary Skills

  • Azure, AI/ML

Specialization

  • Snowflake Data Architecture: Lead Data Engineer

Job requirements

  • Brillio LLC is a fast growing, pure play Digital Transformation Solutions and Services firm backed by Bain Capital private equity. Founded in 2014 and headquartered in Silicon Valley, Brillio is focused on delivering design led solutions for our customers. We are not an IT Services company trying to pivot and support the “next big thing.” As a digitally native company, everything we have done and will continue to do, will have this laser focus.
  • Our culture is driven by Brillio’s Core Values and it is the foundation of who we are as an organization. We equip and empower our employees to push boundaries with an ‘Founder’s Mindset’ spirit as they craft ‘Customer Success’ stories. With our customer-centric approach, we deliver ‘Excellence and Innovation’ at every level of our collaboration and this is what fuels Brillio’s growth story. While we are proud of our journey so far, ‘ Care and Compassion’ about our customers, employees and the community where we thrive in. We strive to stay committed to lighting up 100,000 young minds through our CSR efforts.
  •  
  • Role: Senior Data Engineer
  • Location: Atlanta, GA
  • Full-Time
  •  
  • The ideal candidate will have extensive expertise in data engineering, with a focus on data warehousing, Snowflake, streaming data pipelines, Kafka, Debezium, BI and reporting tools, embedded reporting, and ETL processes. This role will involve designing, implementing, and optimizing scalable data solutions to support business intelligence, analytics, and AI/ML needs.
  • Key Responsibilities
  • Data Pipeline Development: Design, build, and maintain robust ETL/ELT pipelines for efficient data ingestion, transformation, and integration from diverse sources.
  • Data Warehousing: Architect and optimize data warehouse solutions using Snowflake, ensuring scalability, performance, and reliability.
  • Streaming Data Pipelines: Develop and manage real-time data streaming pipelines using technologies such as Kafka and Debezium.
  • ERP Integration: Collaborate with ERP system teams to ensure seamless integration of enterprise data into the data ecosystem. Understand SSO, embedded reporting scenarios.
  • BI and Reporting: Work with BI tools (e.g., OAS, Domo, etc) to enable embedded reporting solutions and provide actionable insights.
  • Data Modeling: Design scalable data models (e.g., star schema, snowflake schema) to support analytics and reporting needs.
  • Collaboration: Partner with cross-functional teams including to understand requirements and deliver tailored solutions.
  • System Monitoring & Optimization: Monitor system performance, troubleshoot issues, and implement optimizations to enhance efficiency.
  • Required Skills & Qualifications Technical Expertise:
  • Proficiency in Snowflake architecture and SQL for complex queries.
  • Hands-on experience with Kafka for real-time data streaming.
  • Familiarity with cloud platforms such as AWS and Azure.
  • Knowledge of ERP systems integration.
  • Data Engineering Skills:
  • Expertise in data modeling techniques (e.g., star schema, snowflake schema).
  • Solid understanding of access control mechanisms and SSO protocols.
  • Experience in designing scalable ETL/ELT pipelines.
  • Soft Skills:
  • Strong problem-solving abilities in ambiguous environments.
  • Excellent communication skills for collaborating across teams.
  • Preferred Qualifications
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • Experience migrating on-premise systems to cloud-based platforms.
  • Familiarity with modern CI/CD pipelines for deployment automation.
  •  
 Know what it’s like to work and grow at Brillio: Click here
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  0  0  0

Tags: Architecture AWS Azure Business Intelligence CI/CD Computer Science Data pipelines Data warehouse Data Warehousing ELT Engineering ETL Kafka Machine Learning Pipelines Python Snowflake SQL Streaming T-SQL

Perks/benefits: Startup environment

Region: North America
Country: United States

More jobs like this