Staff Data Engineer (Data Lake)

Who We AreRed Canary was founded to create a world where every organization can make its greatest impact without fear of cyber threats. We’re a cyber security company who protects, supports and empowers organizations to make better security decisions so they can focus on their mission without fear of cyber threats.
The combination of our market-defining technology and expertise prevents breaches every day and sets a new standard for partnership in the industry. We’re united in our commitment to customers and grounded in our values, which earned us a place on Built In’s 2025 Best Places to Work list.  If our mission resonates with you, let’s talk.
What We Believe In- Do what’s right for the customer- Be kind and authentic- Deliver great quality- Be relentless
Challenges You Will SolveAt Red Canary, we believe data is the key to outsmarting cyber threats.  We’re building a state-of-the-art security data lake to empower our customers and teams across Red Canary and we are looking for expertise to join and help shape the future of this technology.  You’ll be part of a high-impact, lean team dedicated to building governance and automation solutions that keep our data lake optimized, scalable, and secure. As the center of excellence for Red Canary’s production data lake, this team ensures seamless access, drives continuous evolution, and upholds the highest standards of governance and operational efficiency.
As a Staff Data Engineer, you will be a key contributor to our mission to harness data for securing organizations. Your technical expertise will directly influence Red Canary's ability to detect and respond to cybersecurity threats at scale. By building and optimizing robust data pipelines and frameworks, you will ensure that our platform continues to deliver actionable, data-driven insights to our customers.
Your work will focus on solving complex data challenges, streamlining data processing, and delivering high-quality data solutions that power Red Canary's detection engines. You will contribute significantly to the evolution of our data engineering practices and the enhancement of our cybersecurity capabilities.

What You'll Do

• Design, develop, and maintain data pipelines and workflows to support scalable and reliable data processing with cybersecurity considerations at the forefront.
• Develop and implement comprehensive data strategies that address the needs of our customers, enhancing Red Canary’s ability to detect and respond to cybersecurity threats.
• Collaborate closely with other departments to integrate cybersecurity data insights into our overall service offering.
• Oversee the enhancement of data quality, reliability, and security, ensuring our data infrastructure is robust, scalable, and aligned with industry best practices.
• Research and implement modern tools and technologies to optimize data pipelines and storage solutions.
• Troubleshoot and resolve data pipeline and infrastructure challenges to ensure operational continuity.
• Actively contribute to team discussions on architecture, technical designs, and future roadmap items.

What You'll Bring

• Demonstrated impact at scale  in data engineering, with a strong background in cybersecurity or a related field.
• Expertise in programming and scripting languages such as Python, SQL, and Scala or PySpark.
• Experience building and maintaining data processing systems using cloud platforms, especially AWS (Glue, EMR, Athena, S3, Redshift).
• Strong understanding of modern data storage formats like Parquet and Delta Lake, and open table formats (Iceberg, Hudi).
• Familiarity with big data frameworks (Apache Spark, Kafka) and orchestration tools like Apache Airflow.
• Experience working with ETL/ELT pipelines and transformation tools (e.g., dbt).
• A solid understanding of containerization and orchestration technologies, such as Docker and Kubernetes.
• Strong problem-solving skills, with the ability to debug and optimize complex data workflows.
• Effective communication skills for working collaboratively across technical and non-technical teams.
• A strong desire to mentor and develop others, sharing your expertise to elevate the team's capabilities.

Targeted base salary range: $198,462 - $225,000. This role is eligible for participation in the company's bonus program. This role is also eligible for a grant of stock options, subject to the approval of the company's board of directors. The application deadline is 3/14/2025.
Benefit Highlights:- 100% Paid Premiums:  Red Canary offers a 100% paid plan option for medical, dental and vision for you and your dependents. No waiting period.- Health & Wellness - Access to mental health services, Employee Assistance Program and additional programs to incentivize healthy habits.  - Fertility Benefits: All new hires are eligible for benefits as of their first day.- Flexible Time Off: Take the time you need to recharge including vacation, sick, bereavement, jury duty, and holidays. - Paid Parental Leave- Full base pay to bond/care for your new child.- Pre-Tax Plans - Red Canary offers a variety of plans to fit you and your dependent specific needs including FSA, HRA and HSA, with employer funding to offset out of pocket health care expenses. - Flexible Work Environment- With 60% remote workforce, Canaries can work virtually from almost anywhere in the US.
Why Red Canary?Red Canary is where people embody our mission to improve security outcomes for all. People work hard to maintain a culture that encourages authenticity in order to do your best work. Our people are driven and committed to finding the best security outcomes, delivering real and actionable answers, and being transparent along the way. 
At Red Canary, we offer a very rich benefits program to our full-time team members so they can focus on their families and improving our customers’ security. For a full list of benefits, please review our Benefits Summary:https://resource.redcanary.com/rs/003-YRU-314/images/RedCanary_2025BenefitsSummary.pdf?version=0
Individuals seeking employment at Red Canary are considered without regard to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation.