Senior Data Engineer
San Francisco
Kiddom
Kiddom drives K-12 school performance. The highest-quality curriculum combined with teaching tools to make your classroom more efficient and effective.Kiddom is a groundbreaking educational platform that promotes student equity and growth by uniting high-quality instructional materials with dynamic digital learning. Through unparalleled curriculum management functionality, Kiddom empowers schools and districts to take ownership of their curriculum – resulting in learning experiences tailored to meet the unique needs and goals of local communities. Kiddom’s high-quality curriculum is layered with robust teacher and leader data insights to drive the continuous improvement of instructional decisions, school/district programming, and professional learning.
Kiddom seeks to fundamentally change how K-12 classrooms around the world use technology. Education technology is increasingly fragmented across various applications, software, and services. This undermines the utility of technology for educators, leading to cognitive overload, frustration, and ultimately rejection. Kiddom's classroom system helps at all levels by integrating content, curriculum, communication and analytics to best improve student outcomes. We are currently helping educators in 70% of US public schools, including hundreds of thousands of K-12 teachers, deliver the kind of education previously only accessible to students attending expensive, high-end private institutions.
As an education technology company, teachers depend on us to be reliable and work as hard as they do. We're looking for an experienced software engineer with a focus on testing to lead our quality assurance initiatives. Help us design and build our testing infrastructure: integration testing, regression testing, but also finding, managing, and squashing bugs.
About the TeamThe Data Architecture team builds and supports Kiddom’s data systems. In addition to improving the core architecture of our curriculum graphs and analytics, they also support other teams in the company and their usage of the Kiddom data platform, with an eye for student data privacy and security.
About the RoleYou will work closely with other departments, including Product, Engineering, and Analytics, to understand and cater to their data needs. You will also define and document data workflows, pipelines, and transformation processes for clear understanding and knowledge sharing.
Projects include:
Scalable Data Pipeline Construction:Design, build, and maintain scalable data pipelines to transform raw data into analytics-ready datasets.Ensure optimal performance, reliability, and efficiency of the data pipelines.Ability to design and build scalable data pipelines using AWS Data Pipeline, AWS Glue, DBT or similar services.Optimization and Performance Tuning:Monitor and Deploy the data infrastructure for performance bottlenecks and implement optimizations as necessary.Collaborate with other engineering teams to ensure seamless data integration with high availability.Tech Stack Mastery:Leverage SQL, DBT, Golang, Python, Terraform and AWS tools to enhance our data infrastructure.keeping the Kiddom team updated on the latest advancements in AI and data engineering tools and best practices.Data Storage and Management: Knowledge of AWS storage solutions (e.g., S3, DynamoDB) and database services (e.g., RDS, Redshift).Data Preprocessing: Skills in preprocessing and transforming raw data into a format suitable for machine learning.
About youWe are looking for someone with excellent communication skills, with the ability to articulate complex technical concepts to non-technical stakeholdersDo you have a strong understanding of PII compliance and best practices in data handling and storage. If you also exhibit strong problem-solving skills, with a knack for optimizing performance and ensuring data integrity and accuracy, we want to chat!
You Have
- Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.
- 3+ years of experience as a data engineer, and 8+ years of software engineering experience (including data engineering)
- Expertise with RDMS and Data Warehousing, demonstrating ability to design and optimize data pipelines, systems and architectures.
- Experience in managed services for data ingestion/processing with hands-on experience working in AWS environments and operational experience with deploying infrastructure on AWS using Terraform.
- Expert-level knowledge of SQL and a solid understanding of NoSQL & graph databases (e.g., Cassandra, Neptune).
- Experience with distributed compute platforms and frameworks, such as Kubernetes/ECS, AWS Lambdas, Spark and distributed storage systems.
- Expertise with any of data orchestration platforms such as Airflow, Dagster, Prefect or similar frameworks.
What we offerFull time permanent employees are eligible for the following benefits:-Competitive salary-Meaningful equity-Health benefits: medical (various PPO/HMO/HSA plans), dental, vision, disability and life insurance -10 paid sick days per year-Unlimited vacation time policy (subject to internal approval). Average use 4 weeks off per year.-Paid family leave for eligible employees
COVID Vaccination PolicyKiddom policy requires employees to be vaccinated before they visit an office or attend company events..We have remote roles but in certain positions where office attendance is deemed to be essential to the role, offers of employment shall be conditional upon proof of vaccination.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture AWS AWS Glue Cassandra Computer Science Dagster Data pipelines Data Warehousing dbt DynamoDB ECS Engineering Golang Kubernetes Machine Learning NoSQL Pipelines Privacy Python Redshift Security Spark SQL Terraform Testing
Perks/benefits: Career development Competitive pay Equity / stock options Health care Insurance Medical leave Startup environment Team events Unlimited paid time off
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.