Data Engineer

We are seeking an experienced Data Engineer to join our AI search team. As a Senior Data Engineer at ThoughtSpot, you will be responsible for designing, building, and maintaining the data infrastructure that powers our analytics platform and underlying Natural Language Search engine . You will work closely with data scientists, software engineers, and product managers to ensure our data systems are robust, scalable, and efficient. We have a rapidly expanding list of happy customers who love our product and we're growing to serve even more

What you'll do:

• Design, develop, and maintain scalable data pipelines to process large volumes of data from various sources.

• Working closely with our product teams and ML engineers to build features that directly impact the robustness and accuracy of our search infrastructure and NLS engine

• Ensure data quality and consistency through rigorous testing and validation processes.

• Monitor and troubleshoot data pipeline performance and resolve any issues

What you bring: 

•  6+ years of experience in python, building data infra and pipelines for product companies

• Proficiency in programming languages such as Python and data processing libraries such as Pandas and Numpy. Experience with Java is good to have.

• Experience building and maintaining large data pipelines, data infrastructure, (Kubernetes preferred) and Machine learning infrastructure

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases/warehouses 

• Working knowledge of message queuing, stream processing, and highly scalable data stores

• Experience working with data tools: Spark, Kafka, etc.

• Experience with data pipeline and workflow management tools like Dagster or Airflow with code and no-code ETL implementations

• Experience with cloud services such as AWS, GCP, Azure etc

• Knowledge of data warehousing concepts and experience with databases like Snowflake, Redshift with experience with data model design, and optimization for data warehousing

• Understanding of data governance, data quality, data anonymization and security best practices.

• Advanced knowledge of development good practices such as testing, code reviews and git.

• Experience with monitoring, tracing tools and alerting tools.

• Strong problem-solving skills and the ability to work independently and as part of a team.

• You love building and leading exceptional teams in a fast-paced, entrepreneurial environment. You have a strong bias for action and being resourceful

• You are obsessed with the customer experience and uncompromising engineering standards

• Bring amazing problem-solving skills and an ability to identify, quantify, debug, and remove bottlenecks and functional issues

• Great communication skills, both verbal and written, and an interest in working with a diverse set of peers and customers

• Alignment with ThoughtSpot Values

What makes ThoughtSpot a great place to work?

ThoughtSpot is the experience layer of the modern data stack, leading the industry with our AI-powered analytics and natural language search. We hire people with unique identities, backgrounds, and perspectives—this balance-for-the-better philosophy is key to our success. When paired with our culture of Selfless Excellence and our drive for continuous improvement (2% done), ThoughtSpot cultivates a respectful culture that pushes norms to create world-class products. If you’re excited by the opportunity to work with some of the brightest minds in the business and make your mark on a truly innovative company, we invite you to read more about our mission, and apply to the role that’s right for you.

ThoughtSpot for All

Building a diverse and inclusive team isn't just the right thing to do for our people, it's the right thing to do for our business. We know we can’t solve complex data problems with a single perspective. It takes many voices, experiences, and areas of expertise to deliver the innovative solutions our customers need. At ThoughtSpot, we continually celebrate the diverse communities that individuals cultivate to empower every Spotter to bring their whole authentic self to work. We’re committed to being real and continuously learning when it comes to equality, equity, and creating space for underrepresented groups to thrive. Research shows that in order to apply for a job, women feel they need to meet 100% of the criteria while men usually apply after meeting 60%. Regardless of how you identify, if you believe you can do the job and are a good match, we encourage you to apply.