Software Development Engineer - Data Acquisition and Scraping

Seattle, WA, US

Red Violet

red violet identity intelligence solutions enable frictionless commerce, ensure safety, and reduce fraud and the concomitant expense borne by society.

View all jobs at Red Violet

Apply now Apply later

Description

Our Company:

At red violet, we build proprietary technologies and apply analytical capabilities to deliver identity intelligence. Our technology powers critical solutions, which empower organizations to operate with confidence. Our solutions enable the real-time identification and location of people, businesses, assets and their interrelationships. These solutions are used for purposes including risk mitigation, due diligence, fraud detection and prevention, regulatory compliance, and customer acquisition. Our intelligent platform, CORE™, is purpose-built for the enterprise, yet flexible enough for organizations of all sizes, bringing clarity to massive datasets by transforming data into intelligence. Our solutions are used today to enable frictionless commerce, to ensure safety, and to reduce fraud and the concomitant expense borne by society.


The Role:

We are seeking a talented Software Development Engineer - Data Acquisition and Scraping to join our dynamic Seattle team. In this role, you will use your software development and automation skills to design and build high-performance automated web crawling and scraping systems, create ETL data pipelines, and manage the data aggregation systems that enhance Red Violet’s data assets and service offerings. Together we’ll be working in a highly distributed, Linux-based environment that leverages the best of open-source technologies, cloud computing, and our proprietary distributed search and computing platform. You’ll collaborate with the data science team to assist with data integration, analysis and much more. If you're ready to tackle exciting challenges, work with a highly skilled team, and help us build the best identity verification products, we’d love to hear from you. 


What You Will Do:

  • Design, develop, and maintain complex web crawling and scraping solutions with a focus on performance and accuracy with full ownership of the platform and technologies used.
  • Build scalable tools that automate web crawling, scraping, and data aggregation to populate databases in a distributed Linux environment.
  • Develop ETL systems and data pipelines to interface new data assets with our proprietary distributed data processing platform.


What You Bring:

  • A bachelor's degree in computer science or related degree.
  • Experience with Linux, Python, and various web scraping tools.
  • Experience with distributed computing in a cloud environment.
  • Applicants must have permanent work authorization in the U.S.; we are not sponsoring visas for this role. 


What We Offer:

red violet offers excellent benefits including opportunity for stock (RSU) grants, a 401K and generous company match, flexible PTO policy, medical, dental and vision coverage, commuter benefits, in-office healthy snacks, team events and more.


red violet is proud to be an Equal Opportunity Employer.


Salary Description

Salary Range for WA: $145,000 – $165,000

Apply now Apply later
Job stats:  1  0  0
Category: Engineering Jobs

Tags: Computer Science Data pipelines ETL Linux Open Source Pipelines Python

Perks/benefits: 401(k) matching Flex hours Flex vacation Health care Team events

Region: North America
Country: United States

More jobs like this