Full Stack Data Collection Lead
Remote, USA
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
Full Time Senior-level / Expert USD 120K - 195K
- Remote-first
- Website
- @twosixtech 𝕏
- Search
Two Six Technologies
Advancing safety and trust on matters of global importance.At Two Six Technologies, we build, deploy, and implement innovative products that solve the world’s most complex challenges today. Through unrivaled collaboration and unwavering trust, we push the boundaries of what’s possible to empower our team and support our customers in building a safer global future.
Would you like to use your full stack engineering skills to help policy makers, corporate leaders, and operators make sense of increasingly complex information spaces? Two Six Technologies provides Information Advantage to Government, Military, and Fortune 50 customers tasked with mission critical decision making.
Our products collect and synthesize huge quantities of publicly available data in multiple languages, then serve that data to be easily queried by our expert analysts and used in machine learning analytics. As the lead engineer on our data collection team you will drive the engineering efforts of the team, and collaborate with architects, data scientists, and devops to design, implement, and support data collection solutions at scale, using the latest approaches and technologies in the web scraping space.
As a top candidate you have extensive knowledge of HTTP, HTML, CSS, JavaScript, and other web technologies, and you understand how these technologies interact to make websites work. You have been working with Python for multiple years and you have experience building solutions using AWS, Linux, and with containerization technologies like Docker and Kubernetes. You also have been a member of remote engineering teams working in Agile software development environments.
You have previously built and maintained web scraping tools that navigate and collect publicly available data at scale. You also enjoy working out novel solutions to technical challenges, and staying current with the latest developments in the web scraping community. You have previously been a key resource or a technical lead for an application or platform capability, and successfully balanced high level individual contribution and technical leadership, providing an example to teammates and mentoring less experienced developers. You have experience being a “go-to” technical expert, leading the implementation of features and fixes, while ensuring the continued quality, scalability, and security of the codebase.
Most importantly you share our passion for applying technology to solve hard problems and finding innovative ways to collect and derive insights from high-volume data.
Responsibilities:
- Leading the development of high volume data collection solutions that enable analysis by both human experts and machine learning solutions
- Rapidly develop software as an individual contributor at a high level and be an exemplar of quality, scalable, robust code
- Creating proofs-of-concept and prototypes to quickly test ideas, as well as designing and building scalable, production-ready solutions
- Collaborating with architects and Product leads on the roadmap for data collection capabilities
- Staying current with the latest technological developments in web scraping and the challenges of maintaining collection as data sources quickly evolve
- Operating in a collaborative environment, with a focus on taking action and working closely with peers to enable team success
- Overseeing the data collection codebase, setting and maintaining coding standards, patterns, and best practices
- Supporting the data collection capability, researching and responding quickly to issues, adapting collection to meet new challenges
- Considering security best practices at every phase of software development
- Continuously learning and improving
- Working within Agile software development methodologies and being an active part of our continuous improvement efforts
- Working in a fully remote team with a diverse set of skills and experiences
- Independently identifying and solving problems, and questioning assumptions in pursuit of the right solutions
- Actively participating in the peer code review process, both providing feedback, but also being open and receptive to feedback
- Creating and executing both manual and automated testing
Qualifications:
- Experience with the design, development, testing, and support of scalable, data-driven applications written in Python and deployed to production SaaS environments
- Experience with web scraping and other techniques for collecting data from the internet
- Deep understanding of HTTP, HTML, JavaScript, CSS, and other technologies that power websites
- Experience with AWS or similar cloud-based infrastructure
- Experience as a technical lead or key resource for an application, capability, or code base
- Experience working independently and as a part of an Agile team
Optional Skills / Domain Experience
- Experience with Scrapy or other web scraping technologies is a huge plus
- Experience with Docker and Kubernetes
- Experience with Object Oriented Programming (OOP)
- Experience with database technologies, ideally Elastic and Postgres
- AWS certification
Clearance/Citizenship:
- Preferred TS Cleared
- Must be eligible to obtain a US government clearance
We write position descriptions to give you the fullest picture we can of what the role entails. You have additional skills and experience that can add to our team that we did not capture in this short description. If you are interested in this role, but are on the fence about applying because you are uncertain that you meet every single criteria, then we encourage you to apply!
Two Six Technologies is an Equal Opportunity Employer and does not discriminate in employment opportunities or practices based on race (including traits historically associated with race, such as hair texture, hair type and protective hairstyles (e.g., braids, twists, locs and twists)), color, religion, national origin, sex (including pregnancy, childbirth or related medical conditions and lactation), sexual orientation, gender identity or expression, age (40 and over), marital status, disability, genetic information, and protected veteran status or any other characteristic protected by applicable federal, state, or local law.
If you are interested in applying for employment with Two Six Technologies and require an accommodation, please contact Human Resources at Two Six Technologies by sending an email to hr@twosixtech.com. Information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.
EOE, including disability/vets.
Two Six Technologies is committed to providing competitive and comprehensive compensation packages that reflect the value we place on our employees and their contributions. We believe in rewarding skills, experience, and performance. Our offerings include but are not limited to, medical, dental, and vision insurance, life and disability insurance, retirement benefits, paid leave, tuition assistance and professional development.
The projected salary range listed for this position is annualized. This is a general guideline and not a guarantee of salary. Salary is one component of our total compensation package and the specific salary offered is determined by various factors, including, but not limited to education, experience, knowledge, skills, geographic location, as well as contract specific affordability and organizational requirements.
Salary Range$120,000—$195,000 USDLooking for other great opportunities? Check out Two Six Technologies Opportunities for all our Company’s current openings!
Ready to make the first move towards growing your career? If so, check out the Two Six Technologies Candidate Journey! This will give you step-by-step directions on applying, what to expect during the application process, information about our rich benefits and perks along with our most frequently asked questions. If you are undecided and would like to learn more about us and how we are contributing to essential missions, check out our Two Six Technologies News page! We share information about the tech world around us and how we are making an impact! Still have questions, no worries! You can reach us at Contact Two Six Technologies. We are happy to connect and cover the information needed to assist you in reaching your next career milestone.
Two Six Technologies is an Equal Opportunity Employer and does not discriminate in employment opportunities or practices based on race (including traits historically associated with race, such as hair texture, hair type and protective hair styles (e.g., braids, twists, locs and twists)), color, religion, national origin, sex (including pregnancy, childbirth or related medical conditions and lactation), sexual orientation, gender identity or expression, age (40 and over), marital status, disability, genetic information, and protected veteran status or any other characteristic protected by applicable federal, state, or local law.
If you are an individual with a disability and would like to request reasonable workplace accommodation for any part of our employment process, please send an email to accommodations@twosixtech.com. Information provided will be kept confidential and used only to the extent required to provide needed reasonable accommodations.
Additionally, please be advised that this business uses E-Verify in its hiring practices.
By submitting the following application, I hereby certify that to the best of my knowledge, the information provided is true and accurate.
Tags: Agile AWS DevOps Docker Engineering JavaScript Kubernetes Linux Machine Learning OOP PostgreSQL Python Security Testing
Perks/benefits: Career development Competitive pay Health care Insurance Medical leave
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.