Software Engineer – Web Crawling
WoflowFull Time
Mid-level (3 to 4 years)
Candidates must possess extensive knowledge of HTTP, HTML, CSS, JavaScript, and other web technologies. A minimum of several years of experience with Python, AWS, Linux, and containerization technologies like Docker and Kubernetes is required. Experience working in remote engineering teams using Agile software development methodologies is also necessary. The ideal candidate will have a proven track record of building and maintaining web scraping tools at scale, acting as a technical lead, and mentoring junior developers.
The Full Stack Data Collection Lead will drive engineering efforts for the data collection team, collaborating with architects, data scientists, and devops to design, implement, and support data collection solutions. This role involves leading the development of high-volume data collection systems, rapidly developing high-quality, scalable code as an individual contributor, and creating proofs-of-concept and prototypes. Responsibilities also include collaborating on the roadmap for data collection capabilities, staying current with web scraping technologies, overseeing the data collection codebase, maintaining coding standards, and ensuring the security and scalability of the software. The lead will also support the data collection capability by responding to issues, adapting collection methods, and independently solving problems within an Agile framework.
Provides advanced technology solutions for defense
Two Six Technologies specializes in providing advanced technological solutions for critical missions, focusing on areas such as cybersecurity, data science, and electronic systems. Their products and services are designed to help U.S. government agencies, including DARPA and U.S. Cyber Command, defend networks and address advanced threats. The company operates on a project-based model, creating custom solutions tailored to the specific needs of their clients, which allows them to effectively respond to the unique challenges in national security and defense. Unlike many competitors, Two Six Technologies emphasizes rapid innovation and has a strong leadership team with expertise in relevant fields. Their goal is to deliver technological superiority to the United States and its allies through impactful advancements.