Senior Software Engineer, Distributed Systems

SecurityScorecard is the global leader in cybersecurity ratings, with over 12 million companies continuously rated, operating in 64 countries. Founded in 2013 by security and risk experts Dr. Alex Yampolskiy and Sam Kassoumeh and funded by world-class investors, SecurityScorecard’s patented rating technology is used by over 25,000 organizations for self-monitoring, third-party risk management, board reporting, and cyber insurance underwriting; making all organizations more resilient by allowing them to easily find and fix cybersecurity risks across their digital footprint.

Headquartered in New York City, our culture has been recognized by Inc Magazine as a “Best Workplace,” by Crain’s NY as a “Best Places to Work in NYC,” and as one of the 10 hottest SaaS startups in New York for two years in a row. Most recently, SecurityScorecard was named to Fast Company’s annual list of the World’s Most Innovative Companies for 2023 and to the Achievers 50 Most Engaged Workplaces in 2023 award recognizing “forward-thinking employers for their unwavering commitment to employee engagement.” SecurityScorecard is proud to be funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV and Riverwood Capital.

About The Team:

The Signals Intelligence (SIGINT) team collects signals and data on a massive scale translating them into actionable intelligence that helps drive SecurityScorecard’s flagship security ratings and Attack Surface Intelligence products. This team develops scalable distributed systems to collect data at scale from the Internet, dark web, clear web, telegram/discord and other content. This team partners with the Threat Research & Insights team and other parts of the organization to understand the requirements that define what goes into new signals. Come be part of an exciting team that is building the next generation of threat intelligence.

About The Role:

This contractor role focuses on the design and development of systems dedicated to distributed data collection and Internet scanning. Responsibilities include overseeing the management of collected data feeds, which are integrated into SecurityScorecard’s processing pipeline and scoring mechanisms to enhance the Ratings Platform. A central responsibility of this role is enhancing and expanding the capabilities of web crawling and data collection systems. This includes scaling these systems to handle higher frequencies of web scans and integrating extensive datasets from millions of companies into the Ratings Platform. Moreover, the position is focused on pioneering and refining techniques for efficiently operationalizing the gathering of comprehensive web-based and Internet-wide data and threat intelligence. This is a remote role located in Canada, LATAM or US only.

Please note that this is a 9-12 month contract position.

Required Qualifications:

• 2+ years experience with low-level languages (e.g. Go, C, C++)
• 3+ years of experience with Scripting languages (e.g. Python, Ruby)
• Experience with SQL (e.g. Postgres)
• Knowledge of Selenium, Scrapy or other web crawling mechanisms
• Experience with Confluent Kafka, Apache Kafka
• Experience with message queues (e.g. RabbitMQ, SQS)
• 3+ years of experience with building distributed systems
• Experience building Restful API’s from scratch.
• Working knowledge in one or more of the following: Networking protocols, Network based scanning (nmap, zmap, nessus, masscan, etc), web crawling

Preferred Qualifications:

• Experience with software design principles, and test-driven development
• Strong experience with Apache Kafka
• Comfortable working as part of a distributed team
• Excellent communication and teamwork skills
• Experience with Internet scanning (NMAP, masscan, ZMAP, etc)
• Experience building web-crawlers and or data crawlers at-scale
• Ability to do independent research
• Ability to make data driven decisions

Benefits:

SecurityScorecard is committed to Equal Employment Opportunity and embraces diversity. We believe that our team is strengthened through hiring and retaining employees with diverse backgrounds, skill sets, ideas, and perspectives. We make hiring decisions based on merit and do not discriminate based on race, color, religion, national origin, sex or gender (including pregnancy) gender identity or expression (including transgender status), sexual orientation, age, marital, veteran, disability status or any other protected category in accordance with applicable law.