NetVendor VS profiles

Needing to benchmark what was in my network I built NetVendor that takes network router output called an arp table and turns into actionable data of what exactly is on the network

Now, the reason for the asterisk in the last section is that it is obviously a little more complicated than simply hardcoding the news sources into the very software itself. OSINTer works by collecting information and then store it in a database, until it's needed by the CTI researcher, which means that when scraping websites we want to be able to filter out unnecessary information and clutter like ads, layout specific sections and other parts of the website which isn't directly related to the news story. To do this, OSINTer makes use of a Domain Specific Language or DSL created by me. All of that sounds rather fancy, but what it all translates to is that OSINTer takes in a series of files in a simple and structured JSON format, which describes which websites to scrape, and which parts of these websites to keep. This also means that it is not only very fast to add new news-sources (approx 5 mins) but also that if OSINTer where to be used for trend research in a completely different area, it would be possible to switch out these JSON files and have OSINTer collect some completely different data. Within the context of OSINTer, are this DSL called profiles and can be found at https://gitlab.com/osinter/profiles