sherlock VS handlefinder

In the interest of cleaning my digital life a bit I really want to delete all of my old accounts that I no longer use. The terminal application "Sherlock" on github can search for instances of a username you input and find associated websites. Sherlock

1.) Search for the username that you use on YouTube on other sites, to find additional information. This could literally involve putting the username in to different search engines, or using tools such as Sherlock.

How can I move and manage large numbers of virtual environments? The most of them is based on GitHub tools, for example: https://github.com/sherlock-project/sherlock. Can I move created virtual environments between the same OS (Ubuntu > Ubuntu or Fedora > Fedora)?

If you're tech savy, you could try running their Internet handles through a software called Sherlock. It will search different social media platforms. I'm not sure if there is a web alternate tp Sherlock, but using different search engines is also worth a shot (like bing).

Met this tool thou so many patches it worked https://sherlock-project.github.io/

Sherlock-Project is the most efficient way to hunt down social media accounts by username across social networks. This is great if your target uses the same username in most media platforms.  https://github.com/sherlock-project/sherlock

MorningBot: https://github.com/bnkc/morningbot HandleFinder: https://github.com/bnkc/handlefinder ThreeSigma: https://www.threesigma.ai

I found myself scrolling through Github’s “trending” repos, looking for some coding inspiration. Within the next hour, I stumbled across something called The Sherlock Project. Interesting, It had over 35k stars, must be pretty popular.

I quickly cloned the repo and started toying around with it. It didn’t take me long to realize the power of this tool. All I had to do was insert a username, and Wa Lah! I was looking at every social media website that was associated with the username. Not only that but direct links to the accounts.

I immediately wanted to turn this into a web app so that everyone could use it. My first challenge was that this was a CLI tool, so I got to work. The Sherlock project makes about 400 requests to various site s to check if your username exists. This was going to be tough... I noticed they were using requests.FutureSession to multithread the result.

My first thought was maybe I could collect all the requests into a list and then dump it back to the frontend with a get request, but the issue here was that the results could take a couple minutes to gather, and no-one is gonna sit and wait that long.

Ok, so how do I continuously report out data to the frontend as the requests get full-filled? The answer? Web-sockets. Not just any web-socket though, a multithreaded web-socket. After ALOT of trial and error I finally got something working. The Issue now though was that it wouldn't run in production due to a multiprocessing error: Daemonic processes are not allowed to have children.

The hell did that mean? back to the drawing board. Eventually I learned that you cant use the standard multiprocessing library for this kind of thing, you had to use billiard. Bam! It worked. I quickly hacked together a simple frontend, configured the web socket, and results were pouring in.

Time to post on reddit. I quickly sent out a post or two and eagerly awaited peoples responses. There was an issue though. The more people flooded the site, the slower it got until it was completely unusable. Dang. How do I fix this? I removed the post quickly and got back to work.

Turns out, the web-socket is considered a "long running request" as it makes 400 external requests. Maybe I could use celery to offload this process to a worker and queue it up. I started working on it and realized this was a little out of my skill range.

I then decided to take a look at the logs where I hosted the code and what do i find? CPU, Memory, and bandwidth all reaching a staggering 100% usage. Welp, I found my issue. I did some rework of my codebase and it started running a little faster.

I then realized the true issue. I was using the free tier of Render that only allowed for one instance of my app...duh.

Needless to say, I learned to take it slow, build tests for my code, and be patient with results.

What do you guys think? Any hard lessons learned in coding? What were your takeaways?

Here is also a link to the repo: https://github.com/bnkc/handlefinder

Here is a link to the repo: https://github.com/bnkc/handlefinder