Facial Recognition – Online Research

Facial recognition is something that you may want to zero in on before you begin any type of reverse image searching. If you just want to see if the photo itself is being used anywhere else online, then leaving the photo as is works well. However, what if you have a photo of a person but can’t identify the person? In that case, you may want to search a bit differently.

Google Reverse Image Search

Google doesn’t really focus all that much on the facial recognition aspect of a photo. Instead, it is geared more to searching content. That means it takes into consideration what the photo is about. Is it a photo of a person eating at a restaurant? You may get a large number of results showing you a photo of a person who looks similar, eating at a restaurant.

It doesn’t focus as much on the facial recognition aspect.

One work around to this is to crop your photo before searching through Google Image. Take out all the background and just focus on the face of the person if possible.

Yandex

Yandex’s image search is far superior for facial recognition. I highly recommend using it. Take a look at the difference between searches. I use a standard head shot in all my marketing online. It should come up in a Google reverse image search without any problem. However, it doesn’t.

Look at how much more you information you get from Yandex than from a basic Google Image Search. While there are photo selections offered to the right, Yandex allows you to further crop an area of the photo. This allows you to try the search in more than one way.

Notice also how it offers you sites containing information about where the image is online. It highlights several sites where this exact photo is being used.

Tin Eye

Tin Eye is used all the time in investigations. For this particular exercise, it did not fair as well as the others, however. The result I received from a basic search was a website that is not even up and running anymore.

The Online Personality of Your Subject

Is the online personality of a person different from their in person personality? I recently watched a documentary on Netflix called, “Crime Scene: The Vanishing at the Cecil Hotel.” The docuseries is about a Canadian college student, Elisa Lam, who was a guest of the hotel in 2013. She disappeared and was missing for a period of time around some very unusual circumstances. I won’t tell you anymore, in case you want to watch it.

Her Tumblr account was an open book. Tumblr is a social media platform that was very popular during this time frame. Elisa Lam used it like a diary and in the documentary it is explained in detail what was obtained from the scrubbing of that open source information (OSINT). Her personality came through loud and clear through analyzing her social media posts.

Online Personality

When it comes to pulling online activity from social media, blogs, forums, etc. on your person of interest, personality plays an important role. Everyone in the investigation’s field knows that a person who is narcissistic for example, will provide you with a treasure of information online. In some cases, perhaps even more than you might need.

But what about all those people in between? People approach social media differently and there are many factors to be considered.

Two Major Personality Differences

One would think that an introvert would be non-social but that is not necessarily true. Consider some actors or comedians. Most seem like extraverts by the way they conduct themselves publicly. However, when interviewed, many of them say they are more introverted.

What are some common traits of Introverts?

  • Introverts in social media care about their privacy.
  • They tend to only accept friend requests from people they know.
  • They really don’t care about the number of “likes”.
  • Most likely unaware of friend requests.
  • Will unfollow or delete you.

What are some common traits of extraverts?

  • Extraverts don’t worry about their privacy.
  • They are more inclined to accept invitations from people they don’t know.
  • Extraverts care very much about the “likes” & shares.
  • They do pay attention to friend requests.
  • Most will keep all of their connections close.

 From a psychology point of view we can take a look at “Introvert vs. Extrovert: A Look at the Spectrum and Psychology.  The article points out the following. “How extroverted we are can have a huge bearing on our day-to-day life across a multitude of contexts and it’s important to note that there’s no ‘better’ level of extroversion/introversion – both ends of the spectrum have their advantages and disadvantages but by understanding where we fall on the scale we can address areas in which we’re perhaps lacking.”

Personality predicts what people do on social media.

A large body of research on social media use and personality has focused on the Big 5 personality traits, the most widely accepted trait theory. When people are asked to rate how much different traits characterize them, those traits cluster into five groups:

Knowing and understanding some of this may be of help in your next investigation. It is well worth it to take a look at your subject’s online activity to reveal glimpses into their personality.

The “Must Have” to the “Nice to Have” in Social Research for OSINT

In the world of online research, social research, OSINT, etc., information falls into two main social research categories. In one group you have the “Must Have” and the other is the “Nice to Have”. Let me explain.

Let’s take a look at this from the viewpoint of information collected on a person of interest.

Must Have: Facebook

Facebook intelligence is still in the “Must Have” category. In part this is due to the fact that there is still so much to discover there, if you know how and where to dig. That is the challenge!

  1. Groups: Sometimes people will showcase their groups and sometimes this information is kept private. If it is kept private, there are search techniques that can be used, but it is not easy. Sometimes this information is readily available on a person’s profile page. When it is, and the group is public, I would suggest taking some time to do a manual search.
Facebook Groups

What Can You Find?

When people post in Groups, I really think that most have a mindset that it is undiscoverable information. Meaning, it is safe within the constraints of the group. That may give a false sense of freedom to speak their mind or to post something that they wouldn’t want the majority of their friends to know. When viewing a person’s page, public posts may give an impression of being squeaky clean but posts in a group setting can reveal the opposite.

Recently, we conducted a scan on a person who from their two facebook profiles, looked to be pretty clean cut. After digging further, we came up with a series of posts that showed a very different side to the individual.

Facebook Post
Post of a person of interest in a Group

In case you are unfamiliar with the term, “wake and bake” it can be described as getting up in the morning and partaking of the drug of choice, without leaving the comforts of one’s bed. (urban dictionary).

Enough to toss that squeaky clean image right out the door!

Twitter:

If you are having trouble finding information online, one suggestion is to turn to Twitter. Is the person currently employed? By whom? What about past jobs? It may be worth it to scan the company’s Twitter pages because many mid to large size companies will post events, fundraisers, blogs, videos, etc. which have employees present.

We recently found several photos of an individual from their company’s Twitter page.

Nice to Have

There is quite a lot of information that can be filed under the “Nice to Have” social research category. When conducting a deep web scan for example, we may find out that the person had some past problems with the law. From simple traffic violations to bankruptcies and everything in the middle. This may date back 10 or more years.

While it may not be important to the case, it is something that is part of the person’s past. Voter registration, financial contributions to a particular political party, volunteer work, newspaper articles, digital records of all kinds, and so on. All of this additional information can help to give you a good picture of the character of the person.

UCC filing
Person had a possible DEA Controlled Substance License that expired in 2015

A piece of information like the one above can be useful in many ways. Perhaps you know the person to be a Veterinarian or he was one in the past. This piece of information can serve as another data point that confirms his profession. It may list an address or name of a business that you didn’t have before.

It can help you to eliminate false positives in your research as well. Without the help or assistance of multiple software platforms, you can easily get two people confused who share the same name.