TMCnet Feature
February 13, 2020

New Search Update! Learn How Google's BERT Works

When technology is not moving, it’s either static or dead. Google’s (News - Alert) BERT Algorithm is finally here to revolutionize search engine Enquiries.  What’s this new search update? Do you know how this Google’s BERT Works? Let’s break it down.

BERT is a  short form for Bi-directional,  Encoder, Representations, and Transformers. We shall discuss each of these elements later in this article

The past search languages such as Glove2Vec and Word2V focused on the context-free word embeddings.

BERT, however, is an open-source natural language pre-training technique that enables the search engine to “think” like humans. It “understands” the key context of words to give more focused results.

The new search algorithm update is built to put more meaning to the use of common prepositions such as “to” and “for”. This will enable the search to fully understand the context words used during your query.

Illustrating How Google’s BERT Works

To illustrate how BERT will “understand” your search intent and provide relevant results, Google did the following test:

Google Search phrase: 2019 brazil traveler to the USA needs a visa Ignore the grammar errors. Online searchers focus more on what they want, not grammar. :)

The relationship of “to” and other words within the query is critical in getting the expected search results.

From the human mind's perspective, it’s a Brazilian who is planning to travel to the U. S. The traveler isn’t traveling to the U.S.A.

Initially, the search couldn’t put into context the use of “to” in this query. It would, therefore, include the result of a U.S traveler traveling to Brazil which is not the expected result.

BERT, therefore, focuses on how the word “to” is used to provide a relevant and helpful query result.

Explaining How Google Bert Works

To better understand how BERT works, let’s focus on its key components:

a.     Bi-directional

Before Google’s BERT, search languages were uni-directional. The context window could move to either the left or right of the target word.

They could not do this at the same time to understand the word’s intended context. This would lead to some search results being irrelevant hence not helpful.  BERT can “visualize” both the left side and the right side of a keyword almost at once.

b.    ER: Encoder Representations

Any programmed information that gets encoded through a search query is immediately decoded. This in-and-out mechanism allows results to be instantly displayed by those conducting the search within fractions of a second.

What gets encoded is decoded. It’s an in-and-out mechanism.

c.      T: Transformers

To fully understand the context in which a search word has been used, “transformers” as well as “masked language modeling” is used in BERT. This is more helpful where pronouns or words that go together are used.

The use of transformers, therefore, ensures that the word is focused from “seeing” itself. With this masking technique, BERT is able to guess the missing words. This helps in fine-tuning search results.

Natural Language Tasks That BERT Will Enhance:

The new BERT algorithm will improve the following query tasks:

  • Determination of Named Entity for fine-tuned search results
  • Word Sense Disambiguation (WSD) which enables you to put in context ambiguous words or polysemous words
  • Textual entailment or “Next Sentence Prediction”.
  • Conference Resolution through effective capturing of contextual information
  • Getting answers to questions through its Question Answering Model
  • Automatic Text Summarization

What Should You Do to Benefit From Google’s BERT?

The new algorithm will only affect about 10% of inquiries. Since it helps Google to better understand searches, it will only be beneficial if your content is written for humans!  

To benefit from this innovative update, your website must be free from keyword stuffing or Spammy content. You need the services of a Premium SEO  company that understands how Google’s BERT works.

This way, your website content will be effectively fine-tuned for high Google ranking and enhanced business growth. Take action and let your business move and flow with the new Google’s BERT.

» More TMCnet Feature Articles


» More TMCnet Feature Articles