The Register: Google finally touts $150 pint-sized Linux dev board with Edge TPU AI math copro brains.

https://www.theregister.co.uk/2019/03/07/google_tensorflow_summit/

# Tag Archives: Google

# Learning Google AI

# Google new O/S Fuchsia – Modular Lego

# Google AI Voice Near Human

# 10招教你用Google搜技巧

# Big Picture: Linear Algebra

**The Big Picture of Linear Algebra 线性代数 (***MIT Open-Courseware by the famous Prof Gilbert Strang)*

**A.X = B**

**A(m, n) ** is a matrix of **m** rows, **n** columns

4 sub-Vector Spaces:

Column Space , dim = **r = rank** (A)

Row Space , dim = **r = rank** (A)

Nullspace , dim = **n – r**

Left Nullspace , dim = **m – r**

Abstract Vector Spaces 向量空间

Any object satisfying these 8 axioms belong to the algebraic structure of Vector Space: eg. Vectors, Polynomials, Functions, …

**Note**: “Vector Space” + “Linear Map” = “Category”

**Eigenvalues & Eigenvectors** (*valeurs propres et vecteurs propres*) 特征值/特征向量

[ Note: “*Eigen*-” is German for *Characteristic* 特征.]

**Important Trick**: (see Monkeys & Coconuts Problem)

If a transformation A is linear, and the “**before**” state and “**after**” state of the “vector” **v** remain the same (keep the status-quo) , then : **Eigenvalue **

Try to compute:

is more difficult than this diagonalized equivalent matrix:

**Note**: This is the secret of the Google computation of diagonalized matrix of billion columns & billion rows, where all the **b**jk are the “PageRanks” (web links coming into a particular webpage and links going out from that webpage).

**The Essence of Determinant (*)**: (行列式)

(*) Determinant was invented by the ancient Chinese Algebraists 李冶 / 朱世杰 /秦九韶 in 13th century (金 / 南宋 / 元) in《天元术》.The Japanese “和算” mathematician 关孝和 spread it further to Europe before the German mathematician Leibniz named it the “Determinant” in 18th century. The world, however, had to wait till the 19th century to discover the theory of **Matrix** 矩阵 by JJ Sylvester (Statistical Math private Tutor of Florence Nightingale, the world’s first nurse) closely linked to the application of **Determinant**.

[**NOTE**] 金庸 武侠小说 《神雕侠女》里 元朝初年的 黄蓉 破解 大理国王妃 瑛姑 苦思不解的 “行列式”, 大概是求 eigenvalues & eigenvectors ? 🙂

# Google PageRanking Algorithm

Google Illustration:

The following Webpages (1) to (n=6) are linked in a network below:

eg.

Page (1) points to (4),

(2) & (3) points to (1)…

Let

= Probability (**PageRank ***) from Page ( i ) linked to Page (j).

(*) **PageRank**: a measure of how relevant the page’s content to the topic of your query. This value is computed by the proprietary formula designed by the 2 Google Founders Larry Page & Sergey Brin, whose Stanford Math Thesis mentor was Prof Tony Chan (who knows the ‘secret ‘ to put his name always on Google 1st search list.)

The **Markov Transition Matrix** (A) is :

Assume we start surfing from Page (1).

We define** PageRank Vector** x

**x** = (1 0 0 0…0), the Probability of reaching from Page (1) to itself is 1, to other pages is 0.

__First Iteration__:

**x**.A = (1 0 0 0…0).

__2nd Iteration__:

or,

.

.

__ nth Iteration__:

When n is large,

converges to a **steady-state vector**, ie

That is,

“Cancel off” both sides by (technically multiply both sides by

So we get,

We say that x is a **Left EigenVector** of A if

By **Perron’s Theorem:**

Every real square matrix with entries that are all positive has

■ a ** unique** eigenvector “

**x**” with all positive entries;

■ the

**x**‘s corresponding eigenvalue ”

**λ**” has only

**associated eigenvector, and**

*one*■ this eigenvalue “

**λ**” is the

**of the eigenvalues.**

*largest*Applying to A (square matrix with positive real numbers),

=> **one and only one** (left) eigenvector x which satisfies x.A = x

=> x is unique and has all positive entries (PageRank values).

It guarantees that no matter how much the Web changes or what set of Web pages Google indexes, the PageRank vector (**x**) can always be found and will be **unique** !

**Example in the above Illustration**:

If the unique PageRank vector x is computed after n iterations as follow:

Then Google will list the search result in this order:

1st: Page 3 (0.63)

2nd: Page 6 (0.47)

3rd: Page 2 (0.35)

4th: Page 1 (0.25)

5th: Page 5 (0.12)

6th: Page 4 (0.05)

Knowing this trick, some hackers in 2003 initiated a “Google Bomb” attack on President George W. Bush, associated him with Google query “** miserable failure**“.

**Revision**:

Linear Algebra (Left & Right Eigenvectors and eigenvalues).

**Ref**:

《Math Bytes》by Tim Charter

Princeton University Press

[NLB #510 CHA]

**Google Patents**:

https://www.google.com/patents/US6285999