English Pronunciation

Google has nice animations for this!

  • Query = [kwee ree]
  • Paradigm = [pa ruh daim] or American [peh ruh daim]

Linear algebra

I’ll be following this: 9.1. Attention Mechanism — Dive into Deep Learning 0.7 documentation

  • Inner product is the generalization of the dot product. Result is a scalar. 1

Python assert statement

UsingAssertionsEffectively - Python Wiki assert condition, message -> if condition is false, it returns an AssertionError.