3.2. Array Broadcasting

3.2.1. Rationale

Vector
Broadcasting
Matrix Multiplication

3.2.2. Broadcasting Rules

  1. Operations between multiple array objects are first checked for proper shape match

  2. Mathematical operators (+, -, *, /, exp, log, ...) apply element by element, on values

  3. Reduction operations (mean, std, skew, kurt, sum, prod, ...) apply to whole array, unless an axis is specified

  4. Missing values propagate, unless explicitly ignored (nanmean, nansum, ...)

3.2.3. Addition

import numpy as np


a = np.array([[1, 2, 3], [4, 5, 6]])
b = np.array([[4, 5, 6], [7, 8, 9]])
c = np.array([1, 2, 3])
d = np.array([4, 5])

a + a
# array([[ 2,  4,  6],
#        [ 8, 10, 12]])

a + b
# array([[ 5,  7,  9],
#        [11, 13, 15]])

a + c
# array([[2, 4, 6],
#        [5, 7, 9]])

a + d
# Traceback (most recent call last):
# ValueError: operands could not be broadcast together with shapes (2,3) (2,)

3.2.4. Subtraction

import numpy as np


a = np.array([[1, 2, 3], [4, 5, 6]])
b = np.array([[4, 5, 6], [7, 8, 9]])
c = np.array([1, 2, 3])
d = np.array([4, 5])

a - a
# array([[0, 0, 0],
#        [0, 0, 0]])

a - b
# array([[-3, -3, -3],
#        [-3, -3, -3]])

a - c
# array([[0, 0, 0],
#        [3, 3, 3]])

a - d
# Traceback (most recent call last):
# ValueError: operands could not be broadcast together with shapes (2,3) (2,)

3.2.5. Division

import numpy as np


a = np.array([[1, 2, 3], [4, 5, 6]])
b = np.array([[4, 5, 6], [7, 8, 9]])
c = np.array([1, 2, 3])
d = np.array([4, 5])

a / a
# array([[1., 1., 1.],
#        [1., 1., 1.]])

a / b
# array([[0.25      , 0.4       , 0.5       ],
#        [0.57142857, 0.625     , 0.66666667]])

a / c
# array([[1. , 1. , 1. ],
#        [4. , 2.5, 2. ]])

a / d
# Traceback (most recent call last):
# ValueError: operands could not be broadcast together with shapes (2,3) (2,)

3.2.6. True Division

import numpy as np


a = np.array([[1, 2, 3], [4, 5, 6]])
b = np.array([[4, 5, 6], [7, 8, 9]])
c = np.array([1, 2, 3])
d = np.array([4, 5])

a // a
# array([[1, 1, 1],
#        [1, 1, 1]])

a // b
# array([[0, 0, 0],
#        [0, 0, 0]])

a // c
# array([[1, 1, 1],
#        [4, 2, 2]])

a // d
# Traceback (most recent call last):
# ValueError: operands could not be broadcast together with shapes (2,3) (2,)

3.2.7. Modulo

import numpy as np


a = np.array([[1, 2, 3], [4, 5, 6]])
b = np.array([[4, 5, 6], [7, 8, 9]])
c = np.array([1, 2, 3])
d = np.array([4, 5])

a % a
# array([[0, 0, 0],
#        [0, 0, 0]])

a % b
# array([[1, 2, 3],
#        [4, 5, 6]])

a % c
# array([[0, 0, 0],
#        [0, 1, 0]])

a % d
# Traceback (most recent call last):
# ValueError: operands could not be broadcast together with shapes (2,3) (2,)

3.2.8. Power

import numpy as np


a = np.array([[1, 2, 3], [4, 5, 6]])
b = np.array([[4, 5, 6], [7, 8, 9]])
c = np.array([1, 2, 3])
d = np.array([4, 5])

a ** a
# array([[    1,     4,    27],
#        [  256,  3125, 46656]])

a ** b
# array([[       1,       32,      729],
#        [   16384,   390625, 10077696]])

a ** c
# array([[  1,   4,  27],
#        [  4,  25, 216]])

a ** d
# Traceback (most recent call last):
# ValueError: operands could not be broadcast together with shapes (2,3) (2,)

3.2.9. Root

import numpy as np


a = np.array([[1, 2, 3], [4, 5, 6]])
b = np.array([[4, 5, 6], [7, 8, 9]])
c = np.array([1, 2, 3])
d = np.array([4, 5])

a ** (1/a)
# array([[1.        , 1.41421356, 1.44224957],
#        [1.41421356, 1.37972966, 1.34800615]])

a ** (1/b)
# array([[1.        , 1.14869835, 1.20093696],
#        [1.21901365, 1.22284454, 1.22028494]])

a ** (1/c)
# array([[1.        , 1.41421356, 1.44224957],
#        [4.        , 2.23606798, 1.81712059]])

a ** (1/d)
# Traceback (most recent call last):
# ValueError: operands could not be broadcast together with shapes (2,3) (2,)

3.2.10. Array Multiplication

  • Multiplication * remains elementwise and does not correspond to matrix multiplication.

import numpy as np


a = np.array([[1, 2, 3], [4, 5, 6]])
b = np.array([[4, 5, 6], [7, 8, 9]])
c = np.array([1, 2, 3])
d = np.array([4, 5])

a * a
# array([[ 1,  4,  9],
#        [16, 25, 36]])

a * b
# array([[ 4, 10, 18],
#        [28, 40, 54]])

a * c
# array([[ 1,  4,  9],
#        [ 4, 10, 18]])

a * d
# Traceback (most recent call last):
# ValueError: operands could not be broadcast together with shapes (2,3) (2,)

3.2.11. Matrix Multiplication

../_images/arithmetic-matmul.gif
../_images/arithmetic-matmul.jpg 
import numpy as np


a = np.array([[1, 2, 3],
              [4, 5, 6]])

b = np.array([[1, 2],
              [3, 4],
              [5, 6]])

a @ b
# array([[22, 28],
#        [49, 64]])

import numpy as np


a = np.array([[1, 2, 3],
              [4, 5, 6]])

b = np.array([[4, 5, 6],
              [7, 8, 9]])

a @ b
# Traceback (most recent call last):
# ValueError: matmul: Input operand 1 has a mismatch in its core dimension 0, with gufunc signature (n?,k),(k,m?)->(n?,m?) (size 2 is different from 3)

3.2.12. Dot

  • np.dot()

  • If either a or b is 0-D (scalar), it is equivalent to multiply and using numpy.multiply(a, b) or a * b is preferred.

  • If both a and b are 1-D arrays, it is inner product of vectors (without complex conjugation).

  • If both a and b are 2-D arrays, it is matrix multiplication, but using matmul or a @ b is preferred.

  • If a is an N-D array and b is a 1-D array, it is a sum product over the last axis of a and b.

  • If a is an N-D array and b is an M-D array (where M>=2), it is a sum product over the last axis of a and the second-to-last axis of b: dot(a, b)[i,j,k,m] = sum(a[i,j,:] * b[k,:,m])

import numpy as np


a = np.array([1, 2, 3], float)
b = np.array([0, 1, 1], float)

np.dot(a, b)
# 5.0

import numpy as np


a = np.array([[0, 1], [2, 3]], float)
b = np.array([2, 3], float)
c = np.array([[1, 1], [4, 0]], float)

np.dot(b, a)
# array([ 6., 11.])

np.dot(a, b)
# array([ 3., 13.])

np.dot(a, c)
# array([[ 4., 0.],
#        [ 14., 2.]])

np.dot(c, a)
# array([[ 2., 4.],
#        [ 0., 4.]])

3.2.13. Assignments

3.2.13.1. Numpy Broadcasting Arithmetic

  • Assignment: Numpy Broadcasting Arithmetic

  • Last update: 2020-10-01

  • Complexity level: easy

  • Lines of code to write: 10 lines

  • Estimated time of completion: 3 min

  • Filename: solution/numpy_broadcasting_arithmetic.py

English:

  1. Use data from "Given" section (see below)

  2. For given: a: np.ndarray, b: np.ndarray, c: np.ndarray

  3. Calculate square root of each element in a and b

  4. Calculate second power (square) of each element in c

  5. Add elements from a to b

  6. Multiply the result by c

  7. Compare result with "Tests" section (see below)

Polish:

  1. Użyj danych z sekcji "Given" (patrz poniżej)

  2. Dla danych: a: np.ndarray, b: np.ndarray, c: np.ndarray

  3. Oblicz pierwiastek kwadratowy każdego z elementu w a i b

  4. Oblicz drugą potęgę (kwadrat) każdego z elementu w c

  5. Dodaj elementy z a do b

  6. Przemnóż wynik przez c

  7. Porównaj wyniki z sekcją "Tests" (patrz poniżej)

Given:
a = np.array([[0, 1], [2, 3]], float)
b = np.array([2, 3], float)
c = np.array([[1, 1], [4, 0]], float)
Tests:
>>> result
array([[ 1.41421356,  2.73205081],
       [45.254834  ,  0.        ]])

3.2.13.2. Numpy Broadcasting Type Cast

  • Assignment: Numpy Broadcasting Type Cast

  • Last update: 2020-10-01

  • Complexity level: easy

  • Lines of code to write: 2 lines

  • Estimated time of completion: 3 min

  • Filename: solution/numpy_broadcasting_typecast.py

English:

  1. For given: a: np.ndarray, b: np.ndarray (see below)

  2. Add a and b

  3. Add b and a

  4. What happened?

Polish:

  1. Dla danych: a: np.ndarray, b: np.ndarray (patrz sekcja input)

  2. Dodaj a i b

  3. Dodaj b i a

  4. Co się stało?

Given:
a = np.array([[1, 0], [0, 1]])
b = [[4, 1], [2, 2]]

3.2.13.3. Numpy Broadcasting Matmul

  • Assignment: Numpy Broadcasting Matmul

  • Last update: 2020-10-01

  • Complexity level: easy

  • Lines of code to write: 4 lines

  • Estimated time of completion: 3 min

  • Filename: solution/numpy_broadcasting_matmul.py

English:

  1. For given: a: np.ndarray, b: np.ndarray (see below)

  2. Multiply a and b using scalar multiplication

  3. Multiply a and b using matrix multiplication

  4. Multiply b and a using scalar multiplication

  5. Multiply b and a using matrix multiplication

  6. Discuss results

Polish:

  1. Dla danych: a: np.ndarray, b: np.ndarray (patrz sekcja input)

  2. Przemnóż a i b używając mnożenia skalarnego

  3. Przemnóż a i b używając mnożenia macierzowego

  4. Przemnóż b i a używając mnożenia skalarnego

  5. Przemnóż b i a używając mnożenia macierzowego

  6. Omów wyniki

Given:
a = np.array([[1,0,1,0],
              [0,1,1,0],
              [3,2,1,0],
              [4,1,2,0]])

b = np.array([[4,1],
              [2,2],
              [5,1],
              [2,3]])