Your programs must be written in Python. All code must be able to compile and run for full credit. Comment all code following proper coding conventions. Remember, if we can’t read it, we can’t grade it! (For more information on python coding standards, refer to: https://www.python.org/dev/peps/pep-0008/)
Question 1 - 2 points
Consider the following multi-layer perceptron.
Figure 1: Two layer multi-layer perceptron
For the set of input data
X
calculate the output vector y∈R6. You can assume that all activation functions ϕ(ν) are rectified linear units (ReLU), where
Question 2 - 8 points
For the following two-dimensional data sets, do the following:
1. For each data set, design two different neural networks by hand which can discriminate between the classes (each class indicated by a different color).
2. Code your solutions in python and verify that the network learns a decision boundarysimilar to what you designed. For this section, you should include plots showing the data and the corresponding decision boundaries learned by the networks.
Figure 2: Data set 1
Figure 3: Data set 2
Figure 4: Data set 3
