In the below questions, prepare a report explaining your answers. If possible, include plots to explain your solution.
You need to show all your work step by step to receive credit. You may be asked to make a demo of your code.
Part 1 - Gradient Descent
Solve Questions 4-7 in the homework available from
https://work.caltech.edu/homework/hw5.pdf
Part 2 – Logistic Regression
Solve Questions 8-9 in the homework available from
https://work.caltech.edu/homework/hw5.pdf
Part 3 - Regularization with weight decay
Solve questions 2-6 from the homework available from
https://work.caltech.edu/homework/hw6.pdf
Part 4 – Neural Networks
Solve questions 8-10 from the homework available from
https://work.caltech.edu/homework/hw6.pdf
