September 4, 2001
Psy 5038W, Fall 2001, 3 credits
26768
Psychology Department , University
of Minnesota
Place: 121 Elliott
Hall (Computer Lab)
Time: 12:00-1:30 TTh
Course home page:
http://gandalf.psych.umn.edu/~kersten/kersten-lab/courses/Psy5038W/5038Syllabus.html
or find it through courses.kersten.org
Instructor: Daniel Kersten Office:
211 Elliott Hall Phone: 625-2589 email: kersten@umn.edu
Office hours: Thursday 1:30-2:30 or by appointment.
TA: Bruce Hartung Office 319 Elliott
Hall Phone: 625-1337 email: hartung@cs.umn.edu
Office hours: Tuesday 1:30-3:00
or by appointment.
Course description. Introduction to large scale parallel distributed processing models in neural and cognitive science. Topics include: linear models, statistical pattern theory, Hebbian rules, self-organization, non-linear models, information optimization, and representation of neural information. Applications to sensory processing, perception, learning, and memory.
Readings
American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: American Psychological Association.
Also see mathsource.com,
a resource site provided by www.wolfram.com
the developers of Mathematica.
The following link is particularly useful:
0205-906: Simulating
Neural Networks with Mathematica---Electronic Supplement
Grade Requirements
There will be a mid-term, final examination, programming assignments, as well as a final project. The grade weights are:
Assignment due BEFORE class start time (12:00 am) on the day due. You can use the downloaded Mathematica notebook for the assignment as your template, add your answers, and email your finished assignment to the TA. You can copy and paste any code bits you need from the Lecture notebooks. But of course, you cannot copy and paste code or any other answer materials from someone else.
(Revised lecture material will be posted on the day given--if you want a preview, check out lectures from 1999)
All lecture notes are in Mathematica Notebook and pdf format. You can either
download the Mathematica files below to view (with MathReader
4, which is free) or to run (with Mathematica 4, which is not free--$139.95
for student license).
Date |
Lecture |
Additional Readings & supplementary material |
Assignments |
||
I.
|
1 |
Sep 4 |
Introduction (pdf file)|Mathematica notebook |
Intro. & Chapters
1, 2 |
|
2 |
Sep 6 |
The
neuron (
pdf file)| Mathematica
notebook |
|||
3 |
Sep 11 |
Neural Models, McCulloch-Pitt (pdf file)| Mathematica notebook |
Chapters 3, 4 |
||
4 |
Sep 13 |
Generic neuron model (pdf file)| Mathematica notebook | |||
II. |
5 |
Sep 18 |
Lateral inhibition (pdf file)| Mathematica notebook | Chapters 5, 6 & 7 | PS
1. Introduction to Mathematica
, vectors, cross-correlation (pdf file) |
6 |
Sep 20 |
Matrices (pdf file)| Mathematica notebook | |||
7 |
Sep 25 |
Learning & Memory (pdf file)| Mathematica notebook | Chapter 8 | ||
III.
|
8 |
Sep 27 |
Linear Associator (pdf file)| Mathematica notebook |
einstein32x32.jpg |
|
9 |
Oct 2 |
Sampling, Summed vector memory (pdf file)| Mathematica notebook | PS
2. Lateral inhibition - (pdf file) |
||
10 |
Oct 4 |
Non-linear networks, Perceptron (pdf file)| Mathematica notebook |
|
||
11 |
Oct 9 |
Regression, Widrow-Hoff (pdf file)| Mathematica notebook | Chapter 9 | ||
12 |
Oct 11 |
Multilayer feedforward nets, Backpropagation (pdf file)| Mathematica notebook |
|
||
IV.
|
13 |
Oct 16 |
Science
writing (pdf) (Mathematica notebook) |
Gopen & Swan,
1990
|
PS
3. Perceptron (pdf file) |
14 |
Oct 18 |
MID-TERM | MID-TERM (16%) | ||
15 |
Oct 23 |
Networks and Visual Representation (pdf file)| Mathematica notebook | Chapters 10, 11 | ||
16 |
Oct 25 |
Neural Representation and coding (pdf file) Mathematica notebook | |||
17 |
Oct 30 |
Self-organization, Principal Components Analysis and NNs (pdf file)| Mathematica notebook | Chapter
12 (Supplement: ContingentAdaptation.nb) |
||
18 |
Nov 1 |
Discrete Hopfield network (pdf file)| Mathematica notebook | Chapter 12 continued | ||
19 |
Nov 6 |
Graded response Hopfield network (pdf file)| Mathematica notebook | |||
20 |
Nov 8 |
Boltzmann machine (pdf file)| Mathematica notebook |
PS
4 Backprop, Hopfield network (pdf file) |
||
21 |
Nov 13 |
Sculpting the energy function, interpolation (pdf file)| Mathematica notebook) | Chapters 13, 14 | Final project title & paragraph outline (2%) | |
22 | Nov 15 | Adaptive maps (pdf file)| Mathematica notebook | Chapters
15, 16 smallRetinaCortexMap.nb GraylefteyeDan.jpg |
||
V.
|
23 | Nov 20 | Probability
(pdf file)| Mathematica notebook |
||
Nov 22 | THANKSGIVING | ||||
24 | Nov 27 | Gaussian
models (pdf file) Mathematica notebook |
|||
25 | Nov 29 | Bayes
nets (pdf) Mathematica notebook |
|||
26 | Dec 4 | Belief
Propagation (pdf) Mathematica notebook |
Complete Draft of Final Project (5%:) | ||
27 | Dec 6 | EM (pdf) Mathematica notebook |
|||
28 | Dec 11 |
Wrap-up & |
Bias/Variance notes (pdf) | (Drafts returned) | |
Dec 13 | FINAL EXAM | FINAL STUDY GUIDE (Updated!) | FINAL EXAM (16%) | ||
Dec 18 | Final Revised Draft of Project (33%) |
This course teaches you how to understand cognitive and perceptual aspects of brain processing in terms of computation. Writing a computer program encourages you to think clearly about the assumptions underlying a given theory. Getting a program to work, however, tests just one level of clear thinking. By writing about your work, you will learn to think through the broader implications of your final project, and to effectively communicate the rationale and results your results in words.
Your final project will involve: 1) a computer simulation and; 2) a 2000-3000 word final paper describing your simulation. For your computer project, you will do one of the following: 1) Devise a novel application for a neural network model studied in the course; 2) Write a program to simulate a model from the neural network literature ; 3) Design and program a method for solving some problem in perception, cognition or motor control. The results of your final project should be written up in the form of a short scientific paper, describing the motivation, methods, results, and interpretation. Your paper will be critiqued and returned for you to revise and resubmit in final form. You should write for an audience consisting of your class peers. You may elect to have your final paper published in the course's web-based electronic journal.
Completing the final paper involves 3 steps:
If you choose to write your program in Mathematica, your paper and program can be combined can be formated as a Mathematica notebook. See: Books and Tutorials on Notebooks.
Your paper will be critiqued and returned for you to revise and resubmit in final form. You should write for an audience consisting of your class peers.
© 1998, 1999, 2001 Computational Vision Lab, University of Minnesota, Department of Psychology.