Abstract
Statistical mechanics is applied to estimate the maximal information capacity per synapse (c) of a multilayered feedforward neural network, functioning as a parity machine. For a large number of hidden units, K, the replica-symmetric solution overestimates dramatically the capacity,K2. However, a one-step replica-symmetry breaking gives lnK/ln2, which coincides with a theoretical upper bound. It is suggested that this asymptotic behavior is exact. Results for finite K are also discussed.
| Original language | English |
|---|---|
| Pages (from-to) | 2312-2315 |
| Number of pages | 4 |
| Journal | Physical Review Letters |
| Volume | 65 |
| Issue number | 18 |
| DOIs | |
| State | Published - 1990 |
Fingerprint
Dive into the research topics of 'Statistical mechanics of a multilayered neural network'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver