Informatica logo


Login Register

  1. Home
  2. Issues
  3. Volume 16, Issue 2 (2005)
  4. An Influence of Nonlinearities to Storag ...

Informatica

Information Submit your article For Referees Help ATTENTION!
  • Article info
  • Related articles
  • More
    Article info Related articles

An Influence of Nonlinearities to Storage Capacity of Neural Networks
Volume 16, Issue 2 (2005), pp. 159–174
Algis Garliauskas  

Authors

 
Placeholder
https://doi.org/10.15388/Informatica.2005.091
Pub. online: 5 August 2022      Type: Research Article      Open accessOpen Access

Received
1 May 2004
Published
5 August 2022

Abstract

The more realistic neural soma and synaptic nonlinear relations and an alternative mean field theory (MFT) approach relevant for strongly interconnected systems as a cortical matter are considered. The general procedure of averaging the quenched random states in the fully-connected networks for MFT, as usually, is based on the Boltzmann Machine learning. But this approach requires an unrealistically large number of samples to provide a reliable performance. We suppose an alternative MFT with deterministic features instead of stochastic nature of searching a solution a set of large number equations. Of course, this alternative theory will not be strictly valid for infinite number of elements. Another property of generalization is an inclusion of the additional member in the effective Hamiltonian allowing to improve the stochastic hill-climbing search of the solution not dropping into local minima of the energy function. Especially, we pay attention to increasing of neural networks retrieval capability transforming the replica-symmetry model by including of different nonlinear elements. Some results of numerical modeling as well as the wide discussion of neural systems storage capacity are presented.

Related articles PDF XML
Related articles PDF XML

Copyright
© 2005 Institute of Mathematics and Informatics, Vilnius
by logo by logo
Open access article under the CC BY license.

Keywords
mean field theory storage capacity nonlinearity neural networks

Metrics
since January 2020
966

Article info
views

0

Full article
views

501

PDF
downloads

210

XML
downloads

Export citation

Copy and paste formatted citation
Placeholder

Download citation in file


Share


RSS

INFORMATICA

  • Online ISSN: 1822-8844
  • Print ISSN: 0868-4952
  • Copyright © 2023 Vilnius University

About

  • About journal

For contributors

  • OA Policy
  • Submit your article
  • Instructions for Referees
    •  

    •  

Contact us

  • Institute of Data Science and Digital Technologies
  • Vilnius University

    Akademijos St. 4

    08412 Vilnius, Lithuania

    Phone: (+370 5) 2109 338

    E-mail: informatica@mii.vu.lt

    https://informatica.vu.lt/journal/INFORMATICA
Powered by PubliMill  •  Privacy policy