Capacity of the upstart algorithm

Ansgar H L West, David Saad

    Research output: Chapter in Book/Published conference outputChapter


    The storage capacity of multilayer networks with overlapping receptive fields is investigated for a constructive algorithm within a one-step replica symmetry breaking (RSB) treatment. We find that the storage capacity increases logarithmically with the number of hidden units <span class='mathrm'>K</span> without saturating the Mitchison-Durbin bound. The slope of the logarithmic increase decays exponentionally with the stability with which the patterns have been stored.
    Original languageEnglish
    Title of host publicationMathematics of Neural Networks: Models, Algorithms and Applications
    EditorsStephen W. Ellacott, John C. Mason, Iain J. Anderson
    Place of PublicationOxford
    Number of pages7
    ISBN (Print)0-7923-9933-1
    Publication statusPublished - 1997

    Bibliographical note

    The original publication is available at


    • algorithms
    • design
    • experimentation
    • human factors
    • measurement
    • performance
    • reliability
    • security
    • theory
    • werification


    Dive into the research topics of 'Capacity of the upstart algorithm'. Together they form a unique fingerprint.

    Cite this