Informatica

Text categorization – the assignment of natural language documents to one or more predefined categories based on their semantic content – is an important component in many information organization and management tasks. Performance of neural networks learning is known to be sensitive to the initial weights and architecture. This paper discusses the use multilayer neural network initialization with decision tree classifier for improving text categorization accuracy. Decision tree from root node until a final leave is used for initialization of each single unit. Growing decision trees with increasingly larger amounts of training data will result in larger decision tree sizes. As a result, the neural networks constructed from these decision trees are often larger and more complex than necessary. Appropriate choice of certainty factor is able to produce trees that are essentially constant in size in the face of increasingly larger training sets. Experimental results support the conclusion that error based pruning can be used to produce appropriately sized trees, which are directly mapped to optimal neural network architecture with good accuracy. The experimental evaluation demonstrates this approach provides better classification accuracy with Reuters‐21578 corpus, one of the standard benchmarks for text categorization tasks. We present results comparing the accuracy of this approach with multilayer neural network initialized with traditional random method and decision tree classifiers.

Color constancy is the perceived stability of the color of objects under different illuminants. Four-layer neural network for color constancy has been developed. It has separate input channels for the test chip and for the background. Input of network was RGB receptors. Second layer consisted of color opponent cells and output have three neurons signaling x, y, Y coordinates (1931 CIE). Network was trained with the back-propagation algorithm. For training and testing we used nine illuminants with wide spectrum. Neural network was able to achieve color constancy. Input of background coordinates and nonlinearity of network have crucial influence for training.

In this paper two popular time series prediction methods – the Auto Regression Moving Average (ARMA) and the multilayer perceptron (MLP) – are compared while forecasting seven real world economical time series. It is shown that the prediction accuracy of both methods is poor in ill-structured problems. In the well-structured cases, when prediction accuracy is high, the MLP predicts better providing lower mean prediction error.

In the present paper, the method of structure analysis for multivariate functions was applied to rational approximation in classification problems. Then the pattern recognition and generalisation ability was investigated experimentally in numerical recognition. A comparison with Hopfield Net was carried out. The overall results of using of new approach may be treated as a success.

Neural networks are often characterized as highly nonlinear systems of fairly large amount of parameters (in order of 10³ – 10⁴). This fact makes the optimization of parameters to be a nontrivial problem. But the astonishing moment is that the local optimization technique is widely used and yields reliable convergence in many cases. Obviously, the optimization of neural networks is high-dimensional, multi-extremal problem, so, as usual, the global optimization methods would be applied in this case. On the basis of Perceptron-like unit (which is the building block for the most architectures of neural networks) we analyze why the local optimization technique is so successful in the field of neural networks. The result is that a linear approximation of the neural network can be sufficient to evaluate the start point for the local optimization procedure in the nonlinear regime. This result can help in developing faster and more robust algorithms for the optimization of neural network parameters.