<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.0 20120330//EN" "JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article"><front><journal-meta><journal-id journal-id-type="publisher-id">INFORMATICA</journal-id><journal-title-group><journal-title>Informatica</journal-title></journal-title-group><issn pub-type="epub">0868-4952</issn><issn pub-type="ppub">0868-4952</issn><publisher><publisher-name>VU</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="publisher-id">inf20208</article-id><article-id pub-id-type="doi">10.15388/Informatica.2009.250</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research article</subject></subj-group></article-categories><title-group><article-title>On Stochastic Optimization and Statistical Learning in Reproducing Kernel Hilbert Spaces by Support Vector Machines (SVM)</article-title></title-group><contrib-group><contrib contrib-type="Author"><name><surname>Norkin</surname><given-names>Vladimir</given-names></name><email xlink:href="mailto:norkin@i.com.ua">norkin@i.com.ua</email><xref ref-type="aff" rid="j_INFORMATICA_aff_000"/></contrib><aff id="j_INFORMATICA_aff_000">Glushkov Institute of Cybernetics, National Academy of Sciences of Ukraine, Glushkov avenue 40, 03187 Kiev, Ukraine</aff></contrib-group><contrib-group><contrib contrib-type="Author"><name><surname>Keyzer</surname><given-names>Michiel</given-names></name><email xlink:href="mailto:m.a.keyzer@sow.vu.nl">m.a.keyzer@sow.vu.nl</email><xref ref-type="aff" rid="j_INFORMATICA_aff_001"/></contrib><aff id="j_INFORMATICA_aff_001">Center for World Food Studies (SOW-VU), VU University of Amsterdam, De Boelelaan 1105, 1081 HV, Amsterdam, The Netherlands</aff></contrib-group><pub-date pub-type="epub"><day>01</day><month>01</month><year>2009</year></pub-date><volume>20</volume><issue>2</issue><fpage>273</fpage><lpage>292</lpage><history><date date-type="received"><day>01</day><month>08</month><year>2008</year></date><date date-type="accepted"><day>01</day><month>02</month><year>2009</year></date></history><abstract><p>The paper studies stochastic optimization problems in Reproducing Kernel Hilbert Spaces (RKHS). The objective function of such problems is a mathematical expectation functional depending on decision rules (or strategies), i.e. on functions of observed random parameters. Feasible rules are restricted to belong to a RKHS. This kind of problems arises in on-line decision making and in statistical learning theory. We solve the problem by sample average approximation combined with Tihonov's regularization and establish sufficient conditions for uniform convergence of approximate solutions with probability one, jointly with a rule for downward adjustment of the regularization factor with increasing sample size.</p></abstract><kwd-group><label>Keywords</label><kwd>stochastic optimization</kwd><kwd>empirical risk minimization</kwd><kwd>decision rule</kwd><kwd>Reproducing Kernel Hilbert Spaces (RKHS)</kwd><kwd>support vector machine (SVM)</kwd><kwd>regularization</kwd><kwd>convergence</kwd></kwd-group></article-meta></front></article>