|
|
| Line 1: |
Line 1: |
| High-dimensional integrals in hundreds or thousands of variables occur commonly in finance. These integrals have to be computed numerically to within a threshold <math>\epsilon</math>. If the integral is of dimension <math>d</math> then in the worst case, where one has a guarantee of error at most <math>\epsilon</math>, the computational complexity is typically of order <math>\epsilon^{-d}</math>. That is, the problem suffers the [[curse of dimensionality]]. In 1977 P. Boyle, University of Waterloo, proposed using [[Monte Carlo Method|Monte Carlo (MC)]] to evaluate options.<ref name="B77">Boyle, P. (1977), Options: a Monte Carlo approach, J. Financial Economics, 4, 323-338.</ref> Starting in early 1992, [[Joseph Traub|J. F. Traub]], Columbia University, and a graduate student at the time, S. Paskov, used [[Quasi-Monte Carlo method|quasi-Monte Carlo]] (QMC) to price a [[Collateralized mortgage obligation]] with parameters specified by Goldman Sachs. Even though it was believed by the world's leading experts that QMC should not be used for high dimensional integration, Paskov and Traub found that QMC beat MC by one to three orders of magnitude and also enjoyed other desirable attributes. Their results were first published<ref name="PTJPM">Paskov, S. H. and Traub, J. F. (1995), Faster evaluation of financial derivatives, J. Portfolio Management, 22(1), 113-120.</ref> in 1995. Today QMC is widely used in the financial sector to value financial derivatives; see [[Quasi-Monte_Carlo_methods_in_finance#Books|list of books below]].
| | Andrew Simcox is the name his mothers and fathers gave him and he completely loves this title. Office supervising is where my primary earnings arrives from but I've usually wanted my own business. The preferred pastime for him and his children is to perform lacross and he would by no means give it up. For years he's been living in Alaska and he doesn't strategy on changing it.<br><br>Here is my website: [http://medialab.zendesk.com/entries/54181460-Will-You-Often-End-Up-Bored-Try-One-Of-These-Hobby-Ideas- free psychic readings] [http://brazil.amor-amore.com/irboothe real psychic] ([http://www.familysurvivalgroup.com/easy-methods-planting-looking-backyard/ www.familysurvivalgroup.com]) |
| | |
| QMC is not a panacea for all high dimensional integrals. A number of explanations have been proposed for why QMC is so good for financial derivatives. This continues to be a very fruitful research area.
| |
| | |
| ==Monte Carlo and quasi-Monte Carlo methods==
| |
| Integrals in hundreds or thousands of variables are common in [[computational finance]]. These have to be approximated numerically to within an error threshold <math>\epsilon</math>. It is well known that if a worst case guarantee of error at most <math>\epsilon</math> is required then the computational complexity of integration may be exponential in <math>d</math>, the dimension of the integrand; See <ref name="TW98">Traub, J. F and Werschulz, A. G. (1998), Complexity and Information, Cambridge University Press, Cambridge, UK.</ref> Ch. 3 for details. To break this curse of dimensionality one can use the Monte Carlo (MC) method defined by
| |
| | |
| :<math>\varphi^{\mathop{\rm MC}}(f)=\frac 1n \sum_{i=1}^nf(x_i),</math>
| |
| | |
| where the evaluation points <math>x_i</math> are randomly chosen. It is well known that the expected error of Monte Carlo is of order <math>n^{-1/2}</math>. Thus the cost of the algorithm that has error <math>\epsilon</math> is of order <math>\epsilon^{-2}</math> breaking the curse of dimensionality.
| |
| | |
| Of course in computational practice pseudo-random points are used. Figure 1 shows the distribution of 500 pseudo-random points on the unit square.
| |
| [[File:MonteCarlo500points.JPG|thumb|right|Figure 1. 500 pseudo-random points]]
| |
| Note there are regions where there are no points and other regions where there are clusters of points. It would be desirable to sample the integrand at uniformly distributed points. A rectangular grid would be uniform but even if there were only 2 grid points in each Cartesian direction there would be <math>2^d</math> points. So the desideratum should be as few points as possible chosen as uniform as possible.
| |
| | |
| It turns out there is a well-developed part of number theory which deals exactly with this desideratum. Discrepancy is a measure of deviation from uniformity so what one wants are low discrepancy sequences (LDS).<ref name="N92">Niederreiter, H. (1992), Random Number Generation and Quasi-Monte Carlo Methods, CBMS-NSF Regional Conference Series in Applied Mathematics, SIAM, Philadelphia.</ref> Numerous LDS have been created named after their inventors, e.g.
| |
| *Halton
| |
| *Hammersley
| |
| *Sobol
| |
| *Faure
| |
| *Niederreiter
| |
| Figure 2. gives the distribution of 500 LDS points. [[File:LowDiscrepancy500points.JPG|thumb|right|Figure 2. 500 low discrepancy points]]
| |
| | |
| The quasi-Monte Carlo (QMC) method is defined by
| |
| | |
| :<math> \varphi^{\mathop{\rm QMC}}(f)=\frac 1n \sum_{i=1}^nf(x_i),</math>
| |
| | |
| where the <math>x_i</math> belong to an LDS. The standard terminology quasi-Monte Carlo is somewhat unfortunate since MC is a randomized method whereas QMC is purely deterministic.
| |
| | |
| The uniform distribution of LDS is desirable. But the worst case error of QMC is of order
| |
| | |
| :<math>\frac{(\log n)^d}{n},</math>
| |
| | |
| where <math>n</math> is the number of sample points. See <ref name="N92" /> for the theory of LDS and references to the literature. The rate of convergence of LDS may be contrasted with the expected rate of convergence of MC which is <math>n^{-1/2}</math>. For <math>d</math> small the rate of convergence of QMC is faster than MC but for <math>d</math> large the factor <math>(\log n)^d</math> is devastating. For example, if <math>d=360</math>, then even with <math>\log n=2</math> the QMC error is proportional to <math>2^{360}</math>. Thus it was widely believed by the world's leading experts that QMC should not be used for high dimensional integration. For example, in 1992 Bratley, Fox and Niederreiter<ref name="BFN92">Bratley, P., Fox, B. L. and Niederreiter, H. (1992), Implementation and tests of low-discrepancy sequences, ACM Transactions on Modelling and Computer Simulation, Vol. 2, No. 3, 195-213.</ref> performed extensive testing on certain mathematical problems. They conclude "in high-dimensional problems (say <math>d > 12</math>), QMC seems to offer no practical advantage over MC". In 1993, Rensburg and Torrie<ref name="RT93">van Rensburg, E. J. J. and Torrie, G. M. (1993), Estimation of multidimensional integrals: is Monte Carlo the best method? J. Phys. A: Math. Gen., 26(4), 943-953.</ref> compared QMC with MC for the numerical estimation of high dimensional integrals which occur in computing virial coefficients for the hard-sphere fluid. They conclude QMC is more effective than MC only if <math>d<10</math>. As we shall see, tests on 360-dimensional integrals arising from a collateralized mortgage obligation (CMO) lead to very different conclusions.
| |
| | |
| Woźniakowski's 1991 paper<ref name="W91">Woźniakowski, H. (1991), Average case complexity of multivariate integration, Bull. Amer. Math. Soc. (New Ser.), 24(1), 185-194.</ref> showing the connection between average case complexity of integration and QMC led to new interest in QMC.
| |
| Woźniakowski's result received considerable coverage in the scientific press<ref name="SIAMQMC">Cipra, B. A. (1991), Multivariate Integration: It ain't so tough (on average), SIAM NEWS, 28 March.</ref>
| |
| .<ref name="SCIAMER">Traub, J. F. and Woźniakowski, H. (1994), Breaking intractability, Scientific American, 270(1), January, 102-107.</ref>
| |
| In early 1992, I. T. Vanderhoof, New York University, became aware of Woźniakowski's result and gave Woźniakowski's colleague [[Joseph Traub|J. F. Traub]], Columbia University, a CMO with parameters set by Goldman Sachs. This CMO had 10 tranches each requiring the computation of a 360 dimensional integral. Traub asked a Ph.D. student, Spassimir Paskov, to compare QMC with MC for the CMO. In 1992 Paskov built a software system called FinDer and ran extensive tests. To the Columbia's research group's surprise and initial disbelief Paskov reported that QMC was always superior to MC in a number of ways. Details are given below. Preliminary results were presented by Paskov and Traub to a number of Wall Street firms in Fall 1993 and Spring 1994. The firms were initially skeptical of the claim that QMC was superior to MC for pricing financial derivatives. A January 1994 article in Scientific American by Traub and Woźniakowski<ref name="SCIAMER" /> discussed the theoretical issues and reported that "Preliminary results obtained by testing certain finance problems suggests the superiority of the deterministic methods in practice".
| |
| In Fall 1994 Paskov wrote a Columbia University Computer Science Report which appeared in slightly modified form in 1997.<ref name="P97">Paskov, S. H., New methodologies for valuing derivatives, 545-582, in Mathematics of Derivative Securities, S. Pliska and M. Dempster eds., Cambridge University Press, Cambridge.</ref>
| |
| | |
| In Fall 1995
| |
| Paskov and Traub published a paper in the "Journal of Portfolio Management".<ref name="PTJPM" /> They compared MC and two QMC methods. The two deterministic methods used Sobol and Halton points. Since better LDS were created later, no comparison will be made between Sobol and Halton sequences. The experiments drew the following conclusions regarding the performance of MC and QMC on the 10 tranche CMO:
| |
| *QMC methods converge significantly faster than MC
| |
| *MC is sensitive to the initial seed
| |
| *The convergence of QMC is smoother than the convergence of MC. This makes automatic termination easier for QMC.
| |
| | |
| To summarize, QMC beats MC for the CMO on accuracy, confidence level, and speed.
| |
| | |
| This paper was followed by reports on tests by a number of researchers which also led to the conclusion the QMC is superior to MC for a variety of high-dimensional finance problems. This includes papers by Caflisch and Morokoff (1996),<ref name="CM96">Caflisch, R. E. and Morokoff, W. (1996), Quasi-Monte Carlo computation of a finance problem, 15-30, in Proceedings Workshop on Quasi-Monte Carlo Methods and their Applications, 11 December 1995, K.-T. Fang and F. Hickernell eds., Hong Kong Baptist University.</ref>
| |
| Joy, Boyle, Tan (1996),<ref name="JBT96">Joy, C., Boyle, P. P. and Tang, K. S. (1996), Quasi-Monte Carlo methods in numerical finance, Management Science, 42(6), 926-938.</ref>
| |
| Ninomiya and Tezuka (1996),<ref name="NT96">Ninomiya, S. and Tezuka, S. (1996), Toward real-time pricing of complex financial derivatives, Appl. Math. Finance, 3, 1-20.</ref>
| |
| Papageorgiou and Traub (1996),<ref name="PT96">Papageorgiou, A. and Traub, J. F. (1996), Beating Monte Carlo, Risk, 9(6), 63-65.</ref>
| |
| Ackworth, Broadie and Glasserman (1997)<ref name="ABG97">Ackworth, P., Broadie, M. and Glasserman, P. (1997), A comparison of some Monte Carlo techniques for option pricing, 1-18, in Monte Carlo and Quasi-Monte Carlo Methods '96, H. Hellekalek, P. Larcher and G. Zinterhof eds., Springer Verlag, New York.</ref>
| |
| | |
| Further testing of the CMO<ref name="PT96"/> was carried out by Anargyros Papageorgiou, who developed an improved version of the FinDer software system. The new results include the following:
| |
| *'''Small number of sample points:''' For the hardest CMO tranche QMC using the generalized Faure LDS due to S. Tezuka<ref name="TEZ">Tezuka, S., Uniform Random Numbers:Theory and Practice, Kluwer, Netherlands.</ref> achieves accuracy <math>10^{-2}</math> with just 170 points. MC requires 2700 points for the same accuracy. The significance of this is that due to future interest rates and prepayment rates being unknown, financial firms are content with accuracy of <math>10^{-2}</math>.
| |
| *'''Large number of sample points:''' The advantage of QMC over MC is further amplified as the sample size and accuracy demands grow. In particular, QMC is 20 to 50 times faster than MC with moderate sample sizes, and can be up to 1000 times faster than MC<ref name="PT96" /> when high accuracy is desired QMC.
| |
| | |
| ==Theoretical explanations==
| |
| The results reported so far in this article are empirical. A number of possible theoretical explanations have been advanced. This has been a very research rich area leading to powerful new concepts but a definite answer has not been obtained.
| |
| | |
| A possible explanation of why QMC is good for finance is the following. Consider a tranche of the CMO mentioned earlier. The integral gives expected future cash flows from a basket of 30 year mortgages at 360 monthly intervals. Because of the discounted value of money variables representing future times are increasingly less important. In a seminal paper I. Sloan and H. Woźniakowski<ref name="SW98">Sloan, I. and Woźniakowski, H. (1998), When are quasi-Monte Carlo algorithms efficient for high dimensional integrals?, J. Complexity, 14(1), 1-33.</ref>
| |
| introduced the idea of weighted spaces. In these spaces the dependence on the successive variables can be moderated by weights. If the weights decrease sufficiently rapidly the curse of dimensionality is broken even with a worst case guarantee. This paper led to a great amount of work on the tractability of integration and other problems.<ref name="NW08" >Novak, E. and Wo�zniakowski, H. (2008), Tractability of multivariate problems, European Mathematical Society, Zurich (forthcoming).</ref> A problem is tractable when its complexity is of order <math>\epsilon^{-p}</math> and <math>p</math> is independent of the dimension.
| |
| | |
| On the other hand, ''effective dimension'' was proposed by Caflisch, Morokoff and Owen<ref name="CMO97">Caflisch, R. E., Morokoff, W. and Owen, A. B. (1997), Valuation of mortgage backed
| |
| securities using Brownian bridges to reduce effective dimension, Journal of
| |
| Computational Finance, 1, 27-46.</ref> as an indicator
| |
| of the difficulty of high dimensional integration. The purpose was to explain
| |
| the remarkable success of quasi-Monte Carlo (QMC) in approximating the very
| |
| high dimensional integrals in finance. They argued that
| |
| the integrands are of low effective dimension and that is why QMC is much
| |
| faster than Monte Carlo (MC).
| |
| The impact of the arguments of Caflisch et al.<ref name="CMO97" /> was great.
| |
| A number of papers deal with the relationship between the error of QMC and the effective dimension<ref name="Hic98">Hickernell, F. J. (1998), Lattice rules: how well do they measure up?, in P. Hellekalek and G. Larcher (Eds.), Random and Quasi-Random Point Sets, Springer, 109-166.</ref>
| |
| .<ref name="WS05">Wang, X. and Sloan, I. H. (2005), Why are high-dimensional finance problems often of low effective dimension?, SIAM Journal on Scientific Computing, 27(1),
| |
| 159-183.</ref>
| |
| | |
| It is known that QMC fails for certain functions that have high effective dimension.<ref name="BFN92" />
| |
| However, low effective dimension is not a necessary condition for QMC to beat MC and for
| |
| high dimensional integration
| |
| to be tractable. In 2005, Tezuka<ref name="T03" >Tezuka, S. (2005), On the necessity of low-effective dimension, Journal of Complexity,
| |
| 21, 710-721.</ref> exhibited a class of functions of
| |
| <math>d</math> variables, all with maximum effective dimension equal to <math>d</math>. For these functions QMC is very fast since its convergence rate is of order <math>n^{-1}</math>, where <math>n</math> is the number of function evaluations.
| |
| | |
| ==Isotropic integrals==
| |
| QMC can also be superior to MC and to other methods for isotropic problems, that is, problems where all variables are equally important. For example, Papageorgiou and Traub<ref name="PT97">Papageorgiou, A. and Traub, J. F. (1997), Faster evaluation of multidimensional
| |
| integrals, Computers in Physics, 11(6), 574-578.</ref> reported test results on the model integration problems suggested by the physicist B. D. Keister<ref name="K96">Keister, B. D. (1996), Multidimensional quadrature algorithms, Computers in Physics, 10(20), 119-122.</ref>
| |
| | |
| :<math>\left(\frac 1{2\pi}\right)^{d/2} \int_{\mathbb R^d}\cos(\|x\| )e^{-\| x\|^2}\,dx,</math> | |
| | |
| where <math>\|\cdot\|</math> denotes the Euclidean norm and <math>d=25</math>. Keister reports that using a standard numerical method some 220,000 points were needed to obtain a relative error on the order of <math>10^{-2}</math>. A QMC calculation using the generalized Faure low discrepancy sequence<ref name="TEZ" /> (QMC-GF) used only 500 points to obtain the same relative error. The same integral was tested for a range of values of <math> d</math> up to <math> d=100</math>. Its error was
| |
| | |
| :<math> c\cdot n^{-1},</math> | |
| | |
| <math>c<110</math>, where <math> n</math> is the number of evaluations of <math>f</math>. This may be compared with the MC method whose error was proportional to <math>n^{-1/2}</math>.
| |
| | |
| These are empirical results. In a theoretical investigation Papageorgiou<ref name="P01">Papageorgiou, A. (2001), Fast convergence of quasi-Monte Carlo for a class of isotropic integrals, Math. Comp., 70, 297-306.</ref> proved that the convergence rate of QMC for a class of <math>d</math>-dimensional isotropic integrals which includes the integral defined above is of the order
| |
| | |
| :<math>\sqrt{\log n}/n.</math>
| |
| | |
| This is with a worst case guarantee compared to the expected convergence rate of <math>n^{-1/2}</math> of Monte Carlo and shows the superiority of QMC for this type of integral.
| |
| | |
| In another theoretical investigation Papageorgiou<ref name="P03">Papageorgiou, A. (2003), Sufficient conditions for fast quasi-Monte Carlo convergence, J. Complexity, 19(3), 332-351.</ref> presented sufficient conditions for fast QMC convergence. The conditions apply to isotropic and non-isotropic problems and, in particular, to a number of problems in computational finance. He presented classes of functions where even in the worst case the convergence rate of QMC is of order
| |
| | |
| ::::<math>n^{-1+p(\log n)^{-1/2}},</math>
| |
| | |
| where <math>p\ge 0</math> is a constant that depends on the class of functions.
| |
| | |
| But this is only a sufficient condition and leaves open the major question we pose in the next section.
| |
| | |
| ==Open questions==
| |
| # Characterize for which high-dimensional integration problems QMC is superior to MC.
| |
| # Characterize types of financial instruments for which QMC is superior to MC.
| |
| | |
| ==See also==
| |
| * [[Monte Carlo methods in finance]]
| |
| | |
| ==Resources==
| |
| === Books ===
| |
| * {{cite book | title = Monte Carlo: methodologies and applications for pricing and risk management | author = [[Bruno Dupire]] | year = 1998 | publisher = Risk |isbn = 1-899332-91-X}}
| |
| * {{cite book | title = Monte Carlo methods in financial engineering | author = Paul Glasserman | year = 2003 | publisher = [[Springer-Verlag]] | isbn = 0-387-00451-3 }}
| |
| * {{cite book | title = Monte Carlo methods in finance | author = [[Peter Jaeckel]] | year = 2002 | publisher = John Wiley and Sons | isbn = 0-471-49741-X }}
| |
| * {{cite book | title = Monte Carlo Simulation & Finance | author = Don L. McLeish| year = 2005 | publisher = |isbn = 0-471-67778-7}}
| |
| * {{cite book | title = Monte Carlo Statistical Methods| author = Christian P. Robert, George Casella| year = 2004 | publisher = |isbn = 0-387-21239-6}}
| |
| | |
| ===Models===
| |
| *[http://www.puc-rio.br/marco.ind/quasi_mc.html Spreadsheets available for download], Prof. Marco Dias, [[Pontifícia Universidade Católica do Rio de Janeiro|PUC-Rio]]
| |
| | |
| ==References==
| |
| {{Reflist|2}}
| |
| {{Use dmy dates|date=September 2010}}
| |
| | |
| {{DEFAULTSORT:Quasi-Monte Carlo Methods In Finance}}
| |
| [[Category:Monte Carlo methods in finance]]
| |
| [[Category:Quasirandomness]]
| |