JUCS - Journal of Universal Computer Science 14(7): 1136-1153, doi: 10.3217/jucs-014-07-1136
Reinforcement Learning on a Futures Market Simulator
expand article infoKoichi Moriyama, Mitsuhiro Matsumoto, Ken-ichi Fukui, Satoshi Kurihara, Masayuki Numao
‡ Osaka University, Osaka, Japan
Open Access
In recent years, market forecasting by machine learning methods has been flourishing.Most existing works use a past market data set, because they assume that each trader's individual decisions do not affect market prices at all. Meanwhile, there have been attempts to analyzeeconomic phenomena by constructing virtual market simulators, in which human and artificial traders really make trades. Since prices in a market are, in fact, determined by every trader'sdecisions, a virtual market is more realistic, and the above assumption does not apply. In this work, we design several reinforcement learners on the futures market simulator U-Mart (UnrealMarket as an Artificial Research Testbed) and compare our learners with the previous champions of U-Mart competitions empirically.
reinforcement learning, market simulation