A Reinforcement Learning Model Based on Temporal Difference Algorithm

Xiali Li, Zhengyu Lv, Song Wang, Zhi Wei, Licheng Wu

Research output: Contribution to journalArticlepeer-review

16 Scopus citations


In some sense, computer game can be used as a test bed of artificial intelligence to develop intelligent algorithms. The paper proposed a kind of intelligent method: a reinforcement learning model based on temporal difference (TD) algorithm. And then the method is used to improve the playing power of the computer game of a special kind of chess. JIU chess, also called Tibetan Go chess, is mainly played in places where Tibetan tribes gather. Its play process is divided two sequential stages: preparation and battle. The layout at preparation is vital for the successive battle, even for the final winning. Studies on Tibetan JIU chess have focused on Bayesian network based pattern extraction and chess shape based strategy, which do not perform well. To address the low chess power of JIU chess from the view of artificial intelligence, we developed a reinforcement learning model based on temporal difference (TD) algorithm for the preparation stage of JIU. First, the search range was limited within a 6 × 6 area at the center of the chessboard, and the TD learning architecture was combined with chess shapes to construct an intelligent environmental feedback system. Second, optimal state transition strategies were obtained by self-play. In addition, the results of the reinforcement learning model were output as SGF files, which act as a pattern library for the battle stage. The experimental results demonstrate that this reinforcement learning model can effectively improve the playing strength of JIU program and outperform the other methods.

Original languageEnglish (US)
Article number8819952
Pages (from-to)121922-121930
Number of pages9
JournalIEEE Access
StatePublished - 2019
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • General Computer Science
  • General Materials Science
  • General Engineering


  • Artificial intelligence
  • JIU chess
  • reinforcement learning
  • temporal difference algorithm


Dive into the research topics of 'A Reinforcement Learning Model Based on Temporal Difference Algorithm'. Together they form a unique fingerprint.

Cite this