Commits · 9aa4c2585ad08afb03fe8e9fba9174d8f565e816 · Zahra Rajabi / pymdptoolbox · GitLab

21 May, 2013 7 commits
- format some lines to fit in 80 characters · 9aa4c258
  Steven Cordwell authored May 21, 2013
  
  9aa4c258
- fix _bellmanOperator to loop over the correct action values · 1fcbe3fa
  Steven Cordwell authored May 21, 2013
  
  1fcbe3fa
- add checkSquareStochastic function to sql mdp · 74c48a4b
  Steven Cordwell authored May 21, 2013
  
  74c48a4b
- order primary integer ascending · 0c0fde1d
  Steven Cordwell authored May 21, 2013
  
  0c0fde1d
- move all sqlite code to mdpsql.py and remove SQLite from class names · d273f3a6
  Steven Cordwell authored May 21, 2013
  
  d273f3a6
- rename util.py to mdpsql.py · 7857e073
  Steven Cordwell authored May 21, 2013
  
  7857e073
- add indices and integer primary keys to sqlite tables · 5c25f03b
  Steven Cordwell authored May 21, 2013
  
  5c25f03b
20 May, 2013 4 commits
- working value iteration algorithm · fb1bc8ea
  Steven Cordwell authored May 21, 2013
  
  fb1bc8ea
- rename base MDP SQLite class to MDPSQLite · eb4cb1fa
  Steven Cordwell authored May 20, 2013
  
  eb4cb1fa
- functional base SQLite class · f1d835d4
  Steven Cordwell authored May 20, 2013
  
  f1d835d4
- reconfigure the reward table to store the state · 287ec766
  Steven Cordwell authored May 20, 2013
  
  287ec766
17 May, 2013 5 commits
- initial functions for the sqlite database manager · 33ebe256
  Steven Cordwell authored May 18, 2013
  
  33ebe256
- use list rather than numpy to generate the states in exampleRand · 8b813dab
  Steven Cordwell authored May 18, 2013
  
  8b813dab
- fix sqlite string and passing reward into db · f30f2588
  Steven Cordwell authored May 17, 2013
  
  f30f2588
- create reward arrays in the sqlite database · 1ffe678e
  Steven Cordwell authored May 17, 2013
  
  1ffe678e
- a working sqlite example generator · 9149df88
  Steven Cordwell authored May 17, 2013
  
  9149df88
16 May, 2013 3 commits
- use numpy for randExample sqlite data generation · 3c26d0da
  Steven Cordwell authored May 17, 2013
  
  3c26d0da
- attempts to speed up sql example code · a1b2f328
  Steven Cordwell authored May 16, 2013
  
  a1b2f328
- initial changes to support sql examples · 0e1da2d7
  Steven Cordwell authored May 16, 2013
  
  0e1da2d7
15 May, 2013 1 commit
- commit new util file. For now this is just to hold the DatabaseManager class · a6c17f16
  Steven Cordwell authored May 15, 2013
  
  a6c17f16
14 Feb, 2013 1 commit
- fixed up the transition code · b475e0a0
  Steven Cordwell authored Feb 14, 2013
  
  b475e0a0
13 Feb, 2013 3 commits
- start on enumerating all state combinations · ccdbac17
  Steven Cordwell authored Feb 14, 2013
  
  ccdbac17
- copy game status functions from RL tictactoe project · 9357eea8
  Steven Cordwell authored Feb 14, 2013
  
  9357eea8
- new examples directory with start of tictactoe example · b393d55f
  Steven Cordwell authored Feb 14, 2013
  
  b393d55f
09 Feb, 2013 8 commits
- change from iter = iter + 1 to iter += 1 · b88931dd
  Steven Cordwell authored Feb 10, 2013
  
  b88931dd
- start tracking a todo list · 3eaaa0e8
  Steven Cordwell authored Feb 09, 2013
  
  3eaaa0e8
- merge using tuples to store P and R · ccab1f84
  Steven Cordwell authored Feb 09, 2013
  
  ccab1f84
- fixed unitests for new tuple storage · 0be11eea
  Steven Cordwell authored Feb 09, 2013
  
  0be11eea
- fixes due to incorrect tuple indexing · 09ceb651
  Steven Cordwell authored Feb 09, 2013
  
  09ceb651
- matrix() is required · 80a0b065
  Steven Cordwell authored Feb 09, 2013
  
  80a0b065
- use empty to initialise Q in Bellman operator, and remove matrix() as it doesn't need this · c735b5f2
  Steven Cordwell authored Feb 09, 2013
  
  c735b5f2
- finished the self.R component of using try-except statements in _computePR · d93367c0
  Steven Cordwell authored Feb 09, 2013
  
  d93367c0
08 Feb, 2013 8 commits
- use empty for zeros · 16b927fb
  Steven Cordwell authored Feb 08, 2013
  
  16b927fb
- clean up to _computePR · c0c5a559
  Steven Cordwell authored Feb 08, 2013
  
  c0c5a559
- changed MDP._computePR to use try-except clauses · 1eb3d702
  Steven Cordwell authored Feb 08, 2013
  
  1eb3d702
- added comment line · 58335770
  Steven Cordwell authored Feb 08, 2013
  
  58335770
- fix [] instead of {} · 542fc4cd
  Steven Cordwell authored Feb 08, 2013
  
  542fc4cd
- dict tests for new ability to accept new types in check() · 263ea10c
  Steven Cordwell authored Feb 08, 2013
  
  263ea10c
- more tests for new ability to accept lists and tuples to check() · a04d5210
  Steven Cordwell authored Feb 08, 2013
  
  a04d5210
- add tests for new ability to accept lists and tuples to check() · 940c3c72
  Steven Cordwell authored Feb 08, 2013
  
  940c3c72