GitLab

fix bug in ValueIterationGS where ValueIteration._iterate() was called before its own _iterate() method

't supplied one. we are looping through all states anyway, so just create a small mask for each row

remove .getA1() calls from value and policy returns because arrays rather than matrices are being used now

since we are no longer using matrix types, then have to explicitly call dot function for dot product

rewrite exampleRand's sparse support to directly create a sparse matrix rather than creating a dense matrix then converting to sparse