Number in pile 0? 1 Number in pile 1? 2 Number in pile 2? 3 Number of games to simulate? 100000 Initial board is 1-2-3, simulating 100000 games. Final Q-values: Q[A001, 21] = -1000.0 Q[A002, 21] = 900.0 Q[A002, 22] = -1000.0 Q[A003, 21] = -810.0 Q[A003, 22] = 900.0 Q[A003, 23] = -1000.0 Q[A010, 11] = -1000.0 Q[A011, 11] = 900.0 Q[A011, 21] = 900.0 Q[A013, 11] = -810.0 Q[A013, 21] = -810.0 Q[A013, 22] = -810.0 Q[A013, 23] = 900.0 Q[A020, 11] = 900.0 Q[A020, 12] = -1000.0 Q[A021, 11] = -810.0 Q[A021, 12] = 900.0 Q[A021, 21] = -810.0 Q[A022, 11] = -810.0 Q[A022, 12] = -810.0 Q[A022, 21] = -810.0 Q[A022, 22] = -810.0 Q[A100, 01] = -1000.0 Q[A101, 01] = 900.0 Q[A101, 21] = 900.0 Q[A102, 01] = -810.0 Q[A102, 21] = -810.0 Q[A102, 22] = 900.0 Q[A103, 01] = -810.0 Q[A103, 21] = -810.0 Q[A103, 22] = -810.0 Q[A103, 23] = 900.0 Q[A110, 01] = 900.0 Q[A110, 11] = 900.0 Q[A111, 01] = -810.0 Q[A111, 11] = -810.0 Q[A111, 21] = -810.0 Q[A112, 01] = -810.0 Q[A112, 11] = -810.0 Q[A112, 21] = 729.0 Q[A112, 22] = -810.0 Q[A120, 01] = -810.0 Q[A120, 11] = -810.0 Q[A120, 12] = 900.0 Q[A121, 01] = -810.0 Q[A121, 11] = 729.0 Q[A121, 12] = -810.0 Q[A121, 21] = -810.0 Q[A123, 01] = -656.1 Q[A123, 11] = -656.1 Q[A123, 12] = -810.0 Q[A123, 21] = -656.1 Q[A123, 22] = -656.1 Q[A123, 23] = -810.0 Q[B001, 21] = 1000.0 Q[B002, 21] = -900.0 Q[B002, 22] = 1000.0 Q[B003, 21] = 810.0 Q[B003, 22] = -900.0 Q[B003, 23] = 1000.0 Q[B010, 11] = 1000.0 Q[B011, 11] = -900.0 Q[B011, 21] = -900.0 Q[B012, 11] = 810.0 Q[B012, 21] = 810.0 Q[B012, 22] = -900.0 Q[B020, 11] = -900.0 Q[B020, 12] = 1000.0 Q[B021, 11] = 810.0 Q[B021, 12] = -900.0 Q[B021, 21] = 810.0 Q[B023, 11] = 810.0 Q[B023, 12] = 810.0 Q[B023, 21] = -729.0 Q[B023, 22] = 810.0 Q[B023, 23] = 810.0 Q[B100, 01] = 1000.0 Q[B101, 01] = -900.0 Q[B101, 21] = -900.0 Q[B102, 01] = 810.0 Q[B102, 21] = 810.0 Q[B102, 22] = -900.0 Q[B103, 01] = 810.0 Q[B103, 21] = 810.0 Q[B103, 22] = 810.0 Q[B103, 23] = -900.0 Q[B110, 01] = -900.0 Q[B110, 11] = -900.0 Q[B111, 01] = 810.0 Q[B111, 11] = 810.0 Q[B111, 21] = 810.0 Q[B113, 01] = 810.0 Q[B113, 11] = 810.0 Q[B113, 21] = 656.1 Q[B113, 22] = -729.0 Q[B113, 23] = 810.0 Q[B120, 01] = 810.0 Q[B120, 11] = 810.0 Q[B120, 12] = -900.0 Q[B121, 01] = 810.0 Q[B121, 11] = -729.0 Q[B121, 12] = 810.0 Q[B121, 21] = 810.0 Q[B122, 01] = -729.0 Q[B122, 11] = 656.1 Q[B122, 12] = 810.0 Q[B122, 21] = 656.1 Q[B122, 22] = 810.0 Who moves first, (1) User or (2) Computer? 1 Player A (user)'s turn; board is (1, 2, 3). What pile? 2 How many? 3 Player B (computer)'s turn; board is (1, 2, 0). Computer chooses pile 1 and removes 2. Player A (user)'s turn; board is (1, 0, 0). What pile? 0 How many? 1 Game over. Winner is B (computer). Play again? (1) Yes (2) No: 1 Who moves first, (1) User or (2) Computer? 1 Player A (user)'s turn; board is (1, 2, 3). What pile? 0 How many? 1 Player B (computer)'s turn; board is (0, 2, 3). Computer chooses pile 2 and removes 1. Player A (user)'s turn; board is (0, 2, 2). What pile? 1 How many? 1 Player B (computer)'s turn; board is (0, 1, 2). Computer chooses pile 2 and removes 2. Player A (user)'s turn; board is (0, 1, 0). What pile? 1 How many? 1 Game over. Winner is B (computer). Play again? (1) Yes (2) No: 1 Who moves first, (1) User or (2) Computer? 1 Player A (user)'s turn; board is (1, 2, 3). What pile? 1 How many? 1 Player B (computer)'s turn; board is (1, 1, 3). Computer chooses pile 2 and removes 2. Player A (user)'s turn; board is (1, 1, 1). What pile? 1 How many? 1 Player B (computer)'s turn; board is (1, 0, 1). Computer chooses pile 0 and removes 1. Player A (user)'s turn; board is (0, 0, 1). What pile? 2 How many? 1 Game over. Winner is B (computer). Play again? (1) Yes (2) No: 2