-
Notifications
You must be signed in to change notification settings - Fork 3
/
Copy pathrandom_search.log
1080 lines (1080 loc) · 101 KB
/
random_search.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
2020-07-07 20:47:23,018 INFO Iter 0
2020-07-07 20:47:23,018 INFO Policy now: [[1.0, 2.0, 7.0, 0.0], [1.0, 4.0, 1.0, 9.0], [0.0, 8.0, 6.0, 8.0], [4.0, 4.0, 3.0, 9.0], [2.0, 3.0, 9.0, 2.0]]
2020-07-07 20:47:23,018 INFO Reward now: 3.51031131029129
2020-07-07 20:47:23,019 INFO Best policy so far: [[2.0, 3.0, 8.0, 0.0], [2.0, 4.0, 2.0, 9.0], [1.0, 8.0, 7.0, 9.0], [4.0, 5.0, 4.0, 9.0], [3.0, 4.0, 9.0, 3.0]]
2020-07-07 20:47:23,019 INFO Best reward so far: 4.069481062889099
2020-07-07 21:38:18,563 INFO Iter 1
2020-07-07 21:38:18,563 INFO Policy now: [[1.0, 2.0, 8.0, 1.0], [2.0, 5.0, 2.0, 9.0], [0.0, 9.0, 7.0, 8.0], [4.0, 5.0, 4.0, 9.0], [2.0, 4.0, 9.0, 3.0]]
2020-07-07 21:38:18,563 INFO Reward now: 8.291544589996338
2020-07-07 21:38:18,564 INFO Best policy so far: [[1.0, 3.0, 8.0, 2.0], [1.0, 5.0, 2.0, 9.0], [1.0, 9.0, 7.0, 9.0], [4.0, 5.0, 4.0, 9.0], [2.0, 5.0, 9.0, 3.0]]
2020-07-07 21:38:18,564 INFO Best reward so far: 9.393874969482422
2020-07-07 22:16:06,426 INFO Iter 2
2020-07-07 22:16:06,426 INFO Policy now: [[1.0, 3.0, 8.0, 2.0], [2.0, 6.0, 3.0, 9.0], [0.0, 9.0, 8.0, 8.0], [4.0, 6.0, 5.0, 9.0], [2.0, 5.0, 9.0, 4.0]]
2020-07-07 22:16:06,426 INFO Reward now: 7.479912757873535
2020-07-07 22:16:06,426 INFO Best policy so far: [[1.0, 3.0, 8.0, 2.0], [1.0, 5.0, 2.0, 9.0], [1.0, 9.0, 7.0, 9.0], [4.0, 5.0, 4.0, 9.0], [2.0, 5.0, 9.0, 3.0]]
2020-07-07 22:16:06,426 INFO Best reward so far: 9.393874969482422
2020-07-07 22:45:33,088 INFO Iter 3
2020-07-07 22:45:33,088 INFO Policy now: [[1.0, 4.0, 8.0, 3.0], [2.0, 7.0, 4.0, 9.0], [0.0, 9.0, 8.0, 8.0], [4.0, 7.0, 6.0, 9.0], [2.0, 6.0, 9.0, 5.0]]
2020-07-07 22:45:33,088 INFO Reward now: 5.1237105369567875
2020-07-07 22:45:33,088 INFO Best policy so far: [[1.0, 3.0, 8.0, 2.0], [1.0, 5.0, 2.0, 9.0], [1.0, 9.0, 7.0, 9.0], [4.0, 5.0, 4.0, 9.0], [2.0, 5.0, 9.0, 3.0]]
2020-07-07 22:45:33,089 INFO Best reward so far: 9.393874969482422
2020-07-07 22:55:43,341 INFO Iter 4
2020-07-07 22:55:43,341 INFO Policy now: [[1.0, 4.0, 9.0, 4.0], [2.0, 7.0, 4.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 7.0, 7.0, 9.0], [2.0, 6.0, 9.0, 5.0]]
2020-07-07 22:55:43,341 INFO Reward now: 6.311603517532348
2020-07-07 22:55:43,341 INFO Best policy so far: [[1.0, 3.0, 8.0, 2.0], [1.0, 5.0, 2.0, 9.0], [1.0, 9.0, 7.0, 9.0], [4.0, 5.0, 4.0, 9.0], [2.0, 5.0, 9.0, 3.0]]
2020-07-07 22:55:43,341 INFO Best reward so far: 9.393874969482422
2020-07-07 23:16:34,955 INFO Iter 5
2020-07-07 23:16:34,955 INFO Policy now: [[1.0, 4.0, 9.0, 4.0], [2.0, 7.0, 4.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 7.0, 7.0, 9.0], [2.0, 6.0, 9.0, 5.0]]
2020-07-07 23:16:34,955 INFO Reward now: 6.3565010070800785
2020-07-07 23:16:34,955 INFO Best policy so far: [[1.0, 3.0, 8.0, 2.0], [1.0, 5.0, 2.0, 9.0], [1.0, 9.0, 7.0, 9.0], [4.0, 5.0, 4.0, 9.0], [2.0, 5.0, 9.0, 3.0]]
2020-07-07 23:16:34,955 INFO Best reward so far: 9.393874969482422
2020-07-07 23:46:36,595 INFO Iter 6
2020-07-07 23:46:36,595 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-07 23:46:36,595 INFO Reward now: 9.448314933776855
2020-07-07 23:46:36,595 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-07 23:46:36,595 INFO Best reward so far: 10.342430038452148
2020-07-08 00:15:35,117 INFO Iter 7
2020-07-08 00:15:35,118 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-08 00:15:35,118 INFO Reward now: 5.4800161933898925
2020-07-08 00:15:35,118 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 00:15:35,118 INFO Best reward so far: 10.342430038452148
2020-07-08 00:57:48,696 INFO Iter 8
2020-07-08 00:57:48,696 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-08 00:57:48,697 INFO Reward now: 5.618277502059937
2020-07-08 00:57:48,697 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 00:57:48,697 INFO Best reward so far: 10.342430038452148
2020-07-08 01:05:57,882 INFO Iter 9
2020-07-08 01:05:57,882 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-08 01:05:57,882 INFO Reward now: 4.778080019950867
2020-07-08 01:05:57,882 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 01:05:57,882 INFO Best reward so far: 10.342430038452148
2020-07-08 01:37:50,047 INFO Iter 10
2020-07-08 01:37:50,047 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-08 01:37:50,047 INFO Reward now: 6.996809797286987
2020-07-08 01:37:50,047 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 01:37:50,047 INFO Best reward so far: 10.342430038452148
2020-07-08 01:52:21,607 INFO Iter 11
2020-07-08 01:52:21,607 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-08 01:52:21,607 INFO Reward now: 2.470147366523743
2020-07-08 01:52:21,607 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 01:52:21,607 INFO Best reward so far: 10.342430038452148
2020-07-08 02:19:46,709 INFO Iter 12
2020-07-08 02:19:46,710 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-08 02:19:46,710 INFO Reward now: 4.42035343170166
2020-07-08 02:19:46,710 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 02:19:46,710 INFO Best reward so far: 10.342430038452148
2020-07-08 02:24:16,558 INFO Iter 13
2020-07-08 02:24:16,558 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-08 02:24:16,558 INFO Reward now: 3.5914510917663574
2020-07-08 02:24:16,558 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 02:24:16,558 INFO Best reward so far: 10.342430038452148
2020-07-08 02:40:57,481 INFO Iter 14
2020-07-08 02:40:57,481 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-08 02:40:57,481 INFO Reward now: 3.8844226455688475
2020-07-08 02:40:57,481 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 02:40:57,481 INFO Best reward so far: 10.342430038452148
2020-07-08 03:00:29,841 INFO Iter 15
2020-07-08 03:00:29,842 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 7.0, 9.0, 6.0]]
2020-07-08 03:00:29,842 INFO Reward now: 5.0435966205596925
2020-07-08 03:00:29,842 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 03:00:29,842 INFO Best reward so far: 10.342430038452148
2020-07-08 03:39:48,853 INFO Iter 16
2020-07-08 03:39:48,853 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 8.0, 9.0, 6.0]]
2020-07-08 03:39:48,853 INFO Reward now: 8.706157836914063
2020-07-08 03:39:48,853 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 03:39:48,854 INFO Best reward so far: 10.342430038452148
2020-07-08 03:57:37,467 INFO Iter 17
2020-07-08 03:57:37,467 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 8.0, 9.0, 6.0]]
2020-07-08 03:57:37,467 INFO Reward now: 4.314184789657593
2020-07-08 03:57:37,467 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 03:57:37,467 INFO Best reward so far: 10.342430038452148
2020-07-08 04:34:53,550 INFO Iter 18
2020-07-08 04:34:53,550 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 8.0, 9.0, 6.0]]
2020-07-08 04:34:53,550 INFO Reward now: 9.075330352783203
2020-07-08 04:34:53,550 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 04:34:53,550 INFO Best reward so far: 10.342430038452148
2020-07-08 04:59:06,670 INFO Iter 19
2020-07-08 04:59:06,670 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 8.0, 9.0, 6.0]]
2020-07-08 04:59:06,670 INFO Reward now: 5.8245884037017825
2020-07-08 04:59:06,670 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 04:59:06,670 INFO Best reward so far: 10.342430038452148
2020-07-08 05:04:54,629 INFO Iter 20
2020-07-08 05:04:54,629 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 8.0, 9.0, 6.0]]
2020-07-08 05:04:54,629 INFO Reward now: 3.3757359838485717
2020-07-08 05:04:54,629 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 05:04:54,629 INFO Best reward so far: 10.342430038452148
2020-07-08 05:21:52,093 INFO Iter 21
2020-07-08 05:21:52,093 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 8.0, 9.0, 6.0]]
2020-07-08 05:21:52,093 INFO Reward now: 3.8365539789199827
2020-07-08 05:21:52,093 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 05:21:52,093 INFO Best reward so far: 10.342430038452148
2020-07-08 05:37:08,586 INFO Iter 22
2020-07-08 05:37:08,587 INFO Policy now: [[2.0, 5.0, 9.0, 5.0], [3.0, 7.0, 5.0, 9.0], [0.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 8.0, 9.0, 6.0]]
2020-07-08 05:37:08,587 INFO Reward now: 5.122727470397949
2020-07-08 05:37:08,587 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 05:37:08,587 INFO Best reward so far: 10.342430038452148
2020-07-08 06:13:47,846 INFO Iter 23
2020-07-08 06:13:47,846 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 06:13:47,846 INFO Reward now: 8.130911598205566
2020-07-08 06:13:47,846 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 06:13:47,846 INFO Best reward so far: 10.342430038452148
2020-07-08 06:37:18,565 INFO Iter 24
2020-07-08 06:37:18,566 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 06:37:18,566 INFO Reward now: 8.475526390075684
2020-07-08 06:37:18,566 INFO Best policy so far: [[1.0, 5.0, 9.0, 5.0], [3.0, 8.0, 4.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 8.0, 8.0, 9.0], [3.0, 6.0, 9.0, 6.0]]
2020-07-08 06:37:18,566 INFO Best reward so far: 10.342430038452148
2020-07-08 07:29:34,702 INFO Iter 25
2020-07-08 07:29:34,702 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 07:29:34,702 INFO Reward now: 9.932292289733887
2020-07-08 07:29:34,702 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 07:29:34,702 INFO Best reward so far: 10.589039134979249
2020-07-08 08:14:39,950 INFO Iter 26
2020-07-08 08:14:39,950 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 08:14:39,950 INFO Reward now: 7.708541030883789
2020-07-08 08:14:39,950 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 08:14:39,950 INFO Best reward so far: 10.589039134979249
2020-07-08 08:51:02,770 INFO Iter 27
2020-07-08 08:51:02,770 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 08:51:02,770 INFO Reward now: 7.6731665897369385
2020-07-08 08:51:02,770 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 08:51:02,770 INFO Best reward so far: 10.589039134979249
2020-07-08 09:16:15,754 INFO Iter 28
2020-07-08 09:16:15,754 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 09:16:15,754 INFO Reward now: 8.807447299957275
2020-07-08 09:16:15,754 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 09:16:15,755 INFO Best reward so far: 10.589039134979249
2020-07-08 09:25:50,341 INFO Iter 29
2020-07-08 09:25:50,342 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 09:25:50,342 INFO Reward now: 7.522489910125732
2020-07-08 09:25:50,342 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 09:25:50,342 INFO Best reward so far: 10.589039134979249
2020-07-08 09:55:44,895 INFO Iter 30
2020-07-08 09:55:44,895 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 09:55:44,895 INFO Reward now: 5.752469806671143
2020-07-08 09:55:44,895 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 09:55:44,895 INFO Best reward so far: 10.589039134979249
2020-07-08 10:12:04,856 INFO Iter 31
2020-07-08 10:12:04,856 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 10:12:04,857 INFO Reward now: 4.184701309204102
2020-07-08 10:12:04,857 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 10:12:04,857 INFO Best reward so far: 10.589039134979249
2020-07-08 10:37:01,750 INFO Iter 32
2020-07-08 10:37:01,751 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 10:37:01,751 INFO Reward now: 9.227486400604247
2020-07-08 10:37:01,751 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 10:37:01,751 INFO Best reward so far: 10.589039134979249
2020-07-08 10:51:18,503 INFO Iter 33
2020-07-08 10:51:18,503 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 10:51:18,503 INFO Reward now: 5.041504735946655
2020-07-08 10:51:18,503 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 10:51:18,503 INFO Best reward so far: 10.589039134979249
2020-07-08 10:53:51,366 INFO Iter 34
2020-07-08 10:53:51,367 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 10:53:51,367 INFO Reward now: 2.5984734678268433
2020-07-08 10:53:51,367 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 10:53:51,367 INFO Best reward so far: 10.589039134979249
2020-07-08 11:47:30,960 INFO Iter 35
2020-07-08 11:47:30,961 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 11:47:30,961 INFO Reward now: 5.07018738746643
2020-07-08 11:47:30,961 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 11:47:30,961 INFO Best reward so far: 10.589039134979249
2020-07-08 12:23:52,270 INFO Iter 36
2020-07-08 12:23:52,270 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 12:23:52,270 INFO Reward now: 7.519836215972901
2020-07-08 12:23:52,270 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 12:23:52,270 INFO Best reward so far: 10.589039134979249
2020-07-08 13:03:59,345 INFO Iter 37
2020-07-08 13:03:59,346 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 13:03:59,346 INFO Reward now: 9.743124351501464
2020-07-08 13:03:59,346 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 13:03:59,346 INFO Best reward so far: 10.589039134979249
2020-07-08 13:26:24,371 INFO Iter 38
2020-07-08 13:26:24,371 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 13:26:24,371 INFO Reward now: 6.895762596130371
2020-07-08 13:26:24,371 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 13:26:24,371 INFO Best reward so far: 10.589039134979249
2020-07-08 14:01:35,907 INFO Iter 39
2020-07-08 14:01:35,907 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 14:01:35,907 INFO Reward now: 8.074891452789307
2020-07-08 14:01:35,907 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 14:01:35,907 INFO Best reward so far: 10.589039134979249
2020-07-08 14:18:36,177 INFO Iter 40
2020-07-08 14:18:36,177 INFO Policy now: [[2.0, 6.0, 9.0, 6.0], [3.0, 8.0, 6.0, 9.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 8.0, 9.0, 7.0]]
2020-07-08 14:18:36,177 INFO Reward now: 4.642655096054077
2020-07-08 14:18:36,177 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 14:18:36,177 INFO Best reward so far: 10.589039134979249
2020-07-08 15:08:45,613 INFO Iter 41
2020-07-08 15:08:45,613 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 8.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 7.0, 9.0, 7.0]]
2020-07-08 15:08:45,613 INFO Reward now: 6.809819822311401
2020-07-08 15:08:45,613 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 15:08:45,613 INFO Best reward so far: 10.589039134979249
2020-07-08 15:38:34,834 INFO Iter 42
2020-07-08 15:38:34,835 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 8.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 7.0, 9.0, 7.0]]
2020-07-08 15:38:34,835 INFO Reward now: 5.872774000167847
2020-07-08 15:38:34,835 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 15:38:34,835 INFO Best reward so far: 10.589039134979249
2020-07-08 15:43:32,226 INFO Iter 43
2020-07-08 15:43:32,227 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 8.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 7.0, 9.0, 7.0]]
2020-07-08 15:43:32,227 INFO Reward now: 3.299534602165222
2020-07-08 15:43:32,227 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 15:43:32,227 INFO Best reward so far: 10.589039134979249
2020-07-08 16:28:23,777 INFO Iter 44
2020-07-08 16:28:23,777 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 8.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 7.0, 9.0, 7.0]]
2020-07-08 16:28:23,777 INFO Reward now: 6.368128652572632
2020-07-08 16:28:23,777 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 16:28:23,777 INFO Best reward so far: 10.589039134979249
2020-07-08 16:51:37,896 INFO Iter 45
2020-07-08 16:51:37,896 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 8.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 7.0, 9.0, 7.0]]
2020-07-08 16:51:37,896 INFO Reward now: 6.358896131515503
2020-07-08 16:51:37,896 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 16:51:37,896 INFO Best reward so far: 10.589039134979249
2020-07-08 17:23:41,449 INFO Iter 46
2020-07-08 17:23:41,449 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 8.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 7.0, 9.0, 7.0]]
2020-07-08 17:23:41,449 INFO Reward now: 7.937573986053467
2020-07-08 17:23:41,449 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 17:23:41,449 INFO Best reward so far: 10.589039134979249
2020-07-08 18:07:36,922 INFO Iter 47
2020-07-08 18:07:36,922 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 8.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 7.0, 9.0, 7.0]]
2020-07-08 18:07:36,922 INFO Reward now: 9.637012557983399
2020-07-08 18:07:36,922 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 8.0, 7.0, 9.0], [2.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [3.0, 9.0, 9.0, 8.0]]
2020-07-08 18:07:36,922 INFO Best reward so far: 10.589039134979249
2020-07-08 18:47:21,610 INFO Iter 48
2020-07-08 18:47:21,610 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 18:47:21,610 INFO Reward now: 10.681966896057128
2020-07-08 18:47:21,610 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 18:47:21,610 INFO Best reward so far: 11.262672882080079
2020-07-08 18:50:42,427 INFO Iter 49
2020-07-08 18:50:42,427 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 18:50:42,427 INFO Reward now: 4.684679803848266
2020-07-08 18:50:42,427 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 18:50:42,427 INFO Best reward so far: 11.262672882080079
2020-07-08 19:42:38,246 INFO Iter 50
2020-07-08 19:42:38,246 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 19:42:38,246 INFO Reward now: 5.574557933807373
2020-07-08 19:42:38,246 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 19:42:38,246 INFO Best reward so far: 11.262672882080079
2020-07-08 20:07:47,485 INFO Iter 51
2020-07-08 20:07:47,485 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 20:07:47,485 INFO Reward now: 4.103039636611938
2020-07-08 20:07:47,485 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 20:07:47,486 INFO Best reward so far: 11.262672882080079
2020-07-08 20:15:40,340 INFO Iter 52
2020-07-08 20:15:40,340 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 20:15:40,340 INFO Reward now: 6.507858505249024
2020-07-08 20:15:40,340 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 20:15:40,340 INFO Best reward so far: 11.262672882080079
2020-07-08 20:20:10,697 INFO Iter 53
2020-07-08 20:20:10,697 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 20:20:10,697 INFO Reward now: 4.662024564743042
2020-07-08 20:20:10,697 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 20:20:10,697 INFO Best reward so far: 11.262672882080079
2020-07-08 20:43:42,694 INFO Iter 54
2020-07-08 20:43:42,694 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 20:43:42,694 INFO Reward now: 6.351921558380127
2020-07-08 20:43:42,694 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 20:43:42,694 INFO Best reward so far: 11.262672882080079
2020-07-08 21:24:08,915 INFO Iter 55
2020-07-08 21:24:08,915 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 21:24:08,915 INFO Reward now: 9.066421527862548
2020-07-08 21:24:08,915 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 21:24:08,915 INFO Best reward so far: 11.262672882080079
2020-07-08 22:11:55,012 INFO Iter 56
2020-07-08 22:11:55,012 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 22:11:55,012 INFO Reward now: 7.468747215270996
2020-07-08 22:11:55,012 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 22:11:55,012 INFO Best reward so far: 11.262672882080079
2020-07-08 22:47:16,486 INFO Iter 57
2020-07-08 22:47:16,486 INFO Policy now: [[2.0, 5.0, 9.0, 6.0], [3.0, 8.0, 6.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 8.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 22:47:16,487 INFO Reward now: 9.474478492736816
2020-07-08 22:47:16,487 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 22:47:16,487 INFO Best reward so far: 11.262672882080079
2020-07-08 23:39:56,475 INFO Iter 58
2020-07-08 23:39:56,475 INFO Policy now: [[2.0, 5.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 6.0, 9.0, 7.0]]
2020-07-08 23:39:56,475 INFO Reward now: 9.664126091003418
2020-07-08 23:39:56,475 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-08 23:39:56,475 INFO Best reward so far: 11.262672882080079
2020-07-09 00:14:14,535 INFO Iter 59
2020-07-09 00:14:14,536 INFO Policy now: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 00:14:14,536 INFO Reward now: 8.643182029724121
2020-07-09 00:14:14,536 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-09 00:14:14,536 INFO Best reward so far: 11.262672882080079
2020-07-09 00:51:17,217 INFO Iter 60
2020-07-09 00:51:17,218 INFO Policy now: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 00:51:17,218 INFO Reward now: 6.397519226074219
2020-07-09 00:51:17,218 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-09 00:51:17,218 INFO Best reward so far: 11.262672882080079
2020-07-09 01:37:41,610 INFO Iter 61
2020-07-09 01:37:41,610 INFO Policy now: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 01:37:41,611 INFO Reward now: 10.18510841369629
2020-07-09 01:37:41,611 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-09 01:37:41,611 INFO Best reward so far: 11.262672882080079
2020-07-09 02:31:24,630 INFO Iter 62
2020-07-09 02:31:24,631 INFO Policy now: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 02:31:24,631 INFO Reward now: 11.119518661499024
2020-07-09 02:31:24,631 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-09 02:31:24,631 INFO Best reward so far: 11.262672882080079
2020-07-09 03:27:39,492 INFO Iter 63
2020-07-09 03:27:39,493 INFO Policy now: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 03:27:39,493 INFO Reward now: 4.731761703491211
2020-07-09 03:27:39,493 INFO Best policy so far: [[2.0, 4.0, 8.0, 5.0], [2.0, 8.0, 6.0, 7.0], [1.0, 8.0, 8.0, 9.0], [4.0, 9.0, 7.0, 9.0], [2.0, 5.0, 9.0, 7.0]]
2020-07-09 03:27:39,493 INFO Best reward so far: 11.262672882080079
2020-07-09 04:11:06,767 INFO Iter 64
2020-07-09 04:11:06,767 INFO Policy now: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 04:11:06,767 INFO Reward now: 12.598196105957031
2020-07-09 04:11:06,767 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 04:11:06,767 INFO Best reward so far: 12.598196105957031
2020-07-09 05:06:19,143 INFO Iter 65
2020-07-09 05:06:19,143 INFO Policy now: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 05:06:19,143 INFO Reward now: 9.791352195739746
2020-07-09 05:06:19,143 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 05:06:19,143 INFO Best reward so far: 12.598196105957031
2020-07-09 05:38:45,964 INFO Iter 66
2020-07-09 05:38:45,964 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 05:38:45,964 INFO Reward now: 6.660331974029541
2020-07-09 05:38:45,964 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 05:38:45,964 INFO Best reward so far: 12.598196105957031
2020-07-09 06:32:09,347 INFO Iter 67
2020-07-09 06:32:09,347 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 06:32:09,347 INFO Reward now: 5.795868759155273
2020-07-09 06:32:09,347 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 06:32:09,347 INFO Best reward so far: 12.598196105957031
2020-07-09 06:56:01,077 INFO Iter 68
2020-07-09 06:56:01,077 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 06:56:01,077 INFO Reward now: 7.334059677124023
2020-07-09 06:56:01,077 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 06:56:01,077 INFO Best reward so far: 12.598196105957031
2020-07-09 07:26:25,548 INFO Iter 69
2020-07-09 07:26:25,548 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 07:26:25,548 INFO Reward now: 6.29440731048584
2020-07-09 07:26:25,548 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 07:26:25,548 INFO Best reward so far: 12.598196105957031
2020-07-09 07:31:22,672 INFO Iter 70
2020-07-09 07:31:22,673 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 07:31:22,673 INFO Reward now: 4.6728434562683105
2020-07-09 07:31:22,673 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 07:31:22,673 INFO Best reward so far: 12.598196105957031
2020-07-09 07:47:36,949 INFO Iter 71
2020-07-09 07:47:36,950 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 07:47:36,950 INFO Reward now: 5.46792293548584
2020-07-09 07:47:36,950 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 07:47:36,950 INFO Best reward so far: 12.598196105957031
2020-07-09 08:21:45,870 INFO Iter 72
2020-07-09 08:21:45,871 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 08:21:45,871 INFO Reward now: 6.405234317779541
2020-07-09 08:21:45,871 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 08:21:45,871 INFO Best reward so far: 12.598196105957031
2020-07-09 08:40:01,131 INFO Iter 73
2020-07-09 08:40:01,131 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 08:40:01,132 INFO Reward now: 6.629491949081421
2020-07-09 08:40:01,132 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 08:40:01,132 INFO Best reward so far: 12.598196105957031
2020-07-09 09:06:30,071 INFO Iter 74
2020-07-09 09:06:30,071 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 09:06:30,071 INFO Reward now: 7.271961498260498
2020-07-09 09:06:30,071 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 09:06:30,071 INFO Best reward so far: 12.598196105957031
2020-07-09 09:42:42,439 INFO Iter 75
2020-07-09 09:42:42,439 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 09:42:42,439 INFO Reward now: 9.03903621673584
2020-07-09 09:42:42,439 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 09:42:42,439 INFO Best reward so far: 12.598196105957031
2020-07-09 10:21:49,448 INFO Iter 76
2020-07-09 10:21:49,449 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 10:21:49,449 INFO Reward now: 10.169734230041504
2020-07-09 10:21:49,449 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 10:21:49,449 INFO Best reward so far: 12.598196105957031
2020-07-09 11:03:57,840 INFO Iter 77
2020-07-09 11:03:57,840 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 11:03:57,840 INFO Reward now: 11.798547859191894
2020-07-09 11:03:57,840 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 11:03:57,840 INFO Best reward so far: 12.598196105957031
2020-07-09 11:34:33,690 INFO Iter 78
2020-07-09 11:34:33,691 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 11:34:33,691 INFO Reward now: 10.146554908752442
2020-07-09 11:34:33,691 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 11:34:33,691 INFO Best reward so far: 12.598196105957031
2020-07-09 12:23:47,386 INFO Iter 79
2020-07-09 12:23:47,386 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 12:23:47,386 INFO Reward now: 6.387242202758789
2020-07-09 12:23:47,387 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 12:23:47,387 INFO Best reward so far: 12.598196105957031
2020-07-09 13:19:54,688 INFO Iter 80
2020-07-09 13:19:54,689 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 13:19:54,689 INFO Reward now: 6.013099145889282
2020-07-09 13:19:54,689 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 13:19:54,689 INFO Best reward so far: 12.598196105957031
2020-07-09 13:25:07,594 INFO Iter 81
2020-07-09 13:25:07,594 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 13:25:07,594 INFO Reward now: 3.91060932636261
2020-07-09 13:25:07,594 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 13:25:07,594 INFO Best reward so far: 12.598196105957031
2020-07-09 14:03:02,474 INFO Iter 82
2020-07-09 14:03:02,475 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 14:03:02,475 INFO Reward now: 9.984695339202881
2020-07-09 14:03:02,475 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 14:03:02,475 INFO Best reward so far: 12.598196105957031
2020-07-09 14:40:12,711 INFO Iter 83
2020-07-09 14:40:12,711 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 14:40:12,712 INFO Reward now: 6.21200719833374
2020-07-09 14:40:12,712 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 14:40:12,712 INFO Best reward so far: 12.598196105957031
2020-07-09 19:01:52,894 INFO Iter 83
2020-07-09 19:01:52,894 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 19:01:52,894 INFO Reward now: 7.439263401031494
2020-07-09 19:01:52,894 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 19:01:52,894 INFO Best reward so far: 12.598196105957031
2020-07-09 19:44:38,663 INFO Iter 84
2020-07-09 19:44:38,664 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 19:44:38,664 INFO Reward now: 9.155229797363281
2020-07-09 19:44:38,664 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 19:44:38,664 INFO Best reward so far: 12.598196105957031
2020-07-09 20:44:11,393 INFO Iter 85
2020-07-09 20:44:11,393 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 20:44:11,393 INFO Reward now: 6.6861302947998045
2020-07-09 20:44:11,393 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 20:44:11,393 INFO Best reward so far: 12.598196105957031
2020-07-09 21:48:34,207 INFO Iter 86
2020-07-09 21:48:34,629 INFO Policy now: [[2.0, 7.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-09 21:48:34,629 INFO Reward now: 10.360926589965821
2020-07-09 21:48:34,629 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 21:48:34,629 INFO Best reward so far: 12.598196105957031
2020-07-09 22:16:24,930 INFO Iter 87
2020-07-09 22:16:24,931 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 22:16:24,931 INFO Reward now: 7.324200687408447
2020-07-09 22:16:24,931 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 22:16:24,931 INFO Best reward so far: 12.598196105957031
2020-07-09 23:11:37,114 INFO Iter 88
2020-07-09 23:11:37,114 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 23:11:37,114 INFO Reward now: 9.449396343231202
2020-07-09 23:11:37,114 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 23:11:37,114 INFO Best reward so far: 12.598196105957031
2020-07-09 23:30:20,961 INFO Iter 89
2020-07-09 23:30:20,996 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 23:30:20,996 INFO Reward now: 4.501120963096619
2020-07-09 23:30:20,996 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 23:30:20,996 INFO Best reward so far: 12.598196105957031
2020-07-09 23:43:21,655 INFO Iter 90
2020-07-09 23:43:21,655 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-09 23:43:21,655 INFO Reward now: 4.274073801040649
2020-07-09 23:43:21,655 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-09 23:43:21,655 INFO Best reward so far: 12.598196105957031
2020-07-10 00:46:56,865 INFO Iter 91
2020-07-10 00:46:56,871 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 00:46:56,872 INFO Reward now: 11.46870449066162
2020-07-10 00:46:56,872 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 00:46:56,872 INFO Best reward so far: 12.598196105957031
2020-07-10 01:20:00,349 INFO Iter 92
2020-07-10 01:20:00,349 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 01:20:00,349 INFO Reward now: 7.716944217681885
2020-07-10 01:20:00,349 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 01:20:00,350 INFO Best reward so far: 12.598196105957031
2020-07-10 02:16:02,825 INFO Iter 93
2020-07-10 02:16:02,825 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 02:16:02,825 INFO Reward now: 10.10285737991333
2020-07-10 02:16:02,825 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 02:16:02,850 INFO Best reward so far: 12.598196105957031
2020-07-10 03:11:03,761 INFO Iter 94
2020-07-10 03:11:03,761 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 03:11:03,761 INFO Reward now: 5.7630982589721675
2020-07-10 03:11:03,761 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 03:11:03,761 INFO Best reward so far: 12.598196105957031
2020-07-10 03:28:01,472 INFO Iter 95
2020-07-10 03:28:01,473 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 03:28:01,473 INFO Reward now: 5.784297246932983
2020-07-10 03:28:01,473 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 03:28:01,473 INFO Best reward so far: 12.598196105957031
2020-07-10 04:19:29,834 INFO Iter 96
2020-07-10 04:19:29,835 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 04:19:29,835 INFO Reward now: 6.508256282806396
2020-07-10 04:19:29,835 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 04:19:29,835 INFO Best reward so far: 12.598196105957031
2020-07-10 05:14:06,116 INFO Iter 97
2020-07-10 05:14:06,117 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 05:14:06,117 INFO Reward now: 11.178030052185058
2020-07-10 05:14:06,117 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 05:14:06,117 INFO Best reward so far: 12.598196105957031
2020-07-10 05:29:24,392 INFO Iter 98
2020-07-10 05:29:24,392 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 05:29:24,392 INFO Reward now: 6.4172352695465085
2020-07-10 05:29:24,392 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 05:29:24,392 INFO Best reward so far: 12.598196105957031
2020-07-10 06:09:59,946 INFO Iter 99
2020-07-10 06:09:59,947 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 06:09:59,947 INFO Reward now: 8.160429344177246
2020-07-10 06:09:59,947 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 06:09:59,947 INFO Best reward so far: 12.598196105957031
2020-07-10 06:45:53,383 INFO Iter 100
2020-07-10 06:45:53,383 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 06:45:53,383 INFO Reward now: 7.034665908813476
2020-07-10 06:45:53,383 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 06:45:53,383 INFO Best reward so far: 12.598196105957031
2020-07-10 07:41:38,374 INFO Iter 101
2020-07-10 07:41:38,375 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 07:41:38,375 INFO Reward now: 9.198839588165283
2020-07-10 07:41:38,375 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 07:41:38,375 INFO Best reward so far: 12.598196105957031
2020-07-10 08:05:38,089 INFO Iter 102
2020-07-10 08:05:38,089 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 08:05:38,089 INFO Reward now: 9.327969169616699
2020-07-10 08:05:38,089 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 08:05:38,089 INFO Best reward so far: 12.598196105957031
2020-07-10 08:12:13,767 INFO Iter 103
2020-07-10 08:12:13,768 INFO Policy now: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 08:12:13,768 INFO Reward now: 6.170391645431518
2020-07-10 08:12:13,768 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 08:12:13,768 INFO Best reward so far: 12.598196105957031
2020-07-10 08:33:35,495 INFO Iter 104
2020-07-10 08:33:35,495 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 08:33:35,495 INFO Reward now: 5.390993709564209
2020-07-10 08:33:35,495 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 08:33:35,495 INFO Best reward so far: 12.598196105957031
2020-07-10 09:11:57,583 INFO Iter 105
2020-07-10 09:11:57,583 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 09:11:57,583 INFO Reward now: 6.251779174804687
2020-07-10 09:11:57,583 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 09:11:57,583 INFO Best reward so far: 12.598196105957031
2020-07-10 10:01:50,601 INFO Iter 106
2020-07-10 10:01:50,602 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 10:01:50,602 INFO Reward now: 8.255153331756592
2020-07-10 10:01:50,602 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 10:01:50,602 INFO Best reward so far: 12.598196105957031
2020-07-10 10:18:18,169 INFO Iter 107
2020-07-10 10:18:18,170 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 10:18:18,170 INFO Reward now: 6.109901084899902
2020-07-10 10:18:18,170 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 10:18:18,170 INFO Best reward so far: 12.598196105957031
2020-07-10 10:21:39,508 INFO Iter 108
2020-07-10 10:21:39,508 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 10:21:39,508 INFO Reward now: 2.704429256916046
2020-07-10 10:21:39,508 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 10:21:39,508 INFO Best reward so far: 12.598196105957031
2020-07-10 10:24:26,590 INFO Iter 109
2020-07-10 10:24:26,590 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 10:24:26,590 INFO Reward now: 3.831890664100647
2020-07-10 10:24:26,590 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 10:24:26,590 INFO Best reward so far: 12.598196105957031
2020-07-10 10:27:49,583 INFO Iter 110
2020-07-10 10:27:49,583 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 10:27:49,583 INFO Reward now: 2.8189176988601683
2020-07-10 10:27:49,583 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 10:27:49,584 INFO Best reward so far: 12.598196105957031
2020-07-10 11:14:03,068 INFO Iter 111
2020-07-10 11:14:03,069 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 11:14:03,069 INFO Reward now: 7.080819244384766
2020-07-10 11:14:03,069 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 11:14:03,069 INFO Best reward so far: 12.598196105957031
2020-07-10 12:06:27,549 INFO Iter 112
2020-07-10 12:06:27,549 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 12:06:27,549 INFO Reward now: 9.504735355377198
2020-07-10 12:06:27,549 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 12:06:27,550 INFO Best reward so far: 12.598196105957031
2020-07-10 12:17:37,137 INFO Iter 113
2020-07-10 12:17:37,137 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 12:17:37,137 INFO Reward now: 5.378316459655761
2020-07-10 12:17:37,137 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 12:17:37,137 INFO Best reward so far: 12.598196105957031
2020-07-10 12:55:19,855 INFO Iter 114
2020-07-10 12:55:19,855 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 12:55:19,855 INFO Reward now: 6.2094823837280275
2020-07-10 12:55:19,855 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 12:55:19,855 INFO Best reward so far: 12.598196105957031
2020-07-10 13:14:45,511 INFO Iter 115
2020-07-10 13:14:45,511 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 13:14:45,511 INFO Reward now: 6.261516914367676
2020-07-10 13:14:45,511 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 13:14:45,511 INFO Best reward so far: 12.598196105957031
2020-07-10 14:02:27,013 INFO Iter 116
2020-07-10 14:02:27,013 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 14:02:27,013 INFO Reward now: 8.909921894073486
2020-07-10 14:02:27,013 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 14:02:27,014 INFO Best reward so far: 12.598196105957031
2020-07-10 14:07:17,127 INFO Iter 117
2020-07-10 14:07:17,127 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 14:07:17,128 INFO Reward now: 4.4344581127166744
2020-07-10 14:07:17,128 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 14:07:17,128 INFO Best reward so far: 12.598196105957031
2020-07-10 14:34:12,581 INFO Iter 118
2020-07-10 14:34:12,581 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 14:34:12,581 INFO Reward now: 5.077427139282227
2020-07-10 14:34:12,581 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 14:34:12,581 INFO Best reward so far: 12.598196105957031
2020-07-10 14:54:38,859 INFO Iter 119
2020-07-10 14:54:38,859 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 14:54:38,859 INFO Reward now: 8.733677158355713
2020-07-10 14:54:38,859 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 14:54:38,859 INFO Best reward so far: 12.598196105957031
2020-07-10 15:35:06,838 INFO Iter 120
2020-07-10 15:35:06,838 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 15:35:06,838 INFO Reward now: 9.491188888549805
2020-07-10 15:35:06,838 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 15:35:06,838 INFO Best reward so far: 12.598196105957031
2020-07-10 15:53:40,067 INFO Iter 121
2020-07-10 15:53:40,068 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 15:53:40,068 INFO Reward now: 5.112373628616333
2020-07-10 15:53:40,068 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 15:53:40,068 INFO Best reward so far: 12.598196105957031
2020-07-10 16:13:15,408 INFO Iter 122
2020-07-10 16:13:15,409 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 16:13:15,411 INFO Reward now: 7.300220813751221
2020-07-10 16:13:15,411 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 16:13:15,411 INFO Best reward so far: 12.598196105957031
2020-07-10 16:35:50,124 INFO Iter 123
2020-07-10 16:35:50,124 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 16:35:50,124 INFO Reward now: 6.584446830749512
2020-07-10 16:35:50,125 INFO Best policy so far: [[2.0, 6.0, 9.0, 7.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 9.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 7.0, 9.0, 8.0]]
2020-07-10 16:35:50,125 INFO Best reward so far: 12.598196105957031
2020-07-10 17:18:39,870 INFO Iter 124
2020-07-10 17:18:39,870 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 17:18:39,870 INFO Reward now: 12.188963165283203
2020-07-10 17:18:39,870 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 17:18:39,870 INFO Best reward so far: 12.646612892150879
2020-07-10 17:38:11,028 INFO Iter 125
2020-07-10 17:38:11,028 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 17:38:11,028 INFO Reward now: 5.539454288482666
2020-07-10 17:38:11,028 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 17:38:11,028 INFO Best reward so far: 12.646612892150879
2020-07-10 18:01:32,568 INFO Iter 126
2020-07-10 18:01:32,568 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:01:32,568 INFO Reward now: 7.518468532562256
2020-07-10 18:01:32,568 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:01:32,568 INFO Best reward so far: 12.646612892150879
2020-07-10 18:16:35,077 INFO Iter 127
2020-07-10 18:16:35,077 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:16:35,077 INFO Reward now: 2.8701086139678953
2020-07-10 18:16:35,078 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:16:35,078 INFO Best reward so far: 12.646612892150879
2020-07-10 18:19:47,229 INFO Iter 128
2020-07-10 18:19:47,229 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:19:47,229 INFO Reward now: 2.2889352297782897
2020-07-10 18:19:47,229 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:19:47,229 INFO Best reward so far: 12.646612892150879
2020-07-10 18:23:43,971 INFO Iter 129
2020-07-10 18:23:43,972 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:23:43,972 INFO Reward now: 4.600705862045288
2020-07-10 18:23:43,972 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:23:43,972 INFO Best reward so far: 12.646612892150879
2020-07-10 18:54:11,413 INFO Iter 130
2020-07-10 18:54:11,414 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:54:11,414 INFO Reward now: 7.068861846923828
2020-07-10 18:54:11,414 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 18:54:11,414 INFO Best reward so far: 12.646612892150879
2020-07-10 19:30:21,479 INFO Iter 131
2020-07-10 19:30:21,479 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 19:30:21,479 INFO Reward now: 7.7100669860839846
2020-07-10 19:30:21,479 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 19:30:21,479 INFO Best reward so far: 12.646612892150879
2020-07-10 20:25:36,550 INFO Iter 132
2020-07-10 20:25:36,551 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 20:25:36,551 INFO Reward now: 4.637681608200073
2020-07-10 20:25:36,551 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 20:25:36,551 INFO Best reward so far: 12.646612892150879
2020-07-10 20:52:35,800 INFO Iter 133
2020-07-10 20:52:35,800 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 20:52:35,800 INFO Reward now: 6.817929286956787
2020-07-10 20:52:35,800 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 20:52:35,800 INFO Best reward so far: 12.646612892150879
2020-07-10 21:12:02,552 INFO Iter 134
2020-07-10 21:12:02,552 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 21:12:02,552 INFO Reward now: 4.712928457260132
2020-07-10 21:12:02,553 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 21:12:02,553 INFO Best reward so far: 12.646612892150879
2020-07-10 21:33:59,738 INFO Iter 135
2020-07-10 21:33:59,738 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 21:33:59,738 INFO Reward now: 5.5519262790679935
2020-07-10 21:33:59,738 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 21:33:59,738 INFO Best reward so far: 12.646612892150879
2020-07-10 21:58:52,218 INFO Iter 136
2020-07-10 21:58:52,218 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 21:58:52,219 INFO Reward now: 9.198523101806641
2020-07-10 21:58:52,219 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 21:58:52,219 INFO Best reward so far: 12.646612892150879
2020-07-10 22:22:38,179 INFO Iter 137
2020-07-10 22:22:38,180 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 22:22:38,180 INFO Reward now: 6.130751876831055
2020-07-10 22:22:38,180 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 22:22:38,180 INFO Best reward so far: 12.646612892150879
2020-07-10 23:14:15,325 INFO Iter 138
2020-07-10 23:14:15,325 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 23:14:15,325 INFO Reward now: 9.643355617523193
2020-07-10 23:14:15,325 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-10 23:14:15,325 INFO Best reward so far: 12.646612892150879
2020-07-11 00:03:09,372 INFO Iter 139
2020-07-11 00:03:09,373 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 00:03:09,373 INFO Reward now: 8.141095371246339
2020-07-11 00:03:09,373 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 00:03:09,373 INFO Best reward so far: 12.646612892150879
2020-07-11 00:35:55,898 INFO Iter 140
2020-07-11 00:35:55,898 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 00:35:55,898 INFO Reward now: 8.198428726196289
2020-07-11 00:35:55,898 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 00:35:55,898 INFO Best reward so far: 12.646612892150879
2020-07-11 01:16:19,960 INFO Iter 141
2020-07-11 01:16:19,960 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 01:16:19,960 INFO Reward now: 7.080389652252197
2020-07-11 01:16:19,960 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 01:16:19,960 INFO Best reward so far: 12.646612892150879
2020-07-11 01:54:29,814 INFO Iter 142
2020-07-11 01:54:29,814 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 01:54:29,814 INFO Reward now: 9.274979000091554
2020-07-11 01:54:29,814 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 01:54:29,814 INFO Best reward so far: 12.646612892150879
2020-07-11 01:59:47,532 INFO Iter 143
2020-07-11 01:59:47,533 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 01:59:47,533 INFO Reward now: 4.952339935302734
2020-07-11 01:59:47,533 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 01:59:47,533 INFO Best reward so far: 12.646612892150879
2020-07-11 02:38:39,088 INFO Iter 144
2020-07-11 02:38:39,089 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 02:38:39,089 INFO Reward now: 9.71011209487915
2020-07-11 02:38:39,089 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 02:38:39,089 INFO Best reward so far: 12.646612892150879
2020-07-11 03:26:47,915 INFO Iter 145
2020-07-11 03:26:47,915 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 03:26:47,915 INFO Reward now: 6.792022571563721
2020-07-11 03:26:47,915 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 03:26:47,915 INFO Best reward so far: 12.646612892150879
2020-07-11 03:49:51,199 INFO Iter 146
2020-07-11 03:49:51,199 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 03:49:51,199 INFO Reward now: 6.61485821723938
2020-07-11 03:49:51,200 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 03:49:51,200 INFO Best reward so far: 12.646612892150879
2020-07-11 04:18:51,322 INFO Iter 147
2020-07-11 04:18:51,322 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 04:18:51,322 INFO Reward now: 5.129030361175537
2020-07-11 04:18:51,323 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 04:18:51,323 INFO Best reward so far: 12.646612892150879
2020-07-11 05:06:48,921 INFO Iter 148
2020-07-11 05:06:48,921 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 05:06:48,921 INFO Reward now: 8.079408359527587
2020-07-11 05:06:48,921 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 05:06:48,921 INFO Best reward so far: 12.646612892150879
2020-07-11 05:48:40,776 INFO Iter 149
2020-07-11 05:48:40,776 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 05:48:40,776 INFO Reward now: 6.2218114852905275
2020-07-11 05:48:40,776 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 05:48:40,776 INFO Best reward so far: 12.646612892150879
2020-07-11 06:02:14,091 INFO Iter 150
2020-07-11 06:02:14,092 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 06:02:14,092 INFO Reward now: 5.3674985218048095
2020-07-11 06:02:14,092 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 06:02:14,092 INFO Best reward so far: 12.646612892150879
2020-07-11 06:47:40,809 INFO Iter 151
2020-07-11 06:47:40,810 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 06:47:40,810 INFO Reward now: 6.128584499359131
2020-07-11 06:47:40,810 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 06:47:40,810 INFO Best reward so far: 12.646612892150879
2020-07-11 07:08:33,760 INFO Iter 152
2020-07-11 07:08:33,761 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 07:08:33,761 INFO Reward now: 7.772845954895019
2020-07-11 07:08:33,761 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 07:08:33,761 INFO Best reward so far: 12.646612892150879
2020-07-11 07:46:51,903 INFO Iter 153
2020-07-11 07:46:51,904 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 07:46:51,904 INFO Reward now: 7.175388259887695
2020-07-11 07:46:51,904 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 07:46:51,904 INFO Best reward so far: 12.646612892150879
2020-07-11 08:20:04,953 INFO Iter 154
2020-07-11 08:20:04,953 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 08:20:04,953 INFO Reward now: 7.38707540512085
2020-07-11 08:20:04,953 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 08:20:04,953 INFO Best reward so far: 12.646612892150879
2020-07-11 08:50:07,906 INFO Iter 155
2020-07-11 08:50:07,906 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 08:50:07,906 INFO Reward now: 5.6720196151733395
2020-07-11 08:50:07,906 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 08:50:07,906 INFO Best reward so far: 12.646612892150879
2020-07-11 09:12:05,234 INFO Iter 156
2020-07-11 09:12:05,234 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 09:12:05,234 INFO Reward now: 6.060533857345581
2020-07-11 09:12:05,234 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 09:12:05,234 INFO Best reward so far: 12.646612892150879
2020-07-11 09:20:22,915 INFO Iter 157
2020-07-11 09:20:22,915 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 09:20:22,915 INFO Reward now: 4.834630565643311
2020-07-11 09:20:22,915 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 09:20:22,915 INFO Best reward so far: 12.646612892150879
2020-07-11 09:25:24,736 INFO Iter 158
2020-07-11 09:25:24,737 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 09:25:24,737 INFO Reward now: 4.1189009380340575
2020-07-11 09:25:24,737 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 09:25:24,737 INFO Best reward so far: 12.646612892150879
2020-07-11 10:21:53,349 INFO Iter 159
2020-07-11 10:21:53,349 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 10:21:53,349 INFO Reward now: 8.942289714813233
2020-07-11 10:21:53,349 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 10:21:53,350 INFO Best reward so far: 12.646612892150879
2020-07-11 10:46:14,259 INFO Iter 160
2020-07-11 10:46:14,260 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 10:46:14,260 INFO Reward now: 7.8651658630371095
2020-07-11 10:46:14,260 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 10:46:14,260 INFO Best reward so far: 12.646612892150879
2020-07-11 11:03:21,539 INFO Iter 161
2020-07-11 11:03:21,539 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 11:03:21,539 INFO Reward now: 3.743757405281067
2020-07-11 11:03:21,539 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 11:03:21,539 INFO Best reward so far: 12.646612892150879
2020-07-11 11:19:33,353 INFO Iter 162
2020-07-11 11:19:33,353 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 11:19:33,353 INFO Reward now: 3.226667881011963
2020-07-11 11:19:33,353 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 11:19:33,353 INFO Best reward so far: 12.646612892150879
2020-07-11 11:56:46,021 INFO Iter 163
2020-07-11 11:56:46,022 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 11:56:46,022 INFO Reward now: 9.685844593048095
2020-07-11 11:56:46,022 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 11:56:46,022 INFO Best reward so far: 12.646612892150879
2020-07-11 12:32:55,887 INFO Iter 164
2020-07-11 12:32:55,887 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 12:32:55,887 INFO Reward now: 6.818116989135742
2020-07-11 12:32:55,887 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 12:32:55,888 INFO Best reward so far: 12.646612892150879
2020-07-11 13:31:28,430 INFO Iter 165
2020-07-11 13:31:28,431 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 13:31:28,431 INFO Reward now: 4.506689624786377
2020-07-11 13:31:28,431 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 13:31:28,431 INFO Best reward so far: 12.646612892150879
2020-07-11 13:37:59,792 INFO Iter 166
2020-07-11 13:37:59,792 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 13:37:59,792 INFO Reward now: 4.87383999824524
2020-07-11 13:37:59,792 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 13:37:59,792 INFO Best reward so far: 12.646612892150879
2020-07-11 13:57:28,743 INFO Iter 167
2020-07-11 13:57:28,743 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 13:57:28,743 INFO Reward now: 6.532928619384766
2020-07-11 13:57:28,744 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 13:57:28,744 INFO Best reward so far: 12.646612892150879
2020-07-11 14:52:13,459 INFO Iter 168
2020-07-11 14:52:13,460 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 14:52:13,460 INFO Reward now: 10.157490901947021
2020-07-11 14:52:13,460 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 14:52:13,460 INFO Best reward so far: 12.646612892150879
2020-07-11 14:55:32,739 INFO Iter 169
2020-07-11 14:55:32,739 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 14:55:32,739 INFO Reward now: 2.3775107312202453
2020-07-11 14:55:32,739 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 14:55:32,740 INFO Best reward so far: 12.646612892150879
2020-07-11 15:31:26,047 INFO Iter 170
2020-07-11 15:31:26,047 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 15:31:26,047 INFO Reward now: 6.164610958099365
2020-07-11 15:31:26,047 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 15:31:26,047 INFO Best reward so far: 12.646612892150879
2020-07-11 15:52:44,442 INFO Iter 171
2020-07-11 15:52:44,442 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 15:52:44,442 INFO Reward now: 6.2804108905792235
2020-07-11 15:52:44,442 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 15:52:44,442 INFO Best reward so far: 12.646612892150879
2020-07-11 16:07:29,067 INFO Iter 172
2020-07-11 16:07:29,068 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 16:07:29,068 INFO Reward now: 3.1686285638809206
2020-07-11 16:07:29,068 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 16:07:29,068 INFO Best reward so far: 12.646612892150879
2020-07-11 16:22:02,635 INFO Iter 173
2020-07-11 16:22:02,635 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 16:22:02,635 INFO Reward now: 5.658190631866455
2020-07-11 16:22:02,635 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 16:22:02,635 INFO Best reward so far: 12.646612892150879
2020-07-11 16:26:43,834 INFO Iter 174
2020-07-11 16:26:43,834 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 16:26:43,835 INFO Reward now: 5.526351881027222
2020-07-11 16:26:43,835 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 16:26:43,835 INFO Best reward so far: 12.646612892150879
2020-07-11 17:19:42,458 INFO Iter 175
2020-07-11 17:19:42,459 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 17:19:42,459 INFO Reward now: 4.872008113861084
2020-07-11 17:19:42,459 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 17:19:42,459 INFO Best reward so far: 12.646612892150879
2020-07-11 18:01:12,333 INFO Iter 176
2020-07-11 18:01:12,333 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 7.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 8.0, 9.0]]
2020-07-11 18:01:12,333 INFO Reward now: 8.483961410522461
2020-07-11 18:01:12,333 INFO Best policy so far: [[2.0, 7.0, 9.0, 9.0], [3.0, 9.0, 8.0, 9.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 18:01:12,333 INFO Best reward so far: 12.646612892150879
2020-07-11 18:42:03,838 INFO Iter 177
2020-07-11 18:42:03,838 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 18:42:03,838 INFO Reward now: 11.055340461730957
2020-07-11 18:42:03,838 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 9.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 9.0, 9.0, 9.0]]
2020-07-11 18:42:03,838 INFO Best reward so far: 13.114070777893067
2020-07-11 18:44:27,947 INFO Iter 178
2020-07-11 18:44:27,947 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 18:44:27,947 INFO Reward now: 3.027564730644226
2020-07-11 18:44:27,947 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 9.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 9.0, 9.0, 9.0]]
2020-07-11 18:44:27,947 INFO Best reward so far: 13.114070777893067
2020-07-11 19:00:00,580 INFO Iter 179
2020-07-11 19:00:00,580 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 19:00:00,580 INFO Reward now: 5.889107027053833
2020-07-11 19:00:00,580 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 9.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 9.0, 9.0, 9.0]]
2020-07-11 19:00:00,580 INFO Best reward so far: 13.114070777893067
2020-07-11 19:05:07,897 INFO Iter 180
2020-07-11 19:05:07,897 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 19:05:07,898 INFO Reward now: 5.121847286224365
2020-07-11 19:05:07,898 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 9.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 9.0, 9.0, 9.0]]
2020-07-11 19:05:07,898 INFO Best reward so far: 13.114070777893067
2020-07-11 19:28:18,676 INFO Iter 181
2020-07-11 19:28:18,676 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 19:28:18,676 INFO Reward now: 6.682553787231445
2020-07-11 19:28:18,676 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 9.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 9.0, 9.0, 9.0]]
2020-07-11 19:28:18,676 INFO Best reward so far: 13.114070777893067
2020-07-11 20:20:05,999 INFO Iter 182
2020-07-11 20:20:05,999 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 20:20:05,999 INFO Reward now: 9.686132354736328
2020-07-11 20:20:05,999 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 9.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 9.0, 9.0, 9.0]]
2020-07-11 20:20:05,999 INFO Best reward so far: 13.114070777893067
2020-07-11 21:08:53,146 INFO Iter 183
2020-07-11 21:08:53,146 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 21:08:53,146 INFO Reward now: 6.19354476928711
2020-07-11 21:08:53,146 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 9.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 9.0, 9.0, 9.0]]
2020-07-11 21:08:53,146 INFO Best reward so far: 13.114070777893067
2020-07-11 21:27:32,505 INFO Iter 184
2020-07-11 21:27:32,505 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 21:27:32,505 INFO Reward now: 4.894214057922364
2020-07-11 21:27:32,505 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 9.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 9.0, 9.0, 9.0]]
2020-07-11 21:27:32,505 INFO Best reward so far: 13.114070777893067
2020-07-11 21:58:00,292 INFO Iter 185
2020-07-11 21:58:00,293 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 21:58:00,293 INFO Reward now: 6.484683828353882
2020-07-11 21:58:00,293 INFO Best policy so far: [[2.0, 7.0, 9.0, 8.0], [3.0, 9.0, 9.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 9.0], [2.0, 9.0, 9.0, 9.0]]
2020-07-11 21:58:00,293 INFO Best reward so far: 13.114070777893067
2020-07-11 22:39:40,778 INFO Iter 186
2020-07-11 22:39:40,778 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 22:39:40,778 INFO Reward now: 13.447103881835938
2020-07-11 22:39:40,778 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 22:39:40,778 INFO Best reward so far: 13.447103881835938
2020-07-11 23:11:12,768 INFO Iter 187
2020-07-11 23:11:12,768 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 23:11:12,768 INFO Reward now: 6.57696605682373
2020-07-11 23:11:12,768 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 23:11:12,768 INFO Best reward so far: 13.447103881835938
2020-07-11 23:30:09,637 INFO Iter 188
2020-07-11 23:30:09,638 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 23:30:09,638 INFO Reward now: 5.494400005340577
2020-07-11 23:30:09,638 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 23:30:09,638 INFO Best reward so far: 13.447103881835938
2020-07-11 23:56:18,285 INFO Iter 189
2020-07-11 23:56:18,285 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 23:56:18,285 INFO Reward now: 7.311386394500732
2020-07-11 23:56:18,285 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-11 23:56:18,285 INFO Best reward so far: 13.447103881835938
2020-07-12 00:19:54,827 INFO Iter 190
2020-07-12 00:19:54,828 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 00:19:54,828 INFO Reward now: 7.130738487243653
2020-07-12 00:19:54,828 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 00:19:54,828 INFO Best reward so far: 13.447103881835938
2020-07-12 01:12:23,391 INFO Iter 191
2020-07-12 01:12:23,392 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 01:12:23,392 INFO Reward now: 9.798685760498048
2020-07-12 01:12:23,392 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 01:12:23,392 INFO Best reward so far: 13.447103881835938
2020-07-12 01:53:59,830 INFO Iter 192
2020-07-12 01:53:59,830 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 01:53:59,830 INFO Reward now: 12.265917129516602
2020-07-12 01:53:59,830 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 01:53:59,830 INFO Best reward so far: 13.447103881835938
2020-07-12 02:14:07,817 INFO Iter 193
2020-07-12 02:14:07,817 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 02:14:07,818 INFO Reward now: 7.053523178100586
2020-07-12 02:14:07,818 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 02:14:07,818 INFO Best reward so far: 13.447103881835938
2020-07-12 02:37:16,806 INFO Iter 194
2020-07-12 02:37:16,806 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 02:37:16,806 INFO Reward now: 9.90901662826538
2020-07-12 02:37:16,806 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 02:37:16,806 INFO Best reward so far: 13.447103881835938
2020-07-12 02:55:59,671 INFO Iter 195
2020-07-12 02:55:59,672 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 02:55:59,672 INFO Reward now: 5.8431392288208
2020-07-12 02:55:59,672 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 02:55:59,672 INFO Best reward so far: 13.447103881835938
2020-07-12 03:32:11,232 INFO Iter 196
2020-07-12 03:32:11,232 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 03:32:11,232 INFO Reward now: 6.973449716567993
2020-07-12 03:32:11,233 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 03:32:11,233 INFO Best reward so far: 13.447103881835938
2020-07-12 03:48:37,314 INFO Iter 197
2020-07-12 03:48:37,314 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 03:48:37,314 INFO Reward now: 5.792304134368896
2020-07-12 03:48:37,314 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 03:48:37,314 INFO Best reward so far: 13.447103881835938
2020-07-12 04:28:53,457 INFO Iter 198
2020-07-12 04:28:53,457 INFO Policy now: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 04:28:53,457 INFO Reward now: 5.486729602813721
2020-07-12 04:28:53,457 INFO Best policy so far: [[2.0, 7.0, 8.0, 8.0], [3.0, 9.0, 8.0, 7.0], [1.0, 9.0, 8.0, 9.0], [4.0, 9.0, 9.0, 8.0], [2.0, 8.0, 9.0, 9.0]]
2020-07-12 04:28:53,457 INFO Best reward so far: 13.447103881835938