diff options
Diffstat (limited to 'nerv/examples/lmptb/logs/LOG-tnn-h400')
| -rw-r--r-- | nerv/examples/lmptb/logs/LOG-tnn-h400 | 9372 |
1 files changed, 9372 insertions, 0 deletions
diff --git a/nerv/examples/lmptb/logs/LOG-tnn-h400 b/nerv/examples/lmptb/logs/LOG-tnn-h400 new file mode 100644 index 0000000..14270fe --- /dev/null +++ b/nerv/examples/lmptb/logs/LOG-tnn-h400 @@ -0,0 +1,9372 @@ +Greetings +[SCHEDULER]: not user setting, all default... +[SCHEDULER]: printing global_conf... +test_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds +train_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.train.txt.adds +param_random function: 0x41568798 +train_fn_shuf_bak /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf_bak +decay_iter 16 +mmat_type table: 0x4155ddf0 +vocab_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab +train_fn_shuf /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf +param_fn /home/slhome/txh18/workspace/nerv/play/dagL_test/params +log_w_num 40000 +work_dir /home/slhome/txh18/workspace/nerv/play/dagL_test +batch_size 10 +hidden_size 400 +timer nerv.Timer +sche_log_pre [SCHEDULER]: +nn_act_default 0 +max_iter 35 +valid_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds +lrate 1 +momentum 0 +wcost 1e-05 +chunk_size 15 +cumat_type table: 0x4159b8e8 +[SCHEDULER]: printing training scheduling options... +lr_half false +start_iter -1 +ppl_last 100000 +[SCHEDULER]: printing training scheduling end. +[SCHEDULER]: creating work_dir... +[SCHEDULER]: building vocab... +[LOG]LMVocab: Vocab building on file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab... +[LOG]LMVocab: Building finished, vocab size now is 10000. +[SCHEDULER]: preparing parameters... +[SCHEDULER]: first time, generating parameters... +===INITIAL VALIDATION=== +[SCHEDULER]: preparing parameters... +[SCHEDULER]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.0... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46010296 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 2 from 47850982 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 93850772 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 4 from 93855417 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 5 from 93970392 +[SCHEDULER]: preparing parameters end. +[SCHEDULER]: preparing layers... +(23:35:45 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:35:45 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:35:45 2015-11-17)[nerv] info: create layer: combinerL1 +(23:35:45 2015-11-17)[nerv] info: create layer: outputL +(23:35:45 2015-11-17)[nerv] info: create layer: softmaxL +(23:35:45 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER]: preparing layers end. +[SCHEDULER]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER]: Initing TNN end. +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER]: 40095 words processed Tue Nov 17 23:35:51 2015. + [SCHEDULER]: log prob per sample :-4.031438. + [global_conf.timer]: time spent on tnn_beforeprocess:0.51120 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.70094 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.94917 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13248 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER]: Displaying result: +[SCHEDULER]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 11218.277022182> <PPL_OOV 10730.852429653> <LOGP -297299.58025201> +[SCHEDULER]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. + +[SCHEDULER ITER1 LR1]: preparing parameters... +[SCHEDULER ITER1 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.0... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46010296 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 2 from 47850982 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 93850772 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 4 from 93855417 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 5 from 93970392 +[SCHEDULER ITER1 LR1]: preparing parameters end. +[SCHEDULER ITER1 LR1]: preparing layers... +(23:35:59 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:35:59 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:35:59 2015-11-17)[nerv] info: create layer: combinerL1 +(23:35:59 2015-11-17)[nerv] info: create layer: outputL +(23:35:59 2015-11-17)[nerv] info: create layer: softmaxL +(23:35:59 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER ITER1 LR1]: preparing layers end. +[SCHEDULER ITER1 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER1 LR1]: Initing TNN end. +===ITERATION 1 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER1 LR1]: 40099 words processed Tue Nov 17 23:36:12 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-3.307163. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48649 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.71744 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.97858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95986 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46750 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12689 clock time +[SCHEDULER ITER1 LR1]: 80063 words processed Tue Nov 17 23:36:25 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-3.167927. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72435 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.96751 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94566 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46101 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12725 clock time +[SCHEDULER ITER1 LR1]: 120068 words processed Tue Nov 17 23:36:38 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-3.072096. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48641 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.71643 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.94612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94018 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46114 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12611 clock time +[SCHEDULER ITER1 LR1]: 160017 words processed Tue Nov 17 23:36:51 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.999475. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48145 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.70526 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.92051 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93494 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45645 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12565 clock time +[SCHEDULER ITER1 LR1]: 200138 words processed Tue Nov 17 23:37:05 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.960525. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49600 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83974 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20474 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.49050 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13162 clock time +[SCHEDULER ITER1 LR1]: 240007 words processed Tue Nov 17 23:37:19 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.924306. + [global_conf.timer]: time spent on tnn_beforeprocess:0.53133 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:4.03094 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.52548 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.03830 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.51544 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.14333 clock time +[SCHEDULER ITER1 LR1]: 280135 words processed Tue Nov 17 23:37:32 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.895095. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48229 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72695 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.96725 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95236 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46205 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12614 clock time +[SCHEDULER ITER1 LR1]: 320080 words processed Tue Nov 17 23:37:45 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.870160. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47588 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68051 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.88169 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93247 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45305 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12515 clock time +[SCHEDULER ITER1 LR1]: 360059 words processed Tue Nov 17 23:37:58 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.844175. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68577 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.87422 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.92831 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45044 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12469 clock time +[SCHEDULER ITER1 LR1]: 400021 words processed Tue Nov 17 23:38:11 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.825951. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47303 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69065 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.88385 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.92882 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45209 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12487 clock time +[SCHEDULER ITER1 LR1]: 440102 words processed Tue Nov 17 23:38:24 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.806475. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47497 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.70115 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.92202 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94656 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45847 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12536 clock time +[SCHEDULER ITER1 LR1]: 480051 words processed Tue Nov 17 23:38:37 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.789229. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47445 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69055 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.89421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93264 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45604 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12512 clock time +[SCHEDULER ITER1 LR1]: 520093 words processed Tue Nov 17 23:38:50 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.773809. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47723 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.70210 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.93694 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46374 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12594 clock time +[SCHEDULER ITER1 LR1]: 560039 words processed Tue Nov 17 23:39:03 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.756861. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47250 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68531 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.89479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45569 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12633 clock time +[SCHEDULER ITER1 LR1]: 600112 words processed Tue Nov 17 23:39:16 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.746111. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69925 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.93029 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95151 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46304 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12573 clock time +[SCHEDULER ITER1 LR1]: 640076 words processed Tue Nov 17 23:39:29 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.734203. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47329 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68886 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.88582 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93063 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45330 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12580 clock time +[SCHEDULER ITER1 LR1]: 680026 words processed Tue Nov 17 23:39:42 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.724362. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48369 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.73916 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.98914 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95090 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46601 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12844 clock time +[SCHEDULER ITER1 LR1]: 720133 words processed Tue Nov 17 23:39:55 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.714482. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47515 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69692 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.91832 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94618 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46084 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12542 clock time +[SCHEDULER ITER1 LR1]: 760048 words processed Tue Nov 17 23:40:08 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.702566. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47214 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.67797 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.86931 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.92936 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45006 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12517 clock time +[SCHEDULER ITER1 LR1]: 800117 words processed Tue Nov 17 23:40:21 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.694301. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47412 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69251 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.92129 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94998 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46202 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12666 clock time +[SCHEDULER ITER1 LR1]: 840116 words processed Tue Nov 17 23:40:34 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.683815. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68128 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.87316 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93075 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45007 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12553 clock time +[SCHEDULER ITER1 LR1]: 880037 words processed Tue Nov 17 23:40:47 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.675707. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.67969 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.88904 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93759 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45715 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12643 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER1 LR1]: Displaying result: +[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 537.43879542441> <PPL_OOV 472.15153715735> <LOGP -2485796.6619188> +[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER1 LR1]: shuffling training file +===PEEK ON TEST 1=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER1 LR1]: 40087 words processed Tue Nov 17 23:40:58 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.514792. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48655 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72196 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.44770 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12022 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER1 LR1]: Displaying result: +[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 379.24392854515> <PPL_OOV 331.97926131635> <LOGP -207815.17595921> +[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 1=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER1 LR1]: 40095 words processed Tue Nov 17 23:41:09 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.557255. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48268 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69630 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.41725 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12029 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER1 LR1]: Displaying result: +[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 378.18347077578> <PPL_OOV 339.93053715193> <LOGP -186715.339716> +[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER1 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.1... + +[SCHEDULER ITER2 LR1]: preparing parameters... +[SCHEDULER ITER2 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.1... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1910948 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1915804 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 47942998 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48059425 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94081374 +[SCHEDULER ITER2 LR1]: preparing parameters end. +[SCHEDULER ITER2 LR1]: preparing layers... +(23:41:19 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:41:19 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:41:19 2015-11-17)[nerv] info: create layer: combinerL1 +(23:41:19 2015-11-17)[nerv] info: create layer: outputL +(23:41:19 2015-11-17)[nerv] info: create layer: softmaxL +(23:41:19 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER ITER2 LR1]: preparing layers end. +[SCHEDULER ITER2 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER2 LR1]: Initing TNN end. +===ITERATION 2 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER2 LR1]: 40092 words processed Tue Nov 17 23:41:32 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.799221. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48428 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80482 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14528 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99681 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46377 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12475 clock time +[SCHEDULER ITER2 LR1]: 80099 words processed Tue Nov 17 23:41:45 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.675260. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48375 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79010 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09873 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97780 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45608 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12454 clock time +[SCHEDULER ITER2 LR1]: 120004 words processed Tue Nov 17 23:41:58 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.625292. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48345 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79597 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11264 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97879 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45735 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12451 clock time +[SCHEDULER ITER2 LR1]: 160114 words processed Tue Nov 17 23:42:11 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.601139. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48516 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82418 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17616 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00378 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46627 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12504 clock time +[SCHEDULER ITER2 LR1]: 200066 words processed Tue Nov 17 23:42:24 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.586182. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47712 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79828 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10302 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97884 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45548 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12466 clock time +[SCHEDULER ITER2 LR1]: 240045 words processed Tue Nov 17 23:42:37 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.569745. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79973 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98261 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45781 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12517 clock time +[SCHEDULER ITER2 LR1]: 280057 words processed Tue Nov 17 23:42:50 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.558289. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48048 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80717 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14427 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99685 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46324 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12477 clock time +[SCHEDULER ITER2 LR1]: 320106 words processed Tue Nov 17 23:43:03 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.546701. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81916 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16628 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00207 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46745 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12513 clock time +[SCHEDULER ITER2 LR1]: 360024 words processed Tue Nov 17 23:43:16 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.538361. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79494 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09841 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97955 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45588 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12416 clock time +[SCHEDULER ITER2 LR1]: 400089 words processed Tue Nov 17 23:43:29 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.532957. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47372 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80046 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12466 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46212 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12432 clock time +[SCHEDULER ITER2 LR1]: 440067 words processed Tue Nov 17 23:43:42 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.527843. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47471 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80066 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11343 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98547 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45805 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12505 clock time +[SCHEDULER ITER2 LR1]: 480051 words processed Tue Nov 17 23:43:55 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.523169. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47219 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79117 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08952 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97922 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45651 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12449 clock time +[SCHEDULER ITER2 LR1]: 520140 words processed Tue Nov 17 23:44:08 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.518885. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82039 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16701 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00437 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46768 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12620 clock time +[SCHEDULER ITER2 LR1]: 560132 words processed Tue Nov 17 23:44:21 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.514611. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47300 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80568 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11381 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45731 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12516 clock time +[SCHEDULER ITER2 LR1]: 600118 words processed Tue Nov 17 23:44:34 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.512709. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47282 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78555 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08119 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97896 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45351 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12405 clock time +[SCHEDULER ITER2 LR1]: 640090 words processed Tue Nov 17 23:44:47 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.508568. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47266 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79694 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10261 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45628 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12473 clock time +[SCHEDULER ITER2 LR1]: 680075 words processed Tue Nov 17 23:45:00 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.505824. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47217 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79072 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08578 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97795 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45475 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12436 clock time +[SCHEDULER ITER2 LR1]: 720043 words processed Tue Nov 17 23:45:13 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.503375. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47312 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78838 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08623 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97850 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45411 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12403 clock time +[SCHEDULER ITER2 LR1]: 760012 words processed Tue Nov 17 23:45:27 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.500743. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48180 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84003 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00071 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46868 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12720 clock time +[SCHEDULER ITER2 LR1]: 800113 words processed Tue Nov 17 23:45:41 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.497832. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48493 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86594 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.25537 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01879 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47835 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12907 clock time +[SCHEDULER ITER2 LR1]: 840089 words processed Tue Nov 17 23:45:54 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.494761. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79481 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09645 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97914 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45671 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12481 clock time +[SCHEDULER ITER2 LR1]: 880052 words processed Tue Nov 17 23:46:07 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.492221. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47189 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78587 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08043 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97666 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45370 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12444 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER2 LR1]: Displaying result: +[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 356.44368639692> <PPL_OOV 310.37598339711> <LOGP -2316431.7749724> +[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER2 LR1]: shuffling training file +===PEEK ON TEST 2=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER2 LR1]: 40087 words processed Tue Nov 17 23:46:17 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.393024. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80296 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.52763 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11984 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER2 LR1]: Displaying result: +[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 289.978578203> <PPL_OOV 250.00965661609> <LOGP -197663.57767284> +[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 2=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER2 LR1]: 40095 words processed Tue Nov 17 23:46:28 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.438429. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48364 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80517 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53029 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11971 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER2 LR1]: Displaying result: +[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 294.59587868377> <PPL_OOV 261.28808089122> <LOGP -178286.7416284> +[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER2 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.2... + +[SCHEDULER ITER3 LR1]: preparing parameters... +[SCHEDULER ITER3 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.2... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46026952 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46031813 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92080375 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92196721 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94106578 +[SCHEDULER ITER3 LR1]: preparing parameters end. +[SCHEDULER ITER3 LR1]: preparing layers... +(23:46:38 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:46:38 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:46:38 2015-11-17)[nerv] info: create layer: combinerL1 +(23:46:38 2015-11-17)[nerv] info: create layer: outputL +(23:46:38 2015-11-17)[nerv] info: create layer: softmaxL +(23:46:38 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER ITER3 LR1]: preparing layers end. +[SCHEDULER ITER3 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER3 LR1]: Initing TNN end. +===ITERATION 3 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER3 LR1]: 40092 words processed Tue Nov 17 23:46:51 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-3.275433. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48686 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82983 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18385 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00437 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46867 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12702 clock time +[SCHEDULER ITER3 LR1]: 80099 words processed Tue Nov 17 23:47:04 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.872201. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48691 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83027 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15267 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98511 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45764 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12709 clock time +[SCHEDULER ITER3 LR1]: 120004 words processed Tue Nov 17 23:47:17 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.726336. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48330 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81033 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11709 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97568 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45410 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12627 clock time +[SCHEDULER ITER3 LR1]: 160114 words processed Tue Nov 17 23:47:30 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.654691. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48257 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82175 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15289 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99410 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46323 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12676 clock time +[SCHEDULER ITER3 LR1]: 200066 words processed Tue Nov 17 23:47:43 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.611192. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47813 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79822 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08712 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97083 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45243 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12539 clock time +[SCHEDULER ITER3 LR1]: 240045 words processed Tue Nov 17 23:47:56 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.576347. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47970 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81405 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11965 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97946 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45581 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12633 clock time +[SCHEDULER ITER3 LR1]: 280057 words processed Tue Nov 17 23:48:09 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.552071. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48283 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83521 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18161 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00103 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46493 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12686 clock time +[SCHEDULER ITER3 LR1]: 320106 words processed Tue Nov 17 23:48:22 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.531340. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47859 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82901 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16305 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99686 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46314 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12644 clock time +[SCHEDULER ITER3 LR1]: 360024 words processed Tue Nov 17 23:48:35 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.516297. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47427 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81574 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11870 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97977 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45465 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12592 clock time +[SCHEDULER ITER3 LR1]: 400089 words processed Tue Nov 17 23:48:48 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.504316. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47574 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82093 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13828 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98978 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46033 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12630 clock time +[SCHEDULER ITER3 LR1]: 440067 words processed Tue Nov 17 23:49:01 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.494362. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47430 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81113 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97716 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45515 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12567 clock time +[SCHEDULER ITER3 LR1]: 480051 words processed Tue Nov 17 23:49:14 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.485817. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47599 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80855 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09912 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97465 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45298 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12546 clock time +[SCHEDULER ITER3 LR1]: 520140 words processed Tue Nov 17 23:49:27 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.478381. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47686 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82407 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14863 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99306 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46236 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12608 clock time +[SCHEDULER ITER3 LR1]: 560132 words processed Tue Nov 17 23:49:40 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.471582. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47428 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79987 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08308 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97102 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45201 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12557 clock time +[SCHEDULER ITER3 LR1]: 600118 words processed Tue Nov 17 23:49:53 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.465902. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47365 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79892 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08205 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97184 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45132 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12508 clock time +[SCHEDULER ITER3 LR1]: 640090 words processed Tue Nov 17 23:50:06 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.459844. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47306 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79979 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08673 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97417 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45219 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12567 clock time +[SCHEDULER ITER3 LR1]: 680075 words processed Tue Nov 17 23:50:19 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.455940. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47408 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80569 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09643 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97477 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45354 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12616 clock time +[SCHEDULER ITER3 LR1]: 720043 words processed Tue Nov 17 23:50:32 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.452489. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47386 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79883 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08519 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97204 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45168 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12544 clock time +[SCHEDULER ITER3 LR1]: 760012 words processed Tue Nov 17 23:50:45 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.448549. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47306 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79953 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08787 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97325 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45282 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12542 clock time +[SCHEDULER ITER3 LR1]: 800113 words processed Tue Nov 17 23:50:58 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.444581. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47611 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82697 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16209 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99992 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46568 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12624 clock time +[SCHEDULER ITER3 LR1]: 840089 words processed Tue Nov 17 23:51:11 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.440613. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47689 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81480 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12331 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98224 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45805 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12628 clock time +[SCHEDULER ITER3 LR1]: 880052 words processed Tue Nov 17 23:51:24 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.437307. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48057 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84982 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18985 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99558 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46479 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12776 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER3 LR1]: Displaying result: +[SCHEDULER ITER3 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 309.49446578969> <PPL_OOV 273.43845906886> <LOGP -2265277.8768143> +[SCHEDULER ITER3 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER3 LR1]: shuffling training file +===PEEK ON TEST 3=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER3 LR1]: 40087 words processed Tue Nov 17 23:51:34 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.340049. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48392 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81179 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53571 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12052 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER3 LR1]: Displaying result: +[SCHEDULER ITER3 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 255.3746198739> <PPL_OOV 220.35758888935> <LOGP -193144.04200938> +[SCHEDULER ITER3 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 3=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER3 LR1]: 40095 words processed Tue Nov 17 23:51:45 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.391577. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48471 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81184 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53598 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12033 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER3 LR1]: Displaying result: +[SCHEDULER ITER3 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 261.40728193013> <PPL_OOV 231.97231323642> <LOGP -174474.57066833> +[SCHEDULER ITER3 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER3 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.3... + +[SCHEDULER ITER4 LR1]: preparing parameters... +[SCHEDULER ITER4 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.3... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1908429 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1913289 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 47980731 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48097059 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94127997 +[SCHEDULER ITER4 LR1]: preparing parameters end. +[SCHEDULER ITER4 LR1]: preparing layers... +(23:51:55 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:51:55 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:51:55 2015-11-17)[nerv] info: create layer: combinerL1 +(23:51:55 2015-11-17)[nerv] info: create layer: outputL +(23:51:55 2015-11-17)[nerv] info: create layer: softmaxL +(23:51:55 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER ITER4 LR1]: preparing layers end. +[SCHEDULER ITER4 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER4 LR1]: Initing TNN end. +===ITERATION 4 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER4 LR1]: 40092 words processed Tue Nov 17 23:52:08 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.391105. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48539 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81432 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16417 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00374 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46638 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12528 clock time +[SCHEDULER ITER4 LR1]: 80099 words processed Tue Nov 17 23:52:21 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.376497. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48548 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79649 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09962 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97473 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45397 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12458 clock time +[SCHEDULER ITER4 LR1]: 120004 words processed Tue Nov 17 23:52:34 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.366345. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48356 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79999 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11463 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97982 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45566 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12486 clock time +[SCHEDULER ITER4 LR1]: 160114 words processed Tue Nov 17 23:52:47 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.364730. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48263 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82131 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16342 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99907 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46577 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12568 clock time +[SCHEDULER ITER4 LR1]: 200066 words processed Tue Nov 17 23:53:00 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.363363. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47792 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80021 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97855 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45548 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12479 clock time +[SCHEDULER ITER4 LR1]: 240045 words processed Tue Nov 17 23:53:13 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.357506. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47837 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80456 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10986 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97919 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45616 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12440 clock time +[SCHEDULER ITER4 LR1]: 280057 words processed Tue Nov 17 23:53:26 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.353198. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48249 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82284 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16592 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99707 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46601 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER4 LR1]: 320106 words processed Tue Nov 17 23:53:39 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.348552. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47826 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81434 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14530 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99443 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46270 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12508 clock time +[SCHEDULER ITER4 LR1]: 360024 words processed Tue Nov 17 23:53:52 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.346147. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47613 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80613 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98185 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45651 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12450 clock time +[SCHEDULER ITER4 LR1]: 400089 words processed Tue Nov 17 23:54:05 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.344040. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47588 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81837 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14925 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99671 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46336 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12516 clock time +[SCHEDULER ITER4 LR1]: 440067 words processed Tue Nov 17 23:54:18 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.342717. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47411 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80688 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11407 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98416 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45681 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12461 clock time +[SCHEDULER ITER4 LR1]: 480051 words processed Tue Nov 17 23:54:31 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.341647. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47371 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80140 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10077 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97920 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45639 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12481 clock time +[SCHEDULER ITER4 LR1]: 520140 words processed Tue Nov 17 23:54:44 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.340595. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47503 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81045 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13502 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99294 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46319 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12465 clock time +[SCHEDULER ITER4 LR1]: 560132 words processed Tue Nov 17 23:54:57 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.339297. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47364 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79935 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09489 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97666 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45583 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12435 clock time +[SCHEDULER ITER4 LR1]: 600118 words processed Tue Nov 17 23:55:10 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.336693. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47355 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79418 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08926 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97654 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45423 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12426 clock time +[SCHEDULER ITER4 LR1]: 640090 words processed Tue Nov 17 23:55:23 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.334627. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47344 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79737 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08769 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97405 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45357 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12414 clock time +[SCHEDULER ITER4 LR1]: 680075 words processed Tue Nov 17 23:55:36 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.336036. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47343 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79894 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09156 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45479 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12420 clock time +[SCHEDULER ITER4 LR1]: 720043 words processed Tue Nov 17 23:55:49 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.336131. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47387 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80625 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11151 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98073 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45696 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER4 LR1]: 760012 words processed Tue Nov 17 23:56:02 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.335426. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47368 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80295 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10801 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98029 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45734 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12480 clock time +[SCHEDULER ITER4 LR1]: 800113 words processed Tue Nov 17 23:56:15 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.334652. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47484 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80767 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13096 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46276 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12464 clock time +[SCHEDULER ITER4 LR1]: 840089 words processed Tue Nov 17 23:56:28 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.333583. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47328 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79536 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08864 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97559 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45458 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12416 clock time +[SCHEDULER ITER4 LR1]: 880052 words processed Tue Nov 17 23:56:41 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.332886. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47459 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79896 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09837 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97698 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45602 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12422 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER4 LR1]: Displaying result: +[SCHEDULER ITER4 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 244.17099071299> <PPL_OOV 215.2339187841> <LOGP -2168648.1367851> +[SCHEDULER ITER4 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER4 LR1]: shuffling training file +===PEEK ON TEST 4=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER4 LR1]: 40087 words processed Tue Nov 17 23:56:51 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.305606. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80894 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53520 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12058 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER4 LR1]: Displaying result: +[SCHEDULER ITER4 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 233.48496197986> <PPL_OOV 202.80297962883> <LOGP -190172.1371426> +[SCHEDULER ITER4 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 4=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER4 LR1]: 40095 words processed Tue Nov 17 23:57:02 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.357810. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49246 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86264 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.60194 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12239 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER4 LR1]: Displaying result: +[SCHEDULER ITER4 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 238.99690848017> <PPL_OOV 213.18595686152> <LOGP -171769.23382991> +[SCHEDULER ITER4 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER4 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.4... + +[SCHEDULER ITER5 LR1]: preparing parameters... +[SCHEDULER ITER5 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.4... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46035776 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46040636 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92129701 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92246062 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94153510 +[SCHEDULER ITER5 LR1]: preparing parameters end. +[SCHEDULER ITER5 LR1]: preparing layers... +(23:57:12 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:57:12 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:57:12 2015-11-17)[nerv] info: create layer: combinerL1 +(23:57:12 2015-11-17)[nerv] info: create layer: outputL +(23:57:12 2015-11-17)[nerv] info: create layer: softmaxL +(23:57:12 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER ITER5 LR1]: preparing layers end. +[SCHEDULER ITER5 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER5 LR1]: Initing TNN end. +===ITERATION 5 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER5 LR1]: 40092 words processed Tue Nov 17 23:57:25 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.341879. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81077 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13600 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98682 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46231 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12583 clock time +[SCHEDULER ITER5 LR1]: 80099 words processed Tue Nov 17 23:57:38 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.330200. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79137 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07745 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45068 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER5 LR1]: 120004 words processed Tue Nov 17 23:57:51 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.320093. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48250 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79564 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09003 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96886 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45135 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12555 clock time +[SCHEDULER ITER5 LR1]: 160114 words processed Tue Nov 17 23:58:04 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.318935. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82255 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16079 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99482 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46608 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12684 clock time +[SCHEDULER ITER5 LR1]: 200066 words processed Tue Nov 17 23:58:17 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.317904. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47816 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81390 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11923 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97688 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45715 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12674 clock time +[SCHEDULER ITER5 LR1]: 240045 words processed Tue Nov 17 23:58:30 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.311871. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47946 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80619 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11245 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97951 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45628 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12545 clock time +[SCHEDULER ITER5 LR1]: 280057 words processed Tue Nov 17 23:58:43 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.307911. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48034 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81167 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13343 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98857 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45947 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12604 clock time +[SCHEDULER ITER5 LR1]: 320106 words processed Tue Nov 17 23:58:56 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.303675. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47748 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81269 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13313 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98917 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46071 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12596 clock time +[SCHEDULER ITER5 LR1]: 360024 words processed Tue Nov 17 23:59:09 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.301476. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47519 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80706 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10294 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97405 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45343 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12527 clock time +[SCHEDULER ITER5 LR1]: 400089 words processed Tue Nov 17 23:59:22 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.299068. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47730 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82254 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15559 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99856 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46322 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12645 clock time +[SCHEDULER ITER5 LR1]: 440067 words processed Tue Nov 17 23:59:35 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.297905. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47642 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80542 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10340 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97729 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45429 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12565 clock time +[SCHEDULER ITER5 LR1]: 480051 words processed Tue Nov 17 23:59:48 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.297088. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47626 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80721 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09809 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97311 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45371 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12564 clock time +[SCHEDULER ITER5 LR1]: 520140 words processed Wed Nov 18 00:00:01 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.296190. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47705 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81389 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13529 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98981 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46272 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12569 clock time +[SCHEDULER ITER5 LR1]: 560132 words processed Wed Nov 18 00:00:14 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.295017. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47531 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79631 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07954 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97030 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45120 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER5 LR1]: 600118 words processed Wed Nov 18 00:00:27 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.293126. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47400 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79265 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07392 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96942 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45137 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12495 clock time +[SCHEDULER ITER5 LR1]: 640090 words processed Wed Nov 18 00:00:40 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.291223. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47320 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79334 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07288 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96886 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45082 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12475 clock time +[SCHEDULER ITER5 LR1]: 680075 words processed Wed Nov 18 00:00:53 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.290195. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47410 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80400 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09646 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97492 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45468 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12564 clock time +[SCHEDULER ITER5 LR1]: 720043 words processed Wed Nov 18 00:01:06 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.289514. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47524 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80523 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09838 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97378 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45389 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12533 clock time +[SCHEDULER ITER5 LR1]: 760012 words processed Wed Nov 18 00:01:19 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.288551. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47404 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79743 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08497 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97129 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45221 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12573 clock time +[SCHEDULER ITER5 LR1]: 800113 words processed Wed Nov 18 00:01:32 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.287844. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47586 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81189 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13165 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99032 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46185 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12582 clock time +[SCHEDULER ITER5 LR1]: 840089 words processed Wed Nov 18 00:01:45 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.286447. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47526 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80446 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09866 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97499 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45473 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12584 clock time +[SCHEDULER ITER5 LR1]: 880052 words processed Wed Nov 18 00:01:58 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.285828. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47492 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80170 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09282 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97255 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45291 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12572 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER5 LR1]: Displaying result: +[SCHEDULER ITER5 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 218.1589317401> <PPL_OOV 193.11996237388> <LOGP -2124879.7914026> +[SCHEDULER ITER5 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER5 LR1]: shuffling training file +===PEEK ON TEST 5=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER5 LR1]: 40087 words processed Wed Nov 18 00:02:08 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.276905. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81529 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54142 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12086 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER5 LR1]: Displaying result: +[SCHEDULER ITER5 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 218.62485676622> <PPL_OOV 189.98585158717> <LOGP -187834.99345079> +[SCHEDULER ITER5 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 5=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER5 LR1]: 40095 words processed Wed Nov 18 00:02:19 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.331806. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48491 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82663 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55349 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12138 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER5 LR1]: Displaying result: +[SCHEDULER ITER5 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 223.85106524768> <PPL_OOV 199.74657748262> <LOGP -169683.35661397> +[SCHEDULER ITER5 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER5 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.5... + +[SCHEDULER ITER6 LR1]: preparing parameters... +[SCHEDULER ITER6 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.5... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1906458 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1911317 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48021511 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48137877 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94177466 +[SCHEDULER ITER6 LR1]: preparing parameters end. +[SCHEDULER ITER6 LR1]: preparing layers... +(00:02:29 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:02:29 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:02:29 2015-11-18)[nerv] info: create layer: combinerL1 +(00:02:29 2015-11-18)[nerv] info: create layer: outputL +(00:02:29 2015-11-18)[nerv] info: create layer: softmaxL +(00:02:29 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER6 LR1]: preparing layers end. +[SCHEDULER ITER6 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER6 LR1]: Initing TNN end. +===ITERATION 6 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER6 LR1]: 40092 words processed Wed Nov 18 00:02:42 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.270739. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48341 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81363 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16307 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00300 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46862 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12602 clock time +[SCHEDULER ITER6 LR1]: 80099 words processed Wed Nov 18 00:02:55 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.272402. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48551 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80768 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13021 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98502 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45960 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12538 clock time +[SCHEDULER ITER6 LR1]: 120004 words processed Wed Nov 18 00:03:08 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.266183. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48496 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80921 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13557 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45854 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12578 clock time +[SCHEDULER ITER6 LR1]: 160114 words processed Wed Nov 18 00:03:21 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.267539. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48319 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82056 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16769 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00137 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46702 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12609 clock time +[SCHEDULER ITER6 LR1]: 200066 words processed Wed Nov 18 00:03:34 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.268587. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48359 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82839 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99897 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46483 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12825 clock time +[SCHEDULER ITER6 LR1]: 240045 words processed Wed Nov 18 00:03:47 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.263620. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47708 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79699 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10079 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97918 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45482 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER6 LR1]: 280057 words processed Wed Nov 18 00:04:00 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.260267. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48032 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81562 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16258 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00141 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46679 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12616 clock time +[SCHEDULER ITER6 LR1]: 320106 words processed Wed Nov 18 00:04:13 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.257225. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47606 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80907 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13981 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46342 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12502 clock time +[SCHEDULER ITER6 LR1]: 360024 words processed Wed Nov 18 00:04:26 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.255590. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47253 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79706 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09939 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97998 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45466 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12512 clock time +[SCHEDULER ITER6 LR1]: 400089 words processed Wed Nov 18 00:04:39 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.253925. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47823 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82628 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17958 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00594 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47054 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12584 clock time +[SCHEDULER ITER6 LR1]: 440067 words processed Wed Nov 18 00:04:52 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.253657. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47458 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81724 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13939 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99019 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46110 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12628 clock time +[SCHEDULER ITER6 LR1]: 480051 words processed Wed Nov 18 00:05:05 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.253430. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47542 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81150 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98700 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46151 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12597 clock time +[SCHEDULER ITER6 LR1]: 520140 words processed Wed Nov 18 00:05:18 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.252972. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47471 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81100 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14214 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99603 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46494 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12556 clock time +[SCHEDULER ITER6 LR1]: 560132 words processed Wed Nov 18 00:05:31 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.252400. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47710 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81540 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13523 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98726 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46144 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12570 clock time +[SCHEDULER ITER6 LR1]: 600118 words processed Wed Nov 18 00:05:44 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.250246. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80896 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12749 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98765 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46120 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12577 clock time +[SCHEDULER ITER6 LR1]: 640090 words processed Wed Nov 18 00:05:57 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.248656. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47304 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79956 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10246 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98048 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45710 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12551 clock time +[SCHEDULER ITER6 LR1]: 680075 words processed Wed Nov 18 00:06:10 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.248232. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79804 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09940 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98028 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45562 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER6 LR1]: 720043 words processed Wed Nov 18 00:06:23 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.248073. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47439 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81476 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98940 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46171 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12650 clock time +[SCHEDULER ITER6 LR1]: 760012 words processed Wed Nov 18 00:06:36 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.247305. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47539 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81303 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13468 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98793 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46258 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12527 clock time +[SCHEDULER ITER6 LR1]: 800113 words processed Wed Nov 18 00:06:49 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.246902. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47596 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82018 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16715 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00330 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47024 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12576 clock time +[SCHEDULER ITER6 LR1]: 840089 words processed Wed Nov 18 00:07:02 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.245649. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47721 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81961 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14663 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99096 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46274 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12600 clock time +[SCHEDULER ITER6 LR1]: 880052 words processed Wed Nov 18 00:07:16 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.245326. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48977 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86982 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.25216 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47396 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12967 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER6 LR1]: Displaying result: +[SCHEDULER ITER6 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 198.01086196278> <PPL_OOV 175.94379751005> <LOGP -2087274.9354018> +[SCHEDULER ITER6 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER6 LR1]: shuffling training file +===PEEK ON TEST 6=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER6 LR1]: 40087 words processed Wed Nov 18 00:07:26 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.253756. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48231 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80582 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.52990 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11999 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER6 LR1]: Displaying result: +[SCHEDULER ITER6 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 205.60478189154> <PPL_OOV 179.85731302561> <LOGP -185873.72336485> +[SCHEDULER ITER6 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 6=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER6 LR1]: 40095 words processed Wed Nov 18 00:07:37 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.310530. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48385 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81944 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54623 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12094 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER6 LR1]: Displaying result: +[SCHEDULER ITER6 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 210.15095507799> <PPL_OOV 188.4950623323> <LOGP -167826.12639614> +[SCHEDULER ITER6 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER6 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.6... + +[SCHEDULER ITER7 LR1]: preparing parameters... +[SCHEDULER ITER7 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.6... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46042825 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46047682 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92177930 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92294298 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94199860 +[SCHEDULER ITER7 LR1]: preparing parameters end. +[SCHEDULER ITER7 LR1]: preparing layers... +(00:07:47 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:07:47 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:07:47 2015-11-18)[nerv] info: create layer: combinerL1 +(00:07:47 2015-11-18)[nerv] info: create layer: outputL +(00:07:47 2015-11-18)[nerv] info: create layer: softmaxL +(00:07:47 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER7 LR1]: preparing layers end. +[SCHEDULER ITER7 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER7 LR1]: Initing TNN end. +===ITERATION 7 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER7 LR1]: 40092 words processed Wed Nov 18 00:08:00 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.249645. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48501 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81810 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15806 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99653 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46433 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12580 clock time +[SCHEDULER ITER7 LR1]: 80099 words processed Wed Nov 18 00:08:13 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.247314. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79514 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08802 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97111 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45029 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12519 clock time +[SCHEDULER ITER7 LR1]: 120004 words processed Wed Nov 18 00:08:26 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.238712. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48302 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81161 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13044 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98009 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45771 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12685 clock time +[SCHEDULER ITER7 LR1]: 160114 words processed Wed Nov 18 00:08:39 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.239163. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48364 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82127 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15979 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99607 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46444 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12660 clock time +[SCHEDULER ITER7 LR1]: 200066 words processed Wed Nov 18 00:08:52 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.238942. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47849 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80956 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11751 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97920 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45669 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12614 clock time +[SCHEDULER ITER7 LR1]: 240045 words processed Wed Nov 18 00:09:05 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.233293. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47795 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80013 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09748 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97506 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45346 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12549 clock time +[SCHEDULER ITER7 LR1]: 280057 words processed Wed Nov 18 00:09:18 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.229517. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48389 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83202 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17678 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99710 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46535 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12703 clock time +[SCHEDULER ITER7 LR1]: 320106 words processed Wed Nov 18 00:09:31 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.226536. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47671 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80564 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12352 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98766 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46008 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12546 clock time +[SCHEDULER ITER7 LR1]: 360024 words processed Wed Nov 18 00:09:44 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.224857. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47386 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80243 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09739 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97471 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45264 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12541 clock time +[SCHEDULER ITER7 LR1]: 400089 words processed Wed Nov 18 00:09:57 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.222971. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47752 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81685 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14297 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99294 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46151 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12602 clock time +[SCHEDULER ITER7 LR1]: 440067 words processed Wed Nov 18 00:10:10 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.223022. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47610 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80319 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09904 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97460 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45360 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12587 clock time +[SCHEDULER ITER7 LR1]: 480051 words processed Wed Nov 18 00:10:23 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.222837. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47606 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80978 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11340 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97989 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45643 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12577 clock time +[SCHEDULER ITER7 LR1]: 520140 words processed Wed Nov 18 00:10:36 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.222408. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47688 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80837 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13064 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99006 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46228 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12550 clock time +[SCHEDULER ITER7 LR1]: 560132 words processed Wed Nov 18 00:10:49 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.221800. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47633 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80848 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98098 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45587 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12592 clock time +[SCHEDULER ITER7 LR1]: 600118 words processed Wed Nov 18 00:11:02 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.220159. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47407 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79745 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08220 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97112 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45059 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12506 clock time +[SCHEDULER ITER7 LR1]: 640090 words processed Wed Nov 18 00:11:15 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.218556. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47255 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79249 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07513 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97041 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45076 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12526 clock time +[SCHEDULER ITER7 LR1]: 680075 words processed Wed Nov 18 00:11:28 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.218097. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47337 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79154 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96977 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45063 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12509 clock time +[SCHEDULER ITER7 LR1]: 720043 words processed Wed Nov 18 00:11:41 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.217857. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79462 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08181 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97276 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45112 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER7 LR1]: 760012 words processed Wed Nov 18 00:11:54 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.216960. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47277 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79706 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08786 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97350 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45360 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER7 LR1]: 800113 words processed Wed Nov 18 00:12:07 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.216709. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47555 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80492 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12299 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98972 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45991 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12583 clock time +[SCHEDULER ITER7 LR1]: 840089 words processed Wed Nov 18 00:12:20 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.215650. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81590 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12720 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98288 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45871 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12690 clock time +[SCHEDULER ITER7 LR1]: 880052 words processed Wed Nov 18 00:12:33 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.215435. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47717 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81831 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98172 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45775 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12618 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER7 LR1]: Displaying result: +[SCHEDULER ITER7 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 184.28443875474> <PPL_OOV 164.24123168359> <LOGP -2059487.8765421> +[SCHEDULER ITER7 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER7 LR1]: shuffling training file +===PEEK ON TEST 7=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER7 LR1]: 40087 words processed Wed Nov 18 00:12:43 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.238224. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81004 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53633 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12077 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER7 LR1]: Displaying result: +[SCHEDULER ITER7 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 198.03291376928> <PPL_OOV 173.11440783459> <LOGP -184505.80687216> +[SCHEDULER ITER7 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 7=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER7 LR1]: 40095 words processed Wed Nov 18 00:12:54 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.294045. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48393 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80443 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.52934 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12061 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER7 LR1]: Displaying result: +[SCHEDULER ITER7 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 201.62529210464> <PPL_OOV 180.79465304931> <LOGP -166490.00854255> +[SCHEDULER ITER7 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER7 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.7... + +[SCHEDULER ITER8 LR1]: preparing parameters... +[SCHEDULER ITER8 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.7... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1904486 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1909343 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48056478 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48172824 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94217922 +[SCHEDULER ITER8 LR1]: preparing parameters end. +[SCHEDULER ITER8 LR1]: preparing layers... +(00:13:04 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:13:04 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:13:04 2015-11-18)[nerv] info: create layer: combinerL1 +(00:13:04 2015-11-18)[nerv] info: create layer: outputL +(00:13:04 2015-11-18)[nerv] info: create layer: softmaxL +(00:13:04 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER8 LR1]: preparing layers end. +[SCHEDULER ITER8 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER8 LR1]: Initing TNN end. +===ITERATION 8 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER8 LR1]: 40092 words processed Wed Nov 18 00:13:17 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.205572. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48842 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84576 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.22309 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01454 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47310 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12640 clock time +[SCHEDULER ITER8 LR1]: 80099 words processed Wed Nov 18 00:13:30 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.208422. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48275 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80086 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11192 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98038 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45573 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12501 clock time +[SCHEDULER ITER8 LR1]: 120004 words processed Wed Nov 18 00:13:43 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.202741. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48185 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80785 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12672 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98294 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45651 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12494 clock time +[SCHEDULER ITER8 LR1]: 160114 words processed Wed Nov 18 00:13:56 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.204852. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48179 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81183 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14553 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99553 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46277 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12520 clock time +[SCHEDULER ITER8 LR1]: 200066 words processed Wed Nov 18 00:14:09 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.205325. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47698 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80158 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10692 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97944 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45499 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12488 clock time +[SCHEDULER ITER8 LR1]: 240045 words processed Wed Nov 18 00:14:22 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.200758. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47627 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79728 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09697 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97785 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45348 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12452 clock time +[SCHEDULER ITER8 LR1]: 280057 words processed Wed Nov 18 00:14:35 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.197356. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47902 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81324 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15222 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99824 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46423 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12514 clock time +[SCHEDULER ITER8 LR1]: 320106 words processed Wed Nov 18 00:14:48 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.194953. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47704 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81446 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15091 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46472 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12527 clock time +[SCHEDULER ITER8 LR1]: 360024 words processed Wed Nov 18 00:15:01 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.193882. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79939 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10540 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98137 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45528 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12519 clock time +[SCHEDULER ITER8 LR1]: 400089 words processed Wed Nov 18 00:15:14 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.192172. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47530 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82269 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16605 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00382 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46667 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12542 clock time +[SCHEDULER ITER8 LR1]: 440067 words processed Wed Nov 18 00:15:27 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.192464. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47464 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81571 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13816 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99100 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46093 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12536 clock time +[SCHEDULER ITER8 LR1]: 480051 words processed Wed Nov 18 00:15:40 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.192716. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80432 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10973 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98225 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45683 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12505 clock time +[SCHEDULER ITER8 LR1]: 520140 words processed Wed Nov 18 00:15:53 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.192706. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47367 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81156 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14336 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99823 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46376 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12526 clock time +[SCHEDULER ITER8 LR1]: 560132 words processed Wed Nov 18 00:16:06 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.192396. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47419 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80331 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10990 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98442 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45563 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12506 clock time +[SCHEDULER ITER8 LR1]: 600118 words processed Wed Nov 18 00:16:19 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.191599. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47210 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79950 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09832 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98004 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45452 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12460 clock time +[SCHEDULER ITER8 LR1]: 640090 words processed Wed Nov 18 00:16:32 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.190479. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47558 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82533 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15501 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99283 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46193 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12619 clock time +[SCHEDULER ITER8 LR1]: 680075 words processed Wed Nov 18 00:16:45 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.190003. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47457 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81490 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13382 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98962 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45995 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12529 clock time +[SCHEDULER ITER8 LR1]: 720043 words processed Wed Nov 18 00:16:58 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.190076. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47627 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81590 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14334 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99182 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46084 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12541 clock time +[SCHEDULER ITER8 LR1]: 760012 words processed Wed Nov 18 00:17:11 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.189429. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47489 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81188 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12371 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98466 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45677 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12508 clock time +[SCHEDULER ITER8 LR1]: 800113 words processed Wed Nov 18 00:17:24 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.189430. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82488 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17307 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00441 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46693 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12616 clock time +[SCHEDULER ITER8 LR1]: 840089 words processed Wed Nov 18 00:17:37 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.188564. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47269 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80331 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10820 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98196 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45704 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12503 clock time +[SCHEDULER ITER8 LR1]: 880052 words processed Wed Nov 18 00:17:50 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.188497. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47262 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80122 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10586 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98159 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45628 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12520 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER8 LR1]: Displaying result: +[SCHEDULER ITER8 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 172.74267717744> <PPL_OOV 154.3670126021> <LOGP -2034456.1886602> +[SCHEDULER ITER8 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER8 LR1]: shuffling training file +===PEEK ON TEST 8=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER8 LR1]: 40087 words processed Wed Nov 18 00:18:00 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.228045. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48330 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82115 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54725 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12028 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER8 LR1]: Displaying result: +[SCHEDULER ITER8 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 192.23514434273> <PPL_OOV 168.70332456908> <LOGP -183581.80173929> +[SCHEDULER ITER8 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 8=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER8 LR1]: 40095 words processed Wed Nov 18 00:18:11 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.284902. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48496 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82075 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54857 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12068 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER8 LR1]: Displaying result: +[SCHEDULER ITER8 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 196.10284212026> <PPL_OOV 176.46640487651> <LOGP -165713.79192028> +[SCHEDULER ITER8 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER8 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.8... + +[SCHEDULER ITER9 LR1]: preparing parameters... +[SCHEDULER ITER9 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.8... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46046935 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46051792 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92213915 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92330266 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94233834 +[SCHEDULER ITER9 LR1]: preparing parameters end. +[SCHEDULER ITER9 LR1]: preparing layers... +(00:18:21 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:18:21 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:18:21 2015-11-18)[nerv] info: create layer: combinerL1 +(00:18:21 2015-11-18)[nerv] info: create layer: outputL +(00:18:21 2015-11-18)[nerv] info: create layer: softmaxL +(00:18:21 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER9 LR1]: preparing layers end. +[SCHEDULER ITER9 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER9 LR1]: Initing TNN end. +===ITERATION 9 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER9 LR1]: 40092 words processed Wed Nov 18 00:18:34 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.185243. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84695 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.21383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01136 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47049 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12712 clock time +[SCHEDULER ITER9 LR1]: 80099 words processed Wed Nov 18 00:18:47 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.185234. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48442 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80856 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97640 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45293 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12547 clock time +[SCHEDULER ITER9 LR1]: 120004 words processed Wed Nov 18 00:19:00 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.179490. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48235 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81082 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11950 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45318 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12582 clock time +[SCHEDULER ITER9 LR1]: 160114 words processed Wed Nov 18 00:19:13 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.180880. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48303 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82656 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16222 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99787 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46206 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12635 clock time +[SCHEDULER ITER9 LR1]: 200066 words processed Wed Nov 18 00:19:26 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.181628. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82934 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15030 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98974 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45769 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12639 clock time +[SCHEDULER ITER9 LR1]: 240045 words processed Wed Nov 18 00:19:39 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.176834. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47940 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82318 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13651 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98415 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45731 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12577 clock time +[SCHEDULER ITER9 LR1]: 280057 words processed Wed Nov 18 00:19:52 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.173533. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47974 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82177 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15322 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99591 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46131 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12612 clock time +[SCHEDULER ITER9 LR1]: 320106 words processed Wed Nov 18 00:20:05 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.171315. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47775 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82287 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15231 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99679 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46029 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12677 clock time +[SCHEDULER ITER9 LR1]: 360024 words processed Wed Nov 18 00:20:18 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.170219. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47422 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80954 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10625 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97700 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45291 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12593 clock time +[SCHEDULER ITER9 LR1]: 400089 words processed Wed Nov 18 00:20:31 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.168687. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47695 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83156 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16710 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99900 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46483 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12675 clock time +[SCHEDULER ITER9 LR1]: 440067 words processed Wed Nov 18 00:20:44 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.169194. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47455 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82759 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14276 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98991 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45696 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12679 clock time +[SCHEDULER ITER9 LR1]: 480051 words processed Wed Nov 18 00:20:57 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.169547. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82143 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12700 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98386 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45708 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12651 clock time +[SCHEDULER ITER9 LR1]: 520140 words processed Wed Nov 18 00:21:11 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.169675. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47738 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84018 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18636 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00582 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46502 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12752 clock time +[SCHEDULER ITER9 LR1]: 560132 words processed Wed Nov 18 00:21:24 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.169508. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47244 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81236 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10750 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98006 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45400 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12555 clock time +[SCHEDULER ITER9 LR1]: 600118 words processed Wed Nov 18 00:21:37 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.167812. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47259 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81732 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11556 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98129 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45372 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12571 clock time +[SCHEDULER ITER9 LR1]: 640090 words processed Wed Nov 18 00:21:50 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.166520. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47197 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80943 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10228 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97955 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45232 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12542 clock time +[SCHEDULER ITER9 LR1]: 680075 words processed Wed Nov 18 00:22:03 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.165820. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81800 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12001 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98264 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45472 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12591 clock time +[SCHEDULER ITER9 LR1]: 720043 words processed Wed Nov 18 00:22:16 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.165612. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47244 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80786 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10346 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97885 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45348 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12584 clock time +[SCHEDULER ITER9 LR1]: 760012 words processed Wed Nov 18 00:22:29 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.165190. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47507 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82445 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13860 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98772 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45716 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12664 clock time +[SCHEDULER ITER9 LR1]: 800113 words processed Wed Nov 18 00:22:42 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.165356. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47371 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82297 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14787 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99619 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46203 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12605 clock time +[SCHEDULER ITER9 LR1]: 840089 words processed Wed Nov 18 00:22:55 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.165110. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47253 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80951 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10256 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97844 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45296 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12559 clock time +[SCHEDULER ITER9 LR1]: 880052 words processed Wed Nov 18 00:23:08 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.165292. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47344 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81019 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10406 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97853 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45135 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12531 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER9 LR1]: Displaying result: +[SCHEDULER ITER9 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 163.38518005346> <PPL_OOV 146.34744649667> <LOGP -2012918.2154296> +[SCHEDULER ITER9 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER9 LR1]: shuffling training file +===PEEK ON TEST 9=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER9 LR1]: 40087 words processed Wed Nov 18 00:23:18 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.218169. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48467 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83295 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55981 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12120 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER9 LR1]: Displaying result: +[SCHEDULER ITER9 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 188.15775634108> <PPL_OOV 164.85292602699> <LOGP -182755.27768202> +[SCHEDULER ITER9 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 9=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER9 LR1]: 40095 words processed Wed Nov 18 00:23:29 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.276967. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48430 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82871 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55433 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12088 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER9 LR1]: Displaying result: +[SCHEDULER ITER9 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 192.16873850907> <PPL_OOV 172.63376177164> <LOGP -165010.39414878> +[SCHEDULER ITER9 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER9 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.9... + +[SCHEDULER ITER10 LR1]: preparing parameters... +[SCHEDULER ITER10 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.9... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1902646 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1907502 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48081819 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48198168 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94246602 +[SCHEDULER ITER10 LR1]: preparing parameters end. +[SCHEDULER ITER10 LR1]: preparing layers... +(00:23:39 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:23:39 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:23:39 2015-11-18)[nerv] info: create layer: combinerL1 +(00:23:39 2015-11-18)[nerv] info: create layer: outputL +(00:23:39 2015-11-18)[nerv] info: create layer: softmaxL +(00:23:39 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER10 LR1]: preparing layers end. +[SCHEDULER ITER10 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER10 LR1]: Initing TNN end. +===ITERATION 10 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER10 LR1]: 40092 words processed Wed Nov 18 00:23:52 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.161772. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48496 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83139 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18772 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46910 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12547 clock time +[SCHEDULER ITER10 LR1]: 80099 words processed Wed Nov 18 00:24:05 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.170801. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48586 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82466 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15500 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98956 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46107 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12495 clock time +[SCHEDULER ITER10 LR1]: 120004 words processed Wed Nov 18 00:24:18 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.169117. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48332 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82001 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14624 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98846 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45728 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12475 clock time +[SCHEDULER ITER10 LR1]: 160114 words processed Wed Nov 18 00:24:31 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.170123. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48359 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83064 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17982 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00449 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46598 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12572 clock time +[SCHEDULER ITER10 LR1]: 200066 words processed Wed Nov 18 00:24:44 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.169525. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47896 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81955 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14096 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98897 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45843 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12558 clock time +[SCHEDULER ITER10 LR1]: 240045 words processed Wed Nov 18 00:24:57 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.163683. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47827 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82231 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14639 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99016 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46009 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12597 clock time +[SCHEDULER ITER10 LR1]: 280057 words processed Wed Nov 18 00:25:10 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.159520. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47928 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82355 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00328 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46376 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12564 clock time +[SCHEDULER ITER10 LR1]: 320106 words processed Wed Nov 18 00:25:23 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.156659. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47645 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82088 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15667 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99991 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46302 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12544 clock time +[SCHEDULER ITER10 LR1]: 360024 words processed Wed Nov 18 00:25:36 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.155076. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47934 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83399 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16438 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99230 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45984 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12642 clock time +[SCHEDULER ITER10 LR1]: 400089 words processed Wed Nov 18 00:25:50 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.152968. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48734 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.89129 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.29828 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.03081 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.48078 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12932 clock time +[SCHEDULER ITER10 LR1]: 440067 words processed Wed Nov 18 00:26:03 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.153260. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47679 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82524 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98873 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45760 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12561 clock time +[SCHEDULER ITER10 LR1]: 480051 words processed Wed Nov 18 00:26:16 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.153569. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47537 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82198 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13473 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98678 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45745 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12565 clock time +[SCHEDULER ITER10 LR1]: 520140 words processed Wed Nov 18 00:26:29 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.153573. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47661 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82336 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15848 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99956 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46385 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12561 clock time +[SCHEDULER ITER10 LR1]: 560132 words processed Wed Nov 18 00:26:42 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.153237. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47521 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81610 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13317 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98976 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45814 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12576 clock time +[SCHEDULER ITER10 LR1]: 600118 words processed Wed Nov 18 00:26:55 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.151114. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82524 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14536 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99108 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45947 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12528 clock time +[SCHEDULER ITER10 LR1]: 640090 words processed Wed Nov 18 00:27:08 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.149826. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47602 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82031 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13735 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98893 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45792 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12524 clock time +[SCHEDULER ITER10 LR1]: 680075 words processed Wed Nov 18 00:27:21 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.149010. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47491 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82569 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14261 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98829 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45983 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12554 clock time +[SCHEDULER ITER10 LR1]: 720043 words processed Wed Nov 18 00:27:34 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.148674. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47662 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82599 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15562 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99336 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46200 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12627 clock time +[SCHEDULER ITER10 LR1]: 760012 words processed Wed Nov 18 00:27:47 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.148724. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82125 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13788 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98720 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45933 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12572 clock time +[SCHEDULER ITER10 LR1]: 800113 words processed Wed Nov 18 00:28:00 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.149097. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47743 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83863 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19219 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00930 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46817 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12578 clock time +[SCHEDULER ITER10 LR1]: 840089 words processed Wed Nov 18 00:28:13 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.148423. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47254 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81130 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11286 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98181 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45568 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12476 clock time +[SCHEDULER ITER10 LR1]: 880052 words processed Wed Nov 18 00:28:26 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.148551. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47187 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80734 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10861 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98112 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45529 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12488 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER10 LR1]: Displaying result: +[SCHEDULER ITER10 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 156.94959430419> <PPL_OOV 140.81356339944> <LOGP -1997356.2816957> +[SCHEDULER ITER10 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER10 LR1]: shuffling training file +===PEEK ON TEST 10=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER10 LR1]: 40087 words processed Wed Nov 18 00:28:36 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.211341. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82504 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55136 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12047 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER10 LR1]: Displaying result: +[SCHEDULER ITER10 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 184.23108222268> <PPL_OOV 162.15277628145> <LOGP -182164.06736872> +[SCHEDULER ITER10 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 10=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER10 LR1]: 40095 words processed Wed Nov 18 00:28:47 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.271336. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48385 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83030 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55714 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12132 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER10 LR1]: Displaying result: +[SCHEDULER ITER10 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 188.07918878214> <PPL_OOV 169.56604699879> <LOGP -164436.03695526> +[SCHEDULER ITER10 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER10 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.10... + +[SCHEDULER ITER11 LR1]: preparing parameters... +[SCHEDULER ITER11 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.10... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46048635 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46053492 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92239326 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92355669 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94257460 +[SCHEDULER ITER11 LR1]: preparing parameters end. +[SCHEDULER ITER11 LR1]: preparing layers... +(00:28:57 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:28:57 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:28:57 2015-11-18)[nerv] info: create layer: combinerL1 +(00:28:57 2015-11-18)[nerv] info: create layer: outputL +(00:28:57 2015-11-18)[nerv] info: create layer: softmaxL +(00:28:57 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER11 LR1]: preparing layers end. +[SCHEDULER ITER11 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER11 LR1]: Initing TNN end. +===ITERATION 11 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER11 LR1]: 40092 words processed Wed Nov 18 00:29:10 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.143029. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48485 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84337 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19730 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00387 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46808 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12576 clock time +[SCHEDULER ITER11 LR1]: 80099 words processed Wed Nov 18 00:29:23 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.145413. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82191 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12059 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97310 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45131 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER11 LR1]: 120004 words processed Wed Nov 18 00:29:36 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.140768. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48200 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81711 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11940 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97390 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45197 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12486 clock time +[SCHEDULER ITER11 LR1]: 160114 words processed Wed Nov 18 00:29:49 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.142047. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48213 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83749 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16975 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46106 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12570 clock time +[SCHEDULER ITER11 LR1]: 200066 words processed Wed Nov 18 00:30:02 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.143075. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47867 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82557 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12721 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97632 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45334 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12536 clock time +[SCHEDULER ITER11 LR1]: 240045 words processed Wed Nov 18 00:30:15 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.138477. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47733 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82148 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11774 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97564 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45176 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12514 clock time +[SCHEDULER ITER11 LR1]: 280057 words processed Wed Nov 18 00:30:28 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.135379. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47994 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83482 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16503 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99330 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46076 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12545 clock time +[SCHEDULER ITER11 LR1]: 320106 words processed Wed Nov 18 00:30:41 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.133294. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47740 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83249 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15964 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99307 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46148 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12560 clock time +[SCHEDULER ITER11 LR1]: 360024 words processed Wed Nov 18 00:30:54 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.132178. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47311 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81505 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10574 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97380 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45045 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12461 clock time +[SCHEDULER ITER11 LR1]: 400089 words processed Wed Nov 18 00:31:07 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.130465. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47587 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83557 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16566 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99704 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46115 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12545 clock time +[SCHEDULER ITER11 LR1]: 440067 words processed Wed Nov 18 00:31:20 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.131231. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47554 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82629 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13062 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98047 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45468 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12557 clock time +[SCHEDULER ITER11 LR1]: 480051 words processed Wed Nov 18 00:31:33 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.131842. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47339 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82153 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11469 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97634 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45293 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12516 clock time +[SCHEDULER ITER11 LR1]: 520140 words processed Wed Nov 18 00:31:46 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.131951. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47659 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83607 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99444 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46226 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12574 clock time +[SCHEDULER ITER11 LR1]: 560132 words processed Wed Nov 18 00:31:59 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.131942. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47289 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81889 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11204 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97630 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45328 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12524 clock time +[SCHEDULER ITER11 LR1]: 600118 words processed Wed Nov 18 00:32:12 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.130849. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47253 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81801 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10819 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97570 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45123 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12487 clock time +[SCHEDULER ITER11 LR1]: 640090 words processed Wed Nov 18 00:32:25 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.129992. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47308 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82135 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11220 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45182 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12502 clock time +[SCHEDULER ITER11 LR1]: 680075 words processed Wed Nov 18 00:32:38 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.129367. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47484 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82565 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12685 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97970 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45447 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12546 clock time +[SCHEDULER ITER11 LR1]: 720043 words processed Wed Nov 18 00:32:51 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.129210. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47347 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82803 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12872 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97931 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45425 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12513 clock time +[SCHEDULER ITER11 LR1]: 760012 words processed Wed Nov 18 00:33:04 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.128640. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47614 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83990 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15629 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98623 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45751 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12550 clock time +[SCHEDULER ITER11 LR1]: 800113 words processed Wed Nov 18 00:33:18 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.129025. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47660 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85036 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19529 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00160 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46830 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12646 clock time +[SCHEDULER ITER11 LR1]: 840089 words processed Wed Nov 18 00:33:31 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.128246. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47224 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82079 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11696 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97808 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45404 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12527 clock time +[SCHEDULER ITER11 LR1]: 880052 words processed Wed Nov 18 00:33:44 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.128443. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47305 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82409 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12649 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98029 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45470 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12564 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER11 LR1]: Displaying result: +[SCHEDULER ITER11 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 149.57738223526> <PPL_OOV 134.44749237511> <LOGP -1978679.1818492> +[SCHEDULER ITER11 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER11 LR1]: shuffling training file +===PEEK ON TEST 11=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER11 LR1]: 40087 words processed Wed Nov 18 00:33:54 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.205328. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83449 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56122 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12064 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER11 LR1]: Displaying result: +[SCHEDULER ITER11 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 181.9042131837> <PPL_OOV 159.87838763856> <LOGP -181658.38989893> +[SCHEDULER ITER11 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 11=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER11 LR1]: 40095 words processed Wed Nov 18 00:34:05 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.266893. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48888 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86414 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.59864 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12195 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER11 LR1]: Displaying result: +[SCHEDULER ITER11 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 186.20454831969> <PPL_OOV 167.70312840032> <LOGP -164082.15627008> +[SCHEDULER ITER11 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER11 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.11... + +[SCHEDULER ITER12 LR1]: preparing parameters... +[SCHEDULER ITER12 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.11... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1900824 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1905681 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48102353 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48218693 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94267080 +[SCHEDULER ITER12 LR1]: preparing parameters end. +[SCHEDULER ITER12 LR1]: preparing layers... +(00:34:16 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:34:16 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:34:16 2015-11-18)[nerv] info: create layer: combinerL1 +(00:34:16 2015-11-18)[nerv] info: create layer: outputL +(00:34:16 2015-11-18)[nerv] info: create layer: softmaxL +(00:34:16 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER12 LR1]: preparing layers end. +[SCHEDULER ITER12 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER12 LR1]: Initing TNN end. +===ITERATION 12 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER12 LR1]: 40092 words processed Wed Nov 18 00:34:29 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.124180. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48764 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84079 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19820 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00609 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46740 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12597 clock time +[SCHEDULER ITER12 LR1]: 80099 words processed Wed Nov 18 00:34:42 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.126783. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48486 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82197 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13672 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98246 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45601 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12515 clock time +[SCHEDULER ITER12 LR1]: 120004 words processed Wed Nov 18 00:34:55 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.122591. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48585 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83148 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16096 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98543 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46003 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12526 clock time +[SCHEDULER ITER12 LR1]: 160114 words processed Wed Nov 18 00:35:08 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.124062. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48332 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84121 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18849 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00356 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46553 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12578 clock time +[SCHEDULER ITER12 LR1]: 200066 words processed Wed Nov 18 00:35:21 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.125058. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47793 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81435 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11771 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97956 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45406 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12480 clock time +[SCHEDULER ITER12 LR1]: 240045 words processed Wed Nov 18 00:35:34 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.120799. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81217 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11028 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45260 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12508 clock time +[SCHEDULER ITER12 LR1]: 280057 words processed Wed Nov 18 00:35:47 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.117710. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48049 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83354 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17348 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99860 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46432 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12522 clock time +[SCHEDULER ITER12 LR1]: 320106 words processed Wed Nov 18 00:36:01 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.115919. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48274 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86156 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.22847 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01163 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47046 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12717 clock time +[SCHEDULER ITER12 LR1]: 360024 words processed Wed Nov 18 00:36:15 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.115002. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48125 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86168 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.21326 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00162 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46553 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12765 clock time +[SCHEDULER ITER12 LR1]: 400089 words processed Wed Nov 18 00:36:28 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.114106. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47604 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83197 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16527 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99857 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46431 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12555 clock time +[SCHEDULER ITER12 LR1]: 440067 words processed Wed Nov 18 00:36:41 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.115738. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47371 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81419 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11461 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98138 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45448 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12518 clock time +[SCHEDULER ITER12 LR1]: 480051 words processed Wed Nov 18 00:36:54 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.116599. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81750 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11619 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98044 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45492 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12474 clock time +[SCHEDULER ITER12 LR1]: 520140 words processed Wed Nov 18 00:37:07 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.116616. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47579 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84003 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18288 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00273 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46675 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12573 clock time +[SCHEDULER ITER12 LR1]: 560132 words processed Wed Nov 18 00:37:20 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.116748. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47354 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81486 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11196 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98000 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45371 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12465 clock time +[SCHEDULER ITER12 LR1]: 600118 words processed Wed Nov 18 00:37:33 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.115547. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47300 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81145 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10477 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97865 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45195 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12440 clock time +[SCHEDULER ITER12 LR1]: 640090 words processed Wed Nov 18 00:37:46 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.114346. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47227 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81320 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97922 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45337 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12489 clock time +[SCHEDULER ITER12 LR1]: 680075 words processed Wed Nov 18 00:37:59 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.113720. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82419 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13345 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98544 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45675 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12508 clock time +[SCHEDULER ITER12 LR1]: 720043 words processed Wed Nov 18 00:38:12 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.113669. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47389 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82914 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13708 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98393 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45651 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12484 clock time +[SCHEDULER ITER12 LR1]: 760012 words processed Wed Nov 18 00:38:25 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.113996. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47360 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82161 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12656 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98365 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45494 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12472 clock time +[SCHEDULER ITER12 LR1]: 800113 words processed Wed Nov 18 00:38:38 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.114539. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47574 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83423 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17137 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00052 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46550 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12549 clock time +[SCHEDULER ITER12 LR1]: 840089 words processed Wed Nov 18 00:38:51 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.114001. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47404 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82098 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12688 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98411 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45603 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER12 LR1]: 880052 words processed Wed Nov 18 00:39:04 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.114262. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47292 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81611 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11766 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98113 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45499 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12469 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER12 LR1]: Displaying result: +[SCHEDULER ITER12 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 144.58222209601> <PPL_OOV 130.13001826717> <LOGP -1965502.0572496> +[SCHEDULER ITER12 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER12 LR1]: shuffling training file +===PEEK ON TEST 12=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER12 LR1]: 40087 words processed Wed Nov 18 00:39:14 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.201761. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48589 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84843 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.58013 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12216 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER12 LR1]: Displaying result: +[SCHEDULER ITER12 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 180.54676495455> <PPL_OOV 158.7323525418> <LOGP -181400.85328212> +[SCHEDULER ITER12 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 12=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER12 LR1]: 40095 words processed Wed Nov 18 00:39:25 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.264364. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83409 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56194 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12084 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER12 LR1]: Displaying result: +[SCHEDULER ITER12 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 184.84158615395> <PPL_OOV 166.49744218503> <LOGP -163851.02207183> +[SCHEDULER ITER12 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER12 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.12... + +[SCHEDULER ITER13 LR1]: preparing parameters... +[SCHEDULER ITER13 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.12... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46047474 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46052331 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92260944 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92377287 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94277114 +[SCHEDULER ITER13 LR1]: preparing parameters end. +[SCHEDULER ITER13 LR1]: preparing layers... +(00:39:35 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:39:35 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:39:35 2015-11-18)[nerv] info: create layer: combinerL1 +(00:39:35 2015-11-18)[nerv] info: create layer: outputL +(00:39:35 2015-11-18)[nerv] info: create layer: softmaxL +(00:39:35 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER13 LR1]: preparing layers end. +[SCHEDULER ITER13 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER13 LR1]: Initing TNN end. +===ITERATION 13 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER13 LR1]: 40092 words processed Wed Nov 18 00:39:48 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.108782. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48786 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85287 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.22176 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01237 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47093 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12630 clock time +[SCHEDULER ITER13 LR1]: 80099 words processed Wed Nov 18 00:40:01 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.108798. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48449 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82277 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12995 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98017 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45284 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12510 clock time +[SCHEDULER ITER13 LR1]: 120004 words processed Wed Nov 18 00:40:14 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.105841. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48220 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82137 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12661 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45235 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12491 clock time +[SCHEDULER ITER13 LR1]: 160114 words processed Wed Nov 18 00:40:27 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.107861. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48277 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84364 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18398 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00071 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46290 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12613 clock time +[SCHEDULER ITER13 LR1]: 200066 words processed Wed Nov 18 00:40:40 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.109129. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82788 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13782 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98356 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45489 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12561 clock time +[SCHEDULER ITER13 LR1]: 240045 words processed Wed Nov 18 00:40:53 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.105317. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48148 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83894 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98650 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45730 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12537 clock time +[SCHEDULER ITER13 LR1]: 280057 words processed Wed Nov 18 00:41:07 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.102234. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48470 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85391 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.21098 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00582 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46739 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12606 clock time +[SCHEDULER ITER13 LR1]: 320106 words processed Wed Nov 18 00:41:21 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.100410. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48337 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85565 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.21493 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00714 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46851 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12683 clock time +[SCHEDULER ITER13 LR1]: 360024 words processed Wed Nov 18 00:41:35 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.099646. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48572 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.89600 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.27077 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01018 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47075 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12953 clock time +[SCHEDULER ITER13 LR1]: 400089 words processed Wed Nov 18 00:41:49 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.098502. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.89187 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.27826 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02146 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47426 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12894 clock time +[SCHEDULER ITER13 LR1]: 440067 words processed Wed Nov 18 00:42:02 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.099850. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47791 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84259 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16115 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98921 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45745 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12570 clock time +[SCHEDULER ITER13 LR1]: 480051 words processed Wed Nov 18 00:42:15 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.100737. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47688 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83268 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13879 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45417 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12598 clock time +[SCHEDULER ITER13 LR1]: 520140 words processed Wed Nov 18 00:42:29 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.100767. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85293 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20560 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00680 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46819 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12619 clock time +[SCHEDULER ITER13 LR1]: 560132 words processed Wed Nov 18 00:42:42 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.101049. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47731 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83343 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15142 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98941 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45912 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12526 clock time +[SCHEDULER ITER13 LR1]: 600118 words processed Wed Nov 18 00:42:55 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.099862. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47476 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83072 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13714 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45581 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER13 LR1]: 640090 words processed Wed Nov 18 00:43:08 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.098814. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47635 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83430 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15283 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99078 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45720 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12645 clock time +[SCHEDULER ITER13 LR1]: 680075 words processed Wed Nov 18 00:43:21 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.098536. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47434 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82509 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12325 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97968 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45456 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12486 clock time +[SCHEDULER ITER13 LR1]: 720043 words processed Wed Nov 18 00:43:34 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.098495. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47490 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82273 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97991 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45514 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12509 clock time +[SCHEDULER ITER13 LR1]: 760012 words processed Wed Nov 18 00:43:47 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.098293. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47439 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82589 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12854 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98122 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45420 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12542 clock time +[SCHEDULER ITER13 LR1]: 800113 words processed Wed Nov 18 00:44:00 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.098735. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47648 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83450 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99834 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46155 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12585 clock time +[SCHEDULER ITER13 LR1]: 840089 words processed Wed Nov 18 00:44:13 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.098021. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47246 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81898 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10851 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97653 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45105 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12503 clock time +[SCHEDULER ITER13 LR1]: 880052 words processed Wed Nov 18 00:44:26 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.098288. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47325 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82010 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11403 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45229 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12492 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER13 LR1]: Displaying result: +[SCHEDULER ITER13 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 139.14707992521> <PPL_OOV 125.43173243352> <LOGP -1950656.4557867> +[SCHEDULER ITER13 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER13 LR1]: shuffling training file +===PEEK ON TEST 13=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER13 LR1]: 40087 words processed Wed Nov 18 00:44:36 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.196971. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48488 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84254 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.57022 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12048 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER13 LR1]: Displaying result: +[SCHEDULER ITER13 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 178.83623497243> <PPL_OOV 156.85079313441> <LOGP -180973.97025543> +[SCHEDULER ITER13 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 13=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER13 LR1]: 40095 words processed Wed Nov 18 00:44:47 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.261017. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48406 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84288 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56977 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12062 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER13 LR1]: Displaying result: +[SCHEDULER ITER13 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 183.60232537013> <PPL_OOV 165.06778643143> <LOGP -163574.77326985> +[SCHEDULER ITER13 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER13 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.13... + +[SCHEDULER ITER14 LR1]: preparing parameters... +[SCHEDULER ITER14 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.13... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1898779 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1903636 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48124723 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48241050 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94286873 +[SCHEDULER ITER14 LR1]: preparing parameters end. +[SCHEDULER ITER14 LR1]: preparing layers... +(00:44:58 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:44:58 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:44:58 2015-11-18)[nerv] info: create layer: combinerL1 +(00:44:58 2015-11-18)[nerv] info: create layer: outputL +(00:44:58 2015-11-18)[nerv] info: create layer: softmaxL +(00:44:58 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER14 LR1]: preparing layers end. +[SCHEDULER ITER14 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER14 LR1]: Initing TNN end. +===ITERATION 14 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER14 LR1]: 40092 words processed Wed Nov 18 00:45:11 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.095183. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48528 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84731 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20431 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00528 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46767 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12588 clock time +[SCHEDULER ITER14 LR1]: 80099 words processed Wed Nov 18 00:45:24 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.099174. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85118 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19616 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99643 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46271 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12632 clock time +[SCHEDULER ITER14 LR1]: 120004 words processed Wed Nov 18 00:45:37 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.095034. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48247 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83246 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15372 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98370 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45672 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12529 clock time +[SCHEDULER ITER14 LR1]: 160114 words processed Wed Nov 18 00:45:51 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.096218. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48290 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84470 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19316 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00413 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46453 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12549 clock time +[SCHEDULER ITER14 LR1]: 200066 words processed Wed Nov 18 00:46:05 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.097160. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49149 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.90569 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.30035 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01638 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47653 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12899 clock time +[SCHEDULER ITER14 LR1]: 240045 words processed Wed Nov 18 00:46:18 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.093351. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47871 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83477 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15275 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98639 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45722 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER14 LR1]: 280057 words processed Wed Nov 18 00:46:32 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.090035. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48170 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84767 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00424 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46981 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER14 LR1]: 320106 words processed Wed Nov 18 00:46:45 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.088070. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47738 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84036 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18189 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00190 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46364 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12496 clock time +[SCHEDULER ITER14 LR1]: 360024 words processed Wed Nov 18 00:46:58 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.087120. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47124 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80709 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10102 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97545 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45292 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12428 clock time +[SCHEDULER ITER14 LR1]: 400089 words processed Wed Nov 18 00:47:11 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.085270. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81891 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14705 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99503 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46280 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12505 clock time +[SCHEDULER ITER14 LR1]: 440067 words processed Wed Nov 18 00:47:24 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.086460. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47253 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80374 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09799 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97581 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45465 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12412 clock time +[SCHEDULER ITER14 LR1]: 480051 words processed Wed Nov 18 00:47:37 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.087289. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47306 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80497 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10176 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97762 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45506 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12453 clock time +[SCHEDULER ITER14 LR1]: 520140 words processed Wed Nov 18 00:47:50 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.088368. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47558 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83290 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17733 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00184 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46859 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12519 clock time +[SCHEDULER ITER14 LR1]: 560132 words processed Wed Nov 18 00:48:03 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.088686. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81538 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11729 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97983 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45580 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12466 clock time +[SCHEDULER ITER14 LR1]: 600118 words processed Wed Nov 18 00:48:16 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.086702. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47095 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80941 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11138 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98111 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45582 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12448 clock time +[SCHEDULER ITER14 LR1]: 640090 words processed Wed Nov 18 00:48:29 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.085500. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46988 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80579 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10243 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97934 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45553 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12414 clock time +[SCHEDULER ITER14 LR1]: 680075 words processed Wed Nov 18 00:48:42 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.084911. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47137 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81021 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10731 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97949 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45439 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12423 clock time +[SCHEDULER ITER14 LR1]: 720043 words processed Wed Nov 18 00:48:55 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.084741. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47391 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82140 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14059 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46048 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12528 clock time +[SCHEDULER ITER14 LR1]: 760012 words processed Wed Nov 18 00:49:08 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.083971. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47404 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81651 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12721 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98398 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45694 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12508 clock time +[SCHEDULER ITER14 LR1]: 800113 words processed Wed Nov 18 00:49:21 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.084458. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47468 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82866 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16822 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00012 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46687 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12549 clock time +[SCHEDULER ITER14 LR1]: 840089 words processed Wed Nov 18 00:49:34 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.083801. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47488 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81981 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13662 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46026 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12459 clock time +[SCHEDULER ITER14 LR1]: 880052 words processed Wed Nov 18 00:49:47 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.084156. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47212 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81549 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12066 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98033 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45712 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12472 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER14 LR1]: Displaying result: +[SCHEDULER ITER14 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 134.49802594387> <PPL_OOV 121.41682391797> <LOGP -1937522.7088048> +[SCHEDULER ITER14 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER14 LR1]: shuffling training file +===PEEK ON TEST 14=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER14 LR1]: 40087 words processed Wed Nov 18 00:49:57 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.194611. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83446 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56400 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12087 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER14 LR1]: Displaying result: +[SCHEDULER ITER14 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 177.38429774111> <PPL_OOV 155.98874342017> <LOGP -180776.6773882> +[SCHEDULER ITER14 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 14=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER14 LR1]: 40095 words processed Wed Nov 18 00:50:08 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.259121. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48138 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81824 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54278 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12005 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER14 LR1]: Displaying result: +[SCHEDULER ITER14 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 182.26000367412> <PPL_OOV 164.19471013401> <LOGP -163404.89173972> +[SCHEDULER ITER14 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER14 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.14... + +[SCHEDULER ITER15 LR1]: preparing parameters... +[SCHEDULER ITER15 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.14... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46044096 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46048953 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92284056 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92400364 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94298070 +[SCHEDULER ITER15 LR1]: preparing parameters end. +[SCHEDULER ITER15 LR1]: preparing layers... +(00:50:18 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:50:18 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:50:18 2015-11-18)[nerv] info: create layer: combinerL1 +(00:50:18 2015-11-18)[nerv] info: create layer: outputL +(00:50:18 2015-11-18)[nerv] info: create layer: softmaxL +(00:50:18 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER15 LR1]: preparing layers end. +[SCHEDULER ITER15 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER15 LR1]: Initing TNN end. +===ITERATION 15 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER15 LR1]: 40092 words processed Wed Nov 18 00:50:31 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.084755. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48456 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83619 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18507 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00208 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46413 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12568 clock time +[SCHEDULER ITER15 LR1]: 80099 words processed Wed Nov 18 00:50:44 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.083071. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48307 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80411 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10743 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97613 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45225 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12520 clock time +[SCHEDULER ITER15 LR1]: 120004 words processed Wed Nov 18 00:50:57 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.079476. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48189 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80686 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11642 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97712 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45290 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12558 clock time +[SCHEDULER ITER15 LR1]: 160114 words processed Wed Nov 18 00:51:10 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.081760. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48315 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82603 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99654 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46150 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12625 clock time +[SCHEDULER ITER15 LR1]: 200066 words processed Wed Nov 18 00:51:23 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.082811. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47749 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80413 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10360 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97585 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45237 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER15 LR1]: 240045 words processed Wed Nov 18 00:51:36 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.079307. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47737 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80264 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09892 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97470 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45130 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12547 clock time +[SCHEDULER ITER15 LR1]: 280057 words processed Wed Nov 18 00:51:49 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.076124. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47945 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81845 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15137 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99428 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46088 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12576 clock time +[SCHEDULER ITER15 LR1]: 320106 words processed Wed Nov 18 00:52:03 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.074328. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48047 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83752 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19090 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00348 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46671 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12689 clock time +[SCHEDULER ITER15 LR1]: 360024 words processed Wed Nov 18 00:52:16 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.073550. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47444 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82126 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13777 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98504 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45708 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12598 clock time +[SCHEDULER ITER15 LR1]: 400089 words processed Wed Nov 18 00:52:29 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.071915. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47546 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83048 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46556 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12653 clock time +[SCHEDULER ITER15 LR1]: 440067 words processed Wed Nov 18 00:52:42 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.073241. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47567 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82187 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13908 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98663 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45818 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12617 clock time +[SCHEDULER ITER15 LR1]: 480051 words processed Wed Nov 18 00:52:55 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.074109. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47480 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82636 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14499 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98766 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45918 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12631 clock time +[SCHEDULER ITER15 LR1]: 520140 words processed Wed Nov 18 00:53:08 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.075079. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47531 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82914 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00094 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46218 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12589 clock time +[SCHEDULER ITER15 LR1]: 560132 words processed Wed Nov 18 00:53:21 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.075447. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47272 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81482 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12029 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98257 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45487 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12636 clock time +[SCHEDULER ITER15 LR1]: 600118 words processed Wed Nov 18 00:53:34 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.073494. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81963 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13379 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98648 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45673 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12585 clock time +[SCHEDULER ITER15 LR1]: 640090 words processed Wed Nov 18 00:53:47 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.072317. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47485 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81078 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11494 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98053 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45463 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12550 clock time +[SCHEDULER ITER15 LR1]: 680075 words processed Wed Nov 18 00:54:00 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.071806. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47567 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82900 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98874 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45880 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12682 clock time +[SCHEDULER ITER15 LR1]: 720043 words processed Wed Nov 18 00:54:13 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.071717. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47223 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80727 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10483 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97748 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45332 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12520 clock time +[SCHEDULER ITER15 LR1]: 760012 words processed Wed Nov 18 00:54:26 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.070849. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47245 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80543 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97837 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45427 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12529 clock time +[SCHEDULER ITER15 LR1]: 800113 words processed Wed Nov 18 00:54:39 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.071356. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47337 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83036 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16661 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99934 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46391 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12608 clock time +[SCHEDULER ITER15 LR1]: 840089 words processed Wed Nov 18 00:54:52 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.070792. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47159 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80588 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10110 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97913 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45147 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER15 LR1]: 880052 words processed Wed Nov 18 00:55:05 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.071187. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47381 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82087 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13882 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98704 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45753 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12682 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER15 LR1]: Displaying result: +[SCHEDULER ITER15 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 130.36860152819> <PPL_OOV 117.84951850067> <LOGP -1925483.5498581> +[SCHEDULER ITER15 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER15 LR1]: shuffling training file +===PEEK ON TEST 15=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER15 LR1]: 40087 words processed Wed Nov 18 00:55:15 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.193578. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48545 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83504 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56477 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12086 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER15 LR1]: Displaying result: +[SCHEDULER ITER15 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 176.622874266> <PPL_OOV 155.5227444733> <LOGP -180669.57212844> +[SCHEDULER ITER15 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 15=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER15 LR1]: 40095 words processed Wed Nov 18 00:55:26 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.258322. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48441 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82182 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54943 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12068 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER15 LR1]: Displaying result: +[SCHEDULER ITER15 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 181.60902176624> <PPL_OOV 163.76844354467> <LOGP -163321.6211386> +[SCHEDULER ITER15 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER15 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.15... + +[SCHEDULER ITER16 LR1]: preparing parameters... +[SCHEDULER ITER16 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.15... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1896582 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1901439 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48151007 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48267317 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94309673 +[SCHEDULER ITER16 LR1]: preparing parameters end. +[SCHEDULER ITER16 LR1]: preparing layers... +(00:55:37 2015-11-18)[nerv] info: create layer: recurrentL1 +(00:55:37 2015-11-18)[nerv] info: create layer: sigmoidL1 +(00:55:37 2015-11-18)[nerv] info: create layer: combinerL1 +(00:55:37 2015-11-18)[nerv] info: create layer: outputL +(00:55:37 2015-11-18)[nerv] info: create layer: softmaxL +(00:55:37 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER16 LR1]: preparing layers end. +[SCHEDULER ITER16 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER16 LR1]: Initing TNN end. +===ITERATION 16 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER16 LR1]: 40092 words processed Wed Nov 18 00:55:50 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.071227. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48352 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82187 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18100 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00859 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47075 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER16 LR1]: 80099 words processed Wed Nov 18 00:56:03 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.072173. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49029 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83847 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18593 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99683 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46302 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12643 clock time +[SCHEDULER ITER16 LR1]: 120004 words processed Wed Nov 18 00:56:16 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.068604. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48425 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82204 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14755 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98562 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45836 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12536 clock time +[SCHEDULER ITER16 LR1]: 160114 words processed Wed Nov 18 00:56:29 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.069902. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81624 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15281 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99791 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46414 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12483 clock time +[SCHEDULER ITER16 LR1]: 200066 words processed Wed Nov 18 00:56:42 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.070775. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47853 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81125 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12364 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45772 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12496 clock time +[SCHEDULER ITER16 LR1]: 240045 words processed Wed Nov 18 00:56:55 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.067488. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47931 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81144 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12349 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98349 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45729 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12504 clock time +[SCHEDULER ITER16 LR1]: 280057 words processed Wed Nov 18 00:57:09 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.064263. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48363 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82973 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19167 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00886 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46967 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12544 clock time +[SCHEDULER ITER16 LR1]: 320106 words processed Wed Nov 18 00:57:22 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.062450. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47732 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82964 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17934 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00413 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46965 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12550 clock time +[SCHEDULER ITER16 LR1]: 360024 words processed Wed Nov 18 00:57:35 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.061649. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47227 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79884 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09840 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97862 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45604 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12442 clock time +[SCHEDULER ITER16 LR1]: 400089 words processed Wed Nov 18 00:57:48 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.059971. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47477 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82120 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15848 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00067 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46666 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12554 clock time +[SCHEDULER ITER16 LR1]: 440067 words processed Wed Nov 18 00:58:01 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.061392. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47253 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79939 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09898 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97950 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45727 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12445 clock time +[SCHEDULER ITER16 LR1]: 480051 words processed Wed Nov 18 00:58:14 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.062296. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47135 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79912 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97840 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45543 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12455 clock time +[SCHEDULER ITER16 LR1]: 520140 words processed Wed Nov 18 00:58:27 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.062546. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47370 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80748 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12849 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99300 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46253 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12442 clock time +[SCHEDULER ITER16 LR1]: 560132 words processed Wed Nov 18 00:58:40 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.063029. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47221 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79284 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08114 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45313 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12431 clock time +[SCHEDULER ITER16 LR1]: 600118 words processed Wed Nov 18 00:58:53 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.061276. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47216 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80477 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10875 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98306 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45775 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12440 clock time +[SCHEDULER ITER16 LR1]: 640090 words processed Wed Nov 18 00:59:06 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.060129. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47336 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81350 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11917 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98273 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45712 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12494 clock time +[SCHEDULER ITER16 LR1]: 680075 words processed Wed Nov 18 00:59:19 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.059711. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47198 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79441 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08449 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97632 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45365 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12426 clock time +[SCHEDULER ITER16 LR1]: 720043 words processed Wed Nov 18 00:59:32 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.059707. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47252 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79452 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08711 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97585 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45428 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12452 clock time +[SCHEDULER ITER16 LR1]: 760012 words processed Wed Nov 18 00:59:45 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.059127. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47173 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79547 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08641 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97585 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45337 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12426 clock time +[SCHEDULER ITER16 LR1]: 800113 words processed Wed Nov 18 00:59:58 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.059780. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47525 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81711 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15106 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99926 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46492 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12552 clock time +[SCHEDULER ITER16 LR1]: 840089 words processed Wed Nov 18 01:00:11 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.059387. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47223 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80847 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11131 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98269 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45646 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12478 clock time +[SCHEDULER ITER16 LR1]: 880052 words processed Wed Nov 18 01:00:24 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.059834. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47305 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80350 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10329 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98000 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45519 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12423 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER16 LR1]: Displaying result: +[SCHEDULER ITER16 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 126.85826557967> <PPL_OOV 114.80783342275> <LOGP -1914926.8665176> +[SCHEDULER ITER16 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER16 LR1]: shuffling training file +===PEEK ON TEST 16=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER16 LR1]: 40087 words processed Wed Nov 18 01:00:34 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.189529. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48442 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82575 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55181 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11996 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER16 LR1]: Displaying result: +[SCHEDULER ITER16 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 175.63446833412> <PPL_OOV 154.27206703806> <LOGP -180380.52201727> +[SCHEDULER ITER16 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 16=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER16 LR1]: 40095 words processed Wed Nov 18 01:00:45 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.255335. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48288 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81055 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53316 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11933 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER16 LR1]: Displaying result: +[SCHEDULER ITER16 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 180.57065508419> <PPL_OOV 162.50437885542> <LOGP -163073.40741604> +[SCHEDULER ITER16 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER16 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.16... + +[SCHEDULER ITER17 LR1]: preparing parameters... +[SCHEDULER ITER17 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.16... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46040789 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46045646 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92309964 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92426275 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94321898 +[SCHEDULER ITER17 LR1]: preparing parameters end. +[SCHEDULER ITER17 LR1]: preparing layers... +(01:00:55 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:00:55 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:00:55 2015-11-18)[nerv] info: create layer: combinerL1 +(01:00:55 2015-11-18)[nerv] info: create layer: outputL +(01:00:55 2015-11-18)[nerv] info: create layer: softmaxL +(01:00:55 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER17 LR1]: preparing layers end. +[SCHEDULER ITER17 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER17 LR1]: Initing TNN end. +===ITERATION 17 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER17 LR1]: 40092 words processed Wed Nov 18 01:01:08 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.062199. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48728 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83177 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18654 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46800 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12646 clock time +[SCHEDULER ITER17 LR1]: 80099 words processed Wed Nov 18 01:01:21 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.061475. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48785 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80911 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12331 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97954 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45429 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12540 clock time +[SCHEDULER ITER17 LR1]: 120004 words processed Wed Nov 18 01:01:34 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.057783. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48591 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81042 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12768 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97854 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45592 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12537 clock time +[SCHEDULER ITER17 LR1]: 160114 words processed Wed Nov 18 01:01:47 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.058875. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48542 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82748 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17403 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99900 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46582 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12628 clock time +[SCHEDULER ITER17 LR1]: 200066 words processed Wed Nov 18 01:02:01 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.060098. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48662 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84265 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99358 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46418 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12771 clock time +[SCHEDULER ITER17 LR1]: 240045 words processed Wed Nov 18 01:02:14 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.056824. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81026 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12242 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97948 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45699 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12575 clock time +[SCHEDULER ITER17 LR1]: 280057 words processed Wed Nov 18 01:02:27 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.053589. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48000 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80796 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13087 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98814 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45983 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER17 LR1]: 320106 words processed Wed Nov 18 01:02:40 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.051827. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47795 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80612 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12633 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98853 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45942 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12524 clock time +[SCHEDULER ITER17 LR1]: 360024 words processed Wed Nov 18 01:02:53 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.051082. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47468 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79486 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08611 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97118 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45242 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12494 clock time +[SCHEDULER ITER17 LR1]: 400089 words processed Wed Nov 18 01:03:06 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.049413. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81092 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13070 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98900 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46041 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12524 clock time +[SCHEDULER ITER17 LR1]: 440067 words processed Wed Nov 18 01:03:19 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.050777. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47517 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79671 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08933 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97371 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45253 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12497 clock time +[SCHEDULER ITER17 LR1]: 480051 words processed Wed Nov 18 01:03:32 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.051765. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47618 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80279 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10402 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97887 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45532 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12547 clock time +[SCHEDULER ITER17 LR1]: 520140 words processed Wed Nov 18 01:03:45 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.051868. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47970 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83054 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17472 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00078 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46555 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12646 clock time +[SCHEDULER ITER17 LR1]: 560132 words processed Wed Nov 18 01:03:58 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.052340. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47485 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79523 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08696 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97310 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45427 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12519 clock time +[SCHEDULER ITER17 LR1]: 600118 words processed Wed Nov 18 01:04:11 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.050566. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47702 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81171 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12312 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98227 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45727 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12570 clock time +[SCHEDULER ITER17 LR1]: 640090 words processed Wed Nov 18 01:04:25 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.049437. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48534 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84783 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19991 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99801 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46757 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12825 clock time +[SCHEDULER ITER17 LR1]: 680075 words processed Wed Nov 18 01:04:38 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.048901. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47485 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80044 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09377 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97399 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45403 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12519 clock time +[SCHEDULER ITER17 LR1]: 720043 words processed Wed Nov 18 01:04:51 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.048947. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47545 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81309 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11944 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45623 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12540 clock time +[SCHEDULER ITER17 LR1]: 760012 words processed Wed Nov 18 01:05:04 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.048059. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81062 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11812 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45612 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12571 clock time +[SCHEDULER ITER17 LR1]: 800113 words processed Wed Nov 18 01:05:17 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.048592. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81254 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13452 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46283 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12551 clock time +[SCHEDULER ITER17 LR1]: 840089 words processed Wed Nov 18 01:05:30 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.048633. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47424 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79503 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08244 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97079 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45369 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12441 clock time +[SCHEDULER ITER17 LR1]: 880052 words processed Wed Nov 18 01:05:43 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.049066. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47531 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79665 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09063 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97217 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45440 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12503 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER17 LR1]: Displaying result: +[SCHEDULER ITER17 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 123.60939506581> <PPL_OOV 111.9929795575> <LOGP -1904905.2257849> +[SCHEDULER ITER17 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER17 LR1]: shuffling training file +===PEEK ON TEST 17=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER17 LR1]: 40087 words processed Wed Nov 18 01:05:53 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.189179. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48615 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82317 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55264 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12116 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER17 LR1]: Displaying result: +[SCHEDULER ITER17 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 175.34178481977> <PPL_OOV 153.96296950286> <LOGP -180308.72386106> +[SCHEDULER ITER17 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 17=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER17 LR1]: 40095 words processed Wed Nov 18 01:06:04 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.254521. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49475 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86100 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.60289 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12272 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER17 LR1]: Displaying result: +[SCHEDULER ITER17 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 180.65506161296> <PPL_OOV 162.51420142726> <LOGP -163075.34362507> +[SCHEDULER ITER17 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER17 LR1]: PPL did not improve, rejected, copying param file of last iter... + +[SCHEDULER ITER18 LR0.6]: preparing parameters... +[SCHEDULER ITER18 LR0.6]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.17... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46040789 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46045646 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92309964 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92426275 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94321898 +[SCHEDULER ITER18 LR0.6]: preparing parameters end. +[SCHEDULER ITER18 LR0.6]: preparing layers... +(01:06:13 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:06:13 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:06:13 2015-11-18)[nerv] info: create layer: combinerL1 +(01:06:13 2015-11-18)[nerv] info: create layer: outputL +(01:06:13 2015-11-18)[nerv] info: create layer: softmaxL +(01:06:13 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER18 LR0.6]: preparing layers end. +[SCHEDULER ITER18 LR0.6]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER18 LR0.6]: Initing TNN end. +===ITERATION 18 LR 0.600000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER18 LR0.6]: 40092 words processed Wed Nov 18 01:06:26 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.034654. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48302 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81674 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16711 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00550 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46551 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12516 clock time +[SCHEDULER ITER18 LR0.6]: 80099 words processed Wed Nov 18 01:06:39 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.029461. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48300 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80074 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11257 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98268 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45412 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12464 clock time +[SCHEDULER ITER18 LR0.6]: 120004 words processed Wed Nov 18 01:06:52 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.023381. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48143 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80204 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11946 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98410 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45440 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12516 clock time +[SCHEDULER ITER18 LR0.6]: 160114 words processed Wed Nov 18 01:07:05 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.023577. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48289 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82836 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18506 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00914 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46643 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12606 clock time +[SCHEDULER ITER18 LR0.6]: 200066 words processed Wed Nov 18 01:07:18 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.022745. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48104 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82342 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15667 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99391 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46014 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12594 clock time +[SCHEDULER ITER18 LR0.6]: 240045 words processed Wed Nov 18 01:07:31 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.018657. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48474 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83350 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17912 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99889 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46213 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12614 clock time +[SCHEDULER ITER18 LR0.6]: 280057 words processed Wed Nov 18 01:07:44 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.014651. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47989 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81670 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16669 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00640 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46395 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12532 clock time +[SCHEDULER ITER18 LR0.6]: 320106 words processed Wed Nov 18 01:07:58 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.012165. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47996 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83043 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19208 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01019 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46886 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12626 clock time +[SCHEDULER ITER18 LR0.6]: 360024 words processed Wed Nov 18 01:08:11 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.010607. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47574 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80811 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12716 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98808 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45696 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12513 clock time +[SCHEDULER ITER18 LR0.6]: 400089 words processed Wed Nov 18 01:08:24 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.008116. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47543 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81228 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15047 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46302 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12562 clock time +[SCHEDULER ITER18 LR0.6]: 440067 words processed Wed Nov 18 01:08:37 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.008955. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47444 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80505 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11756 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98790 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45546 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12536 clock time +[SCHEDULER ITER18 LR0.6]: 480051 words processed Wed Nov 18 01:08:50 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.009446. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47447 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80237 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11394 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98659 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45639 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12575 clock time +[SCHEDULER ITER18 LR0.6]: 520140 words processed Wed Nov 18 01:09:03 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.008913. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47509 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82843 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18219 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46580 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12611 clock time +[SCHEDULER ITER18 LR0.6]: 560132 words processed Wed Nov 18 01:09:16 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.008798. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47312 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80083 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10620 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98484 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45492 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12507 clock time +[SCHEDULER ITER18 LR0.6]: 600118 words processed Wed Nov 18 01:09:29 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.006422. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47252 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79868 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10355 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98489 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45437 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12484 clock time +[SCHEDULER ITER18 LR0.6]: 640090 words processed Wed Nov 18 01:09:42 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.004642. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79893 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10198 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45374 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12495 clock time +[SCHEDULER ITER18 LR0.6]: 680075 words processed Wed Nov 18 01:09:55 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.003595. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47203 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79915 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10271 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98452 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45403 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12503 clock time +[SCHEDULER ITER18 LR0.6]: 720043 words processed Wed Nov 18 01:10:08 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.002975. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47284 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80093 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10834 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98545 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45358 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12515 clock time +[SCHEDULER ITER18 LR0.6]: 760012 words processed Wed Nov 18 01:10:21 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.001556. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47227 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80161 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10848 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98439 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45538 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12472 clock time +[SCHEDULER ITER18 LR0.6]: 800113 words processed Wed Nov 18 01:10:34 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.001687. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81334 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15539 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00615 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46446 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12565 clock time +[SCHEDULER ITER18 LR0.6]: 840089 words processed Wed Nov 18 01:10:47 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.000731. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47482 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80950 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13080 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99234 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45832 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12578 clock time +[SCHEDULER ITER18 LR0.6]: 880052 words processed Wed Nov 18 01:11:00 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.000778. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47317 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80655 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12254 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98965 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45621 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12559 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER18 LR0.6]: Displaying result: +[SCHEDULER ITER18 LR0.6]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 110.74585638614> <PPL_OOV 100.1904092633> <LOGP -1859945.9805466> +[SCHEDULER ITER18 LR0.6]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER18 LR0.6]: shuffling training file +===PEEK ON TEST 18=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER18 LR0.6]: 40087 words processed Wed Nov 18 01:11:10 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.161595. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48174 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81049 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53468 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12008 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER18 LR0.6]: Displaying result: +[SCHEDULER ITER18 LR0.6]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 164.90330871157> <PPL_OOV 144.87847735377> <LOGP -178131.5492493> +[SCHEDULER ITER18 LR0.6]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 18=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER18 LR0.6]: 40095 words processed Wed Nov 18 01:11:21 2015. + [SCHEDULER ITER18 LR0.6]: log prob per sample :-2.230499. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48352 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83333 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56178 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12079 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER18 LR0.6]: Displaying result: +[SCHEDULER ITER18 LR0.6]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 169.96685846585> <PPL_OOV 152.97725438205> <LOGP -161138.07734034> +[SCHEDULER ITER18 LR0.6]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER18 LR0.6]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.18... + +[SCHEDULER ITER19 LR0.36]: preparing parameters... +[SCHEDULER ITER19 LR0.36]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.18... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1894502 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1899358 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48169801 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48286086 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94324698 +[SCHEDULER ITER19 LR0.36]: preparing parameters end. +[SCHEDULER ITER19 LR0.36]: preparing layers... +(01:11:32 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:11:32 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:11:32 2015-11-18)[nerv] info: create layer: combinerL1 +(01:11:32 2015-11-18)[nerv] info: create layer: outputL +(01:11:32 2015-11-18)[nerv] info: create layer: softmaxL +(01:11:32 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER19 LR0.36]: preparing layers end. +[SCHEDULER ITER19 LR0.36]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER19 LR0.36]: Initing TNN end. +===ITERATION 19 LR 0.360000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER19 LR0.36]: 40092 words processed Wed Nov 18 01:11:45 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.997246. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48337 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83523 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14578 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96110 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47066 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12557 clock time +[SCHEDULER ITER19 LR0.36]: 80099 words processed Wed Nov 18 01:11:58 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.992757. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48320 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81225 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07212 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93276 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45445 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12519 clock time +[SCHEDULER ITER19 LR0.36]: 120004 words processed Wed Nov 18 01:12:11 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.986713. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82508 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93910 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45665 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12523 clock time +[SCHEDULER ITER19 LR0.36]: 160114 words processed Wed Nov 18 01:12:24 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.987052. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48156 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82649 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11571 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95162 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46376 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12590 clock time +[SCHEDULER ITER19 LR0.36]: 200066 words processed Wed Nov 18 01:12:37 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.986163. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47823 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80995 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.06602 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93252 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45416 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12543 clock time +[SCHEDULER ITER19 LR0.36]: 240045 words processed Wed Nov 18 01:12:50 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.982070. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47732 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81336 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.06981 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93356 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45468 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER19 LR0.36]: 280057 words processed Wed Nov 18 01:13:03 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.978092. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48029 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83367 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12984 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95412 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46432 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12625 clock time +[SCHEDULER ITER19 LR0.36]: 320106 words processed Wed Nov 18 01:13:16 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.975588. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82115 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10377 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94946 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46156 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12553 clock time +[SCHEDULER ITER19 LR0.36]: 360024 words processed Wed Nov 18 01:13:29 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.973917. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47333 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81012 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.06674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93471 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45467 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12565 clock time +[SCHEDULER ITER19 LR0.36]: 400089 words processed Wed Nov 18 01:13:42 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.971239. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82368 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10715 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95074 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46450 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12580 clock time +[SCHEDULER ITER19 LR0.36]: 440067 words processed Wed Nov 18 01:13:55 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.971940. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47275 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81082 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.06387 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93498 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45465 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12528 clock time +[SCHEDULER ITER19 LR0.36]: 480051 words processed Wed Nov 18 01:14:08 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.972298. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47460 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81485 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07065 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93581 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45494 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12556 clock time +[SCHEDULER ITER19 LR0.36]: 520140 words processed Wed Nov 18 01:14:21 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.971580. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84443 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96062 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46957 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12682 clock time +[SCHEDULER ITER19 LR0.36]: 560132 words processed Wed Nov 18 01:14:34 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.971346. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47320 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81781 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07939 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93985 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45759 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12560 clock time +[SCHEDULER ITER19 LR0.36]: 600118 words processed Wed Nov 18 01:14:47 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.968877. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81593 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07123 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93519 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45555 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12544 clock time +[SCHEDULER ITER19 LR0.36]: 640090 words processed Wed Nov 18 01:15:00 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.966946. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47244 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82273 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08904 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94022 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45997 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12622 clock time +[SCHEDULER ITER19 LR0.36]: 680075 words processed Wed Nov 18 01:15:13 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.965667. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47457 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82104 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08486 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93996 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45677 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12559 clock time +[SCHEDULER ITER19 LR0.36]: 720043 words processed Wed Nov 18 01:15:26 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.964819. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47250 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81494 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.06603 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45369 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12483 clock time +[SCHEDULER ITER19 LR0.36]: 760012 words processed Wed Nov 18 01:15:39 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.963124. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47257 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80951 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.05946 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93174 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45462 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12503 clock time +[SCHEDULER ITER19 LR0.36]: 800113 words processed Wed Nov 18 01:15:52 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.963080. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47487 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82290 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94976 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46399 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12593 clock time +[SCHEDULER ITER19 LR0.36]: 840089 words processed Wed Nov 18 01:16:05 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.961911. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47223 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81142 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.06024 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93225 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45400 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12518 clock time +[SCHEDULER ITER19 LR0.36]: 880052 words processed Wed Nov 18 01:16:18 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-1.961727. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47431 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81524 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.07453 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93706 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45511 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12509 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER19 LR0.36]: Displaying result: +[SCHEDULER ITER19 LR0.36]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 101.04384865279> <PPL_OOV 91.563922711843> <LOGP -1823597.4140822> +[SCHEDULER ITER19 LR0.36]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER19 LR0.36]: shuffling training file +===PEEK ON TEST 19=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER19 LR0.36]: 40087 words processed Wed Nov 18 01:16:28 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-2.140997. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48333 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82854 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55619 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12069 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER19 LR0.36]: Displaying result: +[SCHEDULER ITER19 LR0.36]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 158.06285532222> <PPL_OOV 138.43309683958> <LOGP -176502.40779745> +[SCHEDULER ITER19 LR0.36]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 19=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER19 LR0.36]: 40095 words processed Wed Nov 18 01:16:39 2015. + [SCHEDULER ITER19 LR0.36]: log prob per sample :-2.212296. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48255 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82158 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54767 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12047 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER19 LR0.36]: Displaying result: +[SCHEDULER ITER19 LR0.36]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 162.89537467304> <PPL_OOV 146.24730311894> <LOGP -159696.88101076> +[SCHEDULER ITER19 LR0.36]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER19 LR0.36]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.19... + +[SCHEDULER ITER20 LR0.216]: preparing parameters... +[SCHEDULER ITER20 LR0.216]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.19... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46037538 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46042394 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92315401 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92431688 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94325528 +[SCHEDULER ITER20 LR0.216]: preparing parameters end. +[SCHEDULER ITER20 LR0.216]: preparing layers... +(01:16:49 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:16:49 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:16:49 2015-11-18)[nerv] info: create layer: combinerL1 +(01:16:49 2015-11-18)[nerv] info: create layer: outputL +(01:16:49 2015-11-18)[nerv] info: create layer: softmaxL +(01:16:49 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER20 LR0.216]: preparing layers end. +[SCHEDULER ITER20 LR0.216]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER20 LR0.216]: Initing TNN end. +===ITERATION 20 LR 0.216000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER20 LR0.216]: 40092 words processed Wed Nov 18 01:17:02 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.971285. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48490 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81386 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17711 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01522 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46703 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12504 clock time +[SCHEDULER ITER20 LR0.216]: 80099 words processed Wed Nov 18 01:17:15 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.967177. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48493 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79211 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11219 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99015 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45435 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12431 clock time +[SCHEDULER ITER20 LR0.216]: 120004 words processed Wed Nov 18 01:17:29 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.961339. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49334 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84971 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.23529 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01601 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46915 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12819 clock time +[SCHEDULER ITER20 LR0.216]: 160114 words processed Wed Nov 18 01:17:43 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.961815. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48681 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83328 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20952 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01934 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47159 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12602 clock time +[SCHEDULER ITER20 LR0.216]: 200066 words processed Wed Nov 18 01:17:56 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.960939. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48100 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80087 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12810 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99400 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45714 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12584 clock time +[SCHEDULER ITER20 LR0.216]: 240045 words processed Wed Nov 18 01:18:09 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.957003. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48078 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80500 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13672 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99792 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45731 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER20 LR0.216]: 280057 words processed Wed Nov 18 01:18:22 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.953001. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47997 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80453 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14805 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00615 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46150 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12495 clock time +[SCHEDULER ITER20 LR0.216]: 320106 words processed Wed Nov 18 01:18:35 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.950491. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47822 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81004 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16030 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01066 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46424 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12527 clock time +[SCHEDULER ITER20 LR0.216]: 360024 words processed Wed Nov 18 01:18:48 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.948777. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47758 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81402 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15338 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00054 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46180 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12530 clock time +[SCHEDULER ITER20 LR0.216]: 400089 words processed Wed Nov 18 01:19:01 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.946006. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47781 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81768 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17665 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01590 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46693 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12567 clock time +[SCHEDULER ITER20 LR0.216]: 440067 words processed Wed Nov 18 01:19:14 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.946610. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47449 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79239 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10364 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99062 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45455 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12471 clock time +[SCHEDULER ITER20 LR0.216]: 480051 words processed Wed Nov 18 01:19:27 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.946897. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79401 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10385 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98993 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45517 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12457 clock time +[SCHEDULER ITER20 LR0.216]: 520140 words processed Wed Nov 18 01:19:40 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.946042. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80433 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14620 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00785 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46384 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12477 clock time +[SCHEDULER ITER20 LR0.216]: 560132 words processed Wed Nov 18 01:19:53 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.945762. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47490 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79400 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10434 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99027 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45466 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12491 clock time +[SCHEDULER ITER20 LR0.216]: 600118 words processed Wed Nov 18 01:20:06 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.943262. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47652 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79429 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10431 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98952 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45270 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12459 clock time +[SCHEDULER ITER20 LR0.216]: 640090 words processed Wed Nov 18 01:20:19 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.941123. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79915 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11541 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99433 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45534 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12477 clock time +[SCHEDULER ITER20 LR0.216]: 680075 words processed Wed Nov 18 01:20:32 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.939704. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47352 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79202 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09742 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98874 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45320 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12426 clock time +[SCHEDULER ITER20 LR0.216]: 720043 words processed Wed Nov 18 01:20:45 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.938719. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47342 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79318 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10413 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98964 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45573 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12471 clock time +[SCHEDULER ITER20 LR0.216]: 760012 words processed Wed Nov 18 01:20:58 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.936838. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47371 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79094 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09979 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98961 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45390 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12449 clock time +[SCHEDULER ITER20 LR0.216]: 800113 words processed Wed Nov 18 01:21:11 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.936684. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47558 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81009 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15084 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00722 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46232 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12532 clock time +[SCHEDULER ITER20 LR0.216]: 840089 words processed Wed Nov 18 01:21:24 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.935410. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47494 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79429 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11046 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99310 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45614 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12487 clock time +[SCHEDULER ITER20 LR0.216]: 880052 words processed Wed Nov 18 01:21:37 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-1.935097. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47505 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80100 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11845 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99265 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45551 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12503 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER20 LR0.216]: Displaying result: +[SCHEDULER ITER20 LR0.216]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 94.898460529851> <PPL_OOV 86.111949954208> <LOGP -1798813.6729592> +[SCHEDULER ITER20 LR0.216]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER20 LR0.216]: shuffling training file +===PEEK ON TEST 20=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER20 LR0.216]: 40087 words processed Wed Nov 18 01:21:47 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-2.126993. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48508 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81619 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54602 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12089 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER20 LR0.216]: Displaying result: +[SCHEDULER ITER20 LR0.216]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 153.58878986833> <PPL_OOV 134.20795124944> <LOGP -175392.76087493> +[SCHEDULER ITER20 LR0.216]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 20=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER20 LR0.216]: 40095 words processed Wed Nov 18 01:21:58 2015. + [SCHEDULER ITER20 LR0.216]: log prob per sample :-2.199927. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49645 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87344 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.62012 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12341 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER20 LR0.216]: Displaying result: +[SCHEDULER ITER20 LR0.216]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 158.13661700941> <PPL_OOV 141.70454298301> <LOGP -158686.06715207> +[SCHEDULER ITER20 LR0.216]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER20 LR0.216]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.20... + +[SCHEDULER ITER21 LR0.1296]: preparing parameters... +[SCHEDULER ITER21 LR0.1296]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.20... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1893265 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1898120 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48171853 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48288138 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94324725 +[SCHEDULER ITER21 LR0.1296]: preparing parameters end. +[SCHEDULER ITER21 LR0.1296]: preparing layers... +(01:22:09 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:22:09 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:22:09 2015-11-18)[nerv] info: create layer: combinerL1 +(01:22:09 2015-11-18)[nerv] info: create layer: outputL +(01:22:09 2015-11-18)[nerv] info: create layer: softmaxL +(01:22:09 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER21 LR0.1296]: preparing layers end. +[SCHEDULER ITER21 LR0.1296]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER21 LR0.1296]: Initing TNN end. +===ITERATION 21 LR 0.129600=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER21 LR0.1296]: 40092 words processed Wed Nov 18 01:22:22 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.953742. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48466 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83535 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17975 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99809 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46582 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12606 clock time +[SCHEDULER ITER21 LR0.1296]: 80099 words processed Wed Nov 18 01:22:35 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.949666. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48757 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82389 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14037 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45800 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12579 clock time +[SCHEDULER ITER21 LR0.1296]: 120004 words processed Wed Nov 18 01:22:48 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.944000. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48683 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82121 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13862 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97701 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45749 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12537 clock time +[SCHEDULER ITER21 LR0.1296]: 160114 words processed Wed Nov 18 01:23:01 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.944525. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48415 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83058 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16651 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99290 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46397 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12650 clock time +[SCHEDULER ITER21 LR0.1296]: 200066 words processed Wed Nov 18 01:23:14 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.943686. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47849 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81428 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11347 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97365 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45445 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12575 clock time +[SCHEDULER ITER21 LR0.1296]: 240045 words processed Wed Nov 18 01:23:27 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.939797. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47838 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81217 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97211 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45482 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12543 clock time +[SCHEDULER ITER21 LR0.1296]: 280057 words processed Wed Nov 18 01:23:40 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.935800. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82627 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15537 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99014 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46332 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12574 clock time +[SCHEDULER ITER21 LR0.1296]: 320106 words processed Wed Nov 18 01:23:53 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.933277. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48028 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83419 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17437 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99664 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46524 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12640 clock time +[SCHEDULER ITER21 LR0.1296]: 360024 words processed Wed Nov 18 01:24:06 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.931540. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47296 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81386 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11143 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97410 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45545 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12556 clock time +[SCHEDULER ITER21 LR0.1296]: 400089 words processed Wed Nov 18 01:24:19 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.928721. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84280 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99775 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46928 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12643 clock time +[SCHEDULER ITER21 LR0.1296]: 440067 words processed Wed Nov 18 01:24:32 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.929267. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47607 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83071 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14605 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98428 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46017 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12593 clock time +[SCHEDULER ITER21 LR0.1296]: 480051 words processed Wed Nov 18 01:24:45 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.929487. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47603 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83625 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14747 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98174 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45954 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12603 clock time +[SCHEDULER ITER21 LR0.1296]: 520140 words processed Wed Nov 18 01:24:58 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.928578. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47611 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83502 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17137 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99574 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46753 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12621 clock time +[SCHEDULER ITER21 LR0.1296]: 560132 words processed Wed Nov 18 01:25:11 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.928258. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47394 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81255 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10599 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45465 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12561 clock time +[SCHEDULER ITER21 LR0.1296]: 600118 words processed Wed Nov 18 01:25:24 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.925730. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47340 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80920 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09843 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97168 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45324 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12514 clock time +[SCHEDULER ITER21 LR0.1296]: 640090 words processed Wed Nov 18 01:25:37 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.923506. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47300 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81370 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10628 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97279 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45571 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12543 clock time +[SCHEDULER ITER21 LR0.1296]: 680075 words processed Wed Nov 18 01:25:51 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.922004. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48580 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.88188 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.24231 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99948 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47226 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12863 clock time +[SCHEDULER ITER21 LR0.1296]: 720043 words processed Wed Nov 18 01:26:04 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.920910. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84278 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16868 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98455 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46271 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12712 clock time +[SCHEDULER ITER21 LR0.1296]: 760012 words processed Wed Nov 18 01:26:17 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.918898. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47332 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81215 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10523 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97202 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45502 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12542 clock time +[SCHEDULER ITER21 LR0.1296]: 800113 words processed Wed Nov 18 01:26:30 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.918661. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47582 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82656 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15045 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46417 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12562 clock time +[SCHEDULER ITER21 LR0.1296]: 840089 words processed Wed Nov 18 01:26:43 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.917307. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47427 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81547 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11317 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97564 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45612 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12585 clock time +[SCHEDULER ITER21 LR0.1296]: 880052 words processed Wed Nov 18 01:26:57 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.916896. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48529 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86668 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.22246 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99682 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46953 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12801 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER21 LR0.1296]: Displaying result: +[SCHEDULER ITER21 LR0.1296]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 90.907806161562> <PPL_OOV 82.571896416466> <LOGP -1781866.1828926> +[SCHEDULER ITER21 LR0.1296]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER21 LR0.1296]: shuffling training file +===PEEK ON TEST 21=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER21 LR0.1296]: 40087 words processed Wed Nov 18 01:27:07 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-2.117906. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48806 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83744 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.57050 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12119 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER21 LR0.1296]: Displaying result: +[SCHEDULER ITER21 LR0.1296]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 150.8337307801> <PPL_OOV 131.59012321961> <LOGP -174687.57609084> +[SCHEDULER ITER21 LR0.1296]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 21=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER21 LR0.1296]: 40095 words processed Wed Nov 18 01:27:18 2015. + [SCHEDULER ITER21 LR0.1296]: log prob per sample :-2.192129. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48533 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83460 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56408 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12082 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER21 LR0.1296]: Displaying result: +[SCHEDULER ITER21 LR0.1296]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 155.17968513367> <PPL_OOV 138.8677647813> <LOGP -158038.28259389> +[SCHEDULER ITER21 LR0.1296]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER21 LR0.1296]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.21... + +[SCHEDULER ITER22 LR0.07776]: preparing parameters... +[SCHEDULER ITER22 LR0.07776]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.21... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46035890 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46040744 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92314595 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92430868 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94323820 +[SCHEDULER ITER22 LR0.07776]: preparing parameters end. +[SCHEDULER ITER22 LR0.07776]: preparing layers... +(01:27:29 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:27:29 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:27:29 2015-11-18)[nerv] info: create layer: combinerL1 +(01:27:29 2015-11-18)[nerv] info: create layer: outputL +(01:27:29 2015-11-18)[nerv] info: create layer: softmaxL +(01:27:29 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER22 LR0.07776]: preparing layers end. +[SCHEDULER ITER22 LR0.07776]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER22 LR0.07776]: Initing TNN end. +===ITERATION 22 LR 0.077760=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER22 LR0.07776]: 40092 words processed Wed Nov 18 01:27:42 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.941315. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48716 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82201 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18787 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01553 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46644 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12532 clock time +[SCHEDULER ITER22 LR0.07776]: 80099 words processed Wed Nov 18 01:27:55 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.937218. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48494 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80214 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12705 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99292 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45568 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12482 clock time +[SCHEDULER ITER22 LR0.07776]: 120004 words processed Wed Nov 18 01:28:08 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.931731. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48239 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79921 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12549 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99342 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45448 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12500 clock time +[SCHEDULER ITER22 LR0.07776]: 160114 words processed Wed Nov 18 01:28:21 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.932309. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48095 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80595 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14765 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00583 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46196 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12482 clock time +[SCHEDULER ITER22 LR0.07776]: 200066 words processed Wed Nov 18 01:28:34 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.931543. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47672 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79543 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10446 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98775 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45265 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12452 clock time +[SCHEDULER ITER22 LR0.07776]: 240045 words processed Wed Nov 18 01:28:47 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.927720. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47718 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79387 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10554 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98946 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45351 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12460 clock time +[SCHEDULER ITER22 LR0.07776]: 280057 words processed Wed Nov 18 01:29:00 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.923755. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48090 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81733 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17272 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01077 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46531 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12514 clock time +[SCHEDULER ITER22 LR0.07776]: 320106 words processed Wed Nov 18 01:29:13 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.921251. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47763 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81856 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17521 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01408 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46592 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12537 clock time +[SCHEDULER ITER22 LR0.07776]: 360024 words processed Wed Nov 18 01:29:27 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.919522. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47894 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83634 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19469 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01143 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46466 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12666 clock time +[SCHEDULER ITER22 LR0.07776]: 400089 words processed Wed Nov 18 01:29:40 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.916686. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47599 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81898 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17288 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01459 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46635 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12549 clock time +[SCHEDULER ITER22 LR0.07776]: 440067 words processed Wed Nov 18 01:29:53 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.917239. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47406 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80400 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12217 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45696 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12495 clock time +[SCHEDULER ITER22 LR0.07776]: 480051 words processed Wed Nov 18 01:30:06 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.917423. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47387 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80608 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12823 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99653 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45824 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12519 clock time +[SCHEDULER ITER22 LR0.07776]: 520140 words processed Wed Nov 18 01:30:19 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.916502. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47488 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81649 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16770 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01344 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46653 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12511 clock time +[SCHEDULER ITER22 LR0.07776]: 560132 words processed Wed Nov 18 01:30:32 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.916174. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47542 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81849 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15873 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00673 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46144 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12556 clock time +[SCHEDULER ITER22 LR0.07776]: 600118 words processed Wed Nov 18 01:30:45 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.913629. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47519 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80482 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12689 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99649 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45696 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12518 clock time +[SCHEDULER ITER22 LR0.07776]: 640090 words processed Wed Nov 18 01:30:58 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.911354. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47237 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80166 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12156 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99638 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45834 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12485 clock time +[SCHEDULER ITER22 LR0.07776]: 680075 words processed Wed Nov 18 01:31:11 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.909822. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47266 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79619 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10592 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99131 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45421 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12491 clock time +[SCHEDULER ITER22 LR0.07776]: 720043 words processed Wed Nov 18 01:31:24 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.908650. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47316 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79780 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11068 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99133 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45608 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12443 clock time +[SCHEDULER ITER22 LR0.07776]: 760012 words processed Wed Nov 18 01:31:37 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.906572. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47185 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79590 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10399 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99019 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45390 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12407 clock time +[SCHEDULER ITER22 LR0.07776]: 800113 words processed Wed Nov 18 01:31:50 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.906280. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47450 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81422 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16263 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01155 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46616 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER22 LR0.07776]: 840089 words processed Wed Nov 18 01:32:03 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.904877. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80432 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12632 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99762 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45794 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12469 clock time +[SCHEDULER ITER22 LR0.07776]: 880052 words processed Wed Nov 18 01:32:16 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.904405. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47315 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80183 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12143 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99656 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45471 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12539 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER22 LR0.07776]: Displaying result: +[SCHEDULER ITER22 LR0.07776]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 88.265236341464> <PPL_OOV 80.226713919465> <LOGP -1770233.9985122> +[SCHEDULER ITER22 LR0.07776]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER22 LR0.07776]: shuffling training file +===PEEK ON TEST 22=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER22 LR0.07776]: 40087 words processed Wed Nov 18 01:32:26 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-2.112490. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48318 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81313 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53997 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12032 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER22 LR0.07776]: Displaying result: +[SCHEDULER ITER22 LR0.07776]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 149.22713519715> <PPL_OOV 130.06453588252> <LOGP -174270.11776113> +[SCHEDULER ITER22 LR0.07776]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 22=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER22 LR0.07776]: 40095 words processed Wed Nov 18 01:32:37 2015. + [SCHEDULER ITER22 LR0.07776]: log prob per sample :-2.187414. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49005 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83575 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.57172 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12133 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER22 LR0.07776]: Displaying result: +[SCHEDULER ITER22 LR0.07776]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 153.46420317937> <PPL_OOV 137.222491028> <LOGP -157656.49004677> +[SCHEDULER ITER22 LR0.07776]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER22 LR0.07776]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.22... + +[SCHEDULER ITER23 LR0.046656]: preparing parameters... +[SCHEDULER ITER23 LR0.046656]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.22... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1892674 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1897528 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48170983 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48287254 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94322750 +[SCHEDULER ITER23 LR0.046656]: preparing parameters end. +[SCHEDULER ITER23 LR0.046656]: preparing layers... +(01:32:48 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:32:48 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:32:48 2015-11-18)[nerv] info: create layer: combinerL1 +(01:32:48 2015-11-18)[nerv] info: create layer: outputL +(01:32:48 2015-11-18)[nerv] info: create layer: softmaxL +(01:32:48 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER23 LR0.046656]: preparing layers end. +[SCHEDULER ITER23 LR0.046656]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER23 LR0.046656]: Initing TNN end. +===ITERATION 23 LR 0.046656=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER23 LR0.046656]: 40092 words processed Wed Nov 18 01:33:01 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.932881. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86847 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.24560 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01254 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47426 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12717 clock time +[SCHEDULER ITER23 LR0.046656]: 80099 words processed Wed Nov 18 01:33:14 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.928670. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81421 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11587 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97461 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45340 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12537 clock time +[SCHEDULER ITER23 LR0.046656]: 120004 words processed Wed Nov 18 01:33:27 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.923355. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48218 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81458 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11536 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97196 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45357 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12526 clock time +[SCHEDULER ITER23 LR0.046656]: 160114 words processed Wed Nov 18 01:33:41 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.923978. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48507 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84447 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99969 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46561 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12645 clock time +[SCHEDULER ITER23 LR0.046656]: 200066 words processed Wed Nov 18 01:33:54 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.923299. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48151 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82826 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98159 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45768 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12569 clock time +[SCHEDULER ITER23 LR0.046656]: 240045 words processed Wed Nov 18 01:34:07 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.919549. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48011 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82144 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13153 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97986 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45638 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12608 clock time +[SCHEDULER ITER23 LR0.046656]: 280057 words processed Wed Nov 18 01:34:20 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.915614. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48105 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82969 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16039 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99220 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46212 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12569 clock time +[SCHEDULER ITER23 LR0.046656]: 320106 words processed Wed Nov 18 01:34:33 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.913146. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47693 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82442 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15113 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99084 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46387 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12575 clock time +[SCHEDULER ITER23 LR0.046656]: 360024 words processed Wed Nov 18 01:34:46 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.911406. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47572 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81983 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97639 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45636 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12604 clock time +[SCHEDULER ITER23 LR0.046656]: 400089 words processed Wed Nov 18 01:35:00 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.908580. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48339 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86667 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.23326 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00823 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47334 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12791 clock time +[SCHEDULER ITER23 LR0.046656]: 440067 words processed Wed Nov 18 01:35:13 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.909159. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47505 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82738 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13838 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98201 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46005 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12575 clock time +[SCHEDULER ITER23 LR0.046656]: 480051 words processed Wed Nov 18 01:35:26 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.909343. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47633 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82336 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13212 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98071 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45947 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12588 clock time +[SCHEDULER ITER23 LR0.046656]: 520140 words processed Wed Nov 18 01:35:39 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.908436. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47549 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82857 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15636 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99207 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46541 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12614 clock time +[SCHEDULER ITER23 LR0.046656]: 560132 words processed Wed Nov 18 01:35:52 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.908137. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47624 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82033 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12077 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97669 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45707 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12546 clock time +[SCHEDULER ITER23 LR0.046656]: 600118 words processed Wed Nov 18 01:36:05 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.905594. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47476 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82056 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12165 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97896 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45540 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12600 clock time +[SCHEDULER ITER23 LR0.046656]: 640090 words processed Wed Nov 18 01:36:18 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.903298. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47474 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81864 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97861 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45607 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12550 clock time +[SCHEDULER ITER23 LR0.046656]: 680075 words processed Wed Nov 18 01:36:31 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.901764. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47463 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82587 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13388 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98163 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45911 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12638 clock time +[SCHEDULER ITER23 LR0.046656]: 720043 words processed Wed Nov 18 01:36:44 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.900544. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47672 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83056 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14786 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98536 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46002 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12639 clock time +[SCHEDULER ITER23 LR0.046656]: 760012 words processed Wed Nov 18 01:36:57 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.898446. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47557 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82624 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13468 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98046 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45795 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12617 clock time +[SCHEDULER ITER23 LR0.046656]: 800113 words processed Wed Nov 18 01:37:10 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.898126. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47613 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83127 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16164 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99382 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46495 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12650 clock time +[SCHEDULER ITER23 LR0.046656]: 840089 words processed Wed Nov 18 01:37:23 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.896699. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47404 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81496 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10889 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97356 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45643 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12508 clock time +[SCHEDULER ITER23 LR0.046656]: 880052 words processed Wed Nov 18 01:37:36 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.896203. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81142 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10624 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97334 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45553 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12553 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER23 LR0.046656]: Displaying result: +[SCHEDULER ITER23 LR0.046656]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 86.574538972118> <PPL_OOV 78.723561298553> <LOGP -1762598.1021734> +[SCHEDULER ITER23 LR0.046656]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER23 LR0.046656]: shuffling training file +===PEEK ON TEST 23=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER23 LR0.046656]: 40087 words processed Wed Nov 18 01:37:46 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-2.108984. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83821 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56405 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12059 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER23 LR0.046656]: Displaying result: +[SCHEDULER ITER23 LR0.046656]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 148.16429358285> <PPL_OOV 129.06697398247> <LOGP -173994.49100086> +[SCHEDULER ITER23 LR0.046656]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 23=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER23 LR0.046656]: 40095 words processed Wed Nov 18 01:37:57 2015. + [SCHEDULER ITER23 LR0.046656]: log prob per sample :-2.184135. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48333 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83036 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55543 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12080 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER23 LR0.046656]: Displaying result: +[SCHEDULER ITER23 LR0.046656]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 152.34358280652> <PPL_OOV 136.15525315815> <LOGP -157406.37749156> +[SCHEDULER ITER23 LR0.046656]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER23 LR0.046656]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.23... + +[SCHEDULER ITER24 LR0.0279936]: preparing parameters... +[SCHEDULER ITER24 LR0.0279936]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.23... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46035274 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46040128 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92313338 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92429593 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94322130 +[SCHEDULER ITER24 LR0.0279936]: preparing parameters end. +[SCHEDULER ITER24 LR0.0279936]: preparing layers... +(01:38:08 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:38:08 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:38:08 2015-11-18)[nerv] info: create layer: combinerL1 +(01:38:08 2015-11-18)[nerv] info: create layer: outputL +(01:38:08 2015-11-18)[nerv] info: create layer: softmaxL +(01:38:08 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER24 LR0.0279936]: preparing layers end. +[SCHEDULER ITER24 LR0.0279936]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER24 LR0.0279936]: Initing TNN end. +===ITERATION 24 LR 0.027994=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER24 LR0.0279936]: 40092 words processed Wed Nov 18 01:38:21 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.927346. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82663 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20208 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02348 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46803 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12551 clock time +[SCHEDULER ITER24 LR0.0279936]: 80099 words processed Wed Nov 18 01:38:34 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.923065. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48636 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82460 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17386 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00757 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45924 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12557 clock time +[SCHEDULER ITER24 LR0.0279936]: 120004 words processed Wed Nov 18 01:38:47 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.917914. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48334 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82725 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17223 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00475 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45732 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12503 clock time +[SCHEDULER ITER24 LR0.0279936]: 160114 words processed Wed Nov 18 01:39:01 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.918557. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48447 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83602 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.21760 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02805 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46935 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12625 clock time +[SCHEDULER ITER24 LR0.0279936]: 200066 words processed Wed Nov 18 01:39:15 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.917932. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49059 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87711 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.27396 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02854 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46990 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12790 clock time +[SCHEDULER ITER24 LR0.0279936]: 240045 words processed Wed Nov 18 01:39:29 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.914240. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49086 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86965 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.26590 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02569 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47292 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12812 clock time +[SCHEDULER ITER24 LR0.0279936]: 280057 words processed Wed Nov 18 01:39:42 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.910323. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48008 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82121 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18070 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01663 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46383 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12522 clock time +[SCHEDULER ITER24 LR0.0279936]: 320106 words processed Wed Nov 18 01:39:56 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.907871. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47788 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82603 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19097 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01901 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46768 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12556 clock time +[SCHEDULER ITER24 LR0.0279936]: 360024 words processed Wed Nov 18 01:40:09 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.906106. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47566 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82167 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15847 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00508 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45668 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12527 clock time +[SCHEDULER ITER24 LR0.0279936]: 400089 words processed Wed Nov 18 01:40:22 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.903274. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47491 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82663 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18647 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02247 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46445 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12535 clock time +[SCHEDULER ITER24 LR0.0279936]: 440067 words processed Wed Nov 18 01:40:35 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.903857. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47440 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81978 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15129 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45790 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER24 LR0.0279936]: 480051 words processed Wed Nov 18 01:40:48 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.904034. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47511 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82033 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14983 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00312 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45689 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12517 clock time +[SCHEDULER ITER24 LR0.0279936]: 520140 words processed Wed Nov 18 01:41:02 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.903124. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47713 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83832 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.21457 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02857 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46783 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12679 clock time +[SCHEDULER ITER24 LR0.0279936]: 560132 words processed Wed Nov 18 01:41:15 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.902836. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47498 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82581 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15974 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00460 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45762 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12574 clock time +[SCHEDULER ITER24 LR0.0279936]: 600118 words processed Wed Nov 18 01:41:28 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.900274. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47704 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83125 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18117 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01066 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46368 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12506 clock time +[SCHEDULER ITER24 LR0.0279936]: 640090 words processed Wed Nov 18 01:41:41 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.897943. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47282 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81048 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13337 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99975 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45670 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12504 clock time +[SCHEDULER ITER24 LR0.0279936]: 680075 words processed Wed Nov 18 01:41:54 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.896393. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47328 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80771 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12700 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99820 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45543 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12474 clock time +[SCHEDULER ITER24 LR0.0279936]: 720043 words processed Wed Nov 18 01:42:07 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.895120. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47390 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81936 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14823 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00191 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45623 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12498 clock time +[SCHEDULER ITER24 LR0.0279936]: 760012 words processed Wed Nov 18 01:42:20 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.892989. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47393 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81813 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15018 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00439 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45695 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12513 clock time +[SCHEDULER ITER24 LR0.0279936]: 800113 words processed Wed Nov 18 01:42:33 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.892636. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47518 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82474 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17842 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01629 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46474 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12544 clock time +[SCHEDULER ITER24 LR0.0279936]: 840089 words processed Wed Nov 18 01:42:46 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.891173. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80759 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12728 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99824 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45534 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12467 clock time +[SCHEDULER ITER24 LR0.0279936]: 880052 words processed Wed Nov 18 01:42:59 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.890643. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47299 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80823 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13114 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99963 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45542 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12483 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER24 LR0.0279936]: Displaying result: +[SCHEDULER ITER24 LR0.0279936]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 85.44815241644> <PPL_OOV 77.720338988107> <LOGP -1757420.2483801> +[SCHEDULER ITER24 LR0.0279936]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER24 LR0.0279936]: shuffling training file +===PEEK ON TEST 24=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER24 LR0.0279936]: 40087 words processed Wed Nov 18 01:43:09 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-2.106615. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83298 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56120 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12035 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER24 LR0.0279936]: Displaying result: +[SCHEDULER ITER24 LR0.0279936]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 147.37328782741> <PPL_OOV 128.39098511424> <LOGP -173806.50139952> +[SCHEDULER ITER24 LR0.0279936]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 24=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER24 LR0.0279936]: 40095 words processed Wed Nov 18 01:43:20 2015. + [SCHEDULER ITER24 LR0.0279936]: log prob per sample :-2.182032. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48285 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82630 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55240 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12035 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER24 LR0.0279936]: Displaying result: +[SCHEDULER ITER24 LR0.0279936]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 151.53876248028> <PPL_OOV 135.44193656287> <LOGP -157238.1126931> +[SCHEDULER ITER24 LR0.0279936]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER24 LR0.0279936]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.24... + +[SCHEDULER ITER25 LR0.01679616]: preparing parameters... +[SCHEDULER ITER25 LR0.01679616]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.24... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1892462 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1897316 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48170373 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48286625 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94321713 +[SCHEDULER ITER25 LR0.01679616]: preparing parameters end. +[SCHEDULER ITER25 LR0.01679616]: preparing layers... +(01:43:31 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:43:31 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:43:31 2015-11-18)[nerv] info: create layer: combinerL1 +(01:43:31 2015-11-18)[nerv] info: create layer: outputL +(01:43:31 2015-11-18)[nerv] info: create layer: softmaxL +(01:43:31 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER25 LR0.01679616]: preparing layers end. +[SCHEDULER ITER25 LR0.01679616]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER25 LR0.01679616]: Initing TNN end. +===ITERATION 25 LR 0.016796=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER25 LR0.01679616]: 40092 words processed Wed Nov 18 01:43:44 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.923243. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48782 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84846 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.21400 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00810 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46831 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12708 clock time +[SCHEDULER ITER25 LR0.01679616]: 80099 words processed Wed Nov 18 01:43:57 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.918872. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48372 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82030 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97731 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45476 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12504 clock time +[SCHEDULER ITER25 LR0.01679616]: 120004 words processed Wed Nov 18 01:44:10 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.913860. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48402 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83143 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16045 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98739 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45705 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12466 clock time +[SCHEDULER ITER25 LR0.01679616]: 160114 words processed Wed Nov 18 01:44:24 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.914503. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48467 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85043 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20979 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00669 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46763 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12625 clock time +[SCHEDULER ITER25 LR0.01679616]: 200066 words processed Wed Nov 18 01:44:37 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.913919. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47864 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82544 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13357 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97932 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45479 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12500 clock time +[SCHEDULER ITER25 LR0.01679616]: 240045 words processed Wed Nov 18 01:44:50 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.910294. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47968 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83133 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15005 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98512 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45737 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12541 clock time +[SCHEDULER ITER25 LR0.01679616]: 280057 words processed Wed Nov 18 01:45:03 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.906410. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48020 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83915 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00035 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46365 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12573 clock time +[SCHEDULER ITER25 LR0.01679616]: 320106 words processed Wed Nov 18 01:45:16 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.903988. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47798 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83760 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17821 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99788 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46428 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12547 clock time +[SCHEDULER ITER25 LR0.01679616]: 360024 words processed Wed Nov 18 01:45:29 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.902222. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47451 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83055 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14282 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98222 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45612 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12516 clock time +[SCHEDULER ITER25 LR0.01679616]: 400089 words processed Wed Nov 18 01:45:42 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.899396. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47664 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83601 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17470 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99974 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46363 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12519 clock time +[SCHEDULER ITER25 LR0.01679616]: 440067 words processed Wed Nov 18 01:45:55 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.899992. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82870 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13911 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98411 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45643 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12512 clock time +[SCHEDULER ITER25 LR0.01679616]: 480051 words processed Wed Nov 18 01:46:08 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.900186. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47443 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82508 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13979 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98593 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45761 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12578 clock time +[SCHEDULER ITER25 LR0.01679616]: 520140 words processed Wed Nov 18 01:46:22 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.899293. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84951 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20098 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00366 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46878 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12564 clock time +[SCHEDULER ITER25 LR0.01679616]: 560132 words processed Wed Nov 18 01:46:35 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.899029. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47581 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82833 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14083 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98298 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45808 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12570 clock time +[SCHEDULER ITER25 LR0.01679616]: 600118 words processed Wed Nov 18 01:46:48 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.896469. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47373 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82974 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14048 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98437 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45657 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12531 clock time +[SCHEDULER ITER25 LR0.01679616]: 640090 words processed Wed Nov 18 01:47:01 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.894124. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47645 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83862 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15950 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98646 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45952 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12610 clock time +[SCHEDULER ITER25 LR0.01679616]: 680075 words processed Wed Nov 18 01:47:14 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.892577. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47333 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82686 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13526 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98382 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45558 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12522 clock time +[SCHEDULER ITER25 LR0.01679616]: 720043 words processed Wed Nov 18 01:47:27 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.891284. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47350 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82183 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12543 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98033 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45401 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12460 clock time +[SCHEDULER ITER25 LR0.01679616]: 760012 words processed Wed Nov 18 01:47:40 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.889149. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47507 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82752 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14247 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98462 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45714 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12533 clock time +[SCHEDULER ITER25 LR0.01679616]: 800113 words processed Wed Nov 18 01:47:54 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.888790. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47564 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84821 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19787 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00498 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46743 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12583 clock time +[SCHEDULER ITER25 LR0.01679616]: 840089 words processed Wed Nov 18 01:48:07 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.887314. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47416 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82977 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14301 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98284 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45923 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER25 LR0.01679616]: 880052 words processed Wed Nov 18 01:48:20 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.886777. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82408 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13444 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98342 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45582 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12485 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER25 LR0.01679616]: Displaying result: +[SCHEDULER ITER25 LR0.01679616]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 84.673150072491> <PPL_OOV 77.031136573215> <LOGP -1753824.244546> +[SCHEDULER ITER25 LR0.01679616]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER25 LR0.01679616]: shuffling training file +===PEEK ON TEST 25=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER25 LR0.01679616]: 40087 words processed Wed Nov 18 01:48:30 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-2.104737. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48496 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85025 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.58033 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12100 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER25 LR0.01679616]: Displaying result: +[SCHEDULER ITER25 LR0.01679616]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.64814537045> <PPL_OOV 127.8666692861> <LOGP -173660.00858106> +[SCHEDULER ITER25 LR0.01679616]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 25=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER25 LR0.01679616]: 40095 words processed Wed Nov 18 01:48:41 2015. + [SCHEDULER ITER25 LR0.01679616]: log prob per sample :-2.180301. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48440 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83196 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55931 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12020 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER25 LR0.01679616]: Displaying result: +[SCHEDULER ITER25 LR0.01679616]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 150.76760912254> <PPL_OOV 134.8423497064> <LOGP -157095.9887546> +[SCHEDULER ITER25 LR0.01679616]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER25 LR0.01679616]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.25... + +[SCHEDULER ITER26 LR0.010077696]: preparing parameters... +[SCHEDULER ITER26 LR0.010077696]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.25... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46034991 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46039845 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92312815 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92429068 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94321469 +[SCHEDULER ITER26 LR0.010077696]: preparing parameters end. +[SCHEDULER ITER26 LR0.010077696]: preparing layers... +(01:48:51 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:48:51 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:48:51 2015-11-18)[nerv] info: create layer: combinerL1 +(01:48:51 2015-11-18)[nerv] info: create layer: outputL +(01:48:51 2015-11-18)[nerv] info: create layer: softmaxL +(01:48:51 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER26 LR0.010077696]: preparing layers end. +[SCHEDULER ITER26 LR0.010077696]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER26 LR0.010077696]: Initing TNN end. +===ITERATION 26 LR 0.010078=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER26 LR0.010077696]: 40092 words processed Wed Nov 18 01:49:04 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.920626. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49168 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85961 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.27304 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.03938 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47828 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12591 clock time +[SCHEDULER ITER26 LR0.010077696]: 80099 words processed Wed Nov 18 01:49:17 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.916180. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48746 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82235 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16845 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00409 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45812 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12550 clock time +[SCHEDULER ITER26 LR0.010077696]: 120004 words processed Wed Nov 18 01:49:30 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.911254. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48364 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81727 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16373 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45742 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12550 clock time +[SCHEDULER ITER26 LR0.010077696]: 160114 words processed Wed Nov 18 01:49:44 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.911897. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48476 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82834 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20454 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02367 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46825 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12671 clock time +[SCHEDULER ITER26 LR0.010077696]: 200066 words processed Wed Nov 18 01:49:57 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.911342. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47917 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81701 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15716 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00500 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45923 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12505 clock time +[SCHEDULER ITER26 LR0.010077696]: 240045 words processed Wed Nov 18 01:50:10 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.907754. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47885 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81615 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15616 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00504 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45852 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12530 clock time +[SCHEDULER ITER26 LR0.010077696]: 280057 words processed Wed Nov 18 01:50:24 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.903906. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48373 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83223 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.21212 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02422 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46915 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12645 clock time +[SCHEDULER ITER26 LR0.010077696]: 320106 words processed Wed Nov 18 01:50:37 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.901507. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47696 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81787 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17480 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01634 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46518 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12542 clock time +[SCHEDULER ITER26 LR0.010077696]: 360024 words processed Wed Nov 18 01:50:50 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.899747. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47647 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80904 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00378 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45724 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12527 clock time +[SCHEDULER ITER26 LR0.010077696]: 400089 words processed Wed Nov 18 01:51:03 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.896921. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47401 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81503 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16093 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01342 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46190 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12511 clock time +[SCHEDULER ITER26 LR0.010077696]: 440067 words processed Wed Nov 18 01:51:16 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.897524. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47457 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81492 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14131 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99993 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45580 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12524 clock time +[SCHEDULER ITER26 LR0.010077696]: 480051 words processed Wed Nov 18 01:51:29 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.897736. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47509 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80871 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99992 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45591 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12493 clock time +[SCHEDULER ITER26 LR0.010077696]: 520140 words processed Wed Nov 18 01:51:42 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.896857. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47682 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82353 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18375 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01883 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46490 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12588 clock time +[SCHEDULER ITER26 LR0.010077696]: 560132 words processed Wed Nov 18 01:51:55 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.896604. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47474 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81057 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14140 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00438 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45687 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12505 clock time +[SCHEDULER ITER26 LR0.010077696]: 600118 words processed Wed Nov 18 01:52:08 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.894044. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47350 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80995 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14273 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00529 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45825 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER26 LR0.010077696]: 640090 words processed Wed Nov 18 01:52:21 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.891688. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47301 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80540 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12775 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99943 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45606 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12469 clock time +[SCHEDULER ITER26 LR0.010077696]: 680075 words processed Wed Nov 18 01:52:34 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.890140. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47364 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80776 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13522 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00277 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45687 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12516 clock time +[SCHEDULER ITER26 LR0.010077696]: 720043 words processed Wed Nov 18 01:52:47 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.888836. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47335 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80977 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13488 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99997 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45646 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12493 clock time +[SCHEDULER ITER26 LR0.010077696]: 760012 words processed Wed Nov 18 01:53:00 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.886699. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47303 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81074 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13709 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00063 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45667 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12499 clock time +[SCHEDULER ITER26 LR0.010077696]: 800113 words processed Wed Nov 18 01:53:14 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.886342. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47600 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83049 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19414 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02076 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46650 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12552 clock time +[SCHEDULER ITER26 LR0.010077696]: 840089 words processed Wed Nov 18 01:53:27 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.884857. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47543 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81385 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14607 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00343 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45786 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12526 clock time +[SCHEDULER ITER26 LR0.010077696]: 880052 words processed Wed Nov 18 01:53:40 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.884316. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47589 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80817 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13744 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00145 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45547 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12539 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER26 LR0.010077696]: Displaying result: +[SCHEDULER ITER26 LR0.010077696]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 84.184044013878> <PPL_OOV 76.595967425186> <LOGP -1751537.0837484> +[SCHEDULER ITER26 LR0.010077696]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER26 LR0.010077696]: shuffling training file +===PEEK ON TEST 26=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER26 LR0.010077696]: 40087 words processed Wed Nov 18 01:53:50 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-2.103395. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48599 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83410 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56428 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12065 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER26 LR0.010077696]: Displaying result: +[SCHEDULER ITER26 LR0.010077696]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.05233075615> <PPL_OOV 127.50046195875> <LOGP -173557.33423712> +[SCHEDULER ITER26 LR0.010077696]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 26=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER26 LR0.010077696]: 40095 words processed Wed Nov 18 01:54:01 2015. + [SCHEDULER ITER26 LR0.010077696]: log prob per sample :-2.179033. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48444 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81957 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54693 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12043 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER26 LR0.010077696]: Displaying result: +[SCHEDULER ITER26 LR0.010077696]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 150.11721636677> <PPL_OOV 134.38886200695> <LOGP -156988.07526625> +[SCHEDULER ITER26 LR0.010077696]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER26 LR0.010077696]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.26... + +[SCHEDULER ITER27 LR0.0060466176]: preparing parameters... +[SCHEDULER ITER27 LR0.0060466176]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.26... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1892361 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1897215 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48170074 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48286329 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94321229 +[SCHEDULER ITER27 LR0.0060466176]: preparing parameters end. +[SCHEDULER ITER27 LR0.0060466176]: preparing layers... +(01:54:12 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:54:12 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:54:12 2015-11-18)[nerv] info: create layer: combinerL1 +(01:54:12 2015-11-18)[nerv] info: create layer: outputL +(01:54:12 2015-11-18)[nerv] info: create layer: softmaxL +(01:54:12 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER27 LR0.0060466176]: preparing layers end. +[SCHEDULER ITER27 LR0.0060466176]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER27 LR0.0060466176]: Initing TNN end. +===ITERATION 27 LR 0.006047=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER27 LR0.0060466176]: 40092 words processed Wed Nov 18 01:54:25 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.918962. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48445 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83920 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18572 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00116 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46619 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12545 clock time +[SCHEDULER ITER27 LR0.0060466176]: 80099 words processed Wed Nov 18 01:54:38 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.914462. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48338 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82325 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97964 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45818 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12515 clock time +[SCHEDULER ITER27 LR0.0060466176]: 120004 words processed Wed Nov 18 01:54:51 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.909585. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48088 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81958 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12847 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97885 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45374 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12445 clock time +[SCHEDULER ITER27 LR0.0060466176]: 160114 words processed Wed Nov 18 01:55:04 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.910233. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48272 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83023 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15932 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99224 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46134 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12487 clock time +[SCHEDULER ITER27 LR0.0060466176]: 200066 words processed Wed Nov 18 01:55:17 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.909692. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47707 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81560 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11334 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97439 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45435 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12499 clock time +[SCHEDULER ITER27 LR0.0060466176]: 240045 words processed Wed Nov 18 01:55:30 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.906124. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47845 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81732 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11949 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97705 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45480 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12523 clock time +[SCHEDULER ITER27 LR0.0060466176]: 280057 words processed Wed Nov 18 01:55:43 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.902309. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47931 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83440 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16899 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99513 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46367 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12528 clock time +[SCHEDULER ITER27 LR0.0060466176]: 320106 words processed Wed Nov 18 01:55:56 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.899928. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47833 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83723 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17711 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99931 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46464 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12544 clock time +[SCHEDULER ITER27 LR0.0060466176]: 360024 words processed Wed Nov 18 01:56:09 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.898177. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47377 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83213 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14560 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45788 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12559 clock time +[SCHEDULER ITER27 LR0.0060466176]: 400089 words processed Wed Nov 18 01:56:22 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.895351. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47587 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83361 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16144 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46407 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12513 clock time +[SCHEDULER ITER27 LR0.0060466176]: 440067 words processed Wed Nov 18 01:56:35 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.895960. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47499 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82324 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12379 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97843 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45537 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12497 clock time +[SCHEDULER ITER27 LR0.0060466176]: 480051 words processed Wed Nov 18 01:56:48 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.896184. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47497 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83371 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14460 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98341 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45978 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12548 clock time +[SCHEDULER ITER27 LR0.0060466176]: 520140 words processed Wed Nov 18 01:57:01 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.895315. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47662 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84194 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18115 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99887 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46705 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12554 clock time +[SCHEDULER ITER27 LR0.0060466176]: 560132 words processed Wed Nov 18 01:57:14 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.895067. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82183 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11798 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97719 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45488 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12481 clock time +[SCHEDULER ITER27 LR0.0060466176]: 600118 words processed Wed Nov 18 01:57:27 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.892505. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47464 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82542 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12880 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97910 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45672 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12558 clock time +[SCHEDULER ITER27 LR0.0060466176]: 640090 words processed Wed Nov 18 01:57:40 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.890141. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47435 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83082 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14368 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98471 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45942 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12541 clock time +[SCHEDULER ITER27 LR0.0060466176]: 680075 words processed Wed Nov 18 01:57:53 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.888591. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47461 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82563 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13128 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98151 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45717 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER27 LR0.0060466176]: 720043 words processed Wed Nov 18 01:58:06 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.887283. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47348 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81934 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11607 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97617 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45483 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12476 clock time +[SCHEDULER ITER27 LR0.0060466176]: 760012 words processed Wed Nov 18 01:58:19 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.885141. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47464 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82369 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12896 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98127 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45581 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12497 clock time +[SCHEDULER ITER27 LR0.0060466176]: 800113 words processed Wed Nov 18 01:58:32 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.884788. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83560 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16876 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99725 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46574 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12570 clock time +[SCHEDULER ITER27 LR0.0060466176]: 840089 words processed Wed Nov 18 01:58:45 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.883297. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47385 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81983 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11609 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97647 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45559 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12485 clock time +[SCHEDULER ITER27 LR0.0060466176]: 880052 words processed Wed Nov 18 01:58:58 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.882758. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47541 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81743 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11799 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97656 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45584 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12498 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER27 LR0.0060466176]: Displaying result: +[SCHEDULER ITER27 LR0.0060466176]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.875768012527> <PPL_OOV 76.321621876328> <LOGP -1750088.4912749> +[SCHEDULER ITER27 LR0.0060466176]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER27 LR0.0060466176]: shuffling training file +===PEEK ON TEST 27=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER27 LR0.0060466176]: 40087 words processed Wed Nov 18 01:59:08 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-2.102501. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83610 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56470 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12065 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER27 LR0.0060466176]: Displaying result: +[SCHEDULER ITER27 LR0.0060466176]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.659092807> <PPL_OOV 127.25401262137> <LOGP -173488.07055484> +[SCHEDULER ITER27 LR0.0060466176]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 27=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER27 LR0.0060466176]: 40095 words processed Wed Nov 18 01:59:19 2015. + [SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-2.178196. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48477 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83898 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56866 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12119 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER27 LR0.0060466176]: Displaying result: +[SCHEDULER ITER27 LR0.0060466176]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.68704110567> <PPL_OOV 134.08164807245> <LOGP -156914.76247969> +[SCHEDULER ITER27 LR0.0060466176]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER27 LR0.0060466176]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.27... + +[SCHEDULER ITER28 LR0.00362797056]: preparing parameters... +[SCHEDULER ITER28 LR0.00362797056]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.27... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46034848 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46039702 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92312519 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92428776 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94321124 +[SCHEDULER ITER28 LR0.00362797056]: preparing parameters end. +[SCHEDULER ITER28 LR0.00362797056]: preparing layers... +(01:59:30 2015-11-18)[nerv] info: create layer: recurrentL1 +(01:59:30 2015-11-18)[nerv] info: create layer: sigmoidL1 +(01:59:30 2015-11-18)[nerv] info: create layer: combinerL1 +(01:59:30 2015-11-18)[nerv] info: create layer: outputL +(01:59:30 2015-11-18)[nerv] info: create layer: softmaxL +(01:59:30 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER28 LR0.00362797056]: preparing layers end. +[SCHEDULER ITER28 LR0.00362797056]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER28 LR0.00362797056]: Initing TNN end. +===ITERATION 28 LR 0.003628=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER28 LR0.00362797056]: 40092 words processed Wed Nov 18 01:59:43 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.917879. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48496 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81600 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18925 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02211 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46814 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12571 clock time +[SCHEDULER ITER28 LR0.00362797056]: 80099 words processed Wed Nov 18 01:59:56 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.913373. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48288 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78962 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11352 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99412 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45499 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12520 clock time +[SCHEDULER ITER28 LR0.00362797056]: 120004 words processed Wed Nov 18 02:00:09 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.908522. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48192 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79546 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12127 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99313 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45402 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12468 clock time +[SCHEDULER ITER28 LR0.00362797056]: 160114 words processed Wed Nov 18 02:00:22 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.909173. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48142 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79737 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14399 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46239 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12465 clock time +[SCHEDULER ITER28 LR0.00362797056]: 200066 words processed Wed Nov 18 02:00:35 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.908638. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47970 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80537 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00141 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46202 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12546 clock time +[SCHEDULER ITER28 LR0.00362797056]: 240045 words processed Wed Nov 18 02:00:48 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.905078. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48256 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80422 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15186 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00595 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46175 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12558 clock time +[SCHEDULER ITER28 LR0.00362797056]: 280057 words processed Wed Nov 18 02:01:01 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.901289. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48248 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81348 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18565 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02030 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46826 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12591 clock time +[SCHEDULER ITER28 LR0.00362797056]: 320106 words processed Wed Nov 18 02:01:14 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.898922. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47723 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81563 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17720 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01761 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46621 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12579 clock time +[SCHEDULER ITER28 LR0.00362797056]: 360024 words processed Wed Nov 18 02:01:27 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.897178. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47484 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80630 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14068 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00120 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45938 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12502 clock time +[SCHEDULER ITER28 LR0.00362797056]: 400089 words processed Wed Nov 18 02:01:40 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.894354. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47663 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81614 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02080 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46682 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12577 clock time +[SCHEDULER ITER28 LR0.00362797056]: 440067 words processed Wed Nov 18 02:01:53 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.894966. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47522 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79957 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13472 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00378 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46057 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12559 clock time +[SCHEDULER ITER28 LR0.00362797056]: 480051 words processed Wed Nov 18 02:02:06 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.895199. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47393 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79683 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99861 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45706 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12545 clock time +[SCHEDULER ITER28 LR0.00362797056]: 520140 words processed Wed Nov 18 02:02:19 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.894337. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47613 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80740 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16109 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01552 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46508 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER28 LR0.00362797056]: 560132 words processed Wed Nov 18 02:02:32 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.894092. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79453 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11449 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99746 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45600 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12512 clock time +[SCHEDULER ITER28 LR0.00362797056]: 600118 words processed Wed Nov 18 02:02:45 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.891529. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47448 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80104 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13010 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00158 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45844 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12522 clock time +[SCHEDULER ITER28 LR0.00362797056]: 640090 words processed Wed Nov 18 02:02:58 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.889160. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47599 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80516 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14319 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00537 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46029 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12564 clock time +[SCHEDULER ITER28 LR0.00362797056]: 680075 words processed Wed Nov 18 02:03:11 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.887609. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47448 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79755 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12216 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99926 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45722 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12491 clock time +[SCHEDULER ITER28 LR0.00362797056]: 720043 words processed Wed Nov 18 02:03:24 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.886300. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47319 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80342 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13496 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00381 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45834 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER28 LR0.00362797056]: 760012 words processed Wed Nov 18 02:03:37 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.884154. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78833 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10391 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99464 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45480 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12497 clock time +[SCHEDULER ITER28 LR0.00362797056]: 800113 words processed Wed Nov 18 02:03:50 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.883803. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47457 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80168 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14514 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01076 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46237 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12515 clock time +[SCHEDULER ITER28 LR0.00362797056]: 840089 words processed Wed Nov 18 02:04:03 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.882309. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47251 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78820 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10016 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45443 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12461 clock time +[SCHEDULER ITER28 LR0.00362797056]: 880052 words processed Wed Nov 18 02:04:16 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.881771. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80354 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13664 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00159 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45867 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER28 LR0.00362797056]: Displaying result: +[SCHEDULER ITER28 LR0.00362797056]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.681016662093> <PPL_OOV 76.14852113772> <LOGP -1749171.8074191> +[SCHEDULER ITER28 LR0.00362797056]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER28 LR0.00362797056]: shuffling training file +===PEEK ON TEST 28=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER28 LR0.00362797056]: 40087 words processed Wed Nov 18 02:04:26 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-2.101971. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48379 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81145 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53844 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12044 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER28 LR0.00362797056]: Displaying result: +[SCHEDULER ITER28 LR0.00362797056]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.48274785558> <PPL_OOV 127.10099131823> <LOGP -173444.99694505> +[SCHEDULER ITER28 LR0.00362797056]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 28=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER28 LR0.00362797056]: 40095 words processed Wed Nov 18 02:04:37 2015. + [SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-2.177686. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48499 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80699 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53471 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12057 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER28 LR0.00362797056]: Displaying result: +[SCHEDULER ITER28 LR0.00362797056]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.48267153936> <PPL_OOV 133.8953857324> <LOGP -156870.23144727> +[SCHEDULER ITER28 LR0.00362797056]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER28 LR0.00362797056]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.28... + +[SCHEDULER ITER29 LR0.002176782336]: preparing parameters... +[SCHEDULER ITER29 LR0.002176782336]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.28... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1892329 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1897183 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48169945 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48286201 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94320985 +[SCHEDULER ITER29 LR0.002176782336]: preparing parameters end. +[SCHEDULER ITER29 LR0.002176782336]: preparing layers... +(02:04:48 2015-11-18)[nerv] info: create layer: recurrentL1 +(02:04:48 2015-11-18)[nerv] info: create layer: sigmoidL1 +(02:04:48 2015-11-18)[nerv] info: create layer: combinerL1 +(02:04:48 2015-11-18)[nerv] info: create layer: outputL +(02:04:48 2015-11-18)[nerv] info: create layer: softmaxL +(02:04:48 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER29 LR0.002176782336]: preparing layers end. +[SCHEDULER ITER29 LR0.002176782336]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER29 LR0.002176782336]: Initing TNN end. +===ITERATION 29 LR 0.002177=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER29 LR0.002176782336]: 40092 words processed Wed Nov 18 02:05:01 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.917179. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48498 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83343 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18030 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99938 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46685 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12514 clock time +[SCHEDULER ITER29 LR0.002176782336]: 80099 words processed Wed Nov 18 02:05:14 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.912694. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48405 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81222 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11724 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45364 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12488 clock time +[SCHEDULER ITER29 LR0.002176782336]: 120004 words processed Wed Nov 18 02:05:27 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.907848. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48170 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81949 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13011 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97659 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45561 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12523 clock time +[SCHEDULER ITER29 LR0.002176782336]: 160114 words processed Wed Nov 18 02:05:40 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.908497. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48285 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82862 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16411 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99454 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46430 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER29 LR0.002176782336]: 200066 words processed Wed Nov 18 02:05:53 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.907967. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47750 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81261 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11633 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97678 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45664 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12474 clock time +[SCHEDULER ITER29 LR0.002176782336]: 240045 words processed Wed Nov 18 02:06:06 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.904411. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48198 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84124 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16936 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46013 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12631 clock time +[SCHEDULER ITER29 LR0.002176782336]: 280057 words processed Wed Nov 18 02:06:19 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.900637. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48150 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83750 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18178 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99871 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46525 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12604 clock time +[SCHEDULER ITER29 LR0.002176782336]: 320106 words processed Wed Nov 18 02:06:32 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.898279. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47992 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84067 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18619 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99879 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46747 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12581 clock time +[SCHEDULER ITER29 LR0.002176782336]: 360024 words processed Wed Nov 18 02:06:45 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.896541. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47423 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80960 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10796 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97473 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45540 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12452 clock time +[SCHEDULER ITER29 LR0.002176782336]: 400089 words processed Wed Nov 18 02:06:58 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.893717. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47572 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82129 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14600 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99167 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46335 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12503 clock time +[SCHEDULER ITER29 LR0.002176782336]: 440067 words processed Wed Nov 18 02:07:11 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.894330. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47402 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81457 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11403 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97861 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45425 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12476 clock time +[SCHEDULER ITER29 LR0.002176782336]: 480051 words processed Wed Nov 18 02:07:24 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.894571. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47433 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82137 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12431 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98016 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45724 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12459 clock time +[SCHEDULER ITER29 LR0.002176782336]: 520140 words processed Wed Nov 18 02:07:37 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.893715. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47681 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83158 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16691 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99660 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46533 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12514 clock time +[SCHEDULER ITER29 LR0.002176782336]: 560132 words processed Wed Nov 18 02:07:50 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.893473. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47279 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81388 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10694 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97475 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45471 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12496 clock time +[SCHEDULER ITER29 LR0.002176782336]: 600118 words processed Wed Nov 18 02:08:03 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.890911. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47311 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80911 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09967 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97417 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45261 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12427 clock time +[SCHEDULER ITER29 LR0.002176782336]: 640090 words processed Wed Nov 18 02:08:16 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.888539. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47473 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81745 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12351 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45766 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12508 clock time +[SCHEDULER ITER29 LR0.002176782336]: 680075 words processed Wed Nov 18 02:08:29 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.886988. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47232 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80884 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09946 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97420 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45402 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12461 clock time +[SCHEDULER ITER29 LR0.002176782336]: 720043 words processed Wed Nov 18 02:08:42 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.885680. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47316 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80962 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10285 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97375 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45455 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12442 clock time +[SCHEDULER ITER29 LR0.002176782336]: 760012 words processed Wed Nov 18 02:08:55 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.883531. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47524 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81901 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12618 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98043 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45670 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12561 clock time +[SCHEDULER ITER29 LR0.002176782336]: 800113 words processed Wed Nov 18 02:09:08 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.883180. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47558 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83445 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17252 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99909 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46604 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12574 clock time +[SCHEDULER ITER29 LR0.002176782336]: 840089 words processed Wed Nov 18 02:09:21 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.881683. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47389 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81773 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11865 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97888 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45645 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12447 clock time +[SCHEDULER ITER29 LR0.002176782336]: 880052 words processed Wed Nov 18 02:09:34 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.881149. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81536 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11698 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97839 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45647 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12475 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER29 LR0.002176782336]: Displaying result: +[SCHEDULER ITER29 LR0.002176782336]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.558053146248> <PPL_OOV 76.039482202699> <LOGP -1748593.3031887> +[SCHEDULER ITER29 LR0.002176782336]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER29 LR0.002176782336]: shuffling training file +===PEEK ON TEST 29=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER29 LR0.002176782336]: 40087 words processed Wed Nov 18 02:09:44 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-2.101638. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48453 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82564 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55342 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12078 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER29 LR0.002176782336]: Displaying result: +[SCHEDULER ITER29 LR0.002176782336]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.41148868824> <PPL_OOV 126.99991116995> <LOGP -173416.51567888> +[SCHEDULER ITER29 LR0.002176782336]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 29=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER29 LR0.002176782336]: 40095 words processed Wed Nov 18 02:09:55 2015. + [SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-2.177333. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48425 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82530 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55272 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12065 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER29 LR0.002176782336]: Displaying result: +[SCHEDULER ITER29 LR0.002176782336]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.38502510904> <PPL_OOV 133.77291036919> <LOGP -156840.91663974> +[SCHEDULER ITER29 LR0.002176782336]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER29 LR0.002176782336]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.29... + +[SCHEDULER ITER30 LR0.0013060694016]: preparing parameters... +[SCHEDULER ITER30 LR0.0013060694016]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.29... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46034762 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46039616 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92312347 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92428603 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94320924 +[SCHEDULER ITER30 LR0.0013060694016]: preparing parameters end. +[SCHEDULER ITER30 LR0.0013060694016]: preparing layers... +(02:10:06 2015-11-18)[nerv] info: create layer: recurrentL1 +(02:10:06 2015-11-18)[nerv] info: create layer: sigmoidL1 +(02:10:06 2015-11-18)[nerv] info: create layer: combinerL1 +(02:10:06 2015-11-18)[nerv] info: create layer: outputL +(02:10:06 2015-11-18)[nerv] info: create layer: softmaxL +(02:10:06 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER30 LR0.0013060694016]: preparing layers end. +[SCHEDULER ITER30 LR0.0013060694016]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER30 LR0.0013060694016]: Initing TNN end. +===ITERATION 30 LR 0.001306=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER30 LR0.0013060694016]: 40092 words processed Wed Nov 18 02:10:19 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.916760. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48566 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80970 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19205 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02907 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46926 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12562 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 80099 words processed Wed Nov 18 02:10:32 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.912289. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48482 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78509 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11820 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00028 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45590 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12450 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 120004 words processed Wed Nov 18 02:10:45 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.907431. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48275 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78218 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99752 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45492 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12489 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 160114 words processed Wed Nov 18 02:10:58 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.908076. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48318 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79448 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15244 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01562 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46499 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12490 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 200066 words processed Wed Nov 18 02:11:11 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.907546. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48142 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80105 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14556 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00476 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46066 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12546 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 240045 words processed Wed Nov 18 02:11:24 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.903993. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78024 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10690 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99897 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45598 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12498 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 280057 words processed Wed Nov 18 02:11:37 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.900226. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48133 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80368 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02333 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46679 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 320106 words processed Wed Nov 18 02:11:50 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.897874. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47777 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79470 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15044 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01561 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46588 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12519 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 360024 words processed Wed Nov 18 02:12:03 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.896141. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47408 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78387 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10911 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99828 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45750 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12447 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 400089 words processed Wed Nov 18 02:12:16 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.893316. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47627 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79605 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14922 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01572 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46509 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12510 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 440067 words processed Wed Nov 18 02:12:29 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.893929. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78053 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10038 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99741 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45621 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12459 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 480051 words processed Wed Nov 18 02:12:42 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.894175. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47403 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78186 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10445 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45646 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12495 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 520140 words processed Wed Nov 18 02:12:55 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.893322. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47565 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79641 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15416 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01804 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46662 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12543 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 560132 words processed Wed Nov 18 02:13:08 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.893083. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47483 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78268 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10331 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99783 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45632 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12504 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 600118 words processed Wed Nov 18 02:13:21 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.890522. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47471 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78370 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10279 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99678 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45592 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12433 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 640090 words processed Wed Nov 18 02:13:34 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.888150. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47427 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78325 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10201 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45567 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12482 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 680075 words processed Wed Nov 18 02:13:47 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.886597. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47415 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78016 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09757 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45547 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12430 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 720043 words processed Wed Nov 18 02:14:00 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.885291. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47386 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78505 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10775 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99963 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45548 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12449 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 760012 words processed Wed Nov 18 02:14:13 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.883141. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47363 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78116 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99779 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45437 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12447 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 800113 words processed Wed Nov 18 02:14:26 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.882789. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47681 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80632 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16953 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02187 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46628 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12572 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 840089 words processed Wed Nov 18 02:14:39 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.881290. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47393 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79047 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12153 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00491 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45752 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12527 clock time +[SCHEDULER ITER30 LR0.0013060694016]: 880052 words processed Wed Nov 18 02:14:52 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.880757. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77958 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99618 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45463 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12461 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER30 LR0.0013060694016]: Displaying result: +[SCHEDULER ITER30 LR0.0013060694016]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.480613065678> <PPL_OOV 75.970757576851> <LOGP -1748228.259493> +[SCHEDULER ITER30 LR0.0013060694016]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER30 LR0.0013060694016]: shuffling training file +===PEEK ON TEST 30=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER30 LR0.0013060694016]: 40087 words processed Wed Nov 18 02:15:02 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-2.101389. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48588 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81395 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54305 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12027 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER30 LR0.0013060694016]: Displaying result: +[SCHEDULER ITER30 LR0.0013060694016]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.35106479125> <PPL_OOV 126.92506396644> <LOGP -173395.41143586> +[SCHEDULER ITER30 LR0.0013060694016]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 30=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER30 LR0.0013060694016]: 40095 words processed Wed Nov 18 02:15:13 2015. + [SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-2.177054. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48218 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79590 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.51918 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11959 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER30 LR0.0013060694016]: Displaying result: +[SCHEDULER ITER30 LR0.0013060694016]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.30058258205> <PPL_OOV 133.67832148002> <LOGP -156818.25816062> +[SCHEDULER ITER30 LR0.0013060694016]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER30 LR0.0013060694016]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.30... + +[SCHEDULER ITER31 LR0.00078364164096]: preparing parameters... +[SCHEDULER ITER31 LR0.00078364164096]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.30... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1892328 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1897182 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48169884 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48286140 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94320886 +[SCHEDULER ITER31 LR0.00078364164096]: preparing parameters end. +[SCHEDULER ITER31 LR0.00078364164096]: preparing layers... +(02:15:23 2015-11-18)[nerv] info: create layer: recurrentL1 +(02:15:23 2015-11-18)[nerv] info: create layer: sigmoidL1 +(02:15:23 2015-11-18)[nerv] info: create layer: combinerL1 +(02:15:23 2015-11-18)[nerv] info: create layer: outputL +(02:15:23 2015-11-18)[nerv] info: create layer: softmaxL +(02:15:23 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER31 LR0.00078364164096]: preparing layers end. +[SCHEDULER ITER31 LR0.00078364164096]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER31 LR0.00078364164096]: Initing TNN end. +===ITERATION 31 LR 0.000784=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER31 LR0.00078364164096]: 40092 words processed Wed Nov 18 02:15:36 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.916482. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48985 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86521 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.24216 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01266 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47402 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12716 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 80099 words processed Wed Nov 18 02:15:49 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.912027. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48542 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83559 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14658 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97718 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45596 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12529 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 120004 words processed Wed Nov 18 02:16:02 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.907158. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48551 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82804 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14831 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98150 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45605 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12556 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 160114 words processed Wed Nov 18 02:16:16 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.907802. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48509 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85410 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20128 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00061 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46485 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12606 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 200066 words processed Wed Nov 18 02:16:29 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.907273. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48053 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83748 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15419 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98220 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45851 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12538 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 240045 words processed Wed Nov 18 02:16:42 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.903721. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47949 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82770 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13994 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98149 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45669 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12597 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 280057 words processed Wed Nov 18 02:16:56 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.899957. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48166 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85302 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19754 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99701 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46618 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12636 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 320106 words processed Wed Nov 18 02:17:10 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.897610. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47912 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84476 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18961 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00039 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46583 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12642 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 360024 words processed Wed Nov 18 02:17:23 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.895884. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47563 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84060 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15261 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98103 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45695 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12604 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 400089 words processed Wed Nov 18 02:17:36 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.893060. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47685 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83361 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16474 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99531 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46391 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12549 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 440067 words processed Wed Nov 18 02:17:49 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.893671. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47527 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81839 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45423 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12510 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 480051 words processed Wed Nov 18 02:18:02 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.893922. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47463 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81831 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11020 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97402 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45346 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12497 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 520140 words processed Wed Nov 18 02:18:15 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.893072. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47545 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82853 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15001 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98998 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46178 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 560132 words processed Wed Nov 18 02:18:28 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.892834. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47470 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81743 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97350 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45404 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12529 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 600118 words processed Wed Nov 18 02:18:41 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.890274. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47472 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81966 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11592 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97507 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45486 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12526 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 640090 words processed Wed Nov 18 02:18:54 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.887903. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47447 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81847 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11164 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97392 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45461 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12488 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 680075 words processed Wed Nov 18 02:19:07 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.886349. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47464 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82386 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11944 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97564 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45366 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12500 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 720043 words processed Wed Nov 18 02:19:20 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.885044. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47403 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82015 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11988 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97766 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45468 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12511 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 760012 words processed Wed Nov 18 02:19:33 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.882894. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47432 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82212 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12320 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97828 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45573 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12500 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 800113 words processed Wed Nov 18 02:19:47 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.882540. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47800 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85160 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20185 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46880 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12616 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 840089 words processed Wed Nov 18 02:20:00 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.881040. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47571 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82968 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98432 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45712 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12596 clock time +[SCHEDULER ITER31 LR0.00078364164096]: 880052 words processed Wed Nov 18 02:20:13 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.880507. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47439 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82158 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97933 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45469 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12574 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER31 LR0.00078364164096]: Displaying result: +[SCHEDULER ITER31 LR0.00078364164096]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.431197879376> <PPL_OOV 75.9270359518> <LOGP -1747995.8520004> +[SCHEDULER ITER31 LR0.00078364164096]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER31 LR0.00078364164096]: shuffling training file +===PEEK ON TEST 31=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER31 LR0.00078364164096]: 40087 words processed Wed Nov 18 02:20:23 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-2.101190. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48466 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83412 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56044 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11991 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER31 LR0.00078364164096]: Displaying result: +[SCHEDULER ITER31 LR0.00078364164096]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.28426876172> <PPL_OOV 126.86526752386> <LOGP -173378.54202602> +[SCHEDULER ITER31 LR0.00078364164096]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 31=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER31 LR0.00078364164096]: 40095 words processed Wed Nov 18 02:20:34 2015. + [SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-2.176852. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48467 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83837 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.56509 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12030 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER31 LR0.00078364164096]: Displaying result: +[SCHEDULER ITER31 LR0.00078364164096]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.22134668534> <PPL_OOV 133.60601825601> <LOGP -156800.92733013> +[SCHEDULER ITER31 LR0.00078364164096]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER31 LR0.00078364164096]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.31... + +[SCHEDULER ITER32 LR0.000470184984576]: preparing parameters... +[SCHEDULER ITER32 LR0.000470184984576]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.31... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46034718 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46039572 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92312284 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92428540 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94320874 +[SCHEDULER ITER32 LR0.000470184984576]: preparing parameters end. +[SCHEDULER ITER32 LR0.000470184984576]: preparing layers... +(02:20:45 2015-11-18)[nerv] info: create layer: recurrentL1 +(02:20:45 2015-11-18)[nerv] info: create layer: sigmoidL1 +(02:20:45 2015-11-18)[nerv] info: create layer: combinerL1 +(02:20:45 2015-11-18)[nerv] info: create layer: outputL +(02:20:45 2015-11-18)[nerv] info: create layer: softmaxL +(02:20:45 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER32 LR0.000470184984576]: preparing layers end. +[SCHEDULER ITER32 LR0.000470184984576]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER32 LR0.000470184984576]: Initing TNN end. +===ITERATION 32 LR 0.000470=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER32 LR0.000470184984576]: 40092 words processed Wed Nov 18 02:20:58 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.916317. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48678 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80814 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18681 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46831 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12497 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 80099 words processed Wed Nov 18 02:21:11 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.911870. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48546 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79978 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14271 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00132 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45710 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12511 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 120004 words processed Wed Nov 18 02:21:24 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.906990. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48225 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78443 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11651 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99704 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45257 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12447 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 160114 words processed Wed Nov 18 02:21:37 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.907631. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48488 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80414 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17403 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01957 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46479 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12516 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 200066 words processed Wed Nov 18 02:21:50 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.907103. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48085 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79178 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12872 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00040 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45676 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12470 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 240045 words processed Wed Nov 18 02:22:03 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.903548. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47891 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78402 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11018 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99654 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45406 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12471 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 280057 words processed Wed Nov 18 02:22:16 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.899787. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48008 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79795 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15696 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01550 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46218 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12490 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 320106 words processed Wed Nov 18 02:22:29 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.897441. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47956 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80744 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17757 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46552 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12512 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 360024 words processed Wed Nov 18 02:22:42 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.895721. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47738 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79665 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14177 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00664 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45885 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12521 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 400089 words processed Wed Nov 18 02:22:55 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.892898. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47696 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81402 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18095 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02093 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46649 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12571 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 440067 words processed Wed Nov 18 02:23:08 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.893509. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47513 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79395 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12699 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00271 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45690 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12498 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 480051 words processed Wed Nov 18 02:23:21 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.893763. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47577 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80002 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00537 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45896 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12520 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 520140 words processed Wed Nov 18 02:23:34 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.892915. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47616 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79736 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15120 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46273 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12505 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 560132 words processed Wed Nov 18 02:23:47 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.892679. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47441 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77917 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09468 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99404 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45272 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12421 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 600118 words processed Wed Nov 18 02:24:00 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.890118. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78364 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10842 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99855 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45479 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12474 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 640090 words processed Wed Nov 18 02:24:13 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.887748. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47339 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78330 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10550 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99784 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45433 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12439 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 680075 words processed Wed Nov 18 02:24:27 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.886192. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48061 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82601 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20034 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02041 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46725 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12742 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 720043 words processed Wed Nov 18 02:24:41 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.884888. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48543 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85108 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.24924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02878 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47203 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12886 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 760012 words processed Wed Nov 18 02:24:55 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.882738. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48512 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85024 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.24686 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02789 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47207 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12838 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 800113 words processed Wed Nov 18 02:25:09 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.882383. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47765 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81234 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18636 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02363 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46882 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12606 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 840089 words processed Wed Nov 18 02:25:22 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.880882. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47357 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78161 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10372 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99705 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45546 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12436 clock time +[SCHEDULER ITER32 LR0.000470184984576]: 880052 words processed Wed Nov 18 02:25:35 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.880349. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78181 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10547 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99679 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45530 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12445 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER32 LR0.000470184984576]: Displaying result: +[SCHEDULER ITER32 LR0.000470184984576]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.398816118862> <PPL_OOV 75.899411719649> <LOGP -1747848.9431122> +[SCHEDULER ITER32 LR0.000470184984576]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER32 LR0.000470184984576]: shuffling training file +===PEEK ON TEST 32=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER32 LR0.000470184984576]: 40087 words processed Wed Nov 18 02:25:45 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-2.101053. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49133 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84555 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.58612 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12231 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER32 LR0.000470184984576]: Displaying result: +[SCHEDULER ITER32 LR0.000470184984576]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.24083558061> <PPL_OOV 126.82368054716> <LOGP -173366.80507176> +[SCHEDULER ITER32 LR0.000470184984576]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 32=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER32 LR0.000470184984576]: 40095 words processed Wed Nov 18 02:25:56 2015. + [SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-2.176735. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48523 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81243 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54352 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12074 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER32 LR0.000470184984576]: Displaying result: +[SCHEDULER ITER32 LR0.000470184984576]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.17373819959> <PPL_OOV 133.55978966694> <LOGP -156789.84158264> +[SCHEDULER ITER32 LR0.000470184984576]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER32 LR0.000470184984576]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.32... + +[SCHEDULER ITER33 LR0.0002821109907456]: preparing parameters... +[SCHEDULER ITER33 LR0.0002821109907456]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.32... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1892335 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1897189 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48169887 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48286142 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94320865 +[SCHEDULER ITER33 LR0.0002821109907456]: preparing parameters end. +[SCHEDULER ITER33 LR0.0002821109907456]: preparing layers... +(02:26:07 2015-11-18)[nerv] info: create layer: recurrentL1 +(02:26:07 2015-11-18)[nerv] info: create layer: sigmoidL1 +(02:26:07 2015-11-18)[nerv] info: create layer: combinerL1 +(02:26:07 2015-11-18)[nerv] info: create layer: outputL +(02:26:07 2015-11-18)[nerv] info: create layer: softmaxL +(02:26:07 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER33 LR0.0002821109907456]: preparing layers end. +[SCHEDULER ITER33 LR0.0002821109907456]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER33 LR0.0002821109907456]: Initing TNN end. +===ITERATION 33 LR 0.000282=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER33 LR0.0002821109907456]: 40092 words processed Wed Nov 18 02:26:20 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.916222. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.89155 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.30015 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02130 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.48331 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12890 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 80099 words processed Wed Nov 18 02:26:34 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.911774. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49649 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86263 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.23421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00031 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47155 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12938 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 120004 words processed Wed Nov 18 02:26:48 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.906887. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49427 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86918 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.24397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00024 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47148 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12971 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 160114 words processed Wed Nov 18 02:27:02 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.907526. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48746 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83966 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19208 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99872 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46845 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12714 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 200066 words processed Wed Nov 18 02:27:15 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.906999. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48147 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81190 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12831 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97936 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46017 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12618 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 240045 words processed Wed Nov 18 02:27:28 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.903439. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81111 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12027 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97686 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45846 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12562 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 280057 words processed Wed Nov 18 02:27:41 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.899680. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47918 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81281 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14140 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98890 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46407 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12599 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 320106 words processed Wed Nov 18 02:27:54 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.897335. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82791 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17250 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99795 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46827 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12653 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 360024 words processed Wed Nov 18 02:28:07 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.895619. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47675 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81623 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12868 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97892 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45880 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12594 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 400089 words processed Wed Nov 18 02:28:20 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.892797. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47602 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81633 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14351 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99122 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46538 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12579 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 440067 words processed Wed Nov 18 02:28:33 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.893407. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80196 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09595 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97180 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45653 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12594 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 480051 words processed Wed Nov 18 02:28:46 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.893664. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79440 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08176 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96949 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45480 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12536 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 520140 words processed Wed Nov 18 02:28:59 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.892818. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47660 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81020 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13318 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98828 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46349 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12602 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 560132 words processed Wed Nov 18 02:29:12 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.892582. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47347 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79628 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08106 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96864 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45349 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12513 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 600118 words processed Wed Nov 18 02:29:25 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.890022. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47333 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79568 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08476 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45503 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12543 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 640090 words processed Wed Nov 18 02:29:38 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.887652. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47487 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81029 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11788 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97795 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46041 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12645 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 680075 words processed Wed Nov 18 02:29:51 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.886095. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47435 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80130 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09692 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97275 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45745 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12578 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 720043 words processed Wed Nov 18 02:30:04 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.884791. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47307 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79797 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08920 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97159 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45466 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12523 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 760012 words processed Wed Nov 18 02:30:17 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.882641. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47247 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79318 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08056 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.96993 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45395 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12505 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 800113 words processed Wed Nov 18 02:30:30 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.882286. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47578 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81365 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13810 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98923 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46507 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12590 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 840089 words processed Wed Nov 18 02:30:43 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.880784. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47793 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81662 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12822 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97927 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45988 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12705 clock time +[SCHEDULER ITER33 LR0.0002821109907456]: 880052 words processed Wed Nov 18 02:30:57 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.880250. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48359 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85338 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19994 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99167 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46787 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12870 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER33 LR0.0002821109907456]: Displaying result: +[SCHEDULER ITER33 LR0.0002821109907456]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.377824942775> <PPL_OOV 75.882174723551> <LOGP -1747757.2476635> +[SCHEDULER ITER33 LR0.0002821109907456]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER33 LR0.0002821109907456]: shuffling training file +===PEEK ON TEST 33=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER33 LR0.0002821109907456]: 40087 words processed Wed Nov 18 02:31:07 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-2.100965. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81314 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54102 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12097 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER33 LR0.0002821109907456]: Displaying result: +[SCHEDULER ITER33 LR0.0002821109907456]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.22626804684> <PPL_OOV 126.7969565019> <LOGP -173359.26080184> +[SCHEDULER ITER33 LR0.0002821109907456]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 33=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER33 LR0.0002821109907456]: 40095 words processed Wed Nov 18 02:31:18 2015. + [SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-2.176677. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48435 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82588 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55429 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12190 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER33 LR0.0002821109907456]: Displaying result: +[SCHEDULER ITER33 LR0.0002821109907456]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.16012333483> <PPL_OOV 133.53521831947> <LOGP -156783.9477416> +[SCHEDULER ITER33 LR0.0002821109907456]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER33 LR0.0002821109907456]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.33... + +[SCHEDULER ITER34 LR0.00016926659444736]: preparing parameters... +[SCHEDULER ITER34 LR0.00016926659444736]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.33... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46034721 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46039575 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92312276 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92428531 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94320866 +[SCHEDULER ITER34 LR0.00016926659444736]: preparing parameters end. +[SCHEDULER ITER34 LR0.00016926659444736]: preparing layers... +(02:31:29 2015-11-18)[nerv] info: create layer: recurrentL1 +(02:31:29 2015-11-18)[nerv] info: create layer: sigmoidL1 +(02:31:29 2015-11-18)[nerv] info: create layer: combinerL1 +(02:31:29 2015-11-18)[nerv] info: create layer: outputL +(02:31:29 2015-11-18)[nerv] info: create layer: softmaxL +(02:31:29 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER34 LR0.00016926659444736]: preparing layers end. +[SCHEDULER ITER34 LR0.00016926659444736]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER34 LR0.00016926659444736]: Initing TNN end. +===ITERATION 34 LR 0.000169=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER34 LR0.00016926659444736]: 40092 words processed Wed Nov 18 02:31:42 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.916173. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48488 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79021 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02256 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46890 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12511 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 80099 words processed Wed Nov 18 02:31:55 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.911717. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48343 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77312 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10440 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00005 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45516 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12506 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 120004 words processed Wed Nov 18 02:32:08 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.906826. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48231 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78102 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11991 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00452 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45404 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12518 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 160114 words processed Wed Nov 18 02:32:21 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.907464. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48318 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78485 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14037 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01576 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46273 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12488 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 200066 words processed Wed Nov 18 02:32:34 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.906938. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47885 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77038 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09676 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99912 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45434 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12507 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 240045 words processed Wed Nov 18 02:32:47 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.903374. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47901 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77661 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10645 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00105 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45558 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12495 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 280057 words processed Wed Nov 18 02:33:00 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.899616. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48121 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79563 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16263 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02084 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46547 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12559 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 320106 words processed Wed Nov 18 02:33:13 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.897270. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47942 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79212 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15761 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02129 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46506 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12535 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 360024 words processed Wed Nov 18 02:33:26 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.895556. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47355 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77601 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10014 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99994 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45397 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12514 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 400089 words processed Wed Nov 18 02:33:39 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.892737. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47682 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78990 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14833 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01864 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46572 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12532 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 440067 words processed Wed Nov 18 02:33:52 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.893346. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77901 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10672 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00317 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45643 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12542 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 480051 words processed Wed Nov 18 02:34:05 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.893605. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47399 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78291 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00672 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45908 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12531 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 520140 words processed Wed Nov 18 02:34:18 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.892761. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47851 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80545 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17811 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02700 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46729 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12564 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 560132 words processed Wed Nov 18 02:34:31 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.892524. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47556 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79394 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14106 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01157 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46256 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12667 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 600118 words processed Wed Nov 18 02:34:44 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.889963. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77955 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11258 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00609 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45841 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 640090 words processed Wed Nov 18 02:34:57 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.887594. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47547 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79635 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01019 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46276 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12543 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 680075 words processed Wed Nov 18 02:35:10 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.886037. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47482 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78463 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12101 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00680 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45907 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12559 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 720043 words processed Wed Nov 18 02:35:23 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.884732. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47610 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78831 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12646 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00634 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45859 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12553 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 760012 words processed Wed Nov 18 02:35:36 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.882582. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47379 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77931 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11117 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00543 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45653 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12578 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 800113 words processed Wed Nov 18 02:35:49 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.882227. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80534 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17930 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.02823 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46896 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12618 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 840089 words processed Wed Nov 18 02:36:02 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.880725. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47580 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79459 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13631 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01001 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45899 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12539 clock time +[SCHEDULER ITER34 LR0.00016926659444736]: 880052 words processed Wed Nov 18 02:36:15 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.880191. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47585 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78171 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11604 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00459 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45726 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12526 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER34 LR0.00016926659444736]: Displaying result: +[SCHEDULER ITER34 LR0.00016926659444736]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.365469157621> <PPL_OOV 75.871778747022> <LOGP -1747701.9342373> +[SCHEDULER ITER34 LR0.00016926659444736]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER34 LR0.00016926659444736]: shuffling training file +===PEEK ON TEST 34=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER34 LR0.00016926659444736]: 40087 words processed Wed Nov 18 02:36:25 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-2.100911. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48546 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79941 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.52867 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12060 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER34 LR0.00016926659444736]: Displaying result: +[SCHEDULER ITER34 LR0.00016926659444736]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.2270950014> <PPL_OOV 126.78024520746> <LOGP -173354.54235036> +[SCHEDULER ITER34 LR0.00016926659444736]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 34=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER34 LR0.00016926659444736]: 40095 words processed Wed Nov 18 02:36:36 2015. + [SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-2.176652. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48420 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79263 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.51891 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12022 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER34 LR0.00016926659444736]: Displaying result: +[SCHEDULER ITER34 LR0.00016926659444736]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.16478355106> <PPL_OOV 133.52438706087> <LOGP -156781.34934203> +[SCHEDULER ITER34 LR0.00016926659444736]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER34 LR0.00016926659444736]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.34... + +[SCHEDULER ITER35 LR0.00010155995666842]: preparing parameters... +[SCHEDULER ITER35 LR0.00010155995666842]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.34... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1892335 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1897189 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 48169888 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48286143 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94320861 +[SCHEDULER ITER35 LR0.00010155995666842]: preparing parameters end. +[SCHEDULER ITER35 LR0.00010155995666842]: preparing layers... +(02:36:47 2015-11-18)[nerv] info: create layer: recurrentL1 +(02:36:47 2015-11-18)[nerv] info: create layer: sigmoidL1 +(02:36:47 2015-11-18)[nerv] info: create layer: combinerL1 +(02:36:47 2015-11-18)[nerv] info: create layer: outputL +(02:36:47 2015-11-18)[nerv] info: create layer: softmaxL +(02:36:47 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER35 LR0.00010155995666842]: preparing layers end. +[SCHEDULER ITER35 LR0.00010155995666842]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER35 LR0.00010155995666842]: Initing TNN end. +===ITERATION 35 LR 0.000102=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER35 LR0.00010155995666842]: 40092 words processed Wed Nov 18 02:37:00 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.916146. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48536 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82084 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16636 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99950 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46504 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12606 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 80099 words processed Wed Nov 18 02:37:13 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.911684. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48428 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79784 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09963 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97450 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45199 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12518 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 120004 words processed Wed Nov 18 02:37:26 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.906792. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48187 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80061 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10771 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97667 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45254 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12534 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 160114 words processed Wed Nov 18 02:37:39 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.907428. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48346 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82102 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16213 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99730 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46525 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12594 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 200066 words processed Wed Nov 18 02:37:52 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.906903. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47936 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81529 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98417 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45836 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12658 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 240045 words processed Wed Nov 18 02:38:05 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.903337. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48220 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81476 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.13987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98665 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45966 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12660 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 280057 words processed Wed Nov 18 02:38:18 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.899580. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48189 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83121 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.18229 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00259 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46637 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12651 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 320106 words processed Wed Nov 18 02:38:31 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.897233. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47751 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81373 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14563 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99387 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46353 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12611 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 360024 words processed Wed Nov 18 02:38:44 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.895520. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47451 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79691 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97567 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45418 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12555 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 400089 words processed Wed Nov 18 02:38:57 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.892702. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47677 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81424 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14333 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99364 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46323 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12619 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 440067 words processed Wed Nov 18 02:39:10 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.893311. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47431 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81686 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12920 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98289 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45795 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12636 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 480051 words processed Wed Nov 18 02:39:24 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.893571. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48808 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86001 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.22562 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00583 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46966 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12821 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 520140 words processed Wed Nov 18 02:39:37 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.892728. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47709 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82750 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16855 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99863 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46673 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12635 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 560132 words processed Wed Nov 18 02:39:50 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.892491. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47491 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81715 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12926 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98407 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45836 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12639 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 600118 words processed Wed Nov 18 02:40:03 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.889929. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47540 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81955 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14473 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99121 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46166 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12617 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 640090 words processed Wed Nov 18 02:40:16 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.887560. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47553 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80900 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11958 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98301 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45746 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12600 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 680075 words processed Wed Nov 18 02:40:29 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.886002. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47433 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80222 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10608 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97947 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45713 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12584 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 720043 words processed Wed Nov 18 02:40:42 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.884698. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47346 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80491 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11093 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98196 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45611 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12544 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 760012 words processed Wed Nov 18 02:40:55 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.882549. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47267 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80341 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10355 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97780 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45556 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12565 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 800113 words processed Wed Nov 18 02:41:08 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.882193. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82098 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.15385 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99684 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46404 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12634 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 840089 words processed Wed Nov 18 02:41:21 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.880691. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47555 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80952 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11881 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98250 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45697 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12547 clock time +[SCHEDULER ITER35 LR0.00010155995666842]: 880052 words processed Wed Nov 18 02:41:34 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.880156. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47466 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81422 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12843 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98333 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45924 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12621 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER35 LR0.00010155995666842]: Displaying result: +[SCHEDULER ITER35 LR0.00010155995666842]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.359102563603> <PPL_OOV 75.865754322638> <LOGP -1747669.8768723> +[SCHEDULER ITER35 LR0.00010155995666842]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER35 LR0.00010155995666842]: shuffling training file +===PEEK ON TEST 35=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER35 LR0.00010155995666842]: 40087 words processed Wed Nov 18 02:41:44 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-2.100879. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82830 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.55676 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12067 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER35 LR0.00010155995666842]: Displaying result: +[SCHEDULER ITER35 LR0.00010155995666842]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.23100281009> <PPL_OOV 126.7699956397> <LOGP -173351.64806645> +[SCHEDULER ITER35 LR0.00010155995666842]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 35=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER35 LR0.00010155995666842]: 40095 words processed Wed Nov 18 02:41:55 2015. + [SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-2.176640. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48464 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81537 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.54144 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12010 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER35 LR0.00010155995666842]: Displaying result: +[SCHEDULER ITER35 LR0.00010155995666842]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.17361284705> <PPL_OOV 133.52072369531> <LOGP -156780.47045947> +[SCHEDULER ITER35 LR0.00010155995666842]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER35 LR0.00010155995666842]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.35... + +===VALIDATION PPL record=== +<ITER0 LR0.00000 train:0.000 valid:10730.852 test:0.000> +<ITER1 LR1.00000 train:472.152 valid:339.931 test:331.979> +<ITER2 LR1.00000 train:310.376 valid:261.288 test:250.010> +<ITER3 LR1.00000 train:273.438 valid:231.972 test:220.358> +<ITER4 LR1.00000 train:215.234 valid:213.186 test:202.803> +<ITER5 LR1.00000 train:193.120 valid:199.747 test:189.986> +<ITER6 LR1.00000 train:175.944 valid:188.495 test:179.857> +<ITER7 LR1.00000 train:164.241 valid:180.795 test:173.114> +<ITER8 LR1.00000 train:154.367 valid:176.466 test:168.703> +<ITER9 LR1.00000 train:146.347 valid:172.634 test:164.853> +<ITER10 LR1.00000 train:140.814 valid:169.566 test:162.153> +<ITER11 LR1.00000 train:134.447 valid:167.703 test:159.878> +<ITER12 LR1.00000 train:130.130 valid:166.497 test:158.732> +<ITER13 LR1.00000 train:125.432 valid:165.068 test:156.851> +<ITER14 LR1.00000 train:121.417 valid:164.195 test:155.989> +<ITER15 LR1.00000 train:117.850 valid:163.768 test:155.523> +<ITER16 LR1.00000 train:114.808 valid:162.504 test:154.272> +<ITER17 LR1.00000 train:111.993 valid:162.514 test:153.963> +<ITER18 LR0.60000 train:100.190 valid:152.977 test:144.878> +<ITER19 LR0.36000 train:91.564 valid:146.247 test:138.433> +<ITER20 LR0.21600 train:86.112 valid:141.705 test:134.208> +<ITER21 LR0.12960 train:82.572 valid:138.868 test:131.590> +<ITER22 LR0.07776 train:80.227 valid:137.222 test:130.065> +<ITER23 LR0.04666 train:78.724 valid:136.155 test:129.067> +<ITER24 LR0.02799 train:77.720 valid:135.442 test:128.391> +<ITER25 LR0.01680 train:77.031 valid:134.842 test:127.867> +<ITER26 LR0.01008 train:76.596 valid:134.389 test:127.500> +<ITER27 LR0.00605 train:76.322 valid:134.082 test:127.254> +<ITER28 LR0.00363 train:76.149 valid:133.895 test:127.101> +<ITER29 LR0.00218 train:76.039 valid:133.773 test:127.000> +<ITER30 LR0.00131 train:75.971 valid:133.678 test:126.925> +<ITER31 LR0.00078 train:75.927 valid:133.606 test:126.865> +<ITER32 LR0.00047 train:75.899 valid:133.560 test:126.824> +<ITER33 LR0.00028 train:75.882 valid:133.535 test:126.797> +<ITER34 LR0.00017 train:75.872 valid:133.524 test:126.780> +<ITER35 LR0.00010 train:75.866 valid:133.521 test:126.770> + +===FINAL TEST=== +[SCHEDULER FINAL_TEST]: preparing parameters... +[SCHEDULER FINAL_TEST]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.35... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46034721 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46039575 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92312275 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92428530 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94320866 +[SCHEDULER FINAL_TEST]: preparing parameters end. +[SCHEDULER FINAL_TEST]: preparing layers... +(02:42:06 2015-11-18)[nerv] info: create layer: recurrentL1 +(02:42:06 2015-11-18)[nerv] info: create layer: sigmoidL1 +(02:42:06 2015-11-18)[nerv] info: create layer: combinerL1 +(02:42:06 2015-11-18)[nerv] info: create layer: outputL +(02:42:06 2015-11-18)[nerv] info: create layer: softmaxL +(02:42:06 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER FINAL_TEST]: preparing layers end. +[SCHEDULER FINAL_TEST]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER FINAL_TEST]: Initing TNN end. +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER FINAL_TEST]: 40087 words processed Wed Nov 18 02:42:12 2015. + [SCHEDULER FINAL_TEST]: log prob per sample :-2.100879. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84059 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.57532 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12121 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER FINAL_TEST]: Displaying result: +[SCHEDULER FINAL_TEST]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 145.23100213441> <PPL_OOV 126.76999500943> <LOGP -173351.64788846> +[SCHEDULER FINAL_TEST]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. |