diff options
Diffstat (limited to 'nerv/examples/lmptb/logs/LOG-tnn-h300')
| -rw-r--r-- | nerv/examples/lmptb/logs/LOG-tnn-h300 | 9372 |
1 files changed, 9372 insertions, 0 deletions
diff --git a/nerv/examples/lmptb/logs/LOG-tnn-h300 b/nerv/examples/lmptb/logs/LOG-tnn-h300 new file mode 100644 index 0000000..77fd612 --- /dev/null +++ b/nerv/examples/lmptb/logs/LOG-tnn-h300 @@ -0,0 +1,9372 @@ +Greetings +[SCHEDULER]: applying arg[2](global_conf.hidden_size=300)... +[SCHEDULER]: printing global_conf... +test_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds +train_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.train.txt.adds +param_random function: 0x40237598 +train_fn_shuf_bak /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf_bak +decay_iter 16 +mmat_type table: 0x409280f8 +vocab_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab +train_fn_shuf /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf +param_fn /home/slhome/txh18/workspace/nerv/play/dagL_test/params +log_w_num 40000 +work_dir /home/slhome/txh18/workspace/nerv/play/dagL_test +batch_size 10 +hidden_size 300 +timer nerv.Timer +sche_log_pre [SCHEDULER]: +nn_act_default 0 +max_iter 35 +valid_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds +lrate 1 +momentum 0 +wcost 1e-05 +chunk_size 15 +cumat_type table: 0x40935010 +[SCHEDULER]: printing training scheduling options... +lr_half false +start_iter -1 +ppl_last 100000 +[SCHEDULER]: printing training scheduling end. +[SCHEDULER]: creating work_dir... +[SCHEDULER]: building vocab... +[LOG]LMVocab: Vocab building on file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab... +[LOG]LMVocab: Building finished, vocab size now is 10000. +[SCHEDULER]: preparing parameters... +[SCHEDULER]: first time, generating parameters... +===INITIAL VALIDATION=== +[SCHEDULER]: preparing parameters... +[SCHEDULER]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.0... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34510155 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 2 from 35545278 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 70045626 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 4 from 70049129 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 5 from 70164107 +[SCHEDULER]: preparing parameters end. +[SCHEDULER]: preparing layers... +(10:08:46 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:08:46 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:08:46 2015-11-18)[nerv] info: create layer: combinerL1 +(10:08:46 2015-11-18)[nerv] info: create layer: outputL +(10:08:46 2015-11-18)[nerv] info: create layer: softmaxL +(10:08:46 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER]: preparing layers end. +[SCHEDULER]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER]: Initing TNN end. +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER]: 40095 words processed Wed Nov 18 10:08:51 2015. + [SCHEDULER]: log prob per sample :-4.003230. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47666 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.10684 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.41463 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12208 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER]: Displaying result: +[SCHEDULER]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 10545.667125173> <PPL_OOV 10092.059293004> <LOGP -295333.54956309> +[SCHEDULER]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. + +[SCHEDULER ITER1 LR1]: preparing parameters... +[SCHEDULER ITER1 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.0... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34510155 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 2 from 35545278 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 70045626 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 4 from 70049129 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 5 from 70164107 +[SCHEDULER ITER1 LR1]: preparing parameters end. +[SCHEDULER ITER1 LR1]: preparing layers... +(10:08:58 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:08:58 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:08:58 2015-11-18)[nerv] info: create layer: combinerL1 +(10:08:58 2015-11-18)[nerv] info: create layer: outputL +(10:08:58 2015-11-18)[nerv] info: create layer: softmaxL +(10:08:58 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER1 LR1]: preparing layers end. +[SCHEDULER ITER1 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER1 LR1]: Initing TNN end. +===ITERATION 1 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER1 LR1]: 40099 words processed Wed Nov 18 10:09:09 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-3.210428. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47135 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75538 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22335 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57185 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10319 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12114 clock time +[SCHEDULER ITER1 LR1]: 80063 words processed Wed Nov 18 10:09:21 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-3.048713. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46917 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75080 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19680 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56019 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09740 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12030 clock time +[SCHEDULER ITER1 LR1]: 120068 words processed Wed Nov 18 10:09:33 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.984911. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47044 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74848 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18711 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55472 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09624 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12070 clock time +[SCHEDULER ITER1 LR1]: 160017 words processed Wed Nov 18 10:09:45 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.930297. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47130 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75352 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20206 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55933 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09779 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12088 clock time +[SCHEDULER ITER1 LR1]: 200138 words processed Wed Nov 18 10:09:57 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.897628. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46695 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76538 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23399 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57699 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10442 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12134 clock time +[SCHEDULER ITER1 LR1]: 240007 words processed Wed Nov 18 10:10:09 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.867407. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73963 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.15285 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54229 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.08908 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12042 clock time +[SCHEDULER ITER1 LR1]: 280135 words processed Wed Nov 18 10:10:21 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.842329. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46714 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75314 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21984 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57472 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10567 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12149 clock time +[SCHEDULER ITER1 LR1]: 320080 words processed Wed Nov 18 10:10:33 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.823036. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46701 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75169 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20551 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56419 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10051 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12255 clock time +[SCHEDULER ITER1 LR1]: 360059 words processed Wed Nov 18 10:10:45 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.800986. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47814 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.79713 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30428 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58719 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10865 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12425 clock time +[SCHEDULER ITER1 LR1]: 400021 words processed Wed Nov 18 10:10:57 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.786891. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45977 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73850 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17294 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55793 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09813 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12008 clock time +[SCHEDULER ITER1 LR1]: 440102 words processed Wed Nov 18 10:11:09 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.770894. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75843 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22462 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57475 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10523 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12179 clock time +[SCHEDULER ITER1 LR1]: 480051 words processed Wed Nov 18 10:11:21 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.754795. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46079 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74221 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17129 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55381 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09688 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12041 clock time +[SCHEDULER ITER1 LR1]: 520093 words processed Wed Nov 18 10:11:33 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.740832. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46013 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74097 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19854 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57069 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10617 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12053 clock time +[SCHEDULER ITER1 LR1]: 560039 words processed Wed Nov 18 10:11:45 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.725416. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45905 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73400 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.16478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55572 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09740 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12013 clock time +[SCHEDULER ITER1 LR1]: 600112 words processed Wed Nov 18 10:11:57 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.716177. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46687 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76335 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25973 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58834 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11483 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12277 clock time +[SCHEDULER ITER1 LR1]: 640076 words processed Wed Nov 18 10:12:09 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.705623. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46173 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74375 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17842 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55617 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09811 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12090 clock time +[SCHEDULER ITER1 LR1]: 680026 words processed Wed Nov 18 10:12:21 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.696685. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46080 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73873 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.16648 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09625 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12004 clock time +[SCHEDULER ITER1 LR1]: 720133 words processed Wed Nov 18 10:12:33 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.687998. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46041 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73861 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19165 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57016 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10446 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12015 clock time +[SCHEDULER ITER1 LR1]: 760048 words processed Wed Nov 18 10:12:45 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.676801. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45850 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73148 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.15910 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55561 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09577 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11943 clock time +[SCHEDULER ITER1 LR1]: 800117 words processed Wed Nov 18 10:12:57 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.669544. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45975 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74013 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19139 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56894 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10351 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12031 clock time +[SCHEDULER ITER1 LR1]: 840116 words processed Wed Nov 18 10:13:09 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.659602. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46031 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73769 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17842 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56008 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10197 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12018 clock time +[SCHEDULER ITER1 LR1]: 880037 words processed Wed Nov 18 10:13:20 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.652101. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45781 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73064 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.15936 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55415 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09854 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11997 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER1 LR1]: Displaying result: +[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 512.01508977938> <PPL_OOV 447.19970345812> <LOGP -2463877.0452922> +[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER1 LR1]: shuffling training file +===PEEK ON TEST 1=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER1 LR1]: 40087 words processed Wed Nov 18 10:13:30 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.504076. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46941 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75798 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.45029 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11464 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER1 LR1]: Displaying result: +[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 370.53246252795> <PPL_OOV 323.54357826836> <LOGP -206893.75941108> +[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 1=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER1 LR1]: 40095 words processed Wed Nov 18 10:13:39 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.547314. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75630 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.44636 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11481 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER1 LR1]: Displaying result: +[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 369.92944180373> <PPL_OOV 331.71274183319> <LOGP -185931.4164841> +[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER1 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.1... + +[SCHEDULER ITER2 LR1]: preparing parameters... +[SCHEDULER ITER2 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.1... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1076633 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1080289 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35608824 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35725140 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70244205 +[SCHEDULER ITER2 LR1]: preparing parameters end. +[SCHEDULER ITER2 LR1]: preparing layers... +(10:13:48 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:13:48 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:13:48 2015-11-18)[nerv] info: create layer: combinerL1 +(10:13:48 2015-11-18)[nerv] info: create layer: outputL +(10:13:48 2015-11-18)[nerv] info: create layer: softmaxL +(10:13:48 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER2 LR1]: preparing layers end. +[SCHEDULER ITER2 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER2 LR1]: Initing TNN end. +===ITERATION 2 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER2 LR1]: 40092 words processed Wed Nov 18 10:13:59 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.541969. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46836 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72598 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22414 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56508 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09968 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11795 clock time +[SCHEDULER ITER2 LR1]: 80099 words processed Wed Nov 18 10:14:11 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.535649. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73527 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21641 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55211 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09413 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11941 clock time +[SCHEDULER ITER2 LR1]: 120004 words processed Wed Nov 18 10:14:23 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.527511. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46606 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72308 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19836 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54952 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09336 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11779 clock time +[SCHEDULER ITER2 LR1]: 160114 words processed Wed Nov 18 10:14:35 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.522344. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46532 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72510 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22327 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56668 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10154 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11830 clock time +[SCHEDULER ITER2 LR1]: 200066 words processed Wed Nov 18 10:14:46 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.517881. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46174 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71860 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18739 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55076 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09280 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11754 clock time +[SCHEDULER ITER2 LR1]: 240045 words processed Wed Nov 18 10:14:58 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.512076. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46366 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72754 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21275 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55625 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09893 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11910 clock time +[SCHEDULER ITER2 LR1]: 280057 words processed Wed Nov 18 10:15:10 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.507676. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47597 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.79397 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.37668 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60190 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11988 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12311 clock time +[SCHEDULER ITER2 LR1]: 320106 words processed Wed Nov 18 10:15:22 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.500944. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46251 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73117 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22486 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56401 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10012 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11863 clock time +[SCHEDULER ITER2 LR1]: 360024 words processed Wed Nov 18 10:15:34 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.497026. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45968 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73210 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20736 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55524 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09260 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11888 clock time +[SCHEDULER ITER2 LR1]: 400089 words processed Wed Nov 18 10:15:46 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.493683. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74623 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24888 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56961 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10136 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11942 clock time +[SCHEDULER ITER2 LR1]: 440067 words processed Wed Nov 18 10:15:58 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.490451. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46117 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73519 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21602 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55836 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09430 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time +[SCHEDULER ITER2 LR1]: 480051 words processed Wed Nov 18 10:16:10 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.487587. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45998 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73365 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20277 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55319 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09232 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11882 clock time +[SCHEDULER ITER2 LR1]: 520140 words processed Wed Nov 18 10:16:22 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.484627. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45975 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72819 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21976 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56564 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10028 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11841 clock time +[SCHEDULER ITER2 LR1]: 560132 words processed Wed Nov 18 10:16:33 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.481780. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45692 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71231 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.16816 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54569 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09361 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11724 clock time +[SCHEDULER ITER2 LR1]: 600118 words processed Wed Nov 18 10:16:45 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.479088. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45915 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73072 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18993 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54640 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09120 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11835 clock time +[SCHEDULER ITER2 LR1]: 640090 words processed Wed Nov 18 10:16:57 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.475904. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45833 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72455 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54664 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09177 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11810 clock time +[SCHEDULER ITER2 LR1]: 680075 words processed Wed Nov 18 10:17:09 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.474017. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45720 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71394 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.16784 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54518 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09097 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11778 clock time +[SCHEDULER ITER2 LR1]: 720043 words processed Wed Nov 18 10:17:21 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.471783. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45892 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72588 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19146 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55005 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09232 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11806 clock time +[SCHEDULER ITER2 LR1]: 760012 words processed Wed Nov 18 10:17:33 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.469729. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46006 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73453 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21522 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55667 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09724 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11897 clock time +[SCHEDULER ITER2 LR1]: 800113 words processed Wed Nov 18 10:17:45 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.467617. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46246 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74674 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25543 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57267 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10430 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11946 clock time +[SCHEDULER ITER2 LR1]: 840089 words processed Wed Nov 18 10:17:57 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.465015. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46102 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74097 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21331 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55202 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09360 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11916 clock time +[SCHEDULER ITER2 LR1]: 880052 words processed Wed Nov 18 10:18:09 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.463152. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46119 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74489 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23141 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55830 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09725 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12007 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER2 LR1]: Displaying result: +[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 333.6037428687> <PPL_OOV 290.37375803538> <LOGP -2289538.074234> +[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER2 LR1]: shuffling training file +===PEEK ON TEST 2=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER2 LR1]: 40087 words processed Wed Nov 18 10:18:18 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.380761. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46919 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74486 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.43873 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11428 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER2 LR1]: Displaying result: +[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 275.16079647613> <PPL_OOV 242.77628129243> <LOGP -196612.55158828> +[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 2=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER2 LR1]: 40095 words processed Wed Nov 18 10:18:27 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.427169. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46685 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74609 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.43747 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11425 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER2 LR1]: Displaying result: +[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 279.88256204919> <PPL_OOV 252.80637790871> <LOGP -177229.64482119> +[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER2 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.2... + +[SCHEDULER ITER3 LR1]: preparing parameters... +[SCHEDULER ITER3 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.2... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34525805 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34529462 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69074656 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69190773 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70267310 +[SCHEDULER ITER3 LR1]: preparing parameters end. +[SCHEDULER ITER3 LR1]: preparing layers... +(10:18:36 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:18:36 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:18:36 2015-11-18)[nerv] info: create layer: combinerL1 +(10:18:36 2015-11-18)[nerv] info: create layer: outputL +(10:18:36 2015-11-18)[nerv] info: create layer: softmaxL +(10:18:36 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER3 LR1]: preparing layers end. +[SCHEDULER ITER3 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER3 LR1]: Initing TNN end. +===ITERATION 3 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER3 LR1]: 40092 words processed Wed Nov 18 10:18:47 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.536047. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46841 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72824 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22868 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56381 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10451 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11928 clock time +[SCHEDULER ITER3 LR1]: 80099 words processed Wed Nov 18 10:18:58 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.483923. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46813 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71587 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55022 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09750 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11941 clock time +[SCHEDULER ITER3 LR1]: 120004 words processed Wed Nov 18 10:19:10 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.458421. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46654 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71644 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18811 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54561 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09506 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11902 clock time +[SCHEDULER ITER3 LR1]: 160114 words processed Wed Nov 18 10:19:22 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.448869. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46564 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72314 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21041 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55762 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10313 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11887 clock time +[SCHEDULER ITER3 LR1]: 200066 words processed Wed Nov 18 10:19:34 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.441952. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46164 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72174 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18569 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54325 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09779 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11905 clock time +[SCHEDULER ITER3 LR1]: 240045 words processed Wed Nov 18 10:19:46 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.432993. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72148 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19430 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54829 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09770 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11958 clock time +[SCHEDULER ITER3 LR1]: 280057 words processed Wed Nov 18 10:19:58 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.427091. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46420 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72248 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22334 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56521 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10595 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11918 clock time +[SCHEDULER ITER3 LR1]: 320106 words processed Wed Nov 18 10:20:10 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.420076. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46241 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73121 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23973 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57037 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10789 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11974 clock time +[SCHEDULER ITER3 LR1]: 360024 words processed Wed Nov 18 10:20:22 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.416144. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46100 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72642 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20227 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55015 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09891 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11940 clock time +[SCHEDULER ITER3 LR1]: 400089 words processed Wed Nov 18 10:20:34 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.412820. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46143 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73168 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23198 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56644 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10677 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12013 clock time +[SCHEDULER ITER3 LR1]: 440067 words processed Wed Nov 18 10:20:46 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.410263. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46165 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72661 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19516 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54854 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09580 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11913 clock time +[SCHEDULER ITER3 LR1]: 480051 words processed Wed Nov 18 10:20:58 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.407979. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46140 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72909 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20697 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55568 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09783 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11971 clock time +[SCHEDULER ITER3 LR1]: 520140 words processed Wed Nov 18 10:21:10 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.405734. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46027 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72708 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22339 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56616 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10415 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11944 clock time +[SCHEDULER ITER3 LR1]: 560132 words processed Wed Nov 18 10:21:22 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.403532. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45910 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71769 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18242 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54602 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09924 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11878 clock time +[SCHEDULER ITER3 LR1]: 600118 words processed Wed Nov 18 10:21:33 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.401175. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45834 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71657 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17742 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54693 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09537 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11830 clock time +[SCHEDULER ITER3 LR1]: 640090 words processed Wed Nov 18 10:21:45 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.398582. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45838 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71715 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17104 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54186 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09427 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11879 clock time +[SCHEDULER ITER3 LR1]: 680075 words processed Wed Nov 18 10:21:57 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.397244. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46118 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73236 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55627 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09701 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12054 clock time +[SCHEDULER ITER3 LR1]: 720043 words processed Wed Nov 18 10:22:09 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.396091. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46029 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72831 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20086 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55243 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09483 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11977 clock time +[SCHEDULER ITER3 LR1]: 760012 words processed Wed Nov 18 10:22:21 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.394789. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46249 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72900 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20841 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55161 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10074 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11922 clock time +[SCHEDULER ITER3 LR1]: 800113 words processed Wed Nov 18 10:22:33 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.393428. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45947 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72019 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20872 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56109 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10514 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11855 clock time +[SCHEDULER ITER3 LR1]: 840089 words processed Wed Nov 18 10:22:45 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.391343. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71939 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17808 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54550 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09538 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11851 clock time +[SCHEDULER ITER3 LR1]: 880052 words processed Wed Nov 18 10:22:57 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.389966. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45967 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72022 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18124 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.54495 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09355 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11946 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER3 LR1]: Displaying result: +[SCHEDULER ITER3 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 280.05523911791> <PPL_OOV 245.39663556928> <LOGP -2221595.5658898> +[SCHEDULER ITER3 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER3 LR1]: shuffling training file +===PEEK ON TEST 3=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER3 LR1]: 40087 words processed Wed Nov 18 10:23:06 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.338319. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46632 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73173 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.42069 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11427 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER3 LR1]: Displaying result: +[SCHEDULER ITER3 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 249.21738984732> <PPL_OOV 218.98102897851> <LOGP -192919.70714879> +[SCHEDULER ITER3 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 3=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER3 LR1]: 40095 words processed Wed Nov 18 10:23:15 2015. + [SCHEDULER ITER3 LR1]: log prob per sample :-2.387513. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46562 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73144 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.41963 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11445 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER3 LR1]: Displaying result: +[SCHEDULER ITER3 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 253.6486382493> <PPL_OOV 228.35790895447> <LOGP -173971.52040645> +[SCHEDULER ITER3 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER3 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.3... + +[SCHEDULER ITER4 LR1]: preparing parameters... +[SCHEDULER ITER4 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.3... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1076112 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1079769 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35639160 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35755265 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70285481 +[SCHEDULER ITER4 LR1]: preparing parameters end. +[SCHEDULER ITER4 LR1]: preparing layers... +(10:23:24 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:23:24 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:23:24 2015-11-18)[nerv] info: create layer: combinerL1 +(10:23:24 2015-11-18)[nerv] info: create layer: outputL +(10:23:24 2015-11-18)[nerv] info: create layer: softmaxL +(10:23:24 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER4 LR1]: preparing layers end. +[SCHEDULER ITER4 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER4 LR1]: Initing TNN end. +===ITERATION 4 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER4 LR1]: 40092 words processed Wed Nov 18 10:23:35 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.356761. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47160 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75773 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.29264 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58409 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10959 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11998 clock time +[SCHEDULER ITER4 LR1]: 80099 words processed Wed Nov 18 10:23:47 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.354343. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46970 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73607 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21454 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55435 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09187 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11917 clock time +[SCHEDULER ITER4 LR1]: 120004 words processed Wed Nov 18 10:23:59 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.348934. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46688 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73326 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55149 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09277 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11852 clock time +[SCHEDULER ITER4 LR1]: 160114 words processed Wed Nov 18 10:24:11 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.350011. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47103 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76141 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.29215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58396 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10589 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12027 clock time +[SCHEDULER ITER4 LR1]: 200066 words processed Wed Nov 18 10:24:23 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.350221. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46486 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74205 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22571 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55842 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09508 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11912 clock time +[SCHEDULER ITER4 LR1]: 240045 words processed Wed Nov 18 10:24:35 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.346361. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46475 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75070 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24038 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56038 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09840 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11952 clock time +[SCHEDULER ITER4 LR1]: 280057 words processed Wed Nov 18 10:24:47 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.343892. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46855 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75436 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27547 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57787 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10433 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11990 clock time +[SCHEDULER ITER4 LR1]: 320106 words processed Wed Nov 18 10:24:59 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.340016. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46557 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75534 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27682 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58157 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10343 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12000 clock time +[SCHEDULER ITER4 LR1]: 360024 words processed Wed Nov 18 10:25:11 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.338481. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46402 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75085 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25085 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56377 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10167 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11995 clock time +[SCHEDULER ITER4 LR1]: 400089 words processed Wed Nov 18 10:25:23 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.336970. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46259 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75447 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26929 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57941 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10384 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11980 clock time +[SCHEDULER ITER4 LR1]: 440067 words processed Wed Nov 18 10:25:35 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.336232. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46305 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74314 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22687 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55912 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09659 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11915 clock time +[SCHEDULER ITER4 LR1]: 480051 words processed Wed Nov 18 10:25:47 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.335499. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46142 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74277 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22475 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55799 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09857 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11955 clock time +[SCHEDULER ITER4 LR1]: 520140 words processed Wed Nov 18 10:25:59 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.334860. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46425 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75886 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27816 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58048 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10432 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12038 clock time +[SCHEDULER ITER4 LR1]: 560132 words processed Wed Nov 18 10:26:11 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.333952. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46205 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74473 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22480 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56016 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09360 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11929 clock time +[SCHEDULER ITER4 LR1]: 600118 words processed Wed Nov 18 10:26:23 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.332777. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46069 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74222 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21981 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55734 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09515 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11931 clock time +[SCHEDULER ITER4 LR1]: 640090 words processed Wed Nov 18 10:26:35 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.331373. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46163 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74294 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22136 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09495 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11914 clock time +[SCHEDULER ITER4 LR1]: 680075 words processed Wed Nov 18 10:26:47 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.330378. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46080 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73936 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22054 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55849 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09770 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11932 clock time +[SCHEDULER ITER4 LR1]: 720043 words processed Wed Nov 18 10:26:59 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.329916. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46071 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73811 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20900 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55371 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09249 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11881 clock time +[SCHEDULER ITER4 LR1]: 760012 words processed Wed Nov 18 10:27:11 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.329256. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46228 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74636 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23114 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09538 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11952 clock time +[SCHEDULER ITER4 LR1]: 800113 words processed Wed Nov 18 10:27:23 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.328670. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46365 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75632 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27123 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57626 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10571 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11989 clock time +[SCHEDULER ITER4 LR1]: 840089 words processed Wed Nov 18 10:27:35 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.327835. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46185 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74296 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22645 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56132 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09518 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11956 clock time +[SCHEDULER ITER4 LR1]: 880052 words processed Wed Nov 18 10:27:47 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.327304. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46200 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75015 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24761 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56572 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10060 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12040 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER4 LR1]: Displaying result: +[SCHEDULER ITER4 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 241.20958994184> <PPL_OOV 212.5016612632> <LOGP -2163490.4205743> +[SCHEDULER ITER4 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER4 LR1]: shuffling training file +===PEEK ON TEST 4=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER4 LR1]: 40087 words processed Wed Nov 18 10:27:56 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.311922. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47680 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.79140 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.50005 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11768 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER4 LR1]: Displaying result: +[SCHEDULER ITER4 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 229.16655843007> <PPL_OOV 205.79109682218> <LOGP -190695.75314365> +[SCHEDULER ITER4 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 4=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER4 LR1]: 40095 words processed Wed Nov 18 10:28:05 2015. + [SCHEDULER ITER4 LR1]: log prob per sample :-2.361644. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46707 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74527 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.43673 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11440 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER4 LR1]: Displaying result: +[SCHEDULER ITER4 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 233.67513484246> <PPL_OOV 214.05170779862> <LOGP -171899.05910373> +[SCHEDULER ITER4 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER4 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.4... + +[SCHEDULER ITER5 LR1]: preparing parameters... +[SCHEDULER ITER5 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.4... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34533992 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34537650 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69107906 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69224062 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70299750 +[SCHEDULER ITER5 LR1]: preparing parameters end. +[SCHEDULER ITER5 LR1]: preparing layers... +(10:28:14 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:28:14 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:28:14 2015-11-18)[nerv] info: create layer: combinerL1 +(10:28:14 2015-11-18)[nerv] info: create layer: outputL +(10:28:14 2015-11-18)[nerv] info: create layer: softmaxL +(10:28:14 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER5 LR1]: preparing layers end. +[SCHEDULER ITER5 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER5 LR1]: Initing TNN end. +===ITERATION 5 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER5 LR1]: 40092 words processed Wed Nov 18 10:28:25 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.342229. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47049 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75456 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.28763 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58442 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11110 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11981 clock time +[SCHEDULER ITER5 LR1]: 80099 words processed Wed Nov 18 10:28:37 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.325496. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46939 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74216 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22949 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55726 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09820 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11913 clock time +[SCHEDULER ITER5 LR1]: 120004 words processed Wed Nov 18 10:28:49 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.314607. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46910 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74325 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23677 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55937 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09786 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11937 clock time +[SCHEDULER ITER5 LR1]: 160114 words processed Wed Nov 18 10:29:01 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.314235. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47069 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75472 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27042 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57500 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10372 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12016 clock time +[SCHEDULER ITER5 LR1]: 200066 words processed Wed Nov 18 10:29:13 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.312322. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46407 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73731 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22218 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55908 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09757 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11939 clock time +[SCHEDULER ITER5 LR1]: 240045 words processed Wed Nov 18 10:29:25 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.308654. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46513 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74426 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23656 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55966 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10261 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11947 clock time +[SCHEDULER ITER5 LR1]: 280057 words processed Wed Nov 18 10:29:37 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.305328. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46782 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75094 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26266 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57342 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10246 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11961 clock time +[SCHEDULER ITER5 LR1]: 320106 words processed Wed Nov 18 10:29:49 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.301431. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75036 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26305 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57695 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10340 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11993 clock time +[SCHEDULER ITER5 LR1]: 360024 words processed Wed Nov 18 10:30:01 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.299609. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46319 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74390 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23802 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56393 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09906 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11951 clock time +[SCHEDULER ITER5 LR1]: 400089 words processed Wed Nov 18 10:30:13 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.297780. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46554 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75843 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.28051 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57991 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10791 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12014 clock time +[SCHEDULER ITER5 LR1]: 440067 words processed Wed Nov 18 10:30:25 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.297017. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46181 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74817 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23907 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56744 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09555 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12009 clock time +[SCHEDULER ITER5 LR1]: 480051 words processed Wed Nov 18 10:30:37 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.296471. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46227 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74135 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23129 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56201 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10193 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11990 clock time +[SCHEDULER ITER5 LR1]: 520140 words processed Wed Nov 18 10:30:49 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.295813. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75114 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26550 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57283 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11095 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11931 clock time +[SCHEDULER ITER5 LR1]: 560132 words processed Wed Nov 18 10:31:01 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.294844. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46199 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74167 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22088 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56236 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09129 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11941 clock time +[SCHEDULER ITER5 LR1]: 600118 words processed Wed Nov 18 10:31:13 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.296112. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46173 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74829 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24560 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10230 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12016 clock time +[SCHEDULER ITER5 LR1]: 640090 words processed Wed Nov 18 10:31:25 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.294628. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46158 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74747 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24467 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56448 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10528 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11997 clock time +[SCHEDULER ITER5 LR1]: 680075 words processed Wed Nov 18 10:31:37 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.294433. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46073 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73934 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21765 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56040 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09367 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11932 clock time +[SCHEDULER ITER5 LR1]: 720043 words processed Wed Nov 18 10:31:49 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.294059. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46088 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74279 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23473 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56187 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10443 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11920 clock time +[SCHEDULER ITER5 LR1]: 760012 words processed Wed Nov 18 10:32:01 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.293522. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46137 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74359 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23332 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56142 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10053 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12005 clock time +[SCHEDULER ITER5 LR1]: 800113 words processed Wed Nov 18 10:32:13 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.293090. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74776 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25004 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57351 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09928 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11979 clock time +[SCHEDULER ITER5 LR1]: 840089 words processed Wed Nov 18 10:32:25 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.291937. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74901 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24348 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10076 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11998 clock time +[SCHEDULER ITER5 LR1]: 880052 words processed Wed Nov 18 10:32:37 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.291464. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46515 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74681 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22951 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56141 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09092 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11908 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER5 LR1]: Displaying result: +[SCHEDULER ITER5 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 221.30733235924> <PPL_OOV 195.66770349262> <LOGP -2130170.993105> +[SCHEDULER ITER5 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER5 LR1]: shuffling training file +===PEEK ON TEST 5=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER5 LR1]: 40087 words processed Wed Nov 18 10:32:46 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.285627. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46841 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75339 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.44481 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11435 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER5 LR1]: Displaying result: +[SCHEDULER ITER5 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 222.8321336645> <PPL_OOV 193.91842079921> <LOGP -188568.43959101> +[SCHEDULER ITER5 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 5=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER5 LR1]: 40095 words processed Wed Nov 18 10:32:55 2015. + [SCHEDULER ITER5 LR1]: log prob per sample :-2.339220. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46835 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75101 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.44223 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11451 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER5 LR1]: Displaying result: +[SCHEDULER ITER5 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 228.12299970668> <PPL_OOV 203.70434101172> <LOGP -170311.86095287> +[SCHEDULER ITER5 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER5 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.5... + +[SCHEDULER ITER6 LR1]: preparing parameters... +[SCHEDULER ITER6 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.5... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1075225 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1078883 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35657664 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35773857 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70310639 +[SCHEDULER ITER6 LR1]: preparing parameters end. +[SCHEDULER ITER6 LR1]: preparing layers... +(10:33:04 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:33:04 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:33:04 2015-11-18)[nerv] info: create layer: combinerL1 +(10:33:04 2015-11-18)[nerv] info: create layer: outputL +(10:33:04 2015-11-18)[nerv] info: create layer: softmaxL +(10:33:04 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER6 LR1]: preparing layers end. +[SCHEDULER ITER6 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER6 LR1]: Initing TNN end. +===ITERATION 6 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER6 LR1]: 40092 words processed Wed Nov 18 10:33:15 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.274624. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46939 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75387 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.28249 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58495 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10652 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11975 clock time +[SCHEDULER ITER6 LR1]: 80099 words processed Wed Nov 18 10:33:27 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.274089. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46998 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74679 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24110 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09641 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11948 clock time +[SCHEDULER ITER6 LR1]: 120004 words processed Wed Nov 18 10:33:39 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.269376. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46942 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74932 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25240 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56915 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09510 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11974 clock time +[SCHEDULER ITER6 LR1]: 160114 words processed Wed Nov 18 10:33:51 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.272529. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46932 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75383 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27805 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58302 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10538 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11978 clock time +[SCHEDULER ITER6 LR1]: 200066 words processed Wed Nov 18 10:34:03 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.273086. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46566 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74590 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24741 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56897 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09888 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time +[SCHEDULER ITER6 LR1]: 240045 words processed Wed Nov 18 10:34:15 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.270336. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46523 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74558 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24194 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56707 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09739 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11960 clock time +[SCHEDULER ITER6 LR1]: 280057 words processed Wed Nov 18 10:34:27 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.267457. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46955 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76631 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30883 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59048 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10752 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12089 clock time +[SCHEDULER ITER6 LR1]: 320106 words processed Wed Nov 18 10:34:39 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.264325. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75084 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26563 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57789 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10421 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11986 clock time +[SCHEDULER ITER6 LR1]: 360024 words processed Wed Nov 18 10:34:51 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.263165. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73936 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21825 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09307 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11887 clock time +[SCHEDULER ITER6 LR1]: 400089 words processed Wed Nov 18 10:35:03 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.261798. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46289 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75369 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27194 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10492 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12021 clock time +[SCHEDULER ITER6 LR1]: 440067 words processed Wed Nov 18 10:35:15 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.261720. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46106 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74338 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23310 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09902 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11938 clock time +[SCHEDULER ITER6 LR1]: 480051 words processed Wed Nov 18 10:35:27 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.261638. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46115 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74888 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24538 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56905 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10084 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11952 clock time +[SCHEDULER ITER6 LR1]: 520140 words processed Wed Nov 18 10:35:39 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.261379. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46261 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75682 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27595 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58229 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10587 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11963 clock time +[SCHEDULER ITER6 LR1]: 560132 words processed Wed Nov 18 10:35:51 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.260855. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46142 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75126 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25299 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56931 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10505 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12021 clock time +[SCHEDULER ITER6 LR1]: 600118 words processed Wed Nov 18 10:36:03 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.259417. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46378 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75487 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26827 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57611 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10447 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12054 clock time +[SCHEDULER ITER6 LR1]: 640090 words processed Wed Nov 18 10:36:15 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.258156. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46052 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74638 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23792 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56574 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10022 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11938 clock time +[SCHEDULER ITER6 LR1]: 680075 words processed Wed Nov 18 10:36:27 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.257716. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46070 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74478 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23722 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56557 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10165 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11943 clock time +[SCHEDULER ITER6 LR1]: 720043 words processed Wed Nov 18 10:36:39 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.257695. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46112 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75192 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24788 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56738 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10015 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11978 clock time +[SCHEDULER ITER6 LR1]: 760012 words processed Wed Nov 18 10:36:51 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.257372. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46108 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74870 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25056 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57122 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10129 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12031 clock time +[SCHEDULER ITER6 LR1]: 800113 words processed Wed Nov 18 10:37:03 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.257342. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46458 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76279 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.29298 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10878 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12045 clock time +[SCHEDULER ITER6 LR1]: 840089 words processed Wed Nov 18 10:37:15 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.256451. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46283 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75097 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24796 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57053 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09715 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11975 clock time +[SCHEDULER ITER6 LR1]: 880052 words processed Wed Nov 18 10:37:27 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.256282. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46175 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74750 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24244 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56506 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10116 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11972 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER6 LR1]: Displaying result: +[SCHEDULER ITER6 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 203.44638459567> <PPL_OOV 180.48040863984> <LOGP -2097552.5682739> +[SCHEDULER ITER6 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER6 LR1]: shuffling training file +===PEEK ON TEST 6=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER6 LR1]: 40087 words processed Wed Nov 18 10:37:36 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.270756. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46874 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75384 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.44684 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11462 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER6 LR1]: Displaying result: +[SCHEDULER ITER6 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 213.76177164248> <PPL_OOV 187.55040025392> <LOGP -187373.11635436> +[SCHEDULER ITER6 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 6=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER6 LR1]: 40095 words processed Wed Nov 18 10:37:45 2015. + [SCHEDULER ITER6 LR1]: log prob per sample :-2.327893. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46740 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74780 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.43821 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11425 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER6 LR1]: Displaying result: +[SCHEDULER ITER6 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 218.09202962517> <PPL_OOV 196.16969102515> <LOGP -169104.52953794> +[SCHEDULER ITER6 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER6 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.6... + +[SCHEDULER ITER7 LR1]: preparing parameters... +[SCHEDULER ITER7 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.6... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34539097 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34542754 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69128153 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69244367 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70319220 +[SCHEDULER ITER7 LR1]: preparing parameters end. +[SCHEDULER ITER7 LR1]: preparing layers... +(10:37:54 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:37:54 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:37:54 2015-11-18)[nerv] info: create layer: combinerL1 +(10:37:54 2015-11-18)[nerv] info: create layer: outputL +(10:37:54 2015-11-18)[nerv] info: create layer: softmaxL +(10:37:54 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER7 LR1]: preparing layers end. +[SCHEDULER ITER7 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER7 LR1]: Initing TNN end. +===ITERATION 7 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER7 LR1]: 40092 words processed Wed Nov 18 10:38:05 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.251501. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76764 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.31940 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59447 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11461 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11910 clock time +[SCHEDULER ITER7 LR1]: 80099 words processed Wed Nov 18 10:38:17 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.249180. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46812 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73223 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21086 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55670 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09429 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11759 clock time +[SCHEDULER ITER7 LR1]: 120004 words processed Wed Nov 18 10:38:29 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.243853. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46542 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73284 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21655 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55817 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09571 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11723 clock time +[SCHEDULER ITER7 LR1]: 160114 words processed Wed Nov 18 10:38:41 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.246795. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46712 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74229 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57646 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10261 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11770 clock time +[SCHEDULER ITER7 LR1]: 200066 words processed Wed Nov 18 10:38:53 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.246943. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46211 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73341 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21312 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55895 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09669 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11752 clock time +[SCHEDULER ITER7 LR1]: 240045 words processed Wed Nov 18 10:39:05 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.243492. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46300 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73918 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56107 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09756 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11811 clock time +[SCHEDULER ITER7 LR1]: 280057 words processed Wed Nov 18 10:39:17 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.240411. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46496 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74737 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26065 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57647 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10464 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11824 clock time +[SCHEDULER ITER7 LR1]: 320106 words processed Wed Nov 18 10:39:29 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.237547. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46336 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75410 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26265 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57445 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10285 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11918 clock time +[SCHEDULER ITER7 LR1]: 360024 words processed Wed Nov 18 10:39:41 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.236674. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45882 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74675 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22815 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56278 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09295 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11868 clock time +[SCHEDULER ITER7 LR1]: 400089 words processed Wed Nov 18 10:39:53 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.235629. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46360 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76278 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.28313 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58091 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10666 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11979 clock time +[SCHEDULER ITER7 LR1]: 440067 words processed Wed Nov 18 10:40:05 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.235708. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46147 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74596 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22643 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56116 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09461 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11834 clock time +[SCHEDULER ITER7 LR1]: 480051 words processed Wed Nov 18 10:40:17 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.235789. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45970 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74709 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23079 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09642 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11909 clock time +[SCHEDULER ITER7 LR1]: 520140 words processed Wed Nov 18 10:40:29 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.235653. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46114 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75427 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26328 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57623 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10376 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11941 clock time +[SCHEDULER ITER7 LR1]: 560132 words processed Wed Nov 18 10:40:41 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.235260. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46032 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74784 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23325 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56328 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09741 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11919 clock time +[SCHEDULER ITER7 LR1]: 600118 words processed Wed Nov 18 10:40:53 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.233722. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46126 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74854 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23290 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56513 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09207 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11975 clock time +[SCHEDULER ITER7 LR1]: 640090 words processed Wed Nov 18 10:41:05 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.232544. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46046 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74810 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23177 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56368 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09477 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11905 clock time +[SCHEDULER ITER7 LR1]: 680075 words processed Wed Nov 18 10:41:17 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.232156. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46161 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75615 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25008 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56772 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09848 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11971 clock time +[SCHEDULER ITER7 LR1]: 720043 words processed Wed Nov 18 10:41:29 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.232032. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45956 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74110 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21620 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55854 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09423 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11793 clock time +[SCHEDULER ITER7 LR1]: 760012 words processed Wed Nov 18 10:41:41 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.232176. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45928 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74325 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22199 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.55926 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09584 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11866 clock time +[SCHEDULER ITER7 LR1]: 800113 words processed Wed Nov 18 10:41:53 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.232236. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45960 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74990 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24589 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57133 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10051 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11802 clock time +[SCHEDULER ITER7 LR1]: 840089 words processed Wed Nov 18 10:42:05 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.231563. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46117 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74825 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23400 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56396 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09560 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11919 clock time +[SCHEDULER ITER7 LR1]: 880052 words processed Wed Nov 18 10:42:17 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.231495. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45982 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74912 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23623 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56339 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09719 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11916 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER7 LR1]: Displaying result: +[SCHEDULER ITER7 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 191.66281054712> <PPL_OOV 170.45050083613> <LOGP -2074469.2150481> +[SCHEDULER ITER7 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER7 LR1]: shuffling training file +===PEEK ON TEST 7=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER7 LR1]: 40087 words processed Wed Nov 18 10:42:26 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.250935. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46872 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75737 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.45120 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11487 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER7 LR1]: Displaying result: +[SCHEDULER ITER7 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 206.26330245608> <PPL_OOV 178.68977420066> <LOGP -185640.57827444> +[SCHEDULER ITER7 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 7=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER7 LR1]: 40095 words processed Wed Nov 18 10:42:35 2015. + [SCHEDULER ITER7 LR1]: log prob per sample :-2.308122. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46668 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75255 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.44319 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11436 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER7 LR1]: Displaying result: +[SCHEDULER ITER7 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 210.66094197492> <PPL_OOV 187.46229275885> <LOGP -167650.13106111> +[SCHEDULER ITER7 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER7 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.7... + +[SCHEDULER ITER8 LR1]: preparing parameters... +[SCHEDULER ITER8 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.7... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1074480 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1078136 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35669430 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35785661 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70326762 +[SCHEDULER ITER8 LR1]: preparing parameters end. +[SCHEDULER ITER8 LR1]: preparing layers... +(10:42:44 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:42:44 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:42:44 2015-11-18)[nerv] info: create layer: combinerL1 +(10:42:44 2015-11-18)[nerv] info: create layer: outputL +(10:42:44 2015-11-18)[nerv] info: create layer: softmaxL +(10:42:44 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER8 LR1]: preparing layers end. +[SCHEDULER ITER8 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER8 LR1]: Initing TNN end. +===ITERATION 8 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER8 LR1]: 40092 words processed Wed Nov 18 10:42:55 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.223485. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47200 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75378 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.29123 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59231 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10712 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11986 clock time +[SCHEDULER ITER8 LR1]: 80099 words processed Wed Nov 18 10:43:07 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.223158. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47187 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74128 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23784 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56720 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09445 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11953 clock time +[SCHEDULER ITER8 LR1]: 120004 words processed Wed Nov 18 10:43:19 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.219440. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47016 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74111 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24157 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56875 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09419 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11947 clock time +[SCHEDULER ITER8 LR1]: 160114 words processed Wed Nov 18 10:43:31 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.222712. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47032 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75221 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27212 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58467 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09944 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time +[SCHEDULER ITER8 LR1]: 200066 words processed Wed Nov 18 10:43:43 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.223369. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46715 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74746 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25209 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09616 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11949 clock time +[SCHEDULER ITER8 LR1]: 240045 words processed Wed Nov 18 10:43:55 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.220367. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46430 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73739 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21838 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56495 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.08943 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11917 clock time +[SCHEDULER ITER8 LR1]: 280057 words processed Wed Nov 18 10:44:07 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.217273. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46779 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75278 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27901 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58757 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10111 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11987 clock time +[SCHEDULER ITER8 LR1]: 320106 words processed Wed Nov 18 10:44:19 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.214817. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46468 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74785 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26351 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58130 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10206 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11979 clock time +[SCHEDULER ITER8 LR1]: 360024 words processed Wed Nov 18 10:44:31 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.214075. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45968 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73531 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22015 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56236 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09857 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11860 clock time +[SCHEDULER ITER8 LR1]: 400089 words processed Wed Nov 18 10:44:43 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.213366. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46577 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75979 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.29753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59223 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11076 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12017 clock time +[SCHEDULER ITER8 LR1]: 440067 words processed Wed Nov 18 10:44:55 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.213651. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46208 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74276 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24185 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57217 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10050 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11936 clock time +[SCHEDULER ITER8 LR1]: 480051 words processed Wed Nov 18 10:45:07 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.214115. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46236 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74395 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23556 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57228 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09294 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11950 clock time +[SCHEDULER ITER8 LR1]: 520140 words processed Wed Nov 18 10:45:19 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.214208. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75450 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27509 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58817 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09921 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11984 clock time +[SCHEDULER ITER8 LR1]: 560132 words processed Wed Nov 18 10:45:31 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.213975. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46060 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74065 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22367 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56833 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09161 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11959 clock time +[SCHEDULER ITER8 LR1]: 600118 words processed Wed Nov 18 10:45:43 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.213825. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46104 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74419 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22681 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56828 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09026 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11865 clock time +[SCHEDULER ITER8 LR1]: 640090 words processed Wed Nov 18 10:45:55 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.212654. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46274 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74627 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24920 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57413 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10174 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11935 clock time +[SCHEDULER ITER8 LR1]: 680075 words processed Wed Nov 18 10:46:07 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.212618. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46054 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74089 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23804 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56904 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10392 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11977 clock time +[SCHEDULER ITER8 LR1]: 720043 words processed Wed Nov 18 10:46:19 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.212644. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46065 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74309 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24161 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57031 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10304 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11893 clock time +[SCHEDULER ITER8 LR1]: 760012 words processed Wed Nov 18 10:46:31 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.212618. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46054 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74347 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22727 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56723 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09189 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11893 clock time +[SCHEDULER ITER8 LR1]: 800113 words processed Wed Nov 18 10:46:43 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.212799. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74704 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26342 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58071 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10933 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11905 clock time +[SCHEDULER ITER8 LR1]: 840089 words processed Wed Nov 18 10:46:55 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.211971. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46022 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74098 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23139 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56643 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10115 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11903 clock time +[SCHEDULER ITER8 LR1]: 880052 words processed Wed Nov 18 10:47:07 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.211963. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46174 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74639 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24128 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57056 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09675 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11954 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER8 LR1]: Displaying result: +[SCHEDULER ITER8 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 182.85875939578> <PPL_OOV 162.9490849551> <LOGP -2056299.1378532> +[SCHEDULER ITER8 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER8 LR1]: shuffling training file +===PEEK ON TEST 8=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER8 LR1]: 40087 words processed Wed Nov 18 10:47:16 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.242961. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47194 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75875 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.45598 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11525 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER8 LR1]: Displaying result: +[SCHEDULER ITER8 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 200.73582668906> <PPL_OOV 175.37028924635> <LOGP -184969.29458693> +[SCHEDULER ITER8 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 8=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER8 LR1]: 40095 words processed Wed Nov 18 10:47:25 2015. + [SCHEDULER ITER8 LR1]: log prob per sample :-2.301838. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46955 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75135 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.44506 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11486 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER8 LR1]: Displaying result: +[SCHEDULER ITER8 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 204.97925383417> <PPL_OOV 183.63222465748> <LOGP -166988.87054074> +[SCHEDULER ITER8 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER8 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.8... + +[SCHEDULER ITER9 LR1]: preparing parameters... +[SCHEDULER ITER9 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.8... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34542686 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34546343 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69143526 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69259775 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70333851 +[SCHEDULER ITER9 LR1]: preparing parameters end. +[SCHEDULER ITER9 LR1]: preparing layers... +(10:47:34 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:47:34 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:47:34 2015-11-18)[nerv] info: create layer: combinerL1 +(10:47:34 2015-11-18)[nerv] info: create layer: outputL +(10:47:34 2015-11-18)[nerv] info: create layer: softmaxL +(10:47:34 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER9 LR1]: preparing layers end. +[SCHEDULER ITER9 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER9 LR1]: Initing TNN end. +===ITERATION 9 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER9 LR1]: 40092 words processed Wed Nov 18 10:47:45 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.206042. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74971 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.28213 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58715 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10997 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11997 clock time +[SCHEDULER ITER9 LR1]: 80099 words processed Wed Nov 18 10:47:57 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.206343. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47213 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74031 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25120 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57189 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10262 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12019 clock time +[SCHEDULER ITER9 LR1]: 120004 words processed Wed Nov 18 10:48:09 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.202072. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47115 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74334 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24743 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56756 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09868 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11981 clock time +[SCHEDULER ITER9 LR1]: 160114 words processed Wed Nov 18 10:48:21 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.206597. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46962 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74532 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26954 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58197 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10828 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12014 clock time +[SCHEDULER ITER9 LR1]: 200066 words processed Wed Nov 18 10:48:33 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.206957. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46621 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73933 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23991 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56863 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10075 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12020 clock time +[SCHEDULER ITER9 LR1]: 240045 words processed Wed Nov 18 10:48:45 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.202669. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74566 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25139 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56860 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10550 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12000 clock time +[SCHEDULER ITER9 LR1]: 280057 words processed Wed Nov 18 10:48:57 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.199498. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46745 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74662 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58046 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10272 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11980 clock time +[SCHEDULER ITER9 LR1]: 320106 words processed Wed Nov 18 10:49:09 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.197205. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46554 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74500 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26464 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57759 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11096 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11959 clock time +[SCHEDULER ITER9 LR1]: 360024 words processed Wed Nov 18 10:49:21 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.196210. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45992 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73450 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22412 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56114 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10498 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11900 clock time +[SCHEDULER ITER9 LR1]: 400089 words processed Wed Nov 18 10:49:33 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.195749. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46254 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74420 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25369 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57755 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10525 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11970 clock time +[SCHEDULER ITER9 LR1]: 440067 words processed Wed Nov 18 10:49:45 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.196194. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46419 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74687 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25038 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57106 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10356 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11995 clock time +[SCHEDULER ITER9 LR1]: 480051 words processed Wed Nov 18 10:49:57 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.196723. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46786 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76705 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.29484 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58496 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10636 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12151 clock time +[SCHEDULER ITER9 LR1]: 520140 words processed Wed Nov 18 10:50:09 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.196745. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46525 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75277 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27749 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58528 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10674 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12067 clock time +[SCHEDULER ITER9 LR1]: 560132 words processed Wed Nov 18 10:50:21 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.196443. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46284 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73739 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24005 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56972 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10715 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12050 clock time +[SCHEDULER ITER9 LR1]: 600118 words processed Wed Nov 18 10:50:33 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.195960. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46220 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73731 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22816 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56571 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10159 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11897 clock time +[SCHEDULER ITER9 LR1]: 640090 words processed Wed Nov 18 10:50:45 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.194630. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46790 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76519 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30552 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58990 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11086 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12190 clock time +[SCHEDULER ITER9 LR1]: 680075 words processed Wed Nov 18 10:50:57 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.194485. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46120 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72829 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21634 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56679 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09896 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11895 clock time +[SCHEDULER ITER9 LR1]: 720043 words processed Wed Nov 18 10:51:09 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.194576. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45990 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73048 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20881 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56110 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09525 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11886 clock time +[SCHEDULER ITER9 LR1]: 760012 words processed Wed Nov 18 10:51:21 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.194645. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46073 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73109 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21916 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56221 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10346 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11862 clock time +[SCHEDULER ITER9 LR1]: 800113 words processed Wed Nov 18 10:51:33 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.194792. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46146 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73565 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23971 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57883 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10019 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11928 clock time +[SCHEDULER ITER9 LR1]: 840089 words processed Wed Nov 18 10:51:45 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.193957. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46098 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73214 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21389 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56082 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10031 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11843 clock time +[SCHEDULER ITER9 LR1]: 880052 words processed Wed Nov 18 10:51:57 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.194063. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45976 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72775 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20289 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56160 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09285 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11833 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER9 LR1]: Displaying result: +[SCHEDULER ITER9 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 175.15529644178> <PPL_OOV 156.3706229079> <LOGP -2039662.5067889> +[SCHEDULER ITER9 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER9 LR1]: shuffling training file +===PEEK ON TEST 9=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER9 LR1]: 40087 words processed Wed Nov 18 10:52:06 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.232448. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47015 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75902 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.45569 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11574 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER9 LR1]: Displaying result: +[SCHEDULER ITER9 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 196.68771340668> <PPL_OOV 171.28145024784> <LOGP -184124.74262498> +[SCHEDULER ITER9 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 9=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER9 LR1]: 40095 words processed Wed Nov 18 10:52:16 2015. + [SCHEDULER ITER9 LR1]: log prob per sample :-2.292322. + [global_conf.timer]: time spent on tnn_beforeprocess:0.50580 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89009 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.64386 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12357 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER9 LR1]: Displaying result: +[SCHEDULER ITER9 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 200.74808824921> <PPL_OOV 179.37500626499> <LOGP -166237.47990123> +[SCHEDULER ITER9 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER9 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.9... + +[SCHEDULER ITER10 LR1]: preparing parameters... +[SCHEDULER ITER10 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.9... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1073504 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1077161 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35679936 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35796199 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70340150 +[SCHEDULER ITER10 LR1]: preparing parameters end. +[SCHEDULER ITER10 LR1]: preparing layers... +(10:52:26 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:52:26 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:52:26 2015-11-18)[nerv] info: create layer: combinerL1 +(10:52:26 2015-11-18)[nerv] info: create layer: outputL +(10:52:26 2015-11-18)[nerv] info: create layer: softmaxL +(10:52:26 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER10 LR1]: preparing layers end. +[SCHEDULER ITER10 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER10 LR1]: Initing TNN end. +===ITERATION 10 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER10 LR1]: 40092 words processed Wed Nov 18 10:52:37 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.187626. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49034 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.83385 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.53127 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66879 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13693 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12625 clock time +[SCHEDULER ITER10 LR1]: 80099 words processed Wed Nov 18 10:52:49 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.187185. + [global_conf.timer]: time spent on tnn_beforeprocess:0.51138 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94141 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.79346 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.73667 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.16559 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13340 clock time +[SCHEDULER ITER10 LR1]: 120004 words processed Wed Nov 18 10:53:01 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.183663. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47670 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.78031 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.34401 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59273 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11058 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12225 clock time +[SCHEDULER ITER10 LR1]: 160114 words processed Wed Nov 18 10:53:13 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.186533. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47405 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76657 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.31822 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59381 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10987 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12139 clock time +[SCHEDULER ITER10 LR1]: 200066 words processed Wed Nov 18 10:53:25 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.187822. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46812 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74876 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26041 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57316 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10123 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12045 clock time +[SCHEDULER ITER10 LR1]: 240045 words processed Wed Nov 18 10:53:37 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.184261. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46663 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75239 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26592 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57550 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10219 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12015 clock time +[SCHEDULER ITER10 LR1]: 280057 words processed Wed Nov 18 10:53:49 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.181682. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46951 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76315 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30757 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59070 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11089 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11997 clock time +[SCHEDULER ITER10 LR1]: 320106 words processed Wed Nov 18 10:54:01 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.179709. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48108 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.82285 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48257 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64562 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13202 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12704 clock time +[SCHEDULER ITER10 LR1]: 360024 words processed Wed Nov 18 10:54:13 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.178820. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46470 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74475 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24827 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56957 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09895 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11965 clock time +[SCHEDULER ITER10 LR1]: 400089 words processed Wed Nov 18 10:54:25 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.177844. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75564 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27926 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58299 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10635 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12006 clock time +[SCHEDULER ITER10 LR1]: 440067 words processed Wed Nov 18 10:54:37 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.178455. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46370 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74711 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24594 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56957 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09929 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11961 clock time +[SCHEDULER ITER10 LR1]: 480051 words processed Wed Nov 18 10:54:49 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.178986. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46607 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75624 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27252 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57857 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10255 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12072 clock time +[SCHEDULER ITER10 LR1]: 520140 words processed Wed Nov 18 10:55:01 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.179147. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46629 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76321 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30277 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59194 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10976 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12013 clock time +[SCHEDULER ITER10 LR1]: 560132 words processed Wed Nov 18 10:55:13 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.179057. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46199 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74421 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22938 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56597 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09304 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11943 clock time +[SCHEDULER ITER10 LR1]: 600118 words processed Wed Nov 18 10:55:25 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.178715. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74415 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23768 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56694 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09883 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11922 clock time +[SCHEDULER ITER10 LR1]: 640090 words processed Wed Nov 18 10:55:37 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.177619. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46282 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74450 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23064 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56633 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09281 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11885 clock time +[SCHEDULER ITER10 LR1]: 680075 words processed Wed Nov 18 10:55:49 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.177353. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46317 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74162 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22982 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56488 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09711 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11862 clock time +[SCHEDULER ITER10 LR1]: 720043 words processed Wed Nov 18 10:56:01 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.177437. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46259 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74441 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23905 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56734 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09788 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11947 clock time +[SCHEDULER ITER10 LR1]: 760012 words processed Wed Nov 18 10:56:13 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.177489. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46279 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74377 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23647 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56696 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09629 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11940 clock time +[SCHEDULER ITER10 LR1]: 800113 words processed Wed Nov 18 10:56:25 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.177808. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46449 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75256 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27073 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58336 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10163 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11982 clock time +[SCHEDULER ITER10 LR1]: 840089 words processed Wed Nov 18 10:56:37 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.177156. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46207 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74318 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23297 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56643 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09597 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11963 clock time +[SCHEDULER ITER10 LR1]: 880052 words processed Wed Nov 18 10:56:49 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.177345. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46358 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74369 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23957 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56683 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09873 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11930 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER10 LR1]: Displaying result: +[SCHEDULER ITER10 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 168.28451804124> <PPL_OOV 150.46390246938> <LOGP -2024117.1344033> +[SCHEDULER ITER10 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER10 LR1]: shuffling training file +===PEEK ON TEST 10=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER10 LR1]: 40087 words processed Wed Nov 18 10:56:58 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.226332. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47251 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76387 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.46298 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11545 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER10 LR1]: Displaying result: +[SCHEDULER ITER10 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 193.84009884531> <PPL_OOV 168.90002809503> <LOGP -183623.51796897> +[SCHEDULER ITER10 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 10=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER10 LR1]: 40095 words processed Wed Nov 18 10:57:07 2015. + [SCHEDULER ITER10 LR1]: log prob per sample :-2.288461. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47282 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75930 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.45694 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11482 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER10 LR1]: Displaying result: +[SCHEDULER ITER10 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 198.49192596558> <PPL_OOV 177.42026715645> <LOGP -165886.47816098> +[SCHEDULER ITER10 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER10 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.10... + +[SCHEDULER ITER11 LR1]: preparing parameters... +[SCHEDULER ITER11 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.10... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34544696 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34548353 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69157059 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69273324 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70346338 +[SCHEDULER ITER11 LR1]: preparing parameters end. +[SCHEDULER ITER11 LR1]: preparing layers... +(10:57:16 2015-11-18)[nerv] info: create layer: recurrentL1 +(10:57:16 2015-11-18)[nerv] info: create layer: sigmoidL1 +(10:57:16 2015-11-18)[nerv] info: create layer: combinerL1 +(10:57:16 2015-11-18)[nerv] info: create layer: outputL +(10:57:16 2015-11-18)[nerv] info: create layer: softmaxL +(10:57:16 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER11 LR1]: preparing layers end. +[SCHEDULER ITER11 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER11 LR1]: Initing TNN end. +===ITERATION 11 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER11 LR1]: 40092 words processed Wed Nov 18 10:57:27 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.171852. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47361 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76387 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30974 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58969 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11078 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12087 clock time +[SCHEDULER ITER11 LR1]: 80099 words processed Wed Nov 18 10:57:39 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.172153. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47191 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74498 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24634 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56602 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09802 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11974 clock time +[SCHEDULER ITER11 LR1]: 120004 words processed Wed Nov 18 10:57:51 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.168680. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47058 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74499 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25052 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56585 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09930 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11985 clock time +[SCHEDULER ITER11 LR1]: 160114 words processed Wed Nov 18 10:58:03 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.171976. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47374 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75961 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30222 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58686 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11161 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12051 clock time +[SCHEDULER ITER11 LR1]: 200066 words processed Wed Nov 18 10:58:15 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.173569. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46822 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76367 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.29753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58557 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10574 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12124 clock time +[SCHEDULER ITER11 LR1]: 240045 words processed Wed Nov 18 10:58:27 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.170281. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47443 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77754 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.34750 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60093 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11129 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12451 clock time +[SCHEDULER ITER11 LR1]: 280057 words processed Wed Nov 18 10:58:39 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.167366. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48904 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.83714 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.52092 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65348 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13578 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12800 clock time +[SCHEDULER ITER11 LR1]: 320106 words processed Wed Nov 18 10:58:51 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.165503. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47237 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.78810 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.36706 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60854 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11196 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12336 clock time +[SCHEDULER ITER11 LR1]: 360024 words processed Wed Nov 18 10:59:03 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.164444. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47031 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76536 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30907 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58333 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11299 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12230 clock time +[SCHEDULER ITER11 LR1]: 400089 words processed Wed Nov 18 10:59:15 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.164365. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46607 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75789 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.28348 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10448 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12046 clock time +[SCHEDULER ITER11 LR1]: 440067 words processed Wed Nov 18 10:59:27 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.165207. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74732 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24853 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56774 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10194 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12001 clock time +[SCHEDULER ITER11 LR1]: 480051 words processed Wed Nov 18 10:59:39 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.165767. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46867 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.78041 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.33160 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59420 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10951 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12351 clock time +[SCHEDULER ITER11 LR1]: 520140 words processed Wed Nov 18 10:59:51 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.165936. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47031 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.78899 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.36490 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60669 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11743 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12351 clock time +[SCHEDULER ITER11 LR1]: 560132 words processed Wed Nov 18 11:00:03 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.165982. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46470 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75492 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27104 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57423 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10717 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12081 clock time +[SCHEDULER ITER11 LR1]: 600118 words processed Wed Nov 18 11:00:15 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.165231. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46637 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76577 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30139 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58660 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10742 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12180 clock time +[SCHEDULER ITER11 LR1]: 640090 words processed Wed Nov 18 11:00:27 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.164055. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46516 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76147 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.29472 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58341 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10912 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12261 clock time +[SCHEDULER ITER11 LR1]: 680075 words processed Wed Nov 18 11:00:39 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.163994. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46916 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77237 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.32016 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59077 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11044 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12238 clock time +[SCHEDULER ITER11 LR1]: 720043 words processed Wed Nov 18 11:00:51 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.164189. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46639 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77766 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.33385 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59446 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11466 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12254 clock time +[SCHEDULER ITER11 LR1]: 760012 words processed Wed Nov 18 11:01:03 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.163842. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46357 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75535 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26937 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57476 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10461 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12015 clock time +[SCHEDULER ITER11 LR1]: 800113 words processed Wed Nov 18 11:01:15 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.164110. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46803 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77157 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.33094 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59946 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11348 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12186 clock time +[SCHEDULER ITER11 LR1]: 840089 words processed Wed Nov 18 11:01:27 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.163404. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47160 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.78736 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.34813 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59941 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10880 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12376 clock time +[SCHEDULER ITER11 LR1]: 880052 words processed Wed Nov 18 11:01:39 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.163566. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47440 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.80264 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.37384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59985 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11111 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12318 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER11 LR1]: Displaying result: +[SCHEDULER ITER11 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 162.77539106927> <PPL_OOV 145.7641676188> <LOGP -2011305.9620894> +[SCHEDULER ITER11 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER11 LR1]: shuffling training file +===PEEK ON TEST 11=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER11 LR1]: 40087 words processed Wed Nov 18 11:01:49 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.217961. + [global_conf.timer]: time spent on tnn_beforeprocess:0.52642 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95365 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.73699 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12766 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER11 LR1]: Displaying result: +[SCHEDULER ITER11 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 190.48374176169> <PPL_OOV 165.48555249968> <LOGP -182892.39374501> +[SCHEDULER ITER11 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 11=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER11 LR1]: 40095 words processed Wed Nov 18 11:01:58 2015. + [SCHEDULER ITER11 LR1]: log prob per sample :-2.279941. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46840 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74652 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.43936 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11425 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER11 LR1]: Displaying result: +[SCHEDULER ITER11 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 195.54149127002> <PPL_OOV 174.33505652113> <LOGP -165324.53745505> +[SCHEDULER ITER11 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER11 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.11... + +[SCHEDULER ITER12 LR1]: preparing parameters... +[SCHEDULER ITER12 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.11... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1072320 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1075977 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35691290 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35807569 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70352633 +[SCHEDULER ITER12 LR1]: preparing parameters end. +[SCHEDULER ITER12 LR1]: preparing layers... +(11:02:07 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:02:07 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:02:07 2015-11-18)[nerv] info: create layer: combinerL1 +(11:02:07 2015-11-18)[nerv] info: create layer: outputL +(11:02:07 2015-11-18)[nerv] info: create layer: softmaxL +(11:02:07 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER12 LR1]: preparing layers end. +[SCHEDULER ITER12 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER12 LR1]: Initing TNN end. +===ITERATION 12 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER12 LR1]: 40092 words processed Wed Nov 18 11:02:18 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.161409. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46804 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73464 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25376 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58354 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10334 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11784 clock time +[SCHEDULER ITER12 LR1]: 80099 words processed Wed Nov 18 11:02:30 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.160069. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73095 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22902 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57024 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09515 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11827 clock time +[SCHEDULER ITER12 LR1]: 120004 words processed Wed Nov 18 11:02:42 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.156185. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46643 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73770 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22659 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56344 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09182 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11841 clock time +[SCHEDULER ITER12 LR1]: 160114 words processed Wed Nov 18 11:02:54 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.159227. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46840 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75529 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.28682 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59150 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10272 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11974 clock time +[SCHEDULER ITER12 LR1]: 200066 words processed Wed Nov 18 11:03:06 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.160588. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46305 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73458 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22120 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56632 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09245 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11786 clock time +[SCHEDULER ITER12 LR1]: 240045 words processed Wed Nov 18 11:03:18 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.158727. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46127 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72432 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20139 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56202 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09165 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11760 clock time +[SCHEDULER ITER12 LR1]: 280057 words processed Wed Nov 18 11:03:30 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.156116. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73845 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24876 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57930 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10000 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11791 clock time +[SCHEDULER ITER12 LR1]: 320106 words processed Wed Nov 18 11:03:42 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.154215. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46172 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74409 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25331 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58024 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09971 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11838 clock time +[SCHEDULER ITER12 LR1]: 360024 words processed Wed Nov 18 11:03:54 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.153248. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46075 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75659 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58098 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10165 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12113 clock time +[SCHEDULER ITER12 LR1]: 400089 words processed Wed Nov 18 11:04:06 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.152203. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47339 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.78152 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.35988 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60790 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11952 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12028 clock time +[SCHEDULER ITER12 LR1]: 440067 words processed Wed Nov 18 11:04:18 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.153060. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46945 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77317 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.32184 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58860 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11549 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12029 clock time +[SCHEDULER ITER12 LR1]: 480051 words processed Wed Nov 18 11:04:30 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.153656. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46704 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77470 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.32119 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58881 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11553 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12137 clock time +[SCHEDULER ITER12 LR1]: 520140 words processed Wed Nov 18 11:04:42 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.153706. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46647 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.78471 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.35474 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60051 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12341 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12213 clock time +[SCHEDULER ITER12 LR1]: 560132 words processed Wed Nov 18 11:04:54 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.153747. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46748 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77519 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.32001 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58846 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11321 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12274 clock time +[SCHEDULER ITER12 LR1]: 600118 words processed Wed Nov 18 11:05:06 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.152182. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46889 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77258 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.32317 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58892 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11644 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12163 clock time +[SCHEDULER ITER12 LR1]: 640090 words processed Wed Nov 18 11:05:18 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.151157. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46399 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77629 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.32001 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58683 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11419 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12488 clock time +[SCHEDULER ITER12 LR1]: 680075 words processed Wed Nov 18 11:05:30 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.150658. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46552 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.78214 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.33472 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59564 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11356 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12239 clock time +[SCHEDULER ITER12 LR1]: 720043 words processed Wed Nov 18 11:05:42 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.150768. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46935 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77457 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.32346 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59136 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11228 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12066 clock time +[SCHEDULER ITER12 LR1]: 760012 words processed Wed Nov 18 11:05:54 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.150376. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46493 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77122 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.31371 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58771 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11378 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12127 clock time +[SCHEDULER ITER12 LR1]: 800113 words processed Wed Nov 18 11:06:06 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.150726. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47058 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.78021 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.35393 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60839 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11575 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12193 clock time +[SCHEDULER ITER12 LR1]: 840089 words processed Wed Nov 18 11:06:18 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.150092. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45713 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72990 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20382 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56355 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09099 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11758 clock time +[SCHEDULER ITER12 LR1]: 880052 words processed Wed Nov 18 11:06:30 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.150286. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46365 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77542 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.32099 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59537 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10777 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12332 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER12 LR1]: Displaying result: +[SCHEDULER ITER12 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 157.67304410435> <PPL_OOV 141.37325038058> <LOGP -1998957.7352271> +[SCHEDULER ITER12 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER12 LR1]: shuffling training file +===PEEK ON TEST 12=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER12 LR1]: 40087 words processed Wed Nov 18 11:06:39 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.213910. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47627 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.79067 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.49743 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11713 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER12 LR1]: Displaying result: +[SCHEDULER ITER12 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 188.82922250456> <PPL_OOV 163.82151680349> <LOGP -182530.59680635> +[SCHEDULER ITER12 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 12=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER12 LR1]: 40095 words processed Wed Nov 18 11:06:48 2015. + [SCHEDULER ITER12 LR1]: log prob per sample :-2.276348. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47279 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76275 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.46183 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11499 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER12 LR1]: Displaying result: +[SCHEDULER ITER12 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 194.0611897081> <PPL_OOV 172.80269357813> <LOGP -165041.72545543> +[SCHEDULER ITER12 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER12 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.12... + +[SCHEDULER ITER13 LR1]: preparing parameters... +[SCHEDULER ITER13 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.12... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34545115 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34548772 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69171458 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69287727 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70359323 +[SCHEDULER ITER13 LR1]: preparing parameters end. +[SCHEDULER ITER13 LR1]: preparing layers... +(11:06:57 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:06:57 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:06:57 2015-11-18)[nerv] info: create layer: combinerL1 +(11:06:57 2015-11-18)[nerv] info: create layer: outputL +(11:06:57 2015-11-18)[nerv] info: create layer: softmaxL +(11:06:57 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER13 LR1]: preparing layers end. +[SCHEDULER ITER13 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER13 LR1]: Initing TNN end. +===ITERATION 13 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER13 LR1]: 40092 words processed Wed Nov 18 11:07:08 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.148363. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47396 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76596 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.32880 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60443 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11453 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12052 clock time +[SCHEDULER ITER13 LR1]: 80099 words processed Wed Nov 18 11:07:20 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.147670. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47176 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74437 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25697 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57814 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09877 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11998 clock time +[SCHEDULER ITER13 LR1]: 120004 words processed Wed Nov 18 11:07:32 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.144747. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74474 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57923 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09952 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11961 clock time +[SCHEDULER ITER13 LR1]: 160114 words processed Wed Nov 18 11:07:44 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.148082. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47093 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75136 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.28135 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59058 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10353 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11983 clock time +[SCHEDULER ITER13 LR1]: 200066 words processed Wed Nov 18 11:07:56 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.149260. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46573 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73982 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23573 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57354 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09275 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11962 clock time +[SCHEDULER ITER13 LR1]: 240045 words processed Wed Nov 18 11:08:08 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.145787. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46671 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74277 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24641 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57707 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09559 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11984 clock time +[SCHEDULER ITER13 LR1]: 280057 words processed Wed Nov 18 11:08:20 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.142989. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46930 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75368 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.29202 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59411 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10637 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11980 clock time +[SCHEDULER ITER13 LR1]: 320106 words processed Wed Nov 18 11:08:32 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.141522. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46494 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74790 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27671 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58973 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10661 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time +[SCHEDULER ITER13 LR1]: 360024 words processed Wed Nov 18 11:08:44 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.140712. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46299 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73963 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23861 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57339 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09706 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11945 clock time +[SCHEDULER ITER13 LR1]: 400089 words processed Wed Nov 18 11:08:56 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.139579. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46577 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75574 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.28922 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10744 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12032 clock time +[SCHEDULER ITER13 LR1]: 440067 words processed Wed Nov 18 11:09:08 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.140484. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46466 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75020 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26588 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58459 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09975 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12030 clock time +[SCHEDULER ITER13 LR1]: 480051 words processed Wed Nov 18 11:09:20 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.141125. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46269 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73945 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23088 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57175 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09546 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11945 clock time +[SCHEDULER ITER13 LR1]: 520140 words processed Wed Nov 18 11:09:32 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.141141. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46447 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74927 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27264 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58941 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10330 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11981 clock time +[SCHEDULER ITER13 LR1]: 560132 words processed Wed Nov 18 11:09:44 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.141279. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46258 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74012 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23609 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57320 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09816 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11973 clock time +[SCHEDULER ITER13 LR1]: 600118 words processed Wed Nov 18 11:09:56 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.139978. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46141 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73807 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23119 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09558 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11915 clock time +[SCHEDULER ITER13 LR1]: 640090 words processed Wed Nov 18 11:10:08 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.139004. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74287 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24469 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57710 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09776 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11997 clock time +[SCHEDULER ITER13 LR1]: 680075 words processed Wed Nov 18 11:10:20 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.138886. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46222 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74030 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23620 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57425 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09672 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11966 clock time +[SCHEDULER ITER13 LR1]: 720043 words processed Wed Nov 18 11:10:32 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.139161. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46158 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74596 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25004 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57909 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09737 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12003 clock time +[SCHEDULER ITER13 LR1]: 760012 words processed Wed Nov 18 11:10:44 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.138622. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75269 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27437 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58719 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10122 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12073 clock time +[SCHEDULER ITER13 LR1]: 800113 words processed Wed Nov 18 11:10:56 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.139039. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46319 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75190 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27988 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59340 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10426 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11990 clock time +[SCHEDULER ITER13 LR1]: 840089 words processed Wed Nov 18 11:11:08 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.138421. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46461 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75640 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.27998 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58710 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10361 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12059 clock time +[SCHEDULER ITER13 LR1]: 880052 words processed Wed Nov 18 11:11:20 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.138626. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46274 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74625 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.26140 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58278 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10143 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12049 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER13 LR1]: Displaying result: +[SCHEDULER ITER13 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 153.32287582627> <PPL_OOV 137.63110760163> <LOGP -1988127.4300539> +[SCHEDULER ITER13 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER13 LR1]: shuffling training file +===PEEK ON TEST 13=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER13 LR1]: 40087 words processed Wed Nov 18 11:11:29 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.212208. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47274 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.77361 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.47349 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11629 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER13 LR1]: Displaying result: +[SCHEDULER ITER13 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 187.68231696506> <PPL_OOV 163.13076093519> <LOGP -182379.33110377> +[SCHEDULER ITER13 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 13=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER13 LR1]: 40095 words processed Wed Nov 18 11:11:38 2015. + [SCHEDULER ITER13 LR1]: log prob per sample :-2.275537. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47033 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76167 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.45707 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11498 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER13 LR1]: Displaying result: +[SCHEDULER ITER13 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 193.13701510763> <PPL_OOV 172.21964454358> <LOGP -164933.45910557> +[SCHEDULER ITER13 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER13 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.13... + +[SCHEDULER ITER14 LR1]: preparing parameters... +[SCHEDULER ITER14 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.13... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1070792 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1074449 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35705236 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35821520 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70365868 +[SCHEDULER ITER14 LR1]: preparing parameters end. +[SCHEDULER ITER14 LR1]: preparing layers... +(11:11:47 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:11:47 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:11:47 2015-11-18)[nerv] info: create layer: combinerL1 +(11:11:47 2015-11-18)[nerv] info: create layer: outputL +(11:11:47 2015-11-18)[nerv] info: create layer: softmaxL +(11:11:47 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER14 LR1]: preparing layers end. +[SCHEDULER ITER14 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER14 LR1]: Initing TNN end. +===ITERATION 14 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER14 LR1]: 40092 words processed Wed Nov 18 11:11:58 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.150251. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47041 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91534 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45503 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59565 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10641 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11921 clock time +[SCHEDULER ITER14 LR1]: 80099 words processed Wed Nov 18 11:12:10 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.145932. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47148 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90982 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41327 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57504 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09285 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11949 clock time +[SCHEDULER ITER14 LR1]: 120004 words processed Wed Nov 18 11:12:22 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.139618. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46764 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90625 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41182 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57618 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09351 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11956 clock time +[SCHEDULER ITER14 LR1]: 160114 words processed Wed Nov 18 11:12:34 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.140890. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46819 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92013 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45375 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10410 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11966 clock time +[SCHEDULER ITER14 LR1]: 200066 words processed Wed Nov 18 11:12:46 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.141728. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46662 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91171 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41959 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57911 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09551 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12001 clock time +[SCHEDULER ITER14 LR1]: 240045 words processed Wed Nov 18 11:12:58 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.138069. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46583 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90781 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40710 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57292 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09530 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11981 clock time +[SCHEDULER ITER14 LR1]: 280057 words processed Wed Nov 18 11:13:10 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.134603. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47093 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94100 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.50456 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60816 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10783 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12105 clock time +[SCHEDULER ITER14 LR1]: 320106 words processed Wed Nov 18 11:13:22 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.132832. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48034 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.97739 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.59913 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.63278 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12446 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12282 clock time +[SCHEDULER ITER14 LR1]: 360024 words processed Wed Nov 18 11:13:34 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.131575. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47275 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96039 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.53597 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60708 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11452 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12285 clock time +[SCHEDULER ITER14 LR1]: 400089 words processed Wed Nov 18 11:13:46 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.130441. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47217 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96392 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.55461 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62002 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11852 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12308 clock time +[SCHEDULER ITER14 LR1]: 440067 words processed Wed Nov 18 11:13:58 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.131438. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46898 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95113 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51252 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11246 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12295 clock time +[SCHEDULER ITER14 LR1]: 480051 words processed Wed Nov 18 11:14:10 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.132096. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47060 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95252 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51159 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60575 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10683 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12303 clock time +[SCHEDULER ITER14 LR1]: 520140 words processed Wed Nov 18 11:14:22 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.132082. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47293 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96465 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.56386 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62102 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12395 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12345 clock time +[SCHEDULER ITER14 LR1]: 560132 words processed Wed Nov 18 11:14:34 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.132168. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46982 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95490 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51700 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60588 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11174 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12232 clock time +[SCHEDULER ITER14 LR1]: 600118 words processed Wed Nov 18 11:14:46 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.130284. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46396 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92872 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45166 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58625 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10272 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12092 clock time +[SCHEDULER ITER14 LR1]: 640090 words processed Wed Nov 18 11:14:58 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.128971. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45861 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89984 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38138 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56940 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09154 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11870 clock time +[SCHEDULER ITER14 LR1]: 680075 words processed Wed Nov 18 11:15:10 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.128578. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46160 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91097 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40787 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57834 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09244 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11946 clock time +[SCHEDULER ITER14 LR1]: 720043 words processed Wed Nov 18 11:15:22 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.128705. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91068 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42144 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09973 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11951 clock time +[SCHEDULER ITER14 LR1]: 760012 words processed Wed Nov 18 11:15:34 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.128296. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46131 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90420 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39806 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57231 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09548 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11873 clock time +[SCHEDULER ITER14 LR1]: 800113 words processed Wed Nov 18 11:15:46 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.128718. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46169 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91339 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43186 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58808 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10250 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11919 clock time +[SCHEDULER ITER14 LR1]: 840089 words processed Wed Nov 18 11:15:58 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.128157. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46160 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90462 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39951 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57234 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09741 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11859 clock time +[SCHEDULER ITER14 LR1]: 880052 words processed Wed Nov 18 11:16:10 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.128351. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46259 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90621 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40749 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57675 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09544 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11975 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER14 LR1]: Displaying result: +[SCHEDULER ITER14 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 149.5870281095> <PPL_OOV 134.4143543947> <LOGP -1978579.6637335> +[SCHEDULER ITER14 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER14 LR1]: shuffling training file +===PEEK ON TEST 14=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER14 LR1]: 40087 words processed Wed Nov 18 11:16:19 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.206408. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91040 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.60288 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11501 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER14 LR1]: Displaying result: +[SCHEDULER ITER14 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 184.60529835793> <PPL_OOV 160.99729765694> <LOGP -181908.05608115> +[SCHEDULER ITER14 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 14=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER14 LR1]: 40095 words processed Wed Nov 18 11:16:28 2015. + [SCHEDULER ITER14 LR1]: log prob per sample :-2.269856. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47128 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92020 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.61603 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11468 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER14 LR1]: Displaying result: +[SCHEDULER ITER14 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 189.97648963555> <PPL_OOV 169.84953181086> <LOGP -164489.54675678> +[SCHEDULER ITER14 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER14 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.14... + +[SCHEDULER ITER15 LR1]: preparing parameters... +[SCHEDULER ITER15 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.14... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34543217 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34546874 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69185372 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69301640 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70371575 +[SCHEDULER ITER15 LR1]: preparing parameters end. +[SCHEDULER ITER15 LR1]: preparing layers... +(11:16:37 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:16:37 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:16:37 2015-11-18)[nerv] info: create layer: combinerL1 +(11:16:37 2015-11-18)[nerv] info: create layer: outputL +(11:16:37 2015-11-18)[nerv] info: create layer: softmaxL +(11:16:37 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER15 LR1]: preparing layers end. +[SCHEDULER ITER15 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER15 LR1]: Initing TNN end. +===ITERATION 15 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER15 LR1]: 40092 words processed Wed Nov 18 11:16:48 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.126334. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47281 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90872 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45864 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59812 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10804 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11982 clock time +[SCHEDULER ITER15 LR1]: 80099 words processed Wed Nov 18 11:17:00 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.126555. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47283 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89088 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40018 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57504 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09452 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11950 clock time +[SCHEDULER ITER15 LR1]: 120004 words processed Wed Nov 18 11:17:12 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.123932. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47132 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89178 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40940 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57686 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09738 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11959 clock time +[SCHEDULER ITER15 LR1]: 160114 words processed Wed Nov 18 11:17:24 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.127397. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47140 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90734 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44979 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59540 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10475 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11992 clock time +[SCHEDULER ITER15 LR1]: 200066 words processed Wed Nov 18 11:17:36 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.128886. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89313 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40416 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57835 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09820 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11952 clock time +[SCHEDULER ITER15 LR1]: 240045 words processed Wed Nov 18 11:17:48 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.125460. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46725 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89147 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39646 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57557 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09409 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11943 clock time +[SCHEDULER ITER15 LR1]: 280057 words processed Wed Nov 18 11:18:00 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.122478. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47008 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90419 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44927 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59518 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10608 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12001 clock time +[SCHEDULER ITER15 LR1]: 320106 words processed Wed Nov 18 11:18:12 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.120817. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90055 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43575 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59445 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10286 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12026 clock time +[SCHEDULER ITER15 LR1]: 360024 words processed Wed Nov 18 11:18:24 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.120126. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46204 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.88698 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38615 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57250 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09479 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11928 clock time +[SCHEDULER ITER15 LR1]: 400089 words processed Wed Nov 18 11:18:36 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.118832. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46424 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89624 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41956 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58714 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10255 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11961 clock time +[SCHEDULER ITER15 LR1]: 440067 words processed Wed Nov 18 11:18:48 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.119879. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46410 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89594 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40341 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57877 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09594 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11985 clock time +[SCHEDULER ITER15 LR1]: 480051 words processed Wed Nov 18 11:19:00 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.120634. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46317 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89060 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57547 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09686 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11966 clock time +[SCHEDULER ITER15 LR1]: 520140 words processed Wed Nov 18 11:19:12 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.120748. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46423 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90075 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59509 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10480 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12019 clock time +[SCHEDULER ITER15 LR1]: 560132 words processed Wed Nov 18 11:19:24 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.120808. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46609 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89658 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41628 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58231 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10196 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11999 clock time +[SCHEDULER ITER15 LR1]: 600118 words processed Wed Nov 18 11:19:36 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.118991. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46253 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.88829 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39125 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57646 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09666 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11951 clock time +[SCHEDULER ITER15 LR1]: 640090 words processed Wed Nov 18 11:19:48 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.118087. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46408 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90738 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43047 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58424 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10355 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12001 clock time +[SCHEDULER ITER15 LR1]: 680075 words processed Wed Nov 18 11:20:00 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.117886. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46551 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89564 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41294 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58154 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10046 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11980 clock time +[SCHEDULER ITER15 LR1]: 720043 words processed Wed Nov 18 11:20:12 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.118077. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46369 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89339 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40549 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58043 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09661 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11985 clock time +[SCHEDULER ITER15 LR1]: 760012 words processed Wed Nov 18 11:20:24 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.118207. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46190 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.88916 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39454 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57867 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09549 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11958 clock time +[SCHEDULER ITER15 LR1]: 800113 words processed Wed Nov 18 11:20:36 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.118705. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46559 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90859 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44803 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59495 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10567 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12053 clock time +[SCHEDULER ITER15 LR1]: 840089 words processed Wed Nov 18 11:20:48 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.118178. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46272 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89479 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40872 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58213 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09935 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12020 clock time +[SCHEDULER ITER15 LR1]: 880052 words processed Wed Nov 18 11:21:00 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.118361. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46266 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.88857 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39067 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57567 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09408 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11984 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER15 LR1]: Displaying result: +[SCHEDULER ITER15 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 146.03546688066> <PPL_OOV 131.3598251194> <LOGP -1969299.4941708> +[SCHEDULER ITER15 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER15 LR1]: shuffling training file +===PEEK ON TEST 15=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER15 LR1]: 40087 words processed Wed Nov 18 11:21:09 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.204185. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46840 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90269 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.59680 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11471 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER15 LR1]: Displaying result: +[SCHEDULER ITER15 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 183.37849337646> <PPL_OOV 160.0011301428> <LOGP -181685.86303108> +[SCHEDULER ITER15 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 15=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER15 LR1]: 40095 words processed Wed Nov 18 11:21:18 2015. + [SCHEDULER ITER15 LR1]: log prob per sample :-2.267028. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46884 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90372 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.59827 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11460 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER15 LR1]: Displaying result: +[SCHEDULER ITER15 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 188.55855926685> <PPL_OOV 168.66052507921> <LOGP -164264.51192834> +[SCHEDULER ITER15 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER15 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.15... + +[SCHEDULER ITER16 LR1]: preparing parameters... +[SCHEDULER ITER16 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.15... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1069088 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1072745 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35720170 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35836453 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70378787 +[SCHEDULER ITER16 LR1]: preparing parameters end. +[SCHEDULER ITER16 LR1]: preparing layers... +(11:21:27 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:21:27 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:21:27 2015-11-18)[nerv] info: create layer: combinerL1 +(11:21:27 2015-11-18)[nerv] info: create layer: outputL +(11:21:27 2015-11-18)[nerv] info: create layer: softmaxL +(11:21:27 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER16 LR1]: preparing layers end. +[SCHEDULER ITER16 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER16 LR1]: Initing TNN end. +===ITERATION 16 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER16 LR1]: 40092 words processed Wed Nov 18 11:21:38 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.115694. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47210 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92260 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47435 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60078 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11007 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11977 clock time +[SCHEDULER ITER16 LR1]: 80099 words processed Wed Nov 18 11:21:50 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.116926. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47316 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91554 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57834 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10042 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12021 clock time +[SCHEDULER ITER16 LR1]: 120004 words processed Wed Nov 18 11:22:02 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.113799. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46880 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91035 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42212 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57713 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09679 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11886 clock time +[SCHEDULER ITER16 LR1]: 160114 words processed Wed Nov 18 11:22:14 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.116729. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46849 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91387 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59014 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10396 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11939 clock time +[SCHEDULER ITER16 LR1]: 200066 words processed Wed Nov 18 11:22:26 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.117457. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46369 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90630 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41076 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57584 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09792 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11954 clock time +[SCHEDULER ITER16 LR1]: 240045 words processed Wed Nov 18 11:22:38 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.114227. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46767 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91646 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43849 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58377 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10055 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12030 clock time +[SCHEDULER ITER16 LR1]: 280057 words processed Wed Nov 18 11:22:50 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.111300. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46808 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92176 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46852 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59954 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10617 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12008 clock time +[SCHEDULER ITER16 LR1]: 320106 words processed Wed Nov 18 11:23:02 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.109921. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46519 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92552 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46821 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10863 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11996 clock time +[SCHEDULER ITER16 LR1]: 360024 words processed Wed Nov 18 11:23:14 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.109011. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46117 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90110 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39845 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57121 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09710 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11923 clock time +[SCHEDULER ITER16 LR1]: 400089 words processed Wed Nov 18 11:23:26 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.107795. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46326 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91323 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43619 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10437 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11958 clock time +[SCHEDULER ITER16 LR1]: 440067 words processed Wed Nov 18 11:23:38 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.108945. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46048 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90228 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39038 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57071 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09327 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11885 clock time +[SCHEDULER ITER16 LR1]: 480051 words processed Wed Nov 18 11:23:50 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.109836. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46156 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90198 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39014 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57049 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09295 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11904 clock time +[SCHEDULER ITER16 LR1]: 520140 words processed Wed Nov 18 11:24:02 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.110070. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92108 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45601 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59539 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10468 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12008 clock time +[SCHEDULER ITER16 LR1]: 560132 words processed Wed Nov 18 11:24:14 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.110257. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46024 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90350 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39936 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57477 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09656 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11933 clock time +[SCHEDULER ITER16 LR1]: 600118 words processed Wed Nov 18 11:24:26 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.108735. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46120 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90696 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41226 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57848 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09983 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11914 clock time +[SCHEDULER ITER16 LR1]: 640090 words processed Wed Nov 18 11:24:38 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.107910. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46181 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90976 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41403 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57939 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09664 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11954 clock time +[SCHEDULER ITER16 LR1]: 680075 words processed Wed Nov 18 11:24:50 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.108014. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46037 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90094 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39001 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.56999 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09636 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11860 clock time +[SCHEDULER ITER16 LR1]: 720043 words processed Wed Nov 18 11:25:02 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.108294. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46118 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90305 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39579 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57269 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09312 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11935 clock time +[SCHEDULER ITER16 LR1]: 760012 words processed Wed Nov 18 11:25:14 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.107997. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46314 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91584 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42419 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57971 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09765 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11928 clock time +[SCHEDULER ITER16 LR1]: 800113 words processed Wed Nov 18 11:25:26 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.108498. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46431 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92341 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45787 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59727 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10339 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11947 clock time +[SCHEDULER ITER16 LR1]: 840089 words processed Wed Nov 18 11:25:38 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.107983. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46229 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91069 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58161 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10309 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11938 clock time +[SCHEDULER ITER16 LR1]: 880052 words processed Wed Nov 18 11:25:50 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.108250. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46124 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91089 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41559 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58013 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09542 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11947 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER16 LR1]: Displaying result: +[SCHEDULER ITER16 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 142.52993551102> <PPL_OOV 128.34432819736> <LOGP -1959923.7705658> +[SCHEDULER ITER16 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER16 LR1]: shuffling training file +===PEEK ON TEST 16=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER16 LR1]: 40087 words processed Wed Nov 18 11:25:59 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.199247. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47918 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95565 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.66569 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11720 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER16 LR1]: Displaying result: +[SCHEDULER ITER16 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 181.85232657852> <PPL_OOV 158.47519639689> <LOGP -181342.80984868> +[SCHEDULER ITER16 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 16=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER16 LR1]: 40095 words processed Wed Nov 18 11:26:08 2015. + [SCHEDULER ITER16 LR1]: log prob per sample :-2.262718. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47243 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93331 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.63182 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11466 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER16 LR1]: Displaying result: +[SCHEDULER ITER16 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 186.63524327582> <PPL_OOV 166.8116302904> <LOGP -163911.41386819> +[SCHEDULER ITER16 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER16 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.16... + +[SCHEDULER ITER17 LR1]: preparing parameters... +[SCHEDULER ITER17 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.16... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34541020 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34544677 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69201806 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69318078 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70386500 +[SCHEDULER ITER17 LR1]: preparing parameters end. +[SCHEDULER ITER17 LR1]: preparing layers... +(11:26:17 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:26:17 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:26:17 2015-11-18)[nerv] info: create layer: combinerL1 +(11:26:17 2015-11-18)[nerv] info: create layer: outputL +(11:26:17 2015-11-18)[nerv] info: create layer: softmaxL +(11:26:17 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER17 LR1]: preparing layers end. +[SCHEDULER ITER17 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER17 LR1]: Initing TNN end. +===ITERATION 17 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER17 LR1]: 40092 words processed Wed Nov 18 11:26:28 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.108420. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47070 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91633 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46963 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60356 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10864 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11983 clock time +[SCHEDULER ITER17 LR1]: 80099 words processed Wed Nov 18 11:26:40 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.108591. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47065 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89624 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40623 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57839 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09639 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11870 clock time +[SCHEDULER ITER17 LR1]: 120004 words processed Wed Nov 18 11:26:52 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.105430. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46842 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90293 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42061 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58116 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09776 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11877 clock time +[SCHEDULER ITER17 LR1]: 160114 words processed Wed Nov 18 11:27:04 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.107876. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46971 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90966 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44840 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59813 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10197 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11979 clock time +[SCHEDULER ITER17 LR1]: 200066 words processed Wed Nov 18 11:27:16 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.109757. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46301 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89580 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40292 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58071 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09623 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11921 clock time +[SCHEDULER ITER17 LR1]: 240045 words processed Wed Nov 18 11:27:28 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.106544. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89450 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39429 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57507 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09486 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11897 clock time +[SCHEDULER ITER17 LR1]: 280057 words processed Wed Nov 18 11:27:40 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.103579. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46587 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90502 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43303 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59128 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10095 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11927 clock time +[SCHEDULER ITER17 LR1]: 320106 words processed Wed Nov 18 11:27:52 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.102231. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90426 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43112 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59322 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10025 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11997 clock time +[SCHEDULER ITER17 LR1]: 360024 words processed Wed Nov 18 11:28:04 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.103825. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46076 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89850 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40003 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57779 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09406 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11884 clock time +[SCHEDULER ITER17 LR1]: 400089 words processed Wed Nov 18 11:28:16 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.102596. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46155 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90705 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43219 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59386 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10104 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11954 clock time +[SCHEDULER ITER17 LR1]: 440067 words processed Wed Nov 18 11:28:28 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.103633. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46145 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89711 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57735 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09579 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11901 clock time +[SCHEDULER ITER17 LR1]: 480051 words processed Wed Nov 18 11:28:40 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.104338. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45965 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89582 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57387 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09366 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11897 clock time +[SCHEDULER ITER17 LR1]: 520140 words processed Wed Nov 18 11:28:52 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.104375. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46122 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90595 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43166 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59305 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10238 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11945 clock time +[SCHEDULER ITER17 LR1]: 560132 words processed Wed Nov 18 11:29:04 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.104388. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46012 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89565 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39441 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57740 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09621 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11936 clock time +[SCHEDULER ITER17 LR1]: 600118 words processed Wed Nov 18 11:29:16 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.103305. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89412 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38754 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57428 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09481 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11887 clock time +[SCHEDULER ITER17 LR1]: 640090 words processed Wed Nov 18 11:29:28 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.104230. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45953 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89248 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57504 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09555 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11921 clock time +[SCHEDULER ITER17 LR1]: 680075 words processed Wed Nov 18 11:29:40 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.103934. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46068 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89485 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39272 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57792 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09378 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11946 clock time +[SCHEDULER ITER17 LR1]: 720043 words processed Wed Nov 18 11:29:52 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.104033. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46006 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89192 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38263 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57281 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09239 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11883 clock time +[SCHEDULER ITER17 LR1]: 760012 words processed Wed Nov 18 11:30:04 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.104624. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46126 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89837 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39959 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57811 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09458 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11908 clock time +[SCHEDULER ITER17 LR1]: 800113 words processed Wed Nov 18 11:30:16 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.105026. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46365 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91993 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46566 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60169 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10782 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time +[SCHEDULER ITER17 LR1]: 840089 words processed Wed Nov 18 11:30:28 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.104416. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46128 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90964 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58640 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09750 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12016 clock time +[SCHEDULER ITER17 LR1]: 880052 words processed Wed Nov 18 11:30:40 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.104466. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46401 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91300 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43933 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58860 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10184 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11974 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER17 LR1]: Displaying result: +[SCHEDULER ITER17 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 141.19954804009> <PPL_OOV 127.21379650058> <LOGP -1956351.8551459> +[SCHEDULER ITER17 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER17 LR1]: shuffling training file +===PEEK ON TEST 17=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER17 LR1]: 40087 words processed Wed Nov 18 11:30:49 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.198889. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91153 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.60373 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11422 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER17 LR1]: Displaying result: +[SCHEDULER ITER17 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 180.70520360784> <PPL_OOV 158.41280661091> <LOGP -181328.71347802> +[SCHEDULER ITER17 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 17=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER17 LR1]: 40095 words processed Wed Nov 18 11:30:58 2015. + [SCHEDULER ITER17 LR1]: log prob per sample :-2.263003. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46879 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90774 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.60026 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11386 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER17 LR1]: Displaying result: +[SCHEDULER ITER17 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 185.44844722879> <PPL_OOV 166.57217575974> <LOGP -163865.39734015> +[SCHEDULER ITER17 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER17 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.17... + +[SCHEDULER ITER18 LR1]: preparing parameters... +[SCHEDULER ITER18 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.17... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1067636 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1071293 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35738936 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35855199 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70394860 +[SCHEDULER ITER18 LR1]: preparing parameters end. +[SCHEDULER ITER18 LR1]: preparing layers... +(11:31:07 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:31:07 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:31:07 2015-11-18)[nerv] info: create layer: combinerL1 +(11:31:07 2015-11-18)[nerv] info: create layer: outputL +(11:31:07 2015-11-18)[nerv] info: create layer: softmaxL +(11:31:07 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER18 LR1]: preparing layers end. +[SCHEDULER ITER18 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER18 LR1]: Initing TNN end. +===ITERATION 18 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER18 LR1]: 40092 words processed Wed Nov 18 11:31:18 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.100858. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47344 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92509 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48658 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60662 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10998 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time +[SCHEDULER ITER18 LR1]: 80099 words processed Wed Nov 18 11:31:30 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.100635. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47126 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90330 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41027 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57709 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09284 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11920 clock time +[SCHEDULER ITER18 LR1]: 120004 words processed Wed Nov 18 11:31:42 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.097217. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46894 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90217 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40293 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57342 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09006 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11874 clock time +[SCHEDULER ITER18 LR1]: 160114 words processed Wed Nov 18 11:31:54 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.100555. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46938 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91499 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43863 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58903 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09872 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11905 clock time +[SCHEDULER ITER18 LR1]: 200066 words processed Wed Nov 18 11:32:06 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.101992. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46602 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90144 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39875 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57474 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09039 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11899 clock time +[SCHEDULER ITER18 LR1]: 240045 words processed Wed Nov 18 11:32:18 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.098634. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46616 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90745 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41055 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09234 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11910 clock time +[SCHEDULER ITER18 LR1]: 280057 words processed Wed Nov 18 11:32:30 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.095480. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47852 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96904 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.57313 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11583 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12273 clock time +[SCHEDULER ITER18 LR1]: 320106 words processed Wed Nov 18 11:32:42 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.093899. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47355 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96676 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.56591 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62358 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11704 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12412 clock time +[SCHEDULER ITER18 LR1]: 360024 words processed Wed Nov 18 11:32:54 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.093222. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47020 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94135 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.49107 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59811 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10305 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12157 clock time +[SCHEDULER ITER18 LR1]: 400089 words processed Wed Nov 18 11:33:06 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.092038. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91898 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45023 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59541 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10204 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11955 clock time +[SCHEDULER ITER18 LR1]: 440067 words processed Wed Nov 18 11:33:18 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.093470. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46175 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90663 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40464 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57649 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09385 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11886 clock time +[SCHEDULER ITER18 LR1]: 480051 words processed Wed Nov 18 11:33:30 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.094432. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46175 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90218 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39395 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09144 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11907 clock time +[SCHEDULER ITER18 LR1]: 520140 words processed Wed Nov 18 11:33:42 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.094612. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46238 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91751 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44953 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59597 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10255 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12002 clock time +[SCHEDULER ITER18 LR1]: 560132 words processed Wed Nov 18 11:33:54 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.094673. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46101 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89952 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38704 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57082 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09178 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11903 clock time +[SCHEDULER ITER18 LR1]: 600118 words processed Wed Nov 18 11:34:06 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.094054. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46056 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90180 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39211 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57329 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09092 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11912 clock time +[SCHEDULER ITER18 LR1]: 640090 words processed Wed Nov 18 11:34:18 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.093141. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46103 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90819 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41022 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57965 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09385 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11971 clock time +[SCHEDULER ITER18 LR1]: 680075 words processed Wed Nov 18 11:34:30 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.092928. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46534 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91453 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43017 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58310 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09851 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11998 clock time +[SCHEDULER ITER18 LR1]: 720043 words processed Wed Nov 18 11:34:42 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.093002. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46267 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91386 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58369 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09721 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11979 clock time +[SCHEDULER ITER18 LR1]: 760012 words processed Wed Nov 18 11:34:54 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.092652. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95422 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51660 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60448 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10618 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12299 clock time +[SCHEDULER ITER18 LR1]: 800113 words processed Wed Nov 18 11:35:06 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.093194. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47398 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96804 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.55973 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62116 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11513 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12240 clock time +[SCHEDULER ITER18 LR1]: 840089 words processed Wed Nov 18 11:35:18 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.092664. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46658 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93123 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45958 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59006 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09883 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12123 clock time +[SCHEDULER ITER18 LR1]: 880052 words processed Wed Nov 18 11:35:30 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.092839. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46218 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91158 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41106 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57730 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09176 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11922 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER18 LR1]: Displaying result: +[SCHEDULER ITER18 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 137.34114630761> <PPL_OOV 123.86098737885> <LOGP -1945568.9240026> +[SCHEDULER ITER18 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER18 LR1]: shuffling training file +===PEEK ON TEST 18=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER18 LR1]: 40087 words processed Wed Nov 18 11:35:39 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.194785. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46991 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91814 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.61391 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11487 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER18 LR1]: Displaying result: +[SCHEDULER ITER18 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 179.81187100755> <PPL_OOV 156.95421884454> <LOGP -180997.56787842> +[SCHEDULER ITER18 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 18=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER18 LR1]: 40095 words processed Wed Nov 18 11:35:48 2015. + [SCHEDULER ITER18 LR1]: log prob per sample :-2.259428. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47031 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92876 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62514 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11466 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER18 LR1]: Displaying result: +[SCHEDULER ITER18 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 184.49928420535> <PPL_OOV 165.10810144726> <LOGP -163582.59597025> +[SCHEDULER ITER18 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER18 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.18... + +[SCHEDULER ITER19 LR1]: preparing parameters... +[SCHEDULER ITER19 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.18... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34538074 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34541731 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69220662 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69336928 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70404066 +[SCHEDULER ITER19 LR1]: preparing parameters end. +[SCHEDULER ITER19 LR1]: preparing layers... +(11:35:57 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:35:57 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:35:57 2015-11-18)[nerv] info: create layer: combinerL1 +(11:35:57 2015-11-18)[nerv] info: create layer: outputL +(11:35:57 2015-11-18)[nerv] info: create layer: softmaxL +(11:35:57 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER19 LR1]: preparing layers end. +[SCHEDULER ITER19 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER19 LR1]: Initing TNN end. +===ITERATION 19 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER19 LR1]: 40092 words processed Wed Nov 18 11:36:08 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.090996. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46988 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91173 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47086 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60712 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11041 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12098 clock time +[SCHEDULER ITER19 LR1]: 80099 words processed Wed Nov 18 11:36:20 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.092216. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46934 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89179 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39641 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57506 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09537 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11965 clock time +[SCHEDULER ITER19 LR1]: 120004 words processed Wed Nov 18 11:36:32 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.089189. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46715 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89033 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39664 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57401 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09621 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11983 clock time +[SCHEDULER ITER19 LR1]: 160114 words processed Wed Nov 18 11:36:44 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.091547. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46744 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90322 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59313 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10464 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12014 clock time +[SCHEDULER ITER19 LR1]: 200066 words processed Wed Nov 18 11:36:56 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.092413. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46454 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89897 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40991 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57864 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09925 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12005 clock time +[SCHEDULER ITER19 LR1]: 240045 words processed Wed Nov 18 11:37:08 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.089188. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46391 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89287 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39182 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57381 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09516 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12003 clock time +[SCHEDULER ITER19 LR1]: 280057 words processed Wed Nov 18 11:37:20 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.085994. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46768 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91849 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47115 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60061 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10996 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12102 clock time +[SCHEDULER ITER19 LR1]: 320106 words processed Wed Nov 18 11:37:32 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.084639. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46345 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90954 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45099 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59862 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10691 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12048 clock time +[SCHEDULER ITER19 LR1]: 360024 words processed Wed Nov 18 11:37:44 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.083867. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46085 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89880 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41085 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58037 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10064 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11983 clock time +[SCHEDULER ITER19 LR1]: 400089 words processed Wed Nov 18 11:37:56 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.084462. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46410 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91425 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45488 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59876 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10614 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12118 clock time +[SCHEDULER ITER19 LR1]: 440067 words processed Wed Nov 18 11:38:08 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.085830. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46078 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89885 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39884 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57666 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09639 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11969 clock time +[SCHEDULER ITER19 LR1]: 480051 words processed Wed Nov 18 11:38:20 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.086788. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46045 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89161 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39250 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57527 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10092 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time +[SCHEDULER ITER19 LR1]: 520140 words processed Wed Nov 18 11:38:32 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.087177. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90605 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43098 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59156 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10185 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12029 clock time +[SCHEDULER ITER19 LR1]: 560132 words processed Wed Nov 18 11:38:44 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.087613. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45971 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89090 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38672 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57348 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09837 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11986 clock time +[SCHEDULER ITER19 LR1]: 600118 words processed Wed Nov 18 11:38:56 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.085937. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45985 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89205 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38731 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57363 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09694 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11960 clock time +[SCHEDULER ITER19 LR1]: 640090 words processed Wed Nov 18 11:39:08 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.084914. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46037 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90001 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40597 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58015 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09800 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12059 clock time +[SCHEDULER ITER19 LR1]: 680075 words processed Wed Nov 18 11:39:20 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.084572. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46356 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91029 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43414 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58853 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10193 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12139 clock time +[SCHEDULER ITER19 LR1]: 720043 words processed Wed Nov 18 11:39:32 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.084724. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47208 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94667 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.52487 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60921 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11599 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12372 clock time +[SCHEDULER ITER19 LR1]: 760012 words processed Wed Nov 18 11:39:44 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.084702. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46438 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91615 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45742 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59275 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11009 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12183 clock time +[SCHEDULER ITER19 LR1]: 800113 words processed Wed Nov 18 11:39:56 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.085325. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46129 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90572 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43444 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59536 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10225 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12051 clock time +[SCHEDULER ITER19 LR1]: 840089 words processed Wed Nov 18 11:40:08 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.084822. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46052 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89527 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39881 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57762 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09942 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11991 clock time +[SCHEDULER ITER19 LR1]: 880052 words processed Wed Nov 18 11:40:20 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.085047. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46152 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90107 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40960 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58314 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09522 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11999 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER19 LR1]: Displaying result: +[SCHEDULER ITER19 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 134.79431248528> <PPL_OOV 121.66561590739> <LOGP -1938349.1048702> +[SCHEDULER ITER19 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER19 LR1]: shuffling training file +===PEEK ON TEST 19=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER19 LR1]: 40087 words processed Wed Nov 18 11:40:29 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.194895. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47073 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91618 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.61384 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11614 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER19 LR1]: Displaying result: +[SCHEDULER ITER19 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 179.35664560354> <PPL_OOV 156.98822353866> <LOGP -181005.32299711> +[SCHEDULER ITER19 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 19=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER19 LR1]: 40095 words processed Wed Nov 18 11:40:38 2015. + [SCHEDULER ITER19 LR1]: log prob per sample :-2.258736. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46758 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90503 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.59738 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11484 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER19 LR1]: Displaying result: +[SCHEDULER ITER19 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 184.03899331812> <PPL_OOV 165.02753091> <LOGP -163566.96020714> +[SCHEDULER ITER19 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER19 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.19... + +[SCHEDULER ITER20 LR1]: preparing parameters... +[SCHEDULER ITER20 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.19... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1066494 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1070151 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35761293 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35877568 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70414635 +[SCHEDULER ITER20 LR1]: preparing parameters end. +[SCHEDULER ITER20 LR1]: preparing layers... +(11:40:47 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:40:47 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:40:47 2015-11-18)[nerv] info: create layer: combinerL1 +(11:40:47 2015-11-18)[nerv] info: create layer: outputL +(11:40:47 2015-11-18)[nerv] info: create layer: softmaxL +(11:40:47 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER20 LR1]: preparing layers end. +[SCHEDULER ITER20 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER20 LR1]: Initing TNN end. +===ITERATION 20 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER20 LR1]: 40092 words processed Wed Nov 18 11:40:58 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.085050. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47070 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93031 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48032 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60405 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10566 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11927 clock time +[SCHEDULER ITER20 LR1]: 80099 words processed Wed Nov 18 11:41:10 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.087234. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47026 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92536 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45432 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58958 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10038 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12033 clock time +[SCHEDULER ITER20 LR1]: 120004 words processed Wed Nov 18 11:41:22 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.083289. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91228 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42540 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58007 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09641 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11867 clock time +[SCHEDULER ITER20 LR1]: 160114 words processed Wed Nov 18 11:41:34 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.084575. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46825 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92296 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45552 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59643 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10095 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11891 clock time +[SCHEDULER ITER20 LR1]: 200066 words processed Wed Nov 18 11:41:46 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.085180. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46440 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91039 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41367 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58088 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09134 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11886 clock time +[SCHEDULER ITER20 LR1]: 240045 words processed Wed Nov 18 11:41:58 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.082257. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46458 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91007 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41723 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57974 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09768 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11843 clock time +[SCHEDULER ITER20 LR1]: 280057 words processed Wed Nov 18 11:42:10 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.079229. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46649 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92216 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46209 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59853 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10453 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11882 clock time +[SCHEDULER ITER20 LR1]: 320106 words processed Wed Nov 18 11:42:22 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.077909. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46744 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93629 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.49664 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60842 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10926 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12071 clock time +[SCHEDULER ITER20 LR1]: 360024 words processed Wed Nov 18 11:42:34 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.077304. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46022 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91555 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42326 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58006 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09886 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11911 clock time +[SCHEDULER ITER20 LR1]: 400089 words processed Wed Nov 18 11:42:46 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.076911. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46210 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92434 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45640 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10538 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11932 clock time +[SCHEDULER ITER20 LR1]: 440067 words processed Wed Nov 18 11:42:58 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.078260. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46137 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91551 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58008 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09559 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11879 clock time +[SCHEDULER ITER20 LR1]: 480051 words processed Wed Nov 18 11:43:10 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.079301. + [global_conf.timer]: time spent on tnn_beforeprocess:0.45994 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91479 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41953 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58121 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09827 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11912 clock time +[SCHEDULER ITER20 LR1]: 520140 words processed Wed Nov 18 11:43:22 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.079337. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46392 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93347 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47647 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60159 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10597 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11999 clock time +[SCHEDULER ITER20 LR1]: 560132 words processed Wed Nov 18 11:43:34 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.079429. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49459 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.10094 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.87257 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.70915 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.14386 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13224 clock time +[SCHEDULER ITER20 LR1]: 600118 words processed Wed Nov 18 11:43:46 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.078745. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46556 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92739 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45134 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58882 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09884 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12006 clock time +[SCHEDULER ITER20 LR1]: 640090 words processed Wed Nov 18 11:43:58 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.077633. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46354 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92397 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59169 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10248 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12081 clock time +[SCHEDULER ITER20 LR1]: 680075 words processed Wed Nov 18 11:44:10 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.077152. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46260 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92093 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44081 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58723 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10110 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12010 clock time +[SCHEDULER ITER20 LR1]: 720043 words processed Wed Nov 18 11:44:22 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.077321. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46502 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93127 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45403 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58804 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09637 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12108 clock time +[SCHEDULER ITER20 LR1]: 760012 words processed Wed Nov 18 11:44:34 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.077145. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46358 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93263 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45589 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58963 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09891 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12033 clock time +[SCHEDULER ITER20 LR1]: 800113 words processed Wed Nov 18 11:44:46 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.077730. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47134 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96106 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.53236 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61040 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11125 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12156 clock time +[SCHEDULER ITER20 LR1]: 840089 words processed Wed Nov 18 11:44:58 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.077224. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91634 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43757 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58801 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09929 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12108 clock time +[SCHEDULER ITER20 LR1]: 880052 words processed Wed Nov 18 11:45:10 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.077427. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46151 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91869 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58722 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09678 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11982 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER20 LR1]: Displaying result: +[SCHEDULER ITER20 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 132.32514776759> <PPL_OOV 119.54265480169> <LOGP -1931242.4317517> +[SCHEDULER ITER20 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER20 LR1]: shuffling training file +===PEEK ON TEST 20=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER20 LR1]: 40087 words processed Wed Nov 18 11:45:19 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.192376. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47284 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94029 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.64178 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11641 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER20 LR1]: Displaying result: +[SCHEDULER ITER20 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 178.8707175969> <PPL_OOV 156.1937916313> <LOGP -180823.70436399> +[SCHEDULER ITER20 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 20=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER20 LR1]: 40095 words processed Wed Nov 18 11:45:29 2015. + [SCHEDULER ITER20 LR1]: log prob per sample :-2.256632. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47961 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99205 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.70687 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11972 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER20 LR1]: Displaying result: +[SCHEDULER ITER20 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 183.50506098011> <PPL_OOV 164.22139665816> <LOGP -163410.09772312> +[SCHEDULER ITER20 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER20 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.20... + +[SCHEDULER ITER21 LR1]: preparing parameters... +[SCHEDULER ITER21 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.20... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34535500 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34539157 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69243371 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69359649 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70425551 +[SCHEDULER ITER21 LR1]: preparing parameters end. +[SCHEDULER ITER21 LR1]: preparing layers... +(11:45:38 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:45:38 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:45:38 2015-11-18)[nerv] info: create layer: combinerL1 +(11:45:38 2015-11-18)[nerv] info: create layer: outputL +(11:45:38 2015-11-18)[nerv] info: create layer: softmaxL +(11:45:38 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER21 LR1]: preparing layers end. +[SCHEDULER ITER21 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER21 LR1]: Initing TNN end. +===ITERATION 21 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER21 LR1]: 40092 words processed Wed Nov 18 11:45:50 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.077161. + [global_conf.timer]: time spent on tnn_beforeprocess:0.50699 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.08887 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.91251 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.73291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.15631 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13152 clock time +[SCHEDULER ITER21 LR1]: 80099 words processed Wed Nov 18 11:46:02 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.078484. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48771 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98600 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62440 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.63444 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12169 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12598 clock time +[SCHEDULER ITER21 LR1]: 120004 words processed Wed Nov 18 11:46:14 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.074678. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47229 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93526 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48619 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59706 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10419 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12145 clock time +[SCHEDULER ITER21 LR1]: 160114 words processed Wed Nov 18 11:46:26 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.079716. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48247 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98340 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.61967 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64064 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12428 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12397 clock time +[SCHEDULER ITER21 LR1]: 200066 words processed Wed Nov 18 11:46:38 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.080377. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47351 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95018 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.52890 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60967 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11111 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12296 clock time +[SCHEDULER ITER21 LR1]: 240045 words processed Wed Nov 18 11:46:50 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.077124. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47907 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98218 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.59569 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12385 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12512 clock time +[SCHEDULER ITER21 LR1]: 280057 words processed Wed Nov 18 11:47:02 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.073853. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47034 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94403 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51341 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60744 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11559 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12177 clock time +[SCHEDULER ITER21 LR1]: 320106 words processed Wed Nov 18 11:47:14 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.072403. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46613 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92557 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47272 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59869 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11046 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12044 clock time +[SCHEDULER ITER21 LR1]: 360024 words processed Wed Nov 18 11:47:26 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.071235. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46305 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91240 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42633 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58025 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10088 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12000 clock time +[SCHEDULER ITER21 LR1]: 400089 words processed Wed Nov 18 11:47:38 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.069826. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46598 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92575 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47210 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59917 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11134 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12035 clock time +[SCHEDULER ITER21 LR1]: 440067 words processed Wed Nov 18 11:47:50 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.070909. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46525 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92679 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46226 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59104 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10695 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12148 clock time +[SCHEDULER ITER21 LR1]: 480051 words processed Wed Nov 18 11:48:02 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.071891. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46284 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91525 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42581 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58075 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10126 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11978 clock time +[SCHEDULER ITER21 LR1]: 520140 words processed Wed Nov 18 11:48:14 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.072260. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46420 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92169 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45230 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59549 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10151 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12023 clock time +[SCHEDULER ITER21 LR1]: 560132 words processed Wed Nov 18 11:48:26 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.072402. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46171 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91323 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41795 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57890 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09885 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12001 clock time +[SCHEDULER ITER21 LR1]: 600118 words processed Wed Nov 18 11:48:38 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.070887. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46130 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91167 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42037 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57916 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10251 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12002 clock time +[SCHEDULER ITER21 LR1]: 640090 words processed Wed Nov 18 11:48:50 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.070046. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46180 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91103 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42259 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58164 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10198 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11985 clock time +[SCHEDULER ITER21 LR1]: 680075 words processed Wed Nov 18 11:49:02 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.069803. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46227 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90922 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41674 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57714 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10320 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11970 clock time +[SCHEDULER ITER21 LR1]: 720043 words processed Wed Nov 18 11:49:14 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.069931. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46312 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91349 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42986 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58059 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10467 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11993 clock time +[SCHEDULER ITER21 LR1]: 760012 words processed Wed Nov 18 11:49:26 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.069535. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46294 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91337 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42327 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57970 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09977 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11953 clock time +[SCHEDULER ITER21 LR1]: 800113 words processed Wed Nov 18 11:49:38 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.070118. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46398 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92932 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47662 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59818 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11438 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12040 clock time +[SCHEDULER ITER21 LR1]: 840089 words processed Wed Nov 18 11:49:50 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.069680. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46273 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91298 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41699 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57633 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09978 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11962 clock time +[SCHEDULER ITER21 LR1]: 880052 words processed Wed Nov 18 11:50:02 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.069878. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46142 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91035 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41895 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57709 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10317 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11987 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER21 LR1]: Displaying result: +[SCHEDULER ITER21 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 129.94447642588> <PPL_OOV 117.48605218627> <LOGP -1924236.5045858> +[SCHEDULER ITER21 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER21 LR1]: shuffling training file +===PEEK ON TEST 21=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER21 LR1]: 40087 words processed Wed Nov 18 11:50:11 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.191794. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47015 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93243 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62877 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11544 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER21 LR1]: Displaying result: +[SCHEDULER ITER21 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 177.54148794518> <PPL_OOV 155.83031275648> <LOGP -180740.29960477> +[SCHEDULER ITER21 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 21=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER21 LR1]: 40095 words processed Wed Nov 18 11:50:20 2015. + [SCHEDULER ITER21 LR1]: log prob per sample :-2.256591. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92842 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62402 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11516 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER21 LR1]: Displaying result: +[SCHEDULER ITER21 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 182.38397970157> <PPL_OOV 163.87744761893> <LOGP -163342.9355447> +[SCHEDULER ITER21 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER21 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.21... + +[SCHEDULER ITER22 LR1]: preparing parameters... +[SCHEDULER ITER22 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.21... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1065368 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1069025 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35788267 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35904550 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70438596 +[SCHEDULER ITER22 LR1]: preparing parameters end. +[SCHEDULER ITER22 LR1]: preparing layers... +(11:50:29 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:50:29 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:50:29 2015-11-18)[nerv] info: create layer: combinerL1 +(11:50:29 2015-11-18)[nerv] info: create layer: outputL +(11:50:29 2015-11-18)[nerv] info: create layer: softmaxL +(11:50:29 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER22 LR1]: preparing layers end. +[SCHEDULER ITER22 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER22 LR1]: Initing TNN end. +===ITERATION 22 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER22 LR1]: 40092 words processed Wed Nov 18 11:50:40 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.070689. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47294 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92936 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48504 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60171 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11017 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12013 clock time +[SCHEDULER ITER22 LR1]: 80099 words processed Wed Nov 18 11:50:52 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.070559. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47320 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91899 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58440 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10062 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12067 clock time +[SCHEDULER ITER22 LR1]: 120004 words processed Wed Nov 18 11:51:04 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.067385. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47040 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91730 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43868 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58108 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09874 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time +[SCHEDULER ITER22 LR1]: 160114 words processed Wed Nov 18 11:51:16 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.071316. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47112 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92989 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47913 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60026 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10819 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12014 clock time +[SCHEDULER ITER22 LR1]: 200066 words processed Wed Nov 18 11:51:28 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.072229. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46624 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91882 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58491 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09859 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11998 clock time +[SCHEDULER ITER22 LR1]: 240045 words processed Wed Nov 18 11:51:40 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.068766. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46813 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91796 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44076 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10261 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11978 clock time +[SCHEDULER ITER22 LR1]: 280057 words processed Wed Nov 18 11:51:52 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.065662. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46883 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93045 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48406 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60226 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10881 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12018 clock time +[SCHEDULER ITER22 LR1]: 320106 words processed Wed Nov 18 11:52:04 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.064301. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46617 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92558 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46902 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59649 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10918 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12003 clock time +[SCHEDULER ITER22 LR1]: 360024 words processed Wed Nov 18 11:52:16 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.063798. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46373 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92877 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45268 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58561 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10090 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12041 clock time +[SCHEDULER ITER22 LR1]: 400089 words processed Wed Nov 18 11:52:28 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.062554. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92860 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47055 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10731 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11995 clock time +[SCHEDULER ITER22 LR1]: 440067 words processed Wed Nov 18 11:52:40 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.063656. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46288 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91402 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42446 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57999 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10101 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11957 clock time +[SCHEDULER ITER22 LR1]: 480051 words processed Wed Nov 18 11:52:52 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.064683. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46269 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91547 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42449 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57975 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10091 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11943 clock time +[SCHEDULER ITER22 LR1]: 520140 words processed Wed Nov 18 11:53:04 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.064899. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46370 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92490 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46572 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59769 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10830 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12000 clock time +[SCHEDULER ITER22 LR1]: 560132 words processed Wed Nov 18 11:53:16 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.065037. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46319 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91854 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43594 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58490 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10161 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11978 clock time +[SCHEDULER ITER22 LR1]: 600118 words processed Wed Nov 18 11:53:28 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.063542. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46314 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91652 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42318 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58069 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09594 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11929 clock time +[SCHEDULER ITER22 LR1]: 640090 words processed Wed Nov 18 11:53:40 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.062551. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46485 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92311 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44782 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58853 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10220 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11985 clock time +[SCHEDULER ITER22 LR1]: 680075 words processed Wed Nov 18 11:53:52 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.062470. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46150 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91661 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42771 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58335 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09918 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11946 clock time +[SCHEDULER ITER22 LR1]: 720043 words processed Wed Nov 18 11:54:04 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.062579. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46247 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91963 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43752 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58354 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10265 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11980 clock time +[SCHEDULER ITER22 LR1]: 760012 words processed Wed Nov 18 11:54:16 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.062429. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46192 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91687 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42592 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58204 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09608 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11960 clock time +[SCHEDULER ITER22 LR1]: 800113 words processed Wed Nov 18 11:54:28 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.063025. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46595 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93408 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48883 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60521 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11036 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12087 clock time +[SCHEDULER ITER22 LR1]: 840089 words processed Wed Nov 18 11:54:40 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.062518. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92301 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43526 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58309 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09901 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11982 clock time +[SCHEDULER ITER22 LR1]: 880052 words processed Wed Nov 18 11:54:52 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.062751. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46309 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92228 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44665 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58868 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10188 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11987 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER22 LR1]: Displaying result: +[SCHEDULER ITER22 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 127.72963687075> <PPL_OOV 115.57633745052> <LOGP -1917620.263724> +[SCHEDULER ITER22 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER22 LR1]: shuffling training file +===PEEK ON TEST 22=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER22 LR1]: 40087 words processed Wed Nov 18 11:55:01 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.190838. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47028 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92927 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62624 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11563 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER22 LR1]: Displaying result: +[SCHEDULER ITER22 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 177.63579916812> <PPL_OOV 155.49815507676> <LOGP -180663.9115879> +[SCHEDULER ITER22 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 22=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER22 LR1]: 40095 words processed Wed Nov 18 11:55:10 2015. + [SCHEDULER ITER22 LR1]: log prob per sample :-2.256433. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47013 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92879 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62503 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11514 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER22 LR1]: Displaying result: +[SCHEDULER ITER22 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 182.55913997681> <PPL_OOV 163.69972113613> <LOGP -163308.17602403> +[SCHEDULER ITER22 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER22 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.22... + +[SCHEDULER ITER23 LR1]: preparing parameters... +[SCHEDULER ITER23 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.22... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34532317 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34535974 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69270165 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69386444 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70451255 +[SCHEDULER ITER23 LR1]: preparing parameters end. +[SCHEDULER ITER23 LR1]: preparing layers... +(11:55:19 2015-11-18)[nerv] info: create layer: recurrentL1 +(11:55:19 2015-11-18)[nerv] info: create layer: sigmoidL1 +(11:55:19 2015-11-18)[nerv] info: create layer: combinerL1 +(11:55:19 2015-11-18)[nerv] info: create layer: outputL +(11:55:19 2015-11-18)[nerv] info: create layer: softmaxL +(11:55:19 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER23 LR1]: preparing layers end. +[SCHEDULER ITER23 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER23 LR1]: Initing TNN end. +===ITERATION 23 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER23 LR1]: 40092 words processed Wed Nov 18 11:55:30 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.095018. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47532 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92781 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.49415 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61267 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10823 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12050 clock time +[SCHEDULER ITER23 LR1]: 80099 words processed Wed Nov 18 11:55:42 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.086515. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47435 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91415 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43939 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58751 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09727 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12031 clock time +[SCHEDULER ITER23 LR1]: 120004 words processed Wed Nov 18 11:55:54 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.077029. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91466 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44401 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58747 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09828 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12025 clock time +[SCHEDULER ITER23 LR1]: 160114 words processed Wed Nov 18 11:56:06 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.075436. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47346 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92640 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47844 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60507 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10443 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12070 clock time +[SCHEDULER ITER23 LR1]: 200066 words processed Wed Nov 18 11:56:18 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.073590. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46989 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91459 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43968 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58856 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09874 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12004 clock time +[SCHEDULER ITER23 LR1]: 240045 words processed Wed Nov 18 11:56:30 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.069125. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46995 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91617 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43926 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58842 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09789 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11978 clock time +[SCHEDULER ITER23 LR1]: 280057 words processed Wed Nov 18 11:56:42 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.064858. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47028 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92587 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47623 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10325 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12053 clock time +[SCHEDULER ITER23 LR1]: 320106 words processed Wed Nov 18 11:56:54 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.062961. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46854 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92348 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47390 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60439 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10625 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12026 clock time +[SCHEDULER ITER23 LR1]: 360024 words processed Wed Nov 18 11:57:06 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.061620. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46561 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91583 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43891 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58795 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09882 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12039 clock time +[SCHEDULER ITER23 LR1]: 400089 words processed Wed Nov 18 11:57:18 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.059833. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46677 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92731 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47574 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60452 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10642 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12083 clock time +[SCHEDULER ITER23 LR1]: 440067 words processed Wed Nov 18 11:57:30 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.060592. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46511 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91411 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43198 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58752 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09873 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12000 clock time +[SCHEDULER ITER23 LR1]: 480051 words processed Wed Nov 18 11:57:42 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.061365. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46585 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91257 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43158 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58704 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10079 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12013 clock time +[SCHEDULER ITER23 LR1]: 520140 words processed Wed Nov 18 11:57:54 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.061413. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46678 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92455 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46962 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60354 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10406 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12079 clock time +[SCHEDULER ITER23 LR1]: 560132 words processed Wed Nov 18 11:58:06 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.061345. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46405 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90491 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42098 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58659 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09929 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11995 clock time +[SCHEDULER ITER23 LR1]: 600118 words processed Wed Nov 18 11:58:18 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.059732. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46803 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92628 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48292 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60492 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10576 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12264 clock time +[SCHEDULER ITER23 LR1]: 640090 words processed Wed Nov 18 11:58:30 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.058492. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46412 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91224 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45254 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59944 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10306 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12187 clock time +[SCHEDULER ITER23 LR1]: 680075 words processed Wed Nov 18 11:58:42 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.058583. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46580 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91796 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46151 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60252 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10256 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12175 clock time +[SCHEDULER ITER23 LR1]: 720043 words processed Wed Nov 18 11:58:54 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.058929. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46224 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89935 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40698 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58321 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09721 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11907 clock time +[SCHEDULER ITER23 LR1]: 760012 words processed Wed Nov 18 11:59:06 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.058524. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46265 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90315 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41084 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58366 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09579 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11908 clock time +[SCHEDULER ITER23 LR1]: 800113 words processed Wed Nov 18 11:59:18 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.059124. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46432 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91279 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44913 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60026 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10388 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11947 clock time +[SCHEDULER ITER23 LR1]: 840089 words processed Wed Nov 18 11:59:30 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.058808. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46269 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90330 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41006 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58365 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09636 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11883 clock time +[SCHEDULER ITER23 LR1]: 880052 words processed Wed Nov 18 11:59:42 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.059093. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46466 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90803 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42554 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58569 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10036 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11958 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER23 LR1]: Displaying result: +[SCHEDULER ITER23 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 126.5933315247> <PPL_OOV 114.59548203272> <LOGP -1914179.4532121> +[SCHEDULER ITER23 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER23 LR1]: shuffling training file +===PEEK ON TEST 23=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER23 LR1]: 40087 words processed Wed Nov 18 11:59:51 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.187803. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47363 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93161 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.63241 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11638 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER23 LR1]: Displaying result: +[SCHEDULER ITER23 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 176.69113282554> <PPL_OOV 154.4522825706> <LOGP -180422.316696> +[SCHEDULER ITER23 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 23=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER23 LR1]: 40095 words processed Wed Nov 18 12:00:00 2015. + [SCHEDULER ITER23 LR1]: log prob per sample :-2.253996. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47175 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92880 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62649 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11533 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER23 LR1]: Displaying result: +[SCHEDULER ITER23 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 181.18925970679> <PPL_OOV 162.3281892853> <LOGP -163038.65732971> +[SCHEDULER ITER23 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER23 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.23... + +[SCHEDULER ITER24 LR1]: preparing parameters... +[SCHEDULER ITER24 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.23... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1064210 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1067867 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35817408 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35933682 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70464168 +[SCHEDULER ITER24 LR1]: preparing parameters end. +[SCHEDULER ITER24 LR1]: preparing layers... +(12:00:09 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:00:09 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:00:09 2015-11-18)[nerv] info: create layer: combinerL1 +(12:00:09 2015-11-18)[nerv] info: create layer: outputL +(12:00:09 2015-11-18)[nerv] info: create layer: softmaxL +(12:00:09 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER24 LR1]: preparing layers end. +[SCHEDULER ITER24 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER24 LR1]: Initing TNN end. +===ITERATION 24 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER24 LR1]: 40092 words processed Wed Nov 18 12:00:20 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.068316. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47877 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96281 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.56624 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62275 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12104 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12218 clock time +[SCHEDULER ITER24 LR1]: 80099 words processed Wed Nov 18 12:00:32 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.066020. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47677 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94765 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.49793 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59499 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10381 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12061 clock time +[SCHEDULER ITER24 LR1]: 120004 words processed Wed Nov 18 12:00:44 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.061220. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47017 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92434 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44798 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58124 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09787 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11998 clock time +[SCHEDULER ITER24 LR1]: 160114 words processed Wed Nov 18 12:00:56 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.063568. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47065 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93277 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47973 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59820 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10620 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12011 clock time +[SCHEDULER ITER24 LR1]: 200066 words processed Wed Nov 18 12:01:08 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.062954. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46731 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92860 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45241 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58523 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09823 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12012 clock time +[SCHEDULER ITER24 LR1]: 240045 words processed Wed Nov 18 12:01:20 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.059629. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46771 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92761 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45048 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58407 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09896 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11996 clock time +[SCHEDULER ITER24 LR1]: 280057 words processed Wed Nov 18 12:01:32 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.055936. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95521 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.53857 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61370 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11431 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12263 clock time +[SCHEDULER ITER24 LR1]: 320106 words processed Wed Nov 18 12:01:44 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.054511. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47122 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95186 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.52118 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60969 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10843 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12092 clock time +[SCHEDULER ITER24 LR1]: 360024 words processed Wed Nov 18 12:01:56 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.053542. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46591 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93718 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47571 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59277 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10131 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12139 clock time +[SCHEDULER ITER24 LR1]: 400089 words processed Wed Nov 18 12:02:08 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.051705. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46908 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95995 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.53295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61222 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11164 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12173 clock time +[SCHEDULER ITER24 LR1]: 440067 words processed Wed Nov 18 12:02:20 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.052707. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46296 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92568 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44456 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58493 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09915 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12008 clock time +[SCHEDULER ITER24 LR1]: 480051 words processed Wed Nov 18 12:02:32 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.053509. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46330 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93769 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46468 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58995 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10109 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12061 clock time +[SCHEDULER ITER24 LR1]: 520140 words processed Wed Nov 18 12:02:44 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.054860. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47046 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96227 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.54502 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61623 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11317 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12316 clock time +[SCHEDULER ITER24 LR1]: 560132 words processed Wed Nov 18 12:02:56 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.054986. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47283 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96737 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.54510 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61114 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11297 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12305 clock time +[SCHEDULER ITER24 LR1]: 600118 words processed Wed Nov 18 12:03:08 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.053946. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46986 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96495 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.53254 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60815 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10816 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12281 clock time +[SCHEDULER ITER24 LR1]: 640090 words processed Wed Nov 18 12:03:20 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.052995. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92514 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43422 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58277 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09199 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12022 clock time +[SCHEDULER ITER24 LR1]: 680075 words processed Wed Nov 18 12:03:32 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.052435. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92758 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43855 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58113 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09607 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11996 clock time +[SCHEDULER ITER24 LR1]: 720043 words processed Wed Nov 18 12:03:44 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.052556. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46414 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92571 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44748 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58451 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09938 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12018 clock time +[SCHEDULER ITER24 LR1]: 760012 words processed Wed Nov 18 12:03:56 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.051749. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46523 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94188 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47211 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59200 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09732 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12069 clock time +[SCHEDULER ITER24 LR1]: 800113 words processed Wed Nov 18 12:04:08 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.052259. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46838 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96079 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.53950 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61532 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11421 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12221 clock time +[SCHEDULER ITER24 LR1]: 840089 words processed Wed Nov 18 12:04:20 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.051851. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46453 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93744 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46766 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59173 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10032 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12048 clock time +[SCHEDULER ITER24 LR1]: 880052 words processed Wed Nov 18 12:04:32 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.052134. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92912 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45550 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58541 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10261 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12032 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER24 LR1]: Displaying result: +[SCHEDULER ITER24 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 124.48792856202> <PPL_OOV 112.77495891323> <LOGP -1907714.3307067> +[SCHEDULER ITER24 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER24 LR1]: shuffling training file +===PEEK ON TEST 24=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER24 LR1]: 40087 words processed Wed Nov 18 12:04:41 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.189143. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47170 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94163 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.64191 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11574 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER24 LR1]: Displaying result: +[SCHEDULER ITER24 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 177.06047169718> <PPL_OOV 155.12796790669> <LOGP -180578.58523182> +[SCHEDULER ITER24 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 24=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER24 LR1]: 40095 words processed Wed Nov 18 12:04:50 2015. + [SCHEDULER ITER24 LR1]: log prob per sample :-2.256580. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47267 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94236 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.64526 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11744 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER24 LR1]: Displaying result: +[SCHEDULER ITER24 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 181.96453837948> <PPL_OOV 163.32705467376> <LOGP -163235.16769627> +[SCHEDULER ITER24 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER24 LR1]: PPL did not improve, rejected, copying param file of last iter... + +[SCHEDULER ITER25 LR0.6]: preparing parameters... +[SCHEDULER ITER25 LR0.6]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.24... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1064210 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1067867 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35817408 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35933682 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70464168 +[SCHEDULER ITER25 LR0.6]: preparing parameters end. +[SCHEDULER ITER25 LR0.6]: preparing layers... +(12:04:58 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:04:58 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:04:58 2015-11-18)[nerv] info: create layer: combinerL1 +(12:04:58 2015-11-18)[nerv] info: create layer: outputL +(12:04:58 2015-11-18)[nerv] info: create layer: softmaxL +(12:04:58 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER25 LR0.6]: preparing layers end. +[SCHEDULER ITER25 LR0.6]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER25 LR0.6]: Initing TNN end. +===ITERATION 25 LR 0.600000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER25 LR0.6]: 40092 words processed Wed Nov 18 12:05:09 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.031786. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47559 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92421 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.49377 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61521 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10529 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12154 clock time +[SCHEDULER ITER25 LR0.6]: 80099 words processed Wed Nov 18 12:05:21 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.027880. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47539 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91322 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44897 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09745 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12134 clock time +[SCHEDULER ITER25 LR0.6]: 120004 words processed Wed Nov 18 12:05:33 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.021698. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47358 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91289 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59259 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09935 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12134 clock time +[SCHEDULER ITER25 LR0.6]: 160114 words processed Wed Nov 18 12:05:45 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.022082. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47522 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93109 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.50085 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61470 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10597 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12159 clock time +[SCHEDULER ITER25 LR0.6]: 200066 words processed Wed Nov 18 12:05:57 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.021204. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46811 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89821 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41834 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58945 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09367 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12050 clock time +[SCHEDULER ITER25 LR0.6]: 240045 words processed Wed Nov 18 12:06:09 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.017220. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46718 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89326 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40761 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58620 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09416 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11973 clock time +[SCHEDULER ITER25 LR0.6]: 280057 words processed Wed Nov 18 12:06:21 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.013365. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47118 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91875 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46655 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60666 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09618 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12136 clock time +[SCHEDULER ITER25 LR0.6]: 320106 words processed Wed Nov 18 12:06:33 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.011554. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46882 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91896 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47497 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60626 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10743 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12162 clock time +[SCHEDULER ITER25 LR0.6]: 360024 words processed Wed Nov 18 12:06:45 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.009923. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46184 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89187 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40414 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58473 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09742 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11935 clock time +[SCHEDULER ITER25 LR0.6]: 400089 words processed Wed Nov 18 12:06:57 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.007376. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46319 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89847 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43583 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60084 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10563 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11964 clock time +[SCHEDULER ITER25 LR0.6]: 440067 words processed Wed Nov 18 12:07:09 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.008010. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46460 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90775 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42989 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58809 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10138 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12080 clock time +[SCHEDULER ITER25 LR0.6]: 480051 words processed Wed Nov 18 12:07:21 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.008517. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46515 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90557 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42563 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58875 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09904 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12044 clock time +[SCHEDULER ITER25 LR0.6]: 520140 words processed Wed Nov 18 12:07:33 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.008299. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46661 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91944 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46670 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60524 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10376 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12110 clock time +[SCHEDULER ITER25 LR0.6]: 560132 words processed Wed Nov 18 12:07:45 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.007875. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46230 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89746 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41263 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58678 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10029 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12003 clock time +[SCHEDULER ITER25 LR0.6]: 600118 words processed Wed Nov 18 12:07:57 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.005749. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46345 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89997 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43341 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59533 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10248 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12171 clock time +[SCHEDULER ITER25 LR0.6]: 640090 words processed Wed Nov 18 12:08:09 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.004148. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49615 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.08220 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.86480 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.71813 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.14119 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13261 clock time +[SCHEDULER ITER25 LR0.6]: 680075 words processed Wed Nov 18 12:08:21 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.003208. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47627 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95697 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.56682 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.63987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10643 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12439 clock time +[SCHEDULER ITER25 LR0.6]: 720043 words processed Wed Nov 18 12:08:33 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.002754. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48075 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99602 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.68664 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67512 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12576 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12818 clock time +[SCHEDULER ITER25 LR0.6]: 760012 words processed Wed Nov 18 12:08:45 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.001453. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46981 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94694 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.55503 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.63410 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11301 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12533 clock time +[SCHEDULER ITER25 LR0.6]: 800113 words processed Wed Nov 18 12:08:57 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.001667. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48087 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99964 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.68295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66725 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13223 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12834 clock time +[SCHEDULER ITER25 LR0.6]: 840089 words processed Wed Nov 18 12:09:09 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.000776. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46778 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92299 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60408 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10920 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12288 clock time +[SCHEDULER ITER25 LR0.6]: 880052 words processed Wed Nov 18 12:09:21 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.000744. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46297 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89681 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42192 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59114 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10145 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11999 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER25 LR0.6]: Displaying result: +[SCHEDULER ITER25 LR0.6]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 110.67448591716> <PPL_OOV 100.1769714556> <LOGP -1859891.8295212> +[SCHEDULER ITER25 LR0.6]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER25 LR0.6]: shuffling training file +===PEEK ON TEST 25=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER25 LR0.6]: 40087 words processed Wed Nov 18 12:09:30 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.159875. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47367 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93342 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.63546 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11656 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER25 LR0.6]: Displaying result: +[SCHEDULER ITER25 LR0.6]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 165.44666654399> <PPL_OOV 145.17179861502> <LOGP -178203.95449233> +[SCHEDULER ITER25 LR0.6]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 25=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER25 LR0.6]: 40095 words processed Wed Nov 18 12:09:39 2015. + [SCHEDULER ITER25 LR0.6]: log prob per sample :-2.230972. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47256 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93270 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.63300 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11649 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER25 LR0.6]: Displaying result: +[SCHEDULER ITER25 LR0.6]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 170.02460806547> <PPL_OOV 152.80634249262> <LOGP -161102.26824489> +[SCHEDULER ITER25 LR0.6]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER25 LR0.6]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.25... + +[SCHEDULER ITER26 LR0.36]: preparing parameters... +[SCHEDULER ITER26 LR0.36]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.25... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34528953 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34532610 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69287801 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69404050 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70467695 +[SCHEDULER ITER26 LR0.36]: preparing parameters end. +[SCHEDULER ITER26 LR0.36]: preparing layers... +(12:09:48 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:09:48 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:09:48 2015-11-18)[nerv] info: create layer: combinerL1 +(12:09:48 2015-11-18)[nerv] info: create layer: outputL +(12:09:48 2015-11-18)[nerv] info: create layer: softmaxL +(12:09:48 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER26 LR0.36]: preparing layers end. +[SCHEDULER ITER26 LR0.36]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER26 LR0.36]: Initing TNN end. +===ITERATION 26 LR 0.360000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER26 LR0.36]: 40092 words processed Wed Nov 18 12:10:00 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.996688. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47915 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95989 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.56956 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62875 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12190 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12261 clock time +[SCHEDULER ITER26 LR0.36]: 80099 words processed Wed Nov 18 12:10:12 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.993541. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47391 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91974 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44910 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58699 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10195 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11975 clock time +[SCHEDULER ITER26 LR0.36]: 120004 words processed Wed Nov 18 12:10:24 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.987958. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47140 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91489 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43678 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58234 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09952 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11917 clock time +[SCHEDULER ITER26 LR0.36]: 160114 words processed Wed Nov 18 12:10:36 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.988377. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47236 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92116 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46188 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59698 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10566 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11931 clock time +[SCHEDULER ITER26 LR0.36]: 200066 words processed Wed Nov 18 12:10:48 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.987455. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46790 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91231 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42714 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58112 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10069 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11876 clock time +[SCHEDULER ITER26 LR0.36]: 240045 words processed Wed Nov 18 12:11:00 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.983531. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46960 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92541 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46234 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59207 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10635 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11997 clock time +[SCHEDULER ITER26 LR0.36]: 280057 words processed Wed Nov 18 12:11:12 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.979726. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94011 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51075 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61099 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11318 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12103 clock time +[SCHEDULER ITER26 LR0.36]: 320106 words processed Wed Nov 18 12:11:24 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.977856. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47081 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94043 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.50615 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60942 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11170 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12083 clock time +[SCHEDULER ITER26 LR0.36]: 360024 words processed Wed Nov 18 12:11:36 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.976151. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46723 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93346 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46853 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59249 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10353 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11945 clock time +[SCHEDULER ITER26 LR0.36]: 400089 words processed Wed Nov 18 12:11:48 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.973558. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46809 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93962 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.50217 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60705 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11601 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12037 clock time +[SCHEDULER ITER26 LR0.36]: 440067 words processed Wed Nov 18 12:12:00 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.974075. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46445 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92254 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44463 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58898 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10076 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11973 clock time +[SCHEDULER ITER26 LR0.36]: 480051 words processed Wed Nov 18 12:12:12 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.974452. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46744 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92710 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46191 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59450 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10487 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12041 clock time +[SCHEDULER ITER26 LR0.36]: 520140 words processed Wed Nov 18 12:12:24 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.974107. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46733 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93118 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48843 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60493 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11402 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12034 clock time +[SCHEDULER ITER26 LR0.36]: 560132 words processed Wed Nov 18 12:12:36 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.973552. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46368 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91026 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42476 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58186 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10460 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11945 clock time +[SCHEDULER ITER26 LR0.36]: 600118 words processed Wed Nov 18 12:12:48 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.971346. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46390 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91147 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42577 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58289 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10310 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11931 clock time +[SCHEDULER ITER26 LR0.36]: 640090 words processed Wed Nov 18 12:13:00 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.969490. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91097 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41968 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58116 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09955 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11912 clock time +[SCHEDULER ITER26 LR0.36]: 680075 words processed Wed Nov 18 12:13:12 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.968381. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46427 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91362 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43152 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58302 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10576 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11939 clock time +[SCHEDULER ITER26 LR0.36]: 720043 words processed Wed Nov 18 12:13:24 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.967690. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46487 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91613 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43145 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58442 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09900 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11942 clock time +[SCHEDULER ITER26 LR0.36]: 760012 words processed Wed Nov 18 12:13:36 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.966082. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46423 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91284 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41629 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58204 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09114 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11908 clock time +[SCHEDULER ITER26 LR0.36]: 800113 words processed Wed Nov 18 12:13:48 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.966133. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46562 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92353 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46595 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59862 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10959 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11979 clock time +[SCHEDULER ITER26 LR0.36]: 840089 words processed Wed Nov 18 12:14:00 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.965067. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91166 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42094 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58290 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09866 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11944 clock time +[SCHEDULER ITER26 LR0.36]: 880052 words processed Wed Nov 18 12:14:12 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-1.964871. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46517 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91571 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43677 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58790 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09944 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11961 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER26 LR0.36]: Displaying result: +[SCHEDULER ITER26 LR0.36]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 101.74751036446> <PPL_OOV 92.223276870422> <LOGP -1826494.1615467> +[SCHEDULER ITER26 LR0.36]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER26 LR0.36]: shuffling training file +===PEEK ON TEST 26=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER26 LR0.36]: 40087 words processed Wed Nov 18 12:14:21 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-2.142643. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92402 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62097 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11535 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER26 LR0.36]: Displaying result: +[SCHEDULER ITER26 LR0.36]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 159.3229023722> <PPL_OOV 139.5092618451> <LOGP -176779.62865589> +[SCHEDULER ITER26 LR0.36]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 26=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER26 LR0.36]: 40095 words processed Wed Nov 18 12:14:30 2015. + [SCHEDULER ITER26 LR0.36]: log prob per sample :-2.215991. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47448 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92963 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62958 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11549 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER26 LR0.36]: Displaying result: +[SCHEDULER ITER26 LR0.36]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 163.83398316372> <PPL_OOV 146.95799744127> <LOGP -159852.17229954> +[SCHEDULER ITER26 LR0.36]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER26 LR0.36]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.26... + +[SCHEDULER ITER27 LR0.216]: preparing parameters... +[SCHEDULER ITER27 LR0.216]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.26... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1063239 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1066894 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35823725 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35939977 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70467798 +[SCHEDULER ITER27 LR0.216]: preparing parameters end. +[SCHEDULER ITER27 LR0.216]: preparing layers... +(12:14:39 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:14:39 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:14:39 2015-11-18)[nerv] info: create layer: combinerL1 +(12:14:39 2015-11-18)[nerv] info: create layer: outputL +(12:14:39 2015-11-18)[nerv] info: create layer: softmaxL +(12:14:39 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER27 LR0.216]: preparing layers end. +[SCHEDULER ITER27 LR0.216]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER27 LR0.216]: Initing TNN end. +===ITERATION 27 LR 0.216000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER27 LR0.216]: 40092 words processed Wed Nov 18 12:14:50 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.973334. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91484 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47757 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61267 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10593 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12087 clock time +[SCHEDULER ITER27 LR0.216]: 80099 words processed Wed Nov 18 12:15:02 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.970486. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47247 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89811 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59018 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09599 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12019 clock time +[SCHEDULER ITER27 LR0.216]: 120004 words processed Wed Nov 18 12:15:14 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.965229. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47104 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90382 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42997 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59004 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09348 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12053 clock time +[SCHEDULER ITER27 LR0.216]: 160114 words processed Wed Nov 18 12:15:26 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.965870. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47145 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91094 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45531 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60349 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10090 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12021 clock time +[SCHEDULER ITER27 LR0.216]: 200066 words processed Wed Nov 18 12:15:38 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.964948. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46847 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90485 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42501 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58901 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09463 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12013 clock time +[SCHEDULER ITER27 LR0.216]: 240045 words processed Wed Nov 18 12:15:50 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.961024. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46741 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90016 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41703 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09392 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11989 clock time +[SCHEDULER ITER27 LR0.216]: 280057 words processed Wed Nov 18 12:16:02 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.957283. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46741 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90229 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44591 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60225 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10394 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11995 clock time +[SCHEDULER ITER27 LR0.216]: 320106 words processed Wed Nov 18 12:16:14 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.955454. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46583 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90499 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44292 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09970 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12001 clock time +[SCHEDULER ITER27 LR0.216]: 360024 words processed Wed Nov 18 12:16:26 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.953706. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46236 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89393 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40390 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58504 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09437 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11915 clock time +[SCHEDULER ITER27 LR0.216]: 400089 words processed Wed Nov 18 12:16:38 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.951011. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46415 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90296 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44056 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60284 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10222 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11959 clock time +[SCHEDULER ITER27 LR0.216]: 440067 words processed Wed Nov 18 12:16:50 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.951515. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47001 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92909 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60908 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10588 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12211 clock time +[SCHEDULER ITER27 LR0.216]: 480051 words processed Wed Nov 18 12:17:02 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.951814. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46407 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90699 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42907 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59041 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10094 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12051 clock time +[SCHEDULER ITER27 LR0.216]: 520140 words processed Wed Nov 18 12:17:14 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.951394. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46604 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91905 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47077 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60997 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10360 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12121 clock time +[SCHEDULER ITER27 LR0.216]: 560132 words processed Wed Nov 18 12:17:26 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.950774. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46405 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90826 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42279 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59112 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09222 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12059 clock time +[SCHEDULER ITER27 LR0.216]: 600118 words processed Wed Nov 18 12:17:38 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.948562. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46344 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90077 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41140 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58681 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09426 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12025 clock time +[SCHEDULER ITER27 LR0.216]: 640090 words processed Wed Nov 18 12:17:50 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.946590. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46366 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90235 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41475 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58685 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09588 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11993 clock time +[SCHEDULER ITER27 LR0.216]: 680075 words processed Wed Nov 18 12:18:02 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.945381. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46313 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90135 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41396 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58735 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09607 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12009 clock time +[SCHEDULER ITER27 LR0.216]: 720043 words processed Wed Nov 18 12:18:14 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.944535. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46460 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91359 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44771 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59546 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10296 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12076 clock time +[SCHEDULER ITER27 LR0.216]: 760012 words processed Wed Nov 18 12:18:26 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.942761. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46678 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91923 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45344 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59768 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09793 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12117 clock time +[SCHEDULER ITER27 LR0.216]: 800113 words processed Wed Nov 18 12:18:38 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.942714. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46687 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92992 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48893 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10322 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12156 clock time +[SCHEDULER ITER27 LR0.216]: 840089 words processed Wed Nov 18 12:18:50 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.941552. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46516 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90922 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43813 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59295 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10211 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12069 clock time +[SCHEDULER ITER27 LR0.216]: 880052 words processed Wed Nov 18 12:19:02 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-1.941233. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46569 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90935 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44414 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59548 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10314 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12035 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER27 LR0.216]: Displaying result: +[SCHEDULER ITER27 LR0.216]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 96.230665927949> <PPL_OOV 87.330596039854> <LOGP -1804486.9551715> +[SCHEDULER ITER27 LR0.216]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER27 LR0.216]: shuffling training file +===PEEK ON TEST 27=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER27 LR0.216]: 40087 words processed Wed Nov 18 12:19:11 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-2.129422. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92878 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62932 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11584 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER27 LR0.216]: Displaying result: +[SCHEDULER ITER27 LR0.216]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 155.20859848991> <PPL_OOV 135.39765175113> <LOGP -175708.70563493> +[SCHEDULER ITER27 LR0.216]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 27=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER27 LR0.216]: 40095 words processed Wed Nov 18 12:19:20 2015. + [SCHEDULER ITER27 LR0.216]: log prob per sample :-2.204569. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47198 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92267 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62166 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11625 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER27 LR0.216]: Displaying result: +[SCHEDULER ITER27 LR0.216]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 159.64602319117> <PPL_OOV 142.74466017102> <LOGP -158920.33608658> +[SCHEDULER ITER27 LR0.216]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER27 LR0.216]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.27... + +[SCHEDULER ITER28 LR0.1296]: preparing parameters... +[SCHEDULER ITER28 LR0.1296]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.27... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34526862 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34530515 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69287866 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69404115 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70467110 +[SCHEDULER ITER28 LR0.1296]: preparing parameters end. +[SCHEDULER ITER28 LR0.1296]: preparing layers... +(12:19:29 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:19:29 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:19:29 2015-11-18)[nerv] info: create layer: combinerL1 +(12:19:29 2015-11-18)[nerv] info: create layer: outputL +(12:19:29 2015-11-18)[nerv] info: create layer: softmaxL +(12:19:29 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER28 LR0.1296]: preparing layers end. +[SCHEDULER ITER28 LR0.1296]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER28 LR0.1296]: Initing TNN end. +===ITERATION 28 LR 0.129600=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER28 LR0.1296]: 40092 words processed Wed Nov 18 12:19:40 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.957648. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47576 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92751 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48408 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60251 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10714 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12083 clock time +[SCHEDULER ITER28 LR0.1296]: 80099 words processed Wed Nov 18 12:19:52 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.954866. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47325 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90973 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57823 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09662 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11984 clock time +[SCHEDULER ITER28 LR0.1296]: 120004 words processed Wed Nov 18 12:20:04 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.949844. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47062 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91116 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58075 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09554 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12015 clock time +[SCHEDULER ITER28 LR0.1296]: 160114 words processed Wed Nov 18 12:20:16 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.950754. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47209 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92291 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46389 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59603 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10384 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12023 clock time +[SCHEDULER ITER28 LR0.1296]: 200066 words processed Wed Nov 18 12:20:28 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.949861. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46696 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90745 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41420 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57781 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09484 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11963 clock time +[SCHEDULER ITER28 LR0.1296]: 240045 words processed Wed Nov 18 12:20:40 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.945955. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46724 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91063 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42199 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57837 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09877 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11965 clock time +[SCHEDULER ITER28 LR0.1296]: 280057 words processed Wed Nov 18 12:20:52 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.942211. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47004 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92566 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47240 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59893 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10453 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12074 clock time +[SCHEDULER ITER28 LR0.1296]: 320106 words processed Wed Nov 18 12:21:04 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.940331. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46608 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91992 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46156 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59815 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10482 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12048 clock time +[SCHEDULER ITER28 LR0.1296]: 360024 words processed Wed Nov 18 12:21:16 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.938572. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46452 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91680 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43848 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58455 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10033 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12026 clock time +[SCHEDULER ITER28 LR0.1296]: 400089 words processed Wed Nov 18 12:21:28 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.935784. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46687 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92291 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45548 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59456 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10075 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12045 clock time +[SCHEDULER ITER28 LR0.1296]: 440067 words processed Wed Nov 18 12:21:40 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.936314. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46289 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90890 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41067 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57867 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09343 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11991 clock time +[SCHEDULER ITER28 LR0.1296]: 480051 words processed Wed Nov 18 12:21:52 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.936596. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46571 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91960 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43438 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09648 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12062 clock time +[SCHEDULER ITER28 LR0.1296]: 520140 words processed Wed Nov 18 12:22:04 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.936091. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46598 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92477 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46580 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10321 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12050 clock time +[SCHEDULER ITER28 LR0.1296]: 560132 words processed Wed Nov 18 12:22:16 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.935414. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46406 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91386 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58180 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09615 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11997 clock time +[SCHEDULER ITER28 LR0.1296]: 600118 words processed Wed Nov 18 12:22:28 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.933190. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46526 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92007 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44464 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58817 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10068 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12076 clock time +[SCHEDULER ITER28 LR0.1296]: 640090 words processed Wed Nov 18 12:22:40 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.931133. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46501 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91867 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43812 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58846 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09634 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12051 clock time +[SCHEDULER ITER28 LR0.1296]: 680075 words processed Wed Nov 18 12:22:52 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.929866. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46311 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91126 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41976 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09589 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12012 clock time +[SCHEDULER ITER28 LR0.1296]: 720043 words processed Wed Nov 18 12:23:04 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.928898. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46461 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92253 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45457 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59027 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10466 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12074 clock time +[SCHEDULER ITER28 LR0.1296]: 760012 words processed Wed Nov 18 12:23:16 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.927030. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46419 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91529 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43136 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58456 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09667 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12037 clock time +[SCHEDULER ITER28 LR0.1296]: 800113 words processed Wed Nov 18 12:23:28 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.926926. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96992 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.57577 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62856 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11865 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12383 clock time +[SCHEDULER ITER28 LR0.1296]: 840089 words processed Wed Nov 18 12:23:40 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.925697. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47639 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96560 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.55302 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61785 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11230 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12394 clock time +[SCHEDULER ITER28 LR0.1296]: 880052 words processed Wed Nov 18 12:23:52 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-1.925283. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47514 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.97510 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.58064 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62173 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12226 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12532 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER28 LR0.1296]: Displaying result: +[SCHEDULER ITER28 LR0.1296]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 92.670119900574> <PPL_OOV 84.17526942258> <LOGP -1789630.3482288> +[SCHEDULER ITER28 LR0.1296]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER28 LR0.1296]: shuffling training file +===PEEK ON TEST 28=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER28 LR0.1296]: 40087 words processed Wed Nov 18 12:24:01 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-2.120814. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47127 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92295 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62049 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11555 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER28 LR0.1296]: Displaying result: +[SCHEDULER ITER28 LR0.1296]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 152.54022747212> <PPL_OOV 132.83640444882> <LOGP -175025.0295268> +[SCHEDULER ITER28 LR0.1296]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 28=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER28 LR0.1296]: 40095 words processed Wed Nov 18 12:24:10 2015. + [SCHEDULER ITER28 LR0.1296]: log prob per sample :-2.196983. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47218 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93150 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.63056 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11558 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER28 LR0.1296]: Displaying result: +[SCHEDULER ITER28 LR0.1296]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 156.97759103608> <PPL_OOV 140.13454203292> <LOGP -158329.17384608> +[SCHEDULER ITER28 LR0.1296]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER28 LR0.1296]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.28... + +[SCHEDULER ITER29 LR0.07776]: preparing parameters... +[SCHEDULER ITER29 LR0.07776]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.28... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1062789 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1066441 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35823808 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35940048 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70466632 +[SCHEDULER ITER29 LR0.07776]: preparing parameters end. +[SCHEDULER ITER29 LR0.07776]: preparing layers... +(12:24:19 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:24:19 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:24:19 2015-11-18)[nerv] info: create layer: combinerL1 +(12:24:19 2015-11-18)[nerv] info: create layer: outputL +(12:24:19 2015-11-18)[nerv] info: create layer: softmaxL +(12:24:19 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER29 LR0.07776]: preparing layers end. +[SCHEDULER ITER29 LR0.07776]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER29 LR0.07776]: Initing TNN end. +===ITERATION 29 LR 0.077760=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER29 LR0.07776]: 40092 words processed Wed Nov 18 12:24:30 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.946777. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47512 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93269 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.50526 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61761 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10694 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12063 clock time +[SCHEDULER ITER29 LR0.07776]: 80099 words processed Wed Nov 18 12:24:42 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.943867. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47314 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90926 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43729 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59207 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09450 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11983 clock time +[SCHEDULER ITER29 LR0.07776]: 120004 words processed Wed Nov 18 12:24:54 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.939040. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47314 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91327 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44627 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59133 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09606 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11977 clock time +[SCHEDULER ITER29 LR0.07776]: 160114 words processed Wed Nov 18 12:25:06 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.940226. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47343 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92803 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.48535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10159 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12071 clock time +[SCHEDULER ITER29 LR0.07776]: 200066 words processed Wed Nov 18 12:25:18 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.939366. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47098 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92476 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46657 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09890 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12052 clock time +[SCHEDULER ITER29 LR0.07776]: 240045 words processed Wed Nov 18 12:25:30 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.935511. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91054 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42877 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58785 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09333 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11971 clock time +[SCHEDULER ITER29 LR0.07776]: 280057 words processed Wed Nov 18 12:25:42 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.931795. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46920 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91781 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46106 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60264 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09941 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12016 clock time +[SCHEDULER ITER29 LR0.07776]: 320106 words processed Wed Nov 18 12:25:54 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.929898. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46857 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92084 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46699 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60428 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10031 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12045 clock time +[SCHEDULER ITER29 LR0.07776]: 360024 words processed Wed Nov 18 12:26:06 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.928153. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46496 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91159 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42890 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58868 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09209 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11988 clock time +[SCHEDULER ITER29 LR0.07776]: 400089 words processed Wed Nov 18 12:26:18 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.925337. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46626 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92443 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60646 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09985 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12053 clock time +[SCHEDULER ITER29 LR0.07776]: 440067 words processed Wed Nov 18 12:26:30 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.925902. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46441 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91349 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43133 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59089 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09387 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11978 clock time +[SCHEDULER ITER29 LR0.07776]: 480051 words processed Wed Nov 18 12:26:42 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.926173. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92150 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44978 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59630 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09655 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12026 clock time +[SCHEDULER ITER29 LR0.07776]: 520140 words processed Wed Nov 18 12:26:54 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.925626. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46571 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92512 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47393 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60903 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10114 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12035 clock time +[SCHEDULER ITER29 LR0.07776]: 560132 words processed Wed Nov 18 12:27:06 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.924926. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46577 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91608 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43582 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59094 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09418 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12049 clock time +[SCHEDULER ITER29 LR0.07776]: 600118 words processed Wed Nov 18 12:27:18 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.922706. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46470 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91317 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43105 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59057 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09363 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12010 clock time +[SCHEDULER ITER29 LR0.07776]: 640090 words processed Wed Nov 18 12:27:30 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.920601. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46423 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91189 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42763 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59020 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09271 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12012 clock time +[SCHEDULER ITER29 LR0.07776]: 680075 words processed Wed Nov 18 12:27:42 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.919309. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46435 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91007 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41862 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58598 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09165 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11954 clock time +[SCHEDULER ITER29 LR0.07776]: 720043 words processed Wed Nov 18 12:27:54 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.918272. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91020 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42724 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58901 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09533 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11972 clock time +[SCHEDULER ITER29 LR0.07776]: 760012 words processed Wed Nov 18 12:28:06 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.916346. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46430 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91184 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43111 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59128 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09399 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11987 clock time +[SCHEDULER ITER29 LR0.07776]: 800113 words processed Wed Nov 18 12:28:18 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.916197. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46660 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92285 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46968 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60634 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10210 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12018 clock time +[SCHEDULER ITER29 LR0.07776]: 840089 words processed Wed Nov 18 12:28:30 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.914943. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46473 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91444 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43742 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59262 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09682 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11978 clock time +[SCHEDULER ITER29 LR0.07776]: 880052 words processed Wed Nov 18 12:28:42 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-1.914477. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46559 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91155 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43238 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59180 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09397 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11945 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER29 LR0.07776]: Displaying result: +[SCHEDULER ITER29 LR0.07776]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 90.331762955738> <PPL_OOV 82.103047796228> <LOGP -1779567.3279209> +[SCHEDULER ITER29 LR0.07776]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER29 LR0.07776]: shuffling training file +===PEEK ON TEST 29=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER29 LR0.07776]: 40087 words processed Wed Nov 18 12:28:51 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-2.115230. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47088 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92767 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62634 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11572 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER29 LR0.07776]: Displaying result: +[SCHEDULER ITER29 LR0.07776]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 150.61305621631> <PPL_OOV 131.20309244406> <LOGP -174582.1298087> +[SCHEDULER ITER29 LR0.07776]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 29=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER29 LR0.07776]: 40095 words processed Wed Nov 18 12:29:00 2015. + [SCHEDULER ITER29 LR0.07776]: log prob per sample :-2.191859. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47179 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92795 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62741 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11570 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER29 LR0.07776]: Displaying result: +[SCHEDULER ITER29 LR0.07776]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 155.05059609032> <PPL_OOV 138.44697733307> <LOGP -157941.06936514> +[SCHEDULER ITER29 LR0.07776]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER29 LR0.07776]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.29... + +[SCHEDULER ITER30 LR0.046656]: preparing parameters... +[SCHEDULER ITER30 LR0.046656]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.29... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34526461 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34530113 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69287366 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69403593 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70466227 +[SCHEDULER ITER30 LR0.046656]: preparing parameters end. +[SCHEDULER ITER30 LR0.046656]: preparing layers... +(12:29:09 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:29:09 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:29:09 2015-11-18)[nerv] info: create layer: combinerL1 +(12:29:09 2015-11-18)[nerv] info: create layer: outputL +(12:29:09 2015-11-18)[nerv] info: create layer: softmaxL +(12:29:09 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER30 LR0.046656]: preparing layers end. +[SCHEDULER ITER30 LR0.046656]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER30 LR0.046656]: Initing TNN end. +===ITERATION 30 LR 0.046656=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER30 LR0.046656]: 40092 words processed Wed Nov 18 12:29:20 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.939564. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47323 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91388 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46581 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60149 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10874 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11928 clock time +[SCHEDULER ITER30 LR0.046656]: 80099 words processed Wed Nov 18 12:29:32 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.936511. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47190 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89903 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41530 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58109 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09897 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11891 clock time +[SCHEDULER ITER30 LR0.046656]: 120004 words processed Wed Nov 18 12:29:44 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.931733. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47171 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90058 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43192 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58581 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10386 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11913 clock time +[SCHEDULER ITER30 LR0.046656]: 160114 words processed Wed Nov 18 12:29:56 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.933054. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47051 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90785 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44202 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59732 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09959 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11939 clock time +[SCHEDULER ITER30 LR0.046656]: 200066 words processed Wed Nov 18 12:30:08 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.932265. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46658 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90114 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40893 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57712 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09861 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11913 clock time +[SCHEDULER ITER30 LR0.046656]: 240045 words processed Wed Nov 18 12:30:20 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.928476. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91218 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42615 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58220 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09673 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11965 clock time +[SCHEDULER ITER30 LR0.046656]: 280057 words processed Wed Nov 18 12:30:32 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.924786. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46728 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90785 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44217 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10576 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11904 clock time +[SCHEDULER ITER30 LR0.046656]: 320106 words processed Wed Nov 18 12:30:44 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.922894. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46756 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91692 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46827 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60127 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11160 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11938 clock time +[SCHEDULER ITER30 LR0.046656]: 360024 words processed Wed Nov 18 12:30:56 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.921186. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46577 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90688 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42380 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58556 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09562 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11943 clock time +[SCHEDULER ITER30 LR0.046656]: 400089 words processed Wed Nov 18 12:31:08 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.918359. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46498 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91982 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46522 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60111 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10899 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11999 clock time +[SCHEDULER ITER30 LR0.046656]: 440067 words processed Wed Nov 18 12:31:20 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.918965. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46571 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91087 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44413 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58651 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11306 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11988 clock time +[SCHEDULER ITER30 LR0.046656]: 480051 words processed Wed Nov 18 12:31:32 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.919242. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46365 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90509 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.40934 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58151 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09419 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11921 clock time +[SCHEDULER ITER30 LR0.046656]: 520140 words processed Wed Nov 18 12:31:44 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.918685. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46596 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92273 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46873 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59898 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11193 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11941 clock time +[SCHEDULER ITER30 LR0.046656]: 560132 words processed Wed Nov 18 12:31:56 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.918001. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46366 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91923 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43742 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58558 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10122 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12021 clock time +[SCHEDULER ITER30 LR0.046656]: 600118 words processed Wed Nov 18 12:32:08 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.915795. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46320 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90927 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58082 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09909 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11923 clock time +[SCHEDULER ITER30 LR0.046656]: 640090 words processed Wed Nov 18 12:32:20 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.913679. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46256 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90133 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42019 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58192 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10900 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11919 clock time +[SCHEDULER ITER30 LR0.046656]: 680075 words processed Wed Nov 18 12:32:32 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.912380. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46082 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89145 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.38421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57646 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09318 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11829 clock time +[SCHEDULER ITER30 LR0.046656]: 720043 words processed Wed Nov 18 12:32:44 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.911315. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46067 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89267 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.39630 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.57730 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10051 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11866 clock time +[SCHEDULER ITER30 LR0.046656]: 760012 words processed Wed Nov 18 12:32:56 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.909373. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46430 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90617 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41359 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09288 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11921 clock time +[SCHEDULER ITER30 LR0.046656]: 800113 words processed Wed Nov 18 12:33:08 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.909204. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46693 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92838 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.47629 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60115 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10846 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12048 clock time +[SCHEDULER ITER30 LR0.046656]: 840089 words processed Wed Nov 18 12:33:20 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.907946. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46535 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92198 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45822 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58926 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11251 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12044 clock time +[SCHEDULER ITER30 LR0.046656]: 880052 words processed Wed Nov 18 12:33:32 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-1.907455. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46282 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91155 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42637 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58580 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09735 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11968 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER30 LR0.046656]: Displaying result: +[SCHEDULER ITER30 LR0.046656]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 88.846002225269> <PPL_OOV 80.784476409319> <LOGP -1773031.0487294> +[SCHEDULER ITER30 LR0.046656]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER30 LR0.046656]: shuffling training file +===PEEK ON TEST 30=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER30 LR0.046656]: 40087 words processed Wed Nov 18 12:33:41 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-2.111073. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47174 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92856 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.62710 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11577 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER30 LR0.046656]: Displaying result: +[SCHEDULER ITER30 LR0.046656]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 149.06832367442> <PPL_OOV 130.00664401787> <LOGP -174254.18008769> +[SCHEDULER ITER30 LR0.046656]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 30=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER30 LR0.046656]: 40095 words processed Wed Nov 18 12:33:50 2015. + [SCHEDULER ITER30 LR0.046656]: log prob per sample :-2.187932. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47040 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92161 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.61760 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11538 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER30 LR0.046656]: Displaying result: +[SCHEDULER ITER30 LR0.046656]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 153.4615968442> <PPL_OOV 137.16123257402> <LOGP -157642.18652739> +[SCHEDULER ITER30 LR0.046656]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER30 LR0.046656]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.30... + +[SCHEDULER ITER31 LR0.0279936]: preparing parameters... +[SCHEDULER ITER31 LR0.0279936]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.30... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1062556 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1066208 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35823367 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35939586 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70465956 +[SCHEDULER ITER31 LR0.0279936]: preparing parameters end. +[SCHEDULER ITER31 LR0.0279936]: preparing layers... +(12:33:59 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:33:59 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:33:59 2015-11-18)[nerv] info: create layer: combinerL1 +(12:33:59 2015-11-18)[nerv] info: create layer: outputL +(12:33:59 2015-11-18)[nerv] info: create layer: softmaxL +(12:33:59 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER31 LR0.0279936]: preparing layers end. +[SCHEDULER ITER31 LR0.0279936]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER31 LR0.0279936]: Initing TNN end. +===ITERATION 31 LR 0.027994=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER31 LR0.0279936]: 40092 words processed Wed Nov 18 12:34:10 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.935039. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47640 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93064 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.52273 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62723 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11320 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12098 clock time +[SCHEDULER ITER31 LR0.0279936]: 80099 words processed Wed Nov 18 12:34:22 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.931902. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47206 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89292 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41120 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58834 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09281 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11933 clock time +[SCHEDULER ITER31 LR0.0279936]: 120004 words processed Wed Nov 18 12:34:34 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.927163. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46995 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89755 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41971 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58695 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09593 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11970 clock time +[SCHEDULER ITER31 LR0.0279936]: 160114 words processed Wed Nov 18 12:34:46 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.928513. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47165 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90869 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60222 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09758 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12003 clock time +[SCHEDULER ITER31 LR0.0279936]: 200066 words processed Wed Nov 18 12:34:58 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.927746. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46810 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90199 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42310 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58786 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09741 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11991 clock time +[SCHEDULER ITER31 LR0.0279936]: 240045 words processed Wed Nov 18 12:35:10 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.924005. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46763 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90358 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42622 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59212 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09478 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12022 clock time +[SCHEDULER ITER31 LR0.0279936]: 280057 words processed Wed Nov 18 12:35:22 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.920332. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46890 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91181 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46435 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60724 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10423 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12031 clock time +[SCHEDULER ITER31 LR0.0279936]: 320106 words processed Wed Nov 18 12:35:34 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.918430. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46680 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90794 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44848 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60180 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10136 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12041 clock time +[SCHEDULER ITER31 LR0.0279936]: 360024 words processed Wed Nov 18 12:35:46 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.916720. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46311 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89761 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41214 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58712 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09475 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11972 clock time +[SCHEDULER ITER31 LR0.0279936]: 400089 words processed Wed Nov 18 12:35:58 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.913875. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46481 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90749 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44837 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60297 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10332 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12040 clock time +[SCHEDULER ITER31 LR0.0279936]: 440067 words processed Wed Nov 18 12:36:10 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.914482. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46634 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91175 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44437 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59617 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09966 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12105 clock time +[SCHEDULER ITER31 LR0.0279936]: 480051 words processed Wed Nov 18 12:36:22 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.914748. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46635 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91093 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.43652 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59396 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09694 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12098 clock time +[SCHEDULER ITER31 LR0.0279936]: 520140 words processed Wed Nov 18 12:36:34 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.914169. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46453 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90855 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44925 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60140 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10541 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12020 clock time +[SCHEDULER ITER31 LR0.0279936]: 560132 words processed Wed Nov 18 12:36:46 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.913487. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46373 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.89911 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41676 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58876 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09840 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12024 clock time +[SCHEDULER ITER31 LR0.0279936]: 600118 words processed Wed Nov 18 12:36:58 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.911271. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46461 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90178 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42096 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.58807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09958 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11996 clock time +[SCHEDULER ITER31 LR0.0279936]: 640090 words processed Wed Nov 18 12:37:10 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.909133. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46430 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90341 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.42658 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59187 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09868 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12053 clock time +[SCHEDULER ITER31 LR0.0279936]: 680075 words processed Wed Nov 18 12:37:22 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.907806. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.90403 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.41658 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59090 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09025 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12035 clock time +[SCHEDULER ITER31 LR0.0279936]: 720043 words processed Wed Nov 18 12:37:34 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.906706. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48339 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00535 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.69570 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67737 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12577 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12706 clock time +[SCHEDULER ITER31 LR0.0279936]: 760012 words processed Wed Nov 18 12:37:46 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.904727. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48566 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.04027 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.77595 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.69803 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13485 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13019 clock time +[SCHEDULER ITER31 LR0.0279936]: 800113 words processed Wed Nov 18 12:37:58 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.904523. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47381 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98650 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65570 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66901 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12598 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12719 clock time +[SCHEDULER ITER31 LR0.0279936]: 840089 words processed Wed Nov 18 12:38:10 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.903243. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48731 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.04646 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.79695 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.71087 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12804 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13070 clock time +[SCHEDULER ITER31 LR0.0279936]: 880052 words processed Wed Nov 18 12:38:23 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-1.902719. + [global_conf.timer]: time spent on tnn_beforeprocess:0.50049 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.10777 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.98369 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.76807 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.16031 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13588 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER31 LR0.0279936]: Displaying result: +[SCHEDULER ITER31 LR0.0279936]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 87.858674349694> <PPL_OOV 79.906232708186> <LOGP -1768618.0491743> +[SCHEDULER ITER31 LR0.0279936]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER31 LR0.0279936]: shuffling training file +===PEEK ON TEST 31=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER31 LR0.0279936]: 40087 words processed Wed Nov 18 12:38:32 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-2.108291. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49792 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.03650 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.78124 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12340 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER31 LR0.0279936]: Displaying result: +[SCHEDULER ITER31 LR0.0279936]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 147.99858014623> <PPL_OOV 129.20534519493> <LOGP -174032.85002343> +[SCHEDULER ITER31 LR0.0279936]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 31=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER31 LR0.0279936]: 40095 words processed Wed Nov 18 12:38:42 2015. + [SCHEDULER ITER31 LR0.0279936]: log prob per sample :-2.185472. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49615 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.09369 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.84657 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12753 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER31 LR0.0279936]: Displaying result: +[SCHEDULER ITER31 LR0.0279936]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 152.3641825233> <PPL_OOV 136.30130176941> <LOGP -157440.72026995> +[SCHEDULER ITER31 LR0.0279936]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER31 LR0.0279936]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.31... + +[SCHEDULER ITER32 LR0.01679616]: preparing parameters... +[SCHEDULER ITER32 LR0.01679616]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.31... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34526275 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34529927 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69286931 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69403146 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70465624 +[SCHEDULER ITER32 LR0.01679616]: preparing parameters end. +[SCHEDULER ITER32 LR0.01679616]: preparing layers... +(12:38:52 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:38:52 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:38:52 2015-11-18)[nerv] info: create layer: combinerL1 +(12:38:52 2015-11-18)[nerv] info: create layer: outputL +(12:38:52 2015-11-18)[nerv] info: create layer: softmaxL +(12:38:52 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER32 LR0.01679616]: preparing layers end. +[SCHEDULER ITER32 LR0.01679616]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER32 LR0.01679616]: Initing TNN end. +===ITERATION 32 LR 0.016796=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER32 LR0.01679616]: 40092 words processed Wed Nov 18 12:39:04 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.931442. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49006 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00626 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.71865 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.68077 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13372 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12770 clock time +[SCHEDULER ITER32 LR0.01679616]: 80099 words processed Wed Nov 18 12:39:16 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.928292. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48707 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98502 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.63892 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64141 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12398 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12751 clock time +[SCHEDULER ITER32 LR0.01679616]: 120004 words processed Wed Nov 18 12:39:28 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.923647. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48431 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.97694 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.63508 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64631 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12285 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12643 clock time +[SCHEDULER ITER32 LR0.01679616]: 160114 words processed Wed Nov 18 12:39:40 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.924997. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48575 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00642 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.67710 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65653 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12438 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12778 clock time +[SCHEDULER ITER32 LR0.01679616]: 200066 words processed Wed Nov 18 12:39:52 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.924254. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48340 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99875 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.67236 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65593 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12571 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13006 clock time +[SCHEDULER ITER32 LR0.01679616]: 240045 words processed Wed Nov 18 12:40:04 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.920565. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47752 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98278 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64194 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12063 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12662 clock time +[SCHEDULER ITER32 LR0.01679616]: 280057 words processed Wed Nov 18 12:40:16 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.916922. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47857 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99140 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.66105 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66069 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12368 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12821 clock time +[SCHEDULER ITER32 LR0.01679616]: 320106 words processed Wed Nov 18 12:40:28 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.915045. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47881 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.01313 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.71281 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13988 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12925 clock time +[SCHEDULER ITER32 LR0.01679616]: 360024 words processed Wed Nov 18 12:40:40 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.913357. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47887 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99731 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.66735 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65264 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12911 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12883 clock time +[SCHEDULER ITER32 LR0.01679616]: 400089 words processed Wed Nov 18 12:40:52 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.910512. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48028 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99099 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.68755 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67251 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13887 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12702 clock time +[SCHEDULER ITER32 LR0.01679616]: 440067 words processed Wed Nov 18 12:41:04 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.911129. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47680 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98253 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.63384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64296 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12935 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12726 clock time +[SCHEDULER ITER32 LR0.01679616]: 480051 words processed Wed Nov 18 12:41:16 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.911402. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48140 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00109 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.66080 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11984 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12747 clock time +[SCHEDULER ITER32 LR0.01679616]: 520140 words processed Wed Nov 18 12:41:28 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.910826. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47592 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98938 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65328 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65673 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12699 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12719 clock time +[SCHEDULER ITER32 LR0.01679616]: 560132 words processed Wed Nov 18 12:41:40 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.910163. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47474 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98268 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62839 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64559 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12444 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12717 clock time +[SCHEDULER ITER32 LR0.01679616]: 600118 words processed Wed Nov 18 12:41:52 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.907953. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47731 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99150 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.64494 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65301 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11857 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12746 clock time +[SCHEDULER ITER32 LR0.01679616]: 640090 words processed Wed Nov 18 12:42:04 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.905814. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48793 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.05643 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.81006 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.69610 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.14733 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13093 clock time +[SCHEDULER ITER32 LR0.01679616]: 680075 words processed Wed Nov 18 12:42:16 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.904486. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47539 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99296 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.64966 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64980 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12610 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12863 clock time +[SCHEDULER ITER32 LR0.01679616]: 720043 words processed Wed Nov 18 12:42:28 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.903383. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.02149 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.72594 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67253 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13533 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12929 clock time +[SCHEDULER ITER32 LR0.01679616]: 760012 words processed Wed Nov 18 12:42:40 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.901397. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48373 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.02926 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.74089 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67209 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.14074 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13074 clock time +[SCHEDULER ITER32 LR0.01679616]: 800113 words processed Wed Nov 18 12:42:52 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.901182. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48676 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.04019 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.76458 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67916 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.14204 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13002 clock time +[SCHEDULER ITER32 LR0.01679616]: 840089 words processed Wed Nov 18 12:43:04 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.899902. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47685 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00183 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65355 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65120 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12682 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12583 clock time +[SCHEDULER ITER32 LR0.01679616]: 880052 words processed Wed Nov 18 12:43:16 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-1.899373. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46598 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92368 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46962 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.59446 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11070 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12162 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER32 LR0.01679616]: Displaying result: +[SCHEDULER ITER32 LR0.01679616]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 87.167707631587> <PPL_OOV 79.29226159407> <LOGP -1765504.0648689> +[SCHEDULER ITER32 LR0.01679616]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER32 LR0.01679616]: shuffling training file +===PEEK ON TEST 32=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER32 LR0.01679616]: 40087 words processed Wed Nov 18 12:43:25 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-2.106327. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47254 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93845 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.63866 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11638 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER32 LR0.01679616]: Displaying result: +[SCHEDULER ITER32 LR0.01679616]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 147.22052553121> <PPL_OOV 128.63441536524> <LOGP -173874.31210131> +[SCHEDULER ITER32 LR0.01679616]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 32=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER32 LR0.01679616]: 40095 words processed Wed Nov 18 12:43:34 2015. + [SCHEDULER ITER32 LR0.01679616]: log prob per sample :-2.183727. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47546 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95362 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.65917 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11720 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER32 LR0.01679616]: Displaying result: +[SCHEDULER ITER32 LR0.01679616]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 151.5455837763> <PPL_OOV 135.67036887598> <LOGP -157292.09402864> +[SCHEDULER ITER32 LR0.01679616]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER32 LR0.01679616]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.32... + +[SCHEDULER ITER33 LR0.010077696]: preparing parameters... +[SCHEDULER ITER33 LR0.010077696]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.32... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1062455 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1066108 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35822967 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35939176 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70465439 +[SCHEDULER ITER33 LR0.010077696]: preparing parameters end. +[SCHEDULER ITER33 LR0.010077696]: preparing layers... +(12:43:43 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:43:43 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:43:43 2015-11-18)[nerv] info: create layer: combinerL1 +(12:43:43 2015-11-18)[nerv] info: create layer: outputL +(12:43:43 2015-11-18)[nerv] info: create layer: softmaxL +(12:43:43 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER33 LR0.010077696]: preparing layers end. +[SCHEDULER ITER33 LR0.010077696]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER33 LR0.010077696]: Initing TNN end. +===ITERATION 33 LR 0.010078=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER33 LR0.010077696]: 40092 words processed Wed Nov 18 12:43:55 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.929093. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49326 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.05184 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.80160 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.70523 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13696 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13018 clock time +[SCHEDULER ITER33 LR0.010077696]: 80099 words processed Wed Nov 18 12:44:07 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.925926. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47666 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93380 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.50971 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61537 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10512 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12215 clock time +[SCHEDULER ITER33 LR0.010077696]: 120004 words processed Wed Nov 18 12:44:19 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.921375. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47511 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93011 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51037 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61482 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10676 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12276 clock time +[SCHEDULER ITER33 LR0.010077696]: 160114 words processed Wed Nov 18 12:44:31 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.922722. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47533 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93746 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.52086 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62463 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10575 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12221 clock time +[SCHEDULER ITER33 LR0.010077696]: 200066 words processed Wed Nov 18 12:44:43 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.921991. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47504 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95022 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.54922 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.63240 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10490 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12442 clock time +[SCHEDULER ITER33 LR0.010077696]: 240045 words processed Wed Nov 18 12:44:55 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.918333. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48672 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00091 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.63719 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64180 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11243 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12568 clock time +[SCHEDULER ITER33 LR0.010077696]: 280057 words processed Wed Nov 18 12:45:07 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.914713. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47773 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95508 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.57520 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11357 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12354 clock time +[SCHEDULER ITER33 LR0.010077696]: 320106 words processed Wed Nov 18 12:45:19 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.912862. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47212 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95449 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.55985 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.63461 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11271 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12378 clock time +[SCHEDULER ITER33 LR0.010077696]: 360024 words processed Wed Nov 18 12:45:31 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.911181. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46987 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94331 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51752 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.61670 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10461 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12202 clock time +[SCHEDULER ITER33 LR0.010077696]: 400089 words processed Wed Nov 18 12:45:43 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.908342. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47299 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95056 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.57284 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64702 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11576 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12435 clock time +[SCHEDULER ITER33 LR0.010077696]: 440067 words processed Wed Nov 18 12:45:55 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.908964. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47447 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.97302 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.59874 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65094 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11020 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12471 clock time +[SCHEDULER ITER33 LR0.010077696]: 480051 words processed Wed Nov 18 12:46:07 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.909244. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47210 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95866 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.56068 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.63818 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10737 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12379 clock time +[SCHEDULER ITER33 LR0.010077696]: 520140 words processed Wed Nov 18 12:46:19 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.908674. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46744 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.93725 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51020 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62134 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10777 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12119 clock time +[SCHEDULER ITER33 LR0.010077696]: 560132 words processed Wed Nov 18 12:46:31 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.908028. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46627 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92614 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.46808 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60445 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09855 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12077 clock time +[SCHEDULER ITER33 LR0.010077696]: 600118 words processed Wed Nov 18 12:46:43 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.905823. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46575 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.92047 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.45615 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60183 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09596 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12122 clock time +[SCHEDULER ITER33 LR0.010077696]: 640090 words processed Wed Nov 18 12:46:55 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.903686. + [global_conf.timer]: time spent on tnn_beforeprocess:0.46282 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.91642 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.44927 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.60102 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09803 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12085 clock time +[SCHEDULER ITER33 LR0.010077696]: 680075 words processed Wed Nov 18 12:47:07 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.902356. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47094 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.94265 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.51933 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.62027 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10646 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12210 clock time +[SCHEDULER ITER33 LR0.010077696]: 720043 words processed Wed Nov 18 12:47:19 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.901253. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96782 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.58094 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64182 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10872 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12466 clock time +[SCHEDULER ITER33 LR0.010077696]: 760012 words processed Wed Nov 18 12:47:32 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.899263. + [global_conf.timer]: time spent on tnn_beforeprocess:0.50005 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.16792 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.05536 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.77800 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.16164 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13491 clock time +[SCHEDULER ITER33 LR0.010077696]: 800113 words processed Wed Nov 18 12:47:44 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.899044. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48191 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00530 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.68947 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.68089 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12088 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12640 clock time +[SCHEDULER ITER33 LR0.010077696]: 840089 words processed Wed Nov 18 12:47:56 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.897764. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47427 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00777 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.67260 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67305 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11776 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12626 clock time +[SCHEDULER ITER33 LR0.010077696]: 880052 words processed Wed Nov 18 12:48:08 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-1.897235. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47355 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.97415 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.59852 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64731 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11116 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12408 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER33 LR0.010077696]: Displaying result: +[SCHEDULER ITER33 LR0.010077696]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 86.729095282599> <PPL_OOV 78.902608908036> <LOGP -1763515.2633715> +[SCHEDULER ITER33 LR0.010077696]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER33 LR0.010077696]: shuffling training file +===PEEK ON TEST 33=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER33 LR0.010077696]: 40087 words processed Wed Nov 18 12:48:17 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-2.105025. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47679 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95951 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.66961 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11833 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER33 LR0.010077696]: Displaying result: +[SCHEDULER ITER33 LR0.010077696]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.687178305> <PPL_OOV 128.2464002936> <LOGP -173766.16450762> +[SCHEDULER ITER33 LR0.010077696]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 33=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER33 LR0.010077696]: 40095 words processed Wed Nov 18 12:48:27 2015. + [SCHEDULER ITER33 LR0.010077696]: log prob per sample :-2.182599. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48786 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99972 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.72529 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER33 LR0.010077696]: Displaying result: +[SCHEDULER ITER33 LR0.010077696]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 151.00228818473> <PPL_OOV 135.25645893787> <LOGP -157194.21505764> +[SCHEDULER ITER33 LR0.010077696]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER33 LR0.010077696]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.33... + +[SCHEDULER ITER34 LR0.0060466176]: preparing parameters... +[SCHEDULER ITER34 LR0.0060466176]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.33... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34526300 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34529953 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69286738 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69402945 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70465377 +[SCHEDULER ITER34 LR0.0060466176]: preparing parameters end. +[SCHEDULER ITER34 LR0.0060466176]: preparing layers... +(12:48:36 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:48:36 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:48:36 2015-11-18)[nerv] info: create layer: combinerL1 +(12:48:36 2015-11-18)[nerv] info: create layer: outputL +(12:48:36 2015-11-18)[nerv] info: create layer: softmaxL +(12:48:36 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER34 LR0.0060466176]: preparing layers end. +[SCHEDULER ITER34 LR0.0060466176]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER34 LR0.0060466176]: Initing TNN end. +===ITERATION 34 LR 0.006047=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER34 LR0.0060466176]: 40092 words processed Wed Nov 18 12:48:48 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.927516. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48341 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00205 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.68031 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67014 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13007 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12469 clock time +[SCHEDULER ITER34 LR0.0060466176]: 80099 words processed Wed Nov 18 12:49:00 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.924363. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48701 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00152 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.63440 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64010 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11586 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12344 clock time +[SCHEDULER ITER34 LR0.0060466176]: 120004 words processed Wed Nov 18 12:49:12 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.919896. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48565 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00140 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.64750 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64753 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11754 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12436 clock time +[SCHEDULER ITER34 LR0.0060466176]: 160114 words processed Wed Nov 18 12:49:24 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.921244. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48556 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.01856 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.69348 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66448 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13001 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12436 clock time +[SCHEDULER ITER34 LR0.0060466176]: 200066 words processed Wed Nov 18 12:49:36 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.920525. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48122 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98935 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62497 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64569 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11758 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12284 clock time +[SCHEDULER ITER34 LR0.0060466176]: 240045 words processed Wed Nov 18 12:49:48 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.916893. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47968 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99230 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62215 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64115 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11871 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12411 clock time +[SCHEDULER ITER34 LR0.0060466176]: 280057 words processed Wed Nov 18 12:50:00 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.913290. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48030 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98573 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62934 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64805 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12454 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12336 clock time +[SCHEDULER ITER34 LR0.0060466176]: 320106 words processed Wed Nov 18 12:50:12 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.911461. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48191 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00146 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.66001 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66010 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12166 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12293 clock time +[SCHEDULER ITER34 LR0.0060466176]: 360024 words processed Wed Nov 18 12:50:24 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.909783. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47684 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99920 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65297 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65507 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12505 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12423 clock time +[SCHEDULER ITER34 LR0.0060466176]: 400089 words processed Wed Nov 18 12:50:36 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.906950. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47317 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98452 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62992 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65181 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12892 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12372 clock time +[SCHEDULER ITER34 LR0.0060466176]: 440067 words processed Wed Nov 18 12:50:48 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.907576. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47456 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98303 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.60790 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64580 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11456 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12380 clock time +[SCHEDULER ITER34 LR0.0060466176]: 480051 words processed Wed Nov 18 12:51:00 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.907859. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47196 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98019 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.58384 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.63203 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11347 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12376 clock time +[SCHEDULER ITER34 LR0.0060466176]: 520140 words processed Wed Nov 18 12:51:12 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.907297. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48169 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.02324 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.71107 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67375 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13270 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12569 clock time +[SCHEDULER ITER34 LR0.0060466176]: 560132 words processed Wed Nov 18 12:51:24 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.906662. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47579 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.01046 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65603 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65982 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11530 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12477 clock time +[SCHEDULER ITER34 LR0.0060466176]: 600118 words processed Wed Nov 18 12:51:36 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.904460. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47596 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99203 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62056 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64379 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11688 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12410 clock time +[SCHEDULER ITER34 LR0.0060466176]: 640090 words processed Wed Nov 18 12:51:48 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.902324. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47762 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00946 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.66148 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65471 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12357 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12500 clock time +[SCHEDULER ITER34 LR0.0060466176]: 680075 words processed Wed Nov 18 12:52:00 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.900997. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48074 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.01651 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.67812 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65846 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12636 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER34 LR0.0060466176]: 720043 words processed Wed Nov 18 12:52:12 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.899895. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48134 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00281 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65169 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12287 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12469 clock time +[SCHEDULER ITER34 LR0.0060466176]: 760012 words processed Wed Nov 18 12:52:24 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.897902. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47873 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.03051 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.70760 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66441 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13356 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12620 clock time +[SCHEDULER ITER34 LR0.0060466176]: 800113 words processed Wed Nov 18 12:52:36 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.897682. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47971 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.03194 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.71910 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67635 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13007 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12576 clock time +[SCHEDULER ITER34 LR0.0060466176]: 840089 words processed Wed Nov 18 12:52:48 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.896402. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47695 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00887 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65231 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64851 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12427 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12525 clock time +[SCHEDULER ITER34 LR0.0060466176]: 880052 words processed Wed Nov 18 12:53:00 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-1.895871. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48090 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00792 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64769 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12460 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12384 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER34 LR0.0060466176]: Displaying result: +[SCHEDULER ITER34 LR0.0060466176]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 86.450253074165> <PPL_OOV 78.65525540066> <LOGP -1762247.6592947> +[SCHEDULER ITER34 LR0.0060466176]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER34 LR0.0060466176]: shuffling training file +===PEEK ON TEST 34=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER34 LR0.0060466176]: 40087 words processed Wed Nov 18 12:53:09 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-2.104154. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48671 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.02959 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.75717 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12063 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER34 LR0.0060466176]: Displaying result: +[SCHEDULER ITER34 LR0.0060466176]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.35597848968> <PPL_OOV 127.97734439262> <LOGP -173690.9809428> +[SCHEDULER ITER34 LR0.0060466176]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 34=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER34 LR0.0060466176]: 40095 words processed Wed Nov 18 12:53:19 2015. + [SCHEDULER ITER34 LR0.0060466176]: log prob per sample :-2.181872. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48545 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.01889 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.74313 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12000 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER34 LR0.0060466176]: Displaying result: +[SCHEDULER ITER34 LR0.0060466176]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 150.68103244818> <PPL_OOV 134.98934891245> <LOGP -157130.89131439> +[SCHEDULER ITER34 LR0.0060466176]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER34 LR0.0060466176]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.34... + +[SCHEDULER ITER35 LR0.00362797056]: preparing parameters... +[SCHEDULER ITER35 LR0.00362797056]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.34... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1062432 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1066085 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 35822859 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 35939065 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 70465345 +[SCHEDULER ITER35 LR0.00362797056]: preparing parameters end. +[SCHEDULER ITER35 LR0.00362797056]: preparing layers... +(12:53:29 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:53:29 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:53:29 2015-11-18)[nerv] info: create layer: combinerL1 +(12:53:29 2015-11-18)[nerv] info: create layer: outputL +(12:53:29 2015-11-18)[nerv] info: create layer: softmaxL +(12:53:29 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER ITER35 LR0.00362797056]: preparing layers end. +[SCHEDULER ITER35 LR0.00362797056]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER35 LR0.00362797056]: Initing TNN end. +===ITERATION 35 LR 0.003628=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER35 LR0.00362797056]: 40092 words processed Wed Nov 18 12:53:41 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.926501. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48931 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.03093 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.74216 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.68919 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13462 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12596 clock time +[SCHEDULER ITER35 LR0.00362797056]: 80099 words processed Wed Nov 18 12:53:53 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.923356. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48969 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99884 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65501 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65643 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11986 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12518 clock time +[SCHEDULER ITER35 LR0.00362797056]: 120004 words processed Wed Nov 18 12:54:05 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.918930. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99255 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.64961 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65397 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12042 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12487 clock time +[SCHEDULER ITER35 LR0.00362797056]: 160114 words processed Wed Nov 18 12:54:17 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.920291. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49137 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00943 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.70487 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67881 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12998 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12556 clock time +[SCHEDULER ITER35 LR0.00362797056]: 200066 words processed Wed Nov 18 12:54:29 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.919579. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48742 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00354 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.67469 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66238 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12639 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12564 clock time +[SCHEDULER ITER35 LR0.00362797056]: 240045 words processed Wed Nov 18 12:54:41 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.915968. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48365 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00870 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.67120 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66389 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11996 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12644 clock time +[SCHEDULER ITER35 LR0.00362797056]: 280057 words processed Wed Nov 18 12:54:53 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.912378. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48882 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.02058 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.72367 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.68383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13038 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12643 clock time +[SCHEDULER ITER35 LR0.00362797056]: 320106 words processed Wed Nov 18 12:55:05 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.910563. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48681 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.02039 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.72114 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.68362 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13112 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12607 clock time +[SCHEDULER ITER35 LR0.00362797056]: 360024 words processed Wed Nov 18 12:55:17 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.908889. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48102 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00263 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.66823 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66255 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12503 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12609 clock time +[SCHEDULER ITER35 LR0.00362797056]: 400089 words processed Wed Nov 18 12:55:29 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.906061. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48152 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00318 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.69459 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67890 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.13412 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12647 clock time +[SCHEDULER ITER35 LR0.00362797056]: 440067 words processed Wed Nov 18 12:55:41 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.906689. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47941 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00280 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.65645 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65982 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11976 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12703 clock time +[SCHEDULER ITER35 LR0.00362797056]: 480051 words processed Wed Nov 18 12:55:53 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.906977. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48161 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00954 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.66486 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.66291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11722 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12708 clock time +[SCHEDULER ITER35 LR0.00362797056]: 520140 words processed Wed Nov 18 12:56:05 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.906417. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47997 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.01201 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.69293 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67482 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12926 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12683 clock time +[SCHEDULER ITER35 LR0.00362797056]: 560132 words processed Wed Nov 18 12:56:17 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.905791. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48136 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.99635 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.64164 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65589 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11674 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12566 clock time +[SCHEDULER ITER35 LR0.00362797056]: 600118 words processed Wed Nov 18 12:56:29 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.903593. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47623 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98530 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62253 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64999 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12104 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12545 clock time +[SCHEDULER ITER35 LR0.00362797056]: 640090 words processed Wed Nov 18 12:56:41 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.901457. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47975 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98858 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.63113 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64914 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12413 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12474 clock time +[SCHEDULER ITER35 LR0.00362797056]: 680075 words processed Wed Nov 18 12:56:53 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.900130. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47742 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98445 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.61271 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64424 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11973 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12440 clock time +[SCHEDULER ITER35 LR0.00362797056]: 720043 words processed Wed Nov 18 12:57:05 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.899031. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48383 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.01215 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.68746 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.67444 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11971 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12678 clock time +[SCHEDULER ITER35 LR0.00362797056]: 760012 words processed Wed Nov 18 12:57:17 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.897035. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98906 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.62650 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65730 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11432 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12553 clock time +[SCHEDULER ITER35 LR0.00362797056]: 800113 words processed Wed Nov 18 12:57:29 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.896814. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47329 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.97448 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.60850 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.65262 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.12034 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12447 clock time +[SCHEDULER ITER35 LR0.00362797056]: 840089 words processed Wed Nov 18 12:57:41 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.895535. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47191 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.95956 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.55920 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.63377 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11201 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12305 clock time +[SCHEDULER ITER35 LR0.00362797056]: 880052 words processed Wed Nov 18 12:57:53 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-1.895002. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47568 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.96820 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.58743 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.64028 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11656 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12360 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER35 LR0.00362797056]: Displaying result: +[SCHEDULER ITER35 LR0.00362797056]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 86.272834134732> <PPL_OOV 78.498152777863> <LOGP -1761440.4892072> +[SCHEDULER ITER35 LR0.00362797056]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER35 LR0.00362797056]: shuffling training file +===PEEK ON TEST 35=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER35 LR0.00362797056]: 40087 words processed Wed Nov 18 12:58:02 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-2.103584. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47962 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.98519 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.69977 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11922 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER35 LR0.00362797056]: Displaying result: +[SCHEDULER ITER35 LR0.00362797056]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.17039447141> <PPL_OOV 127.79140045143> <LOGP -173638.92932372> +[SCHEDULER ITER35 LR0.00362797056]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 35=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER35 LR0.00362797056]: 40095 words processed Wed Nov 18 12:58:12 2015. + [SCHEDULER ITER35 LR0.00362797056]: log prob per sample :-2.181381. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48480 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00216 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.72472 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11993 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER35 LR0.00362797056]: Displaying result: +[SCHEDULER ITER35 LR0.00362797056]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 150.51338825824> <PPL_OOV 134.81957448081> <LOGP -157090.57774537> +[SCHEDULER ITER35 LR0.00362797056]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER35 LR0.00362797056]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.35... + +===VALIDATION PPL record=== +<ITER0 LR0.00000 train:0.000 valid:10092.059 test:0.000> +<ITER1 LR1.00000 train:447.200 valid:331.713 test:323.544> +<ITER2 LR1.00000 train:290.374 valid:252.806 test:242.776> +<ITER3 LR1.00000 train:245.397 valid:228.358 test:218.981> +<ITER4 LR1.00000 train:212.502 valid:214.052 test:205.791> +<ITER5 LR1.00000 train:195.668 valid:203.704 test:193.918> +<ITER6 LR1.00000 train:180.480 valid:196.170 test:187.550> +<ITER7 LR1.00000 train:170.451 valid:187.462 test:178.690> +<ITER8 LR1.00000 train:162.949 valid:183.632 test:175.370> +<ITER9 LR1.00000 train:156.371 valid:179.375 test:171.281> +<ITER10 LR1.00000 train:150.464 valid:177.420 test:168.900> +<ITER11 LR1.00000 train:145.764 valid:174.335 test:165.486> +<ITER12 LR1.00000 train:141.373 valid:172.803 test:163.822> +<ITER13 LR1.00000 train:137.631 valid:172.220 test:163.131> +<ITER14 LR1.00000 train:134.414 valid:169.850 test:160.997> +<ITER15 LR1.00000 train:131.360 valid:168.661 test:160.001> +<ITER16 LR1.00000 train:128.344 valid:166.812 test:158.475> +<ITER17 LR1.00000 train:127.214 valid:166.572 test:158.413> +<ITER18 LR1.00000 train:123.861 valid:165.108 test:156.954> +<ITER19 LR1.00000 train:121.666 valid:165.028 test:156.988> +<ITER20 LR1.00000 train:119.543 valid:164.221 test:156.194> +<ITER21 LR1.00000 train:117.486 valid:163.877 test:155.830> +<ITER22 LR1.00000 train:115.576 valid:163.700 test:155.498> +<ITER23 LR1.00000 train:114.595 valid:162.328 test:154.452> +<ITER24 LR1.00000 train:112.775 valid:163.327 test:155.128> +<ITER25 LR0.60000 train:100.177 valid:152.806 test:145.172> +<ITER26 LR0.36000 train:92.223 valid:146.958 test:139.509> +<ITER27 LR0.21600 train:87.331 valid:142.745 test:135.398> +<ITER28 LR0.12960 train:84.175 valid:140.135 test:132.836> +<ITER29 LR0.07776 train:82.103 valid:138.447 test:131.203> +<ITER30 LR0.04666 train:80.784 valid:137.161 test:130.007> +<ITER31 LR0.02799 train:79.906 valid:136.301 test:129.205> +<ITER32 LR0.01680 train:79.292 valid:135.670 test:128.634> +<ITER33 LR0.01008 train:78.903 valid:135.256 test:128.246> +<ITER34 LR0.00605 train:78.655 valid:134.989 test:127.977> +<ITER35 LR0.00363 train:78.498 valid:134.820 test:127.791> + +===FINAL TEST=== +[SCHEDULER FINAL_TEST]: preparing parameters... +[SCHEDULER FINAL_TEST]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.35... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 34526247 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 34529900 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 69286627 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 69402830 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 70465248 +[SCHEDULER FINAL_TEST]: preparing parameters end. +[SCHEDULER FINAL_TEST]: preparing layers... +(12:58:22 2015-11-18)[nerv] info: create layer: recurrentL1 +(12:58:22 2015-11-18)[nerv] info: create layer: sigmoidL1 +(12:58:22 2015-11-18)[nerv] info: create layer: combinerL1 +(12:58:22 2015-11-18)[nerv] info: create layer: outputL +(12:58:22 2015-11-18)[nerv] info: create layer: softmaxL +(12:58:22 2015-11-18)[nerv] info: create layer: selectL1 +[SCHEDULER FINAL_TEST]: preparing layers end. +[SCHEDULER FINAL_TEST]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER FINAL_TEST]: Initing TNN end. +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER FINAL_TEST]: 40087 words processed Wed Nov 18 12:58:26 2015. + [SCHEDULER FINAL_TEST]: log prob per sample :-2.103584. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48147 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.00189 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.71964 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11812 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER FINAL_TEST]: Displaying result: +[SCHEDULER FINAL_TEST]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.17039441757> <PPL_OOV 127.79140027029> <LOGP -173638.92927297> +[SCHEDULER FINAL_TEST]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. |