diff options
Diffstat (limited to 'nerv/examples/lmptb/logs/LOG-tnn-h400')
| -rw-r--r-- | nerv/examples/lmptb/logs/LOG-tnn-h400 | 9372 |
1 files changed, 9372 insertions, 0 deletions
diff --git a/nerv/examples/lmptb/logs/LOG-tnn-h400 b/nerv/examples/lmptb/logs/LOG-tnn-h400 new file mode 100644 index 0000000..14270fe --- /dev/null +++ b/nerv/examples/lmptb/logs/LOG-tnn-h400 @@ -0,0 +1,9372 @@ +Greetings +[SCHEDULER]: not user setting, all default... +[SCHEDULER]: printing global_conf... +test_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds +train_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.train.txt.adds +param_random function: 0x41568798 +train_fn_shuf_bak /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf_bak +decay_iter 16 +mmat_type table: 0x4155ddf0 +vocab_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab +train_fn_shuf /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf +param_fn /home/slhome/txh18/workspace/nerv/play/dagL_test/params +log_w_num 40000 +work_dir /home/slhome/txh18/workspace/nerv/play/dagL_test +batch_size 10 +hidden_size 400 +timer nerv.Timer +sche_log_pre [SCHEDULER]: +nn_act_default 0 +max_iter 35 +valid_fn /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds +lrate 1 +momentum 0 +wcost 1e-05 +chunk_size 15 +cumat_type table: 0x4159b8e8 +[SCHEDULER]: printing training scheduling options... +lr_half false +start_iter -1 +ppl_last 100000 +[SCHEDULER]: printing training scheduling end. +[SCHEDULER]: creating work_dir... +[SCHEDULER]: building vocab... +[LOG]LMVocab: Vocab building on file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab... +[LOG]LMVocab: Building finished, vocab size now is 10000. +[SCHEDULER]: preparing parameters... +[SCHEDULER]: first time, generating parameters... +===INITIAL VALIDATION=== +[SCHEDULER]: preparing parameters... +[SCHEDULER]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.0... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46010296 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 2 from 47850982 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 93850772 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 4 from 93855417 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 5 from 93970392 +[SCHEDULER]: preparing parameters end. +[SCHEDULER]: preparing layers... +(23:35:45 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:35:45 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:35:45 2015-11-17)[nerv] info: create layer: combinerL1 +(23:35:45 2015-11-17)[nerv] info: create layer: outputL +(23:35:45 2015-11-17)[nerv] info: create layer: softmaxL +(23:35:45 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER]: preparing layers end. +[SCHEDULER]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER]: Initing TNN end. +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER]: 40095 words processed Tue Nov 17 23:35:51 2015. + [SCHEDULER]: log prob per sample :-4.031438. + [global_conf.timer]: time spent on tnn_beforeprocess:0.51120 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.70094 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.94917 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13248 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER]: Displaying result: +[SCHEDULER]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 11218.277022182> <PPL_OOV 10730.852429653> <LOGP -297299.58025201> +[SCHEDULER]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. + +[SCHEDULER ITER1 LR1]: preparing parameters... +[SCHEDULER ITER1 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.0... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46010296 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 2 from 47850982 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 93850772 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 4 from 93855417 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 5 from 93970392 +[SCHEDULER ITER1 LR1]: preparing parameters end. +[SCHEDULER ITER1 LR1]: preparing layers... +(23:35:59 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:35:59 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:35:59 2015-11-17)[nerv] info: create layer: combinerL1 +(23:35:59 2015-11-17)[nerv] info: create layer: outputL +(23:35:59 2015-11-17)[nerv] info: create layer: softmaxL +(23:35:59 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER ITER1 LR1]: preparing layers end. +[SCHEDULER ITER1 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER1 LR1]: Initing TNN end. +===ITERATION 1 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER1 LR1]: 40099 words processed Tue Nov 17 23:36:12 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-3.307163. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48649 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.71744 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.97858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95986 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46750 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12689 clock time +[SCHEDULER ITER1 LR1]: 80063 words processed Tue Nov 17 23:36:25 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-3.167927. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72435 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.96751 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94566 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46101 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12725 clock time +[SCHEDULER ITER1 LR1]: 120068 words processed Tue Nov 17 23:36:38 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-3.072096. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48641 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.71643 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.94612 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94018 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46114 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12611 clock time +[SCHEDULER ITER1 LR1]: 160017 words processed Tue Nov 17 23:36:51 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.999475. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48145 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.70526 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.92051 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93494 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45645 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12565 clock time +[SCHEDULER ITER1 LR1]: 200138 words processed Tue Nov 17 23:37:05 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.960525. + [global_conf.timer]: time spent on tnn_beforeprocess:0.49600 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83974 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.20474 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00924 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.49050 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.13162 clock time +[SCHEDULER ITER1 LR1]: 240007 words processed Tue Nov 17 23:37:19 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.924306. + [global_conf.timer]: time spent on tnn_beforeprocess:0.53133 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:4.03094 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.52548 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.03830 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.51544 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.14333 clock time +[SCHEDULER ITER1 LR1]: 280135 words processed Tue Nov 17 23:37:32 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.895095. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48229 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72695 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.96725 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95236 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46205 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12614 clock time +[SCHEDULER ITER1 LR1]: 320080 words processed Tue Nov 17 23:37:45 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.870160. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47588 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68051 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.88169 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93247 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45305 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12515 clock time +[SCHEDULER ITER1 LR1]: 360059 words processed Tue Nov 17 23:37:58 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.844175. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68577 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.87422 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.92831 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45044 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12469 clock time +[SCHEDULER ITER1 LR1]: 400021 words processed Tue Nov 17 23:38:11 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.825951. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47303 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69065 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.88385 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.92882 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45209 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12487 clock time +[SCHEDULER ITER1 LR1]: 440102 words processed Tue Nov 17 23:38:24 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.806475. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47497 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.70115 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.92202 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94656 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45847 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12536 clock time +[SCHEDULER ITER1 LR1]: 480051 words processed Tue Nov 17 23:38:37 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.789229. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47445 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69055 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.89421 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93264 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45604 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12512 clock time +[SCHEDULER ITER1 LR1]: 520093 words processed Tue Nov 17 23:38:50 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.773809. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47723 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.70210 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.93694 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95050 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46374 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12594 clock time +[SCHEDULER ITER1 LR1]: 560039 words processed Tue Nov 17 23:39:03 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.756861. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47250 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68531 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.89479 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93906 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45569 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12633 clock time +[SCHEDULER ITER1 LR1]: 600112 words processed Tue Nov 17 23:39:16 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.746111. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69925 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.93029 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95151 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46304 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12573 clock time +[SCHEDULER ITER1 LR1]: 640076 words processed Tue Nov 17 23:39:29 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.734203. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47329 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68886 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.88582 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93063 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45330 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12580 clock time +[SCHEDULER ITER1 LR1]: 680026 words processed Tue Nov 17 23:39:42 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.724362. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48369 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.73916 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.98914 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.95090 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46601 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12844 clock time +[SCHEDULER ITER1 LR1]: 720133 words processed Tue Nov 17 23:39:55 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.714482. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47515 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69692 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.91832 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94618 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46084 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12542 clock time +[SCHEDULER ITER1 LR1]: 760048 words processed Tue Nov 17 23:40:08 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.702566. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47214 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.67797 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.86931 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.92936 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45006 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12517 clock time +[SCHEDULER ITER1 LR1]: 800117 words processed Tue Nov 17 23:40:21 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.694301. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47412 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69251 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.92129 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.94998 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46202 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12666 clock time +[SCHEDULER ITER1 LR1]: 840116 words processed Tue Nov 17 23:40:34 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.683815. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47287 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68128 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.87316 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93075 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45007 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12553 clock time +[SCHEDULER ITER1 LR1]: 880037 words processed Tue Nov 17 23:40:47 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.675707. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47193 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.67969 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:11.88904 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.93759 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45715 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12643 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER1 LR1]: Displaying result: +[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 537.43879542441> <PPL_OOV 472.15153715735> <LOGP -2485796.6619188> +[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER1 LR1]: shuffling training file +===PEEK ON TEST 1=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER1 LR1]: 40087 words processed Tue Nov 17 23:40:58 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.514792. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48655 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72196 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.44770 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12022 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER1 LR1]: Displaying result: +[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 379.24392854515> <PPL_OOV 331.97926131635> <LOGP -207815.17595921> +[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 1=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER1 LR1]: 40095 words processed Tue Nov 17 23:41:09 2015. + [SCHEDULER ITER1 LR1]: log prob per sample :-2.557255. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48268 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.69630 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.41725 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12029 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER1 LR1]: Displaying result: +[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 378.18347077578> <PPL_OOV 339.93053715193> <LOGP -186715.339716> +[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER1 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.1... + +[SCHEDULER ITER2 LR1]: preparing parameters... +[SCHEDULER ITER2 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.1... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 1 from 1910948 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 1915804 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 47942998 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 48059425 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 5 from 94081374 +[SCHEDULER ITER2 LR1]: preparing parameters end. +[SCHEDULER ITER2 LR1]: preparing layers... +(23:41:19 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:41:19 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:41:19 2015-11-17)[nerv] info: create layer: combinerL1 +(23:41:19 2015-11-17)[nerv] info: create layer: outputL +(23:41:19 2015-11-17)[nerv] info: create layer: softmaxL +(23:41:19 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER ITER2 LR1]: preparing layers end. +[SCHEDULER ITER2 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +combinerL1 #dim_in: 1 #dim_out: 2 #i_conns_p: 1 #o_conns_p 2 +sigmoidL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 1 #o_conns_p 1 +selectL1 #dim_in: 1 #dim_out: 1 #i_conns_p: 0 #o_conns_p 1 +softmaxL #dim_in: 2 #dim_out: 1 #i_conns_p: 1 #o_conns_p 0 +TNN initing storage selectL1 -> recurrentL1 +TNN initing storage recurrentL1 -> sigmoidL1 +TNN initing storage sigmoidL1 -> combinerL1 +TNN initing storage combinerL1 -> recurrentL1 +TNN initing storage combinerL1 -> outputL +TNN initing storage outputL -> softmaxL +[SCHEDULER ITER2 LR1]: Initing TNN end. +===ITERATION 2 LR 1.000000=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER2 LR1]: 40092 words processed Tue Nov 17 23:41:32 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.799221. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48428 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80482 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14528 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99681 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46377 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12475 clock time +[SCHEDULER ITER2 LR1]: 80099 words processed Tue Nov 17 23:41:45 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.675260. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48375 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79010 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09873 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97780 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45608 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12454 clock time +[SCHEDULER ITER2 LR1]: 120004 words processed Tue Nov 17 23:41:58 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.625292. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48345 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79597 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11264 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97879 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45735 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12451 clock time +[SCHEDULER ITER2 LR1]: 160114 words processed Tue Nov 17 23:42:11 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.601139. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48516 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82418 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.17616 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00378 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46627 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12504 clock time +[SCHEDULER ITER2 LR1]: 200066 words processed Tue Nov 17 23:42:24 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.586182. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47712 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79828 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10302 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97884 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45548 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12466 clock time +[SCHEDULER ITER2 LR1]: 240045 words processed Tue Nov 17 23:42:37 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.569745. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47858 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79973 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11324 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98261 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45781 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12517 clock time +[SCHEDULER ITER2 LR1]: 280057 words processed Tue Nov 17 23:42:50 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.558289. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48048 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80717 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.14427 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99685 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46324 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12477 clock time +[SCHEDULER ITER2 LR1]: 320106 words processed Tue Nov 17 23:43:03 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.546701. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47797 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81916 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16628 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00207 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46745 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12513 clock time +[SCHEDULER ITER2 LR1]: 360024 words processed Tue Nov 17 23:43:16 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.538361. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47270 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79494 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09841 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97955 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45588 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12416 clock time +[SCHEDULER ITER2 LR1]: 400089 words processed Tue Nov 17 23:43:29 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.532957. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47372 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80046 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.12466 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.99426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46212 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12432 clock time +[SCHEDULER ITER2 LR1]: 440067 words processed Tue Nov 17 23:43:42 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.527843. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47471 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80066 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11343 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98547 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45805 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12505 clock time +[SCHEDULER ITER2 LR1]: 480051 words processed Tue Nov 17 23:43:55 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.523169. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47219 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79117 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08952 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97922 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45651 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12449 clock time +[SCHEDULER ITER2 LR1]: 520140 words processed Tue Nov 17 23:44:08 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.518885. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47478 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82039 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.16701 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00437 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46768 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12620 clock time +[SCHEDULER ITER2 LR1]: 560132 words processed Tue Nov 17 23:44:21 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.514611. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47300 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80568 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.11381 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98426 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45731 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12516 clock time +[SCHEDULER ITER2 LR1]: 600118 words processed Tue Nov 17 23:44:34 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.512709. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47282 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78555 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08119 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97896 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45351 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12405 clock time +[SCHEDULER ITER2 LR1]: 640090 words processed Tue Nov 17 23:44:47 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.508568. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47266 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79694 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.10261 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.98436 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45628 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12473 clock time +[SCHEDULER ITER2 LR1]: 680075 words processed Tue Nov 17 23:45:00 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.505824. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47217 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79072 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08578 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97795 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45475 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12436 clock time +[SCHEDULER ITER2 LR1]: 720043 words processed Tue Nov 17 23:45:13 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.503375. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47312 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78838 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08623 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97850 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45411 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12403 clock time +[SCHEDULER ITER2 LR1]: 760012 words processed Tue Nov 17 23:45:27 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.500743. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48180 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84003 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.19418 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.00071 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.46868 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12720 clock time +[SCHEDULER ITER2 LR1]: 800113 words processed Tue Nov 17 23:45:41 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.497832. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48493 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86594 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.25537 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:5.01879 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.47835 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12907 clock time +[SCHEDULER ITER2 LR1]: 840089 words processed Tue Nov 17 23:45:54 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.494761. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47353 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79481 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.09645 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97914 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45671 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12481 clock time +[SCHEDULER ITER2 LR1]: 880052 words processed Tue Nov 17 23:46:07 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.492221. + [global_conf.timer]: time spent on tnn_beforeprocess:0.47189 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78587 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.08043 clock time + [global_conf.timer]: time spent on tnn_actual_layer_update:4.97666 clock time + [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45370 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.12444 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER2 LR1]: Displaying result: +[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 356.44368639692> <PPL_OOV 310.37598339711> <LOGP -2316431.7749724> +[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end. +[SCHEDULER ITER2 LR1]: shuffling training file +===PEEK ON TEST 2=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER2 LR1]: 40087 words processed Tue Nov 17 23:46:17 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.393024. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48291 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80296 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.52763 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11984 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER2 LR1]: Displaying result: +[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 289.978578203> <PPL_OOV 250.00965661609> <LOGP -197663.57767284> +[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end. +===VALIDATION 2=== +[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds... +batch_size: 10 chunk_size 15 +[SCHEDULER ITER2 LR1]: 40095 words processed Tue Nov 17 23:46:28 2015. + [SCHEDULER ITER2 LR1]: log prob per sample :-2.438429. + [global_conf.timer]: time spent on tnn_beforeprocess:0.48364 clock time + [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80517 clock time + [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.53029 clock time + [global_conf.timer]: time spent on tnn_afterprocess:0.11971 clock time +[LOG]LMSeqReader: file expires, closing. +[SCHEDULER ITER2 LR1]: Displaying result: +[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 294.59587868377> <PPL_OOV 261.28808089122> <LOGP -178286.7416284> +[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end. +[SCHEDULER ITER2 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.2... + +[SCHEDULER ITER3 LR1]: preparing parameters... +[SCHEDULER ITER3 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.2... +reading chunk 0 from 0 +metadata: return {type="nerv.LinearTransParam",id="ltp_ih"} + +reading chunk 1 from 46026952 +metadata: return {type="nerv.BiasParam",id="bp_h"} + +reading chunk 2 from 46031813 +metadata: return {type="nerv.LinearTransParam",id="ltp_ho"} + +reading chunk 3 from 92080375 +metadata: return {type="nerv.BiasParam",id="bp_o"} + +reading chunk 4 from 92196721 +metadata: return {type="nerv.LinearTransParam",id="ltp_hh"} + +reading chunk 5 from 94106578 +[SCHEDULER ITER3 LR1]: preparing parameters end. +[SCHEDULER ITER3 LR1]: preparing layers... +(23:46:38 2015-11-17)[nerv] info: create layer: recurrentL1 +(23:46:38 2015-11-17)[nerv] info: create layer: sigmoidL1 +(23:46:38 2015-11-17)[nerv] info: create layer: combinerL1 +(23:46:38 2015-11-17)[nerv] info: create layer: outputL +(23:46:38 2015-11-17)[nerv] info: create layer: softmaxL +(23:46:38 2015-11-17)[nerv] info: create layer: selectL1 +[SCHEDULER ITER3 LR1]: preparing layers end. +[SCHEDULER ITER3 LR1]: Generate and initing TNN ... +<input> selectL1 0 +selectL1 recurrentL1 0 +recurrentL1 sigmoidL1 0 +sigmoidL1 combinerL1 0 +combinerL1 recurrentL1 1 +combinerL1 outputL 0 +outputL softmaxL 0 +<input> softmaxL 0 +softmaxL <output> 0 +recurrentL1 #dim_in: 2 #dim_out: 1 #i_conns_p: 2 #o_conns_p 1 +outputL # |