h300 and h400 worked well, log added

2 files changed, 16527 insertions, 5471 deletions

diff --git a/nerv/examples/lmptb/logs/LOG-tnn-h300 b/nerv/examples/lmptb/logs/LOG-tnn-h300
new file mode 100644
index 0000000..77fd612
--- /dev/null
+++ b/nerv/examples/lmptb/logs/LOG-tnn-h300
@@ -0,0 +1,9372 @@
+Greetings
+[SCHEDULER]: applying arg[2](global_conf.hidden_size=300)...
+[SCHEDULER]: printing global_conf...
+test_fn	/home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds
+train_fn	/home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.train.txt.adds
+param_random	function: 0x40237598
+train_fn_shuf_bak	/home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf_bak
+decay_iter	16
+mmat_type	table: 0x409280f8
+vocab_fn	/home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab
+train_fn_shuf	/home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf
+param_fn	/home/slhome/txh18/workspace/nerv/play/dagL_test/params
+log_w_num	40000
+work_dir	/home/slhome/txh18/workspace/nerv/play/dagL_test
+batch_size	10
+hidden_size	300
+timer	nerv.Timer
+sche_log_pre	[SCHEDULER]:
+nn_act_default	0
+max_iter	35
+valid_fn	/home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds
+lrate	1
+momentum	0
+wcost	1e-05
+chunk_size	15
+cumat_type	table: 0x40935010
+[SCHEDULER]: printing training scheduling options...
+lr_half	false
+start_iter	-1
+ppl_last	100000
+[SCHEDULER]: printing training scheduling end.
+[SCHEDULER]: creating work_dir...
+[SCHEDULER]: building vocab...
+[LOG]LMVocab: Vocab building on file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab...
+[LOG]LMVocab: Building finished, vocab size now is 10000.
+[SCHEDULER]: preparing parameters...
+[SCHEDULER]: first time, generating parameters...
+===INITIAL VALIDATION===
+[SCHEDULER]: preparing parameters...
+[SCHEDULER]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.0...
+reading chunk 0 from 0
+metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}
+
+reading chunk 1 from 34510155
+metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}
+
+reading chunk 2 from 35545278
+metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}
+
+reading chunk 3 from 70045626
+metadata: return {type="nerv.BiasParam",id="bp_h"}
+
+reading chunk 4 from 70049129
+metadata: return {type="nerv.BiasParam",id="bp_o"}
+
+reading chunk 5 from 70164107
+[SCHEDULER]: preparing parameters end.
+[SCHEDULER]: preparing layers...
+(10:08:46 2015-11-18)[nerv] info: create layer: recurrentL1
+(10:08:46 2015-11-18)[nerv] info: create layer: sigmoidL1
+(10:08:46 2015-11-18)[nerv] info: create layer: combinerL1
+(10:08:46 2015-11-18)[nerv] info: create layer: outputL
+(10:08:46 2015-11-18)[nerv] info: create layer: softmaxL
+(10:08:46 2015-11-18)[nerv] info: create layer: selectL1
+[SCHEDULER]: preparing layers end.
+[SCHEDULER]: Generate and initing TNN ...
+<input>	selectL1	0
+selectL1	recurrentL1	0
+recurrentL1	sigmoidL1	0
+sigmoidL1	combinerL1	0
+combinerL1	recurrentL1	1
+combinerL1	outputL	0
+outputL	softmaxL	0
+<input>	softmaxL	0
+softmaxL	<output>	0
+recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
+outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
+combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
+sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
+selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
+softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
+TNN initing storage	selectL1	->	recurrentL1
+TNN initing storage	recurrentL1	->	sigmoidL1
+TNN initing storage	sigmoidL1	->	combinerL1
+TNN initing storage	combinerL1	->	recurrentL1
+TNN initing storage	combinerL1	->	outputL
+TNN initing storage	outputL	->	softmaxL
+[SCHEDULER]: Initing TNN end.
+[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
+batch_size:	10	chunk_size	15
+[SCHEDULER]: 40095 words processed Wed Nov 18 10:08:51 2015.
+	[SCHEDULER]: log prob per sample :-4.003230.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.47666 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:4.10684 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.41463 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12208 clock time
+[LOG]LMSeqReader: file expires, closing.
+[SCHEDULER]: Displaying result:
+[SCHEDULER]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 10545.667125173> <PPL_OOV 10092.059293004> <LOGP -295333.54956309>
+[SCHEDULER]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
+
+[SCHEDULER ITER1 LR1]: preparing parameters...
+[SCHEDULER ITER1 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.0...
+reading chunk 0 from 0
+metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}
+
+reading chunk 1 from 34510155
+metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}
+
+reading chunk 2 from 35545278
+metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}
+
+reading chunk 3 from 70045626
+metadata: return {type="nerv.BiasParam",id="bp_h"}
+
+reading chunk 4 from 70049129
+metadata: return {type="nerv.BiasParam",id="bp_o"}
+
+reading chunk 5 from 70164107
+[SCHEDULER ITER1 LR1]: preparing parameters end.
+[SCHEDULER ITER1 LR1]: preparing layers...
+(10:08:58 2015-11-18)[nerv] info: create layer: recurrentL1
+(10:08:58 2015-11-18)[nerv] info: create layer: sigmoidL1
+(10:08:58 2015-11-18)[nerv] info: create layer: combinerL1
+(10:08:58 2015-11-18)[nerv] info: create layer: outputL
+(10:08:58 2015-11-18)[nerv] info: create layer: softmaxL
+(10:08:58 2015-11-18)[nerv] info: create layer: selectL1
+[SCHEDULER ITER1 LR1]: preparing layers end.
+[SCHEDULER ITER1 LR1]: Generate and initing TNN ...
+<input>	selectL1	0
+selectL1	recurrentL1	0
+recurrentL1	sigmoidL1	0
+sigmoidL1	combinerL1	0
+combinerL1	recurrentL1	1
+combinerL1	outputL	0
+outputL	softmaxL	0
+<input>	softmaxL	0
+softmaxL	<output>	0
+recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
+outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
+combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
+sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
+selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
+softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
+TNN initing storage	selectL1	->	recurrentL1
+TNN initing storage	recurrentL1	->	sigmoidL1
+TNN initing storage	sigmoidL1	->	combinerL1
+TNN initing storage	combinerL1	->	recurrentL1
+TNN initing storage	combinerL1	->	outputL
+TNN initing storage	outputL	->	softmaxL
+[SCHEDULER ITER1 LR1]: Initing TNN end.
+===ITERATION 1 LR 1.000000===
+[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
+batch_size:	10	chunk_size	15
+[SCHEDULER ITER1 LR1]: 40099 words processed Wed Nov 18 10:09:09 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-3.210428.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.47135 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75538 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22335 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.57185 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10319 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12114 clock time
+[SCHEDULER ITER1 LR1]: 80063 words processed Wed Nov 18 10:09:21 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-3.048713.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46917 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75080 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19680 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.56019 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09740 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12030 clock time
+[SCHEDULER ITER1 LR1]: 120068 words processed Wed Nov 18 10:09:33 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.984911.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.47044 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74848 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18711 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55472 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09624 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12070 clock time
+[SCHEDULER ITER1 LR1]: 160017 words processed Wed Nov 18 10:09:45 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.930297.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.47130 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75352 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20206 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55933 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09779 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12088 clock time
+[SCHEDULER ITER1 LR1]: 200138 words processed Wed Nov 18 10:09:57 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.897628.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46695 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76538 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23399 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.57699 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10442 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12134 clock time
+[SCHEDULER ITER1 LR1]: 240007 words processed Wed Nov 18 10:10:09 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.867407.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46510 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73963 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.15285 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.54229 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.08908 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12042 clock time
+[SCHEDULER ITER1 LR1]: 280135 words processed Wed Nov 18 10:10:21 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.842329.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46714 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75314 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21984 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.57472 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10567 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12149 clock time
+[SCHEDULER ITER1 LR1]: 320080 words processed Wed Nov 18 10:10:33 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.823036.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46701 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75169 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20551 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.56419 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10051 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12255 clock time
+[SCHEDULER ITER1 LR1]: 360059 words processed Wed Nov 18 10:10:45 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.800986.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.47814 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.79713 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.30428 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.58719 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10865 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12425 clock time
+[SCHEDULER ITER1 LR1]: 400021 words processed Wed Nov 18 10:10:57 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.786891.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45977 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73850 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17294 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55793 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09813 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12008 clock time
+[SCHEDULER ITER1 LR1]: 440102 words processed Wed Nov 18 10:11:09 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.770894.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46478 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75843 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22462 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.57475 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10523 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12179 clock time
+[SCHEDULER ITER1 LR1]: 480051 words processed Wed Nov 18 10:11:21 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.754795.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46079 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74221 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17129 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55381 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09688 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12041 clock time
+[SCHEDULER ITER1 LR1]: 520093 words processed Wed Nov 18 10:11:33 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.740832.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46013 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74097 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19854 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.57069 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10617 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12053 clock time
+[SCHEDULER ITER1 LR1]: 560039 words processed Wed Nov 18 10:11:45 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.725416.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45905 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73400 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.16478 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55572 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09740 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12013 clock time
+[SCHEDULER ITER1 LR1]: 600112 words processed Wed Nov 18 10:11:57 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.716177.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46687 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.76335 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25973 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.58834 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11483 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12277 clock time
+[SCHEDULER ITER1 LR1]: 640076 words processed Wed Nov 18 10:12:09 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.705623.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46173 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74375 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17842 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55617 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09811 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12090 clock time
+[SCHEDULER ITER1 LR1]: 680026 words processed Wed Nov 18 10:12:21 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.696685.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46080 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73873 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.16648 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55295 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09625 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12004 clock time
+[SCHEDULER ITER1 LR1]: 720133 words processed Wed Nov 18 10:12:33 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.687998.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46041 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73861 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19165 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.57016 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10446 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12015 clock time
+[SCHEDULER ITER1 LR1]: 760048 words processed Wed Nov 18 10:12:45 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.676801.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45850 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73148 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.15910 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55561 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09577 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11943 clock time
+[SCHEDULER ITER1 LR1]: 800117 words processed Wed Nov 18 10:12:57 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.669544.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45975 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74013 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19139 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.56894 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10351 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12031 clock time
+[SCHEDULER ITER1 LR1]: 840116 words processed Wed Nov 18 10:13:09 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.659602.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46031 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73769 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.17842 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.56008 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10197 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12018 clock time
+[SCHEDULER ITER1 LR1]: 880037 words processed Wed Nov 18 10:13:20 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.652101.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45781 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73064 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.15936 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55415 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09854 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11997 clock time
+[LOG]LMSeqReader: file expires, closing.
+[SCHEDULER ITER1 LR1]: Displaying result:
+[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 512.01508977938> <PPL_OOV 447.19970345812> <LOGP -2463877.0452922>
+[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
+[SCHEDULER ITER1 LR1]: shuffling training file
+===PEEK ON TEST 1===
+[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
+batch_size:	10	chunk_size	15
+[SCHEDULER ITER1 LR1]: 40087 words processed Wed Nov 18 10:13:30 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.504076.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46941 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75798 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.45029 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11464 clock time
+[LOG]LMSeqReader: file expires, closing.
+[SCHEDULER ITER1 LR1]: Displaying result:
+[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 370.53246252795> <PPL_OOV 323.54357826836> <LOGP -206893.75941108>
+[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
+===VALIDATION 1===
+[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
+batch_size:	10	chunk_size	15
+[SCHEDULER ITER1 LR1]: 40095 words processed Wed Nov 18 10:13:39 2015.
+	[SCHEDULER ITER1 LR1]: log prob per sample :-2.547314.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46703 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.75630 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.44636 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11481 clock time
+[LOG]LMSeqReader: file expires, closing.
+[SCHEDULER ITER1 LR1]: Displaying result:
+[SCHEDULER ITER1 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 369.92944180373> <PPL_OOV 331.71274183319> <LOGP -185931.4164841>
+[SCHEDULER ITER1 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
+[SCHEDULER ITER1 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.1...
+
+[SCHEDULER ITER2 LR1]: preparing parameters...
+[SCHEDULER ITER2 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.1...
+reading chunk 0 from 0
+metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}
+
+reading chunk 1 from 1076633
+metadata: return {type="nerv.BiasParam",id="bp_h"}
+
+reading chunk 2 from 1080289
+metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}
+
+reading chunk 3 from 35608824
+metadata: return {type="nerv.BiasParam",id="bp_o"}
+
+reading chunk 4 from 35725140
+metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}
+
+reading chunk 5 from 70244205
+[SCHEDULER ITER2 LR1]: preparing parameters end.
+[SCHEDULER ITER2 LR1]: preparing layers...
+(10:13:48 2015-11-18)[nerv] info: create layer: recurrentL1
+(10:13:48 2015-11-18)[nerv] info: create layer: sigmoidL1
+(10:13:48 2015-11-18)[nerv] info: create layer: combinerL1
+(10:13:48 2015-11-18)[nerv] info: create layer: outputL
+(10:13:48 2015-11-18)[nerv] info: create layer: softmaxL
+(10:13:48 2015-11-18)[nerv] info: create layer: selectL1
+[SCHEDULER ITER2 LR1]: preparing layers end.
+[SCHEDULER ITER2 LR1]: Generate and initing TNN ...
+<input>	selectL1	0
+selectL1	recurrentL1	0
+recurrentL1	sigmoidL1	0
+sigmoidL1	combinerL1	0
+combinerL1	recurrentL1	1
+combinerL1	outputL	0
+outputL	softmaxL	0
+<input>	softmaxL	0
+softmaxL	<output>	0
+recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
+outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
+combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
+sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
+selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
+softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
+TNN initing storage	selectL1	->	recurrentL1
+TNN initing storage	recurrentL1	->	sigmoidL1
+TNN initing storage	sigmoidL1	->	combinerL1
+TNN initing storage	combinerL1	->	recurrentL1
+TNN initing storage	combinerL1	->	outputL
+TNN initing storage	outputL	->	softmaxL
+[SCHEDULER ITER2 LR1]: Initing TNN end.
+===ITERATION 2 LR 1.000000===
+[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
+batch_size:	10	chunk_size	15
+[SCHEDULER ITER2 LR1]: 40092 words processed Wed Nov 18 10:13:59 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.541969.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46836 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72598 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22414 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.56508 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09968 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11795 clock time
+[SCHEDULER ITER2 LR1]: 80099 words processed Wed Nov 18 10:14:11 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.535649.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46987 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73527 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21641 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55211 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09413 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11941 clock time
+[SCHEDULER ITER2 LR1]: 120004 words processed Wed Nov 18 10:14:23 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.527511.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46606 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72308 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19836 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.54952 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09336 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11779 clock time
+[SCHEDULER ITER2 LR1]: 160114 words processed Wed Nov 18 10:14:35 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.522344.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46532 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72510 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22327 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.56668 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10154 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11830 clock time
+[SCHEDULER ITER2 LR1]: 200066 words processed Wed Nov 18 10:14:46 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.517881.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46174 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71860 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18739 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55076 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09280 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11754 clock time
+[SCHEDULER ITER2 LR1]: 240045 words processed Wed Nov 18 10:14:58 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.512076.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46366 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72754 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21275 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55625 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09893 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11910 clock time
+[SCHEDULER ITER2 LR1]: 280057 words processed Wed Nov 18 10:15:10 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.507676.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.47597 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.79397 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.37668 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.60190 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.11988 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12311 clock time
+[SCHEDULER ITER2 LR1]: 320106 words processed Wed Nov 18 10:15:22 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.500944.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46251 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73117 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.22486 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.56401 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10012 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11863 clock time
+[SCHEDULER ITER2 LR1]: 360024 words processed Wed Nov 18 10:15:34 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.497026.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45968 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73210 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20736 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55524 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09260 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11888 clock time
+[SCHEDULER ITER2 LR1]: 400089 words processed Wed Nov 18 10:15:46 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.493683.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46353 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74623 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.24888 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.56961 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10136 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11942 clock time
+[SCHEDULER ITER2 LR1]: 440067 words processed Wed Nov 18 10:15:58 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.490451.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46117 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73519 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21602 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55836 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09430 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11994 clock time
+[SCHEDULER ITER2 LR1]: 480051 words processed Wed Nov 18 10:16:10 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.487587.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45998 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73365 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.20277 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55319 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09232 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11882 clock time
+[SCHEDULER ITER2 LR1]: 520140 words processed Wed Nov 18 10:16:22 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.484627.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45975 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72819 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21976 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.56564 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10028 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11841 clock time
+[SCHEDULER ITER2 LR1]: 560132 words processed Wed Nov 18 10:16:33 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.481780.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45692 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71231 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.16816 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.54569 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09361 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11724 clock time
+[SCHEDULER ITER2 LR1]: 600118 words processed Wed Nov 18 10:16:45 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.479088.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45915 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73072 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18993 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.54640 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09120 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11835 clock time
+[SCHEDULER ITER2 LR1]: 640090 words processed Wed Nov 18 10:16:57 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.475904.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45833 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72455 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.18397 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.54664 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09177 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11810 clock time
+[SCHEDULER ITER2 LR1]: 680075 words processed Wed Nov 18 10:17:09 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.474017.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45720 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.71394 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.16784 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.54518 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09097 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11778 clock time
+[SCHEDULER ITER2 LR1]: 720043 words processed Wed Nov 18 10:17:21 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.471783.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.45892 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.72588 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.19146 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55005 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09232 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11806 clock time
+[SCHEDULER ITER2 LR1]: 760012 words processed Wed Nov 18 10:17:33 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.469729.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46006 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.73453 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21522 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55667 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09724 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11897 clock time
+[SCHEDULER ITER2 LR1]: 800113 words processed Wed Nov 18 10:17:45 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.467617.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46246 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74674 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.25543 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.57267 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.10430 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11946 clock time
+[SCHEDULER ITER2 LR1]: 840089 words processed Wed Nov 18 10:17:57 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.465015.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46102 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74097 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.21331 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55202 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09360 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11916 clock time
+[SCHEDULER ITER2 LR1]: 880052 words processed Wed Nov 18 10:18:09 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.463152.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46119 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74489 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:10.23141 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.55830 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.09725 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.12007 clock time
+[LOG]LMSeqReader: file expires, closing.
+[SCHEDULER ITER2 LR1]: Displaying result:
+[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 333.6037428687> <PPL_OOV 290.37375803538> <LOGP -2289538.074234>
+[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
+[SCHEDULER ITER2 LR1]: shuffling training file
+===PEEK ON TEST 2===
+[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
+batch_size:	10	chunk_size	15
+[SCHEDULER ITER2 LR1]: 40087 words processed Wed Nov 18 10:18:18 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.380761.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46919 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74486 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.43873 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11428 clock time
+[LOG]LMSeqReader: file expires, closing.
+[SCHEDULER ITER2 LR1]: Displaying result:
+[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 275.16079647613> <PPL_OOV 242.77628129243> <LOGP -196612.55158828>
+[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
+===VALIDATION 2===
+[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
+batch_size:	10	chunk_size	15
+[SCHEDULER ITER2 LR1]: 40095 words processed Wed Nov 18 10:18:27 2015.
+	[SCHEDULER ITER2 LR1]: log prob per sample :-2.427169.
+	 [global_conf.timer]: time spent on tnn_beforeprocess:0.46685 clock time
+	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:2.74609 clock time
+	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:3.43747 clock time
+	 [global_conf.timer]: time spent on tnn_afterprocess:0.11425 clock time
+[LOG]LMSeqReader: file expires, closing.
+[SCHEDULER ITER2 LR1]: Displaying result:
+[SCHEDULER ITER2 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 279.88256204919> <PPL_OOV 252.80637790871> <LOGP -177229.64482119>
+[SCHEDULER ITER2 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
+[SCHEDULER ITER2 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.2...
+
+[SCHEDULER ITER3 LR1]: preparing parameters...
+[SCHEDULER ITER3 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.2...
+reading chunk 0 from 0
+metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}
+
+reading chunk 1 from 34525805
+metadata: return {type="nerv.BiasParam",id="bp_h"}
+
+reading chunk 2 from 34529462
+metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}
+
+reading chunk 3 from 69074656
+metadata: return {type="nerv.BiasParam",id="bp_o"}
+
+reading chunk 4 from 69190773
+metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}
+
+reading chunk 5 from 70267310
+[SCHEDULER ITER3 LR1]: preparing parameters end.
+[SCHEDULER ITER3 LR1]: preparing layers...
+(10:18:36 2015-11-18)[nerv] info: create layer: recurrentL1
+(10:18:36 2015-11-18)[nerv] info: create layer: sigmoidL1