Greetings
[SCHEDULER]: applying arg[2](start_iter=3)...
[SCHEDULER]: printing global_conf...
test_fn	/home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds
train_fn	/home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.train.txt.adds
param_random	function: 0x414d5958
train_fn_shuf_bak	/home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf_bak
decay_iter	16
mmat_type	table: 0x410c5058
vocab_fn	/home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab
train_fn_shuf	/home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf
param_fn	/home/slhome/txh18/workspace/nerv/play/dagL_test/params
log_w_num	40000
work_dir	/home/slhome/txh18/workspace/nerv/play/dagL_test
batch_size	10
hidden_size	400
timer	nerv.Timer
sche_log_pre	[SCHEDULER]:
nn_act_default	0
max_iter	35
valid_fn	/home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds
lrate	1
momentum	0
wcost	1e-05
chunk_size	15
cumat_type	table: 0x4073aa48
[SCHEDULER]: printing training scheduling options...
lr_half	false
start_iter	3
ppl_last	100000
[SCHEDULER]: printing training scheduling end.
[SCHEDULER]: creating work_dir...
[SCHEDULER]: building vocab...
[LOG]LMVocab: Vocab building on file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/vocab...
[LOG]LMVocab: Building finished, vocab size now is 10000.
[SCHEDULER ITER3 LR1]: preparing parameters...
[SCHEDULER ITER3 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.2...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46029692
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46034550
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92091219
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92207421
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94117132
[SCHEDULER ITER3 LR1]: preparing parameters end.
[SCHEDULER ITER3 LR1]: preparing layers...
(19:23:36 2015-11-16)[nerv] info: create layer: recurrentL1
(19:23:36 2015-11-16)[nerv] info: create layer: sigmoidL1
(19:23:36 2015-11-16)[nerv] info: create layer: combinerL1
(19:23:36 2015-11-16)[nerv] info: create layer: outputL
(19:23:36 2015-11-16)[nerv] info: create layer: softmaxL
(19:23:36 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER3 LR1]: preparing layers end.
[SCHEDULER ITER3 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER3 LR1]: Initing TNN end.
===ITERATION 3 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER3 LR1]: 40099 words processed Mon Nov 16 19:23:50 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.401654.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25687 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04683 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72901 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43521 clock time
[SCHEDULER ITER3 LR1]: 80063 words processed Mon Nov 16 19:24:05 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.374433.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19857 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02717 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.71469 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42511 clock time
[SCHEDULER ITER3 LR1]: 120068 words processed Mon Nov 16 19:24:20 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.378173.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31757 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.05634 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76081 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43819 clock time
[SCHEDULER ITER3 LR1]: 160017 words processed Mon Nov 16 19:24:35 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.366419.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21593 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02930 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72744 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42766 clock time
[SCHEDULER ITER3 LR1]: 200138 words processed Mon Nov 16 19:24:50 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.375391.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32834 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.06194 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76647 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44354 clock time
[SCHEDULER ITER3 LR1]: 240007 words processed Mon Nov 16 19:25:05 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.374863.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15444 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01010 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.71058 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.41652 clock time
[SCHEDULER ITER3 LR1]: 280135 words processed Mon Nov 16 19:25:20 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.371663.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32493 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.06209 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77125 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44028 clock time
[SCHEDULER ITER3 LR1]: 320080 words processed Mon Nov 16 19:25:35 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.372572.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22077 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03217 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.73036 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42811 clock time
[SCHEDULER ITER3 LR1]: 360059 words processed Mon Nov 16 19:25:50 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.367750.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30888 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.05146 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77331 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43544 clock time
[SCHEDULER ITER3 LR1]: 400021 words processed Mon Nov 16 19:26:05 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.370284.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19708 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02923 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72020 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42434 clock time
[SCHEDULER ITER3 LR1]: 440102 words processed Mon Nov 16 19:26:20 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.366085.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22346 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04211 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72356 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43221 clock time
[SCHEDULER ITER3 LR1]: 480051 words processed Mon Nov 16 19:26:35 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.362942.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21148 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02936 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.73411 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42472 clock time
[SCHEDULER ITER3 LR1]: 520093 words processed Mon Nov 16 19:26:50 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.359600.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26407 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.05013 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74217 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43525 clock time
[SCHEDULER ITER3 LR1]: 560039 words processed Mon Nov 16 19:27:05 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.352747.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28053 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04418 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76275 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43241 clock time
[SCHEDULER ITER3 LR1]: 600112 words processed Mon Nov 16 19:27:20 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.354185.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28527 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.05332 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75468 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43716 clock time
[SCHEDULER ITER3 LR1]: 640076 words processed Mon Nov 16 19:27:35 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.351938.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17509 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02320 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.71112 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42335 clock time
[SCHEDULER ITER3 LR1]: 680026 words processed Mon Nov 16 19:27:50 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.352402.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19184 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02506 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72222 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42376 clock time
[SCHEDULER ITER3 LR1]: 720133 words processed Mon Nov 16 19:28:05 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.351590.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22742 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04343 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72700 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43243 clock time
[SCHEDULER ITER3 LR1]: 760048 words processed Mon Nov 16 19:28:20 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.347382.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19520 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02816 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72164 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42459 clock time
[SCHEDULER ITER3 LR1]: 800117 words processed Mon Nov 16 19:28:35 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.346849.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33851 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.06692 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77792 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43937 clock time
[SCHEDULER ITER3 LR1]: 840116 words processed Mon Nov 16 19:28:50 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.342472.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32912 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.05813 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76887 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44276 clock time
[SCHEDULER ITER3 LR1]: 880037 words processed Mon Nov 16 19:29:05 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.341243.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22162 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03318 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72779 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43004 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER3 LR1]: Displaying result:
[SCHEDULER ITER3 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 248.43219795907> <PPL_OOV 219.10997078782> <LOGP -2175853.7789479>
[SCHEDULER ITER3 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER3 LR1]: shuffling training file
===PEEK ON TEST 3===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER3 LR1]: 40087 words processed Mon Nov 16 19:29:18 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.354254.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.72881 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78797 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER3 LR1]: Displaying result:
[SCHEDULER ITER3 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 258.77770964542> <PPL_OOV 229.7206912305> <LOGP -194633.7254304>
[SCHEDULER ITER3 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 3===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER3 LR1]: 40095 words processed Mon Nov 16 19:29:31 2015.
	[SCHEDULER ITER3 LR1]: log prob per sample :-2.410570.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.71311 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77428 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER3 LR1]: Displaying result:
[SCHEDULER ITER3 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 261.52515353253> <PPL_OOV 237.80638217976> <LOGP -175270.24579595>
[SCHEDULER ITER3 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER3 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.3...

[SCHEDULER ITER4 LR1]: preparing parameters...
[SCHEDULER ITER4 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.3...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1908286
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1913140
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 47991009
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48107236
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94141877
[SCHEDULER ITER4 LR1]: preparing parameters end.
[SCHEDULER ITER4 LR1]: preparing layers...
(19:29:42 2015-11-16)[nerv] info: create layer: recurrentL1
(19:29:42 2015-11-16)[nerv] info: create layer: sigmoidL1
(19:29:42 2015-11-16)[nerv] info: create layer: combinerL1
(19:29:42 2015-11-16)[nerv] info: create layer: outputL
(19:29:42 2015-11-16)[nerv] info: create layer: softmaxL
(19:29:42 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER4 LR1]: preparing layers end.
[SCHEDULER ITER4 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER4 LR1]: Initing TNN end.
===ITERATION 4 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER4 LR1]: 40092 words processed Mon Nov 16 19:29:56 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.468880.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13283 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94766 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.68819 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43918 clock time
[SCHEDULER ITER4 LR1]: 80099 words processed Mon Nov 16 19:30:10 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.409142.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.02044 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91168 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.64792 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42609 clock time
[SCHEDULER ITER4 LR1]: 120004 words processed Mon Nov 16 19:30:24 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.384936.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.00305 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91040 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.63526 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42683 clock time
[SCHEDULER ITER4 LR1]: 160114 words processed Mon Nov 16 19:30:38 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.375498.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.05765 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93086 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.65223 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43543 clock time
[SCHEDULER ITER4 LR1]: 200066 words processed Mon Nov 16 19:30:52 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.369759.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.02876 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91642 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.64980 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42892 clock time
[SCHEDULER ITER4 LR1]: 240045 words processed Mon Nov 16 19:31:07 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.363138.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.04041 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91797 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.66035 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42694 clock time
[SCHEDULER ITER4 LR1]: 280057 words processed Mon Nov 16 19:31:21 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.357591.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.06577 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93130 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.65938 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43454 clock time
[SCHEDULER ITER4 LR1]: 320106 words processed Mon Nov 16 19:31:35 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.351439.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.03822 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92729 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.64614 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43377 clock time
[SCHEDULER ITER4 LR1]: 360024 words processed Mon Nov 16 19:31:50 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.348008.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.04395 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92032 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.66189 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42712 clock time
[SCHEDULER ITER4 LR1]: 400089 words processed Mon Nov 16 19:32:05 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.345590.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16780 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95229 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.70772 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44402 clock time
[SCHEDULER ITER4 LR1]: 440067 words processed Mon Nov 16 19:32:19 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.343815.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.05752 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92189 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.66830 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42858 clock time
[SCHEDULER ITER4 LR1]: 480051 words processed Mon Nov 16 19:32:33 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.342301.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.00684 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91463 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.64211 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42672 clock time
[SCHEDULER ITER4 LR1]: 520140 words processed Mon Nov 16 19:32:47 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.340726.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.06603 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93166 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.66309 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43539 clock time
[SCHEDULER ITER4 LR1]: 560132 words processed Mon Nov 16 19:33:01 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.339017.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.02621 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91591 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.65417 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42811 clock time
[SCHEDULER ITER4 LR1]: 600118 words processed Mon Nov 16 19:33:15 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.337135.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.04052 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91867 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.66001 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42870 clock time
[SCHEDULER ITER4 LR1]: 640090 words processed Mon Nov 16 19:33:29 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.335000.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.99942 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.90996 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.64063 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42654 clock time
[SCHEDULER ITER4 LR1]: 680075 words processed Mon Nov 16 19:33:43 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.334276.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.97986 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.90818 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.63057 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42476 clock time
[SCHEDULER ITER4 LR1]: 720043 words processed Mon Nov 16 19:33:58 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.333732.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.02579 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91550 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.65667 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42625 clock time
[SCHEDULER ITER4 LR1]: 760012 words processed Mon Nov 16 19:34:12 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.332585.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.06318 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92825 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.66598 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43217 clock time
[SCHEDULER ITER4 LR1]: 800113 words processed Mon Nov 16 19:34:27 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.331627.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19833 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95841 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.72071 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44986 clock time
[SCHEDULER ITER4 LR1]: 840089 words processed Mon Nov 16 19:34:41 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.330192.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:12.99251 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91047 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.63615 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42593 clock time
[SCHEDULER ITER4 LR1]: 880052 words processed Mon Nov 16 19:34:55 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.329379.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.01230 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91390 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.64582 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42720 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER4 LR1]: Displaying result:
[SCHEDULER ITER4 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 241.85074825678> <PPL_OOV 213.49747663731> <LOGP -2165377.8737255>
[SCHEDULER ITER4 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER4 LR1]: shuffling training file
===PEEK ON TEST 4===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER4 LR1]: 40087 words processed Mon Nov 16 19:35:06 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.298894.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.65216 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.70372 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER4 LR1]: Displaying result:
[SCHEDULER ITER4 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 230.35932079439> <PPL_OOV 200.65005327988> <LOGP -189790.06980019>
[SCHEDULER ITER4 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 4===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER4 LR1]: 40095 words processed Mon Nov 16 19:35:19 2015.
	[SCHEDULER ITER4 LR1]: log prob per sample :-2.353715.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.55962 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.64709 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER4 LR1]: Displaying result:
[SCHEDULER ITER4 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 235.61401547839> <PPL_OOV 210.50727974032> <LOGP -171364.18270901>
[SCHEDULER ITER4 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER4 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.4...

[SCHEDULER ITER5 LR1]: preparing parameters...
[SCHEDULER ITER5 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.4...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46037941
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46042798
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92142353
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92258769
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94165007
[SCHEDULER ITER5 LR1]: preparing parameters end.
[SCHEDULER ITER5 LR1]: preparing layers...
(19:35:30 2015-11-16)[nerv] info: create layer: recurrentL1
(19:35:30 2015-11-16)[nerv] info: create layer: sigmoidL1
(19:35:30 2015-11-16)[nerv] info: create layer: combinerL1
(19:35:30 2015-11-16)[nerv] info: create layer: outputL
(19:35:30 2015-11-16)[nerv] info: create layer: softmaxL
(19:35:30 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER5 LR1]: preparing layers end.
[SCHEDULER ITER5 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER5 LR1]: Initing TNN end.
===ITERATION 5 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER5 LR1]: 40092 words processed Mon Nov 16 19:35:45 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.339645.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32348 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97352 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84007 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44747 clock time
[SCHEDULER ITER5 LR1]: 80099 words processed Mon Nov 16 19:36:00 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.317425.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25965 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94775 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81422 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43733 clock time
[SCHEDULER ITER5 LR1]: 120004 words processed Mon Nov 16 19:36:15 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.305748.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28908 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96200 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81970 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44193 clock time
[SCHEDULER ITER5 LR1]: 160114 words processed Mon Nov 16 19:36:29 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.302881.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18222 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94439 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76730 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43387 clock time
[SCHEDULER ITER5 LR1]: 200066 words processed Mon Nov 16 19:36:44 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.300586.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26352 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95203 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80939 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44018 clock time
[SCHEDULER ITER5 LR1]: 240045 words processed Mon Nov 16 19:36:59 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.294586.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15493 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92808 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77520 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42416 clock time
[SCHEDULER ITER5 LR1]: 280057 words processed Mon Nov 16 19:37:14 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.290372.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21407 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94570 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79555 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43495 clock time
[SCHEDULER ITER5 LR1]: 320106 words processed Mon Nov 16 19:37:28 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.285735.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16169 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94020 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76253 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43204 clock time
[SCHEDULER ITER5 LR1]: 360024 words processed Mon Nov 16 19:37:42 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.283445.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15456 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93256 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76159 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42953 clock time
[SCHEDULER ITER5 LR1]: 400089 words processed Mon Nov 16 19:37:57 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.281396.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18383 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94399 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77670 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43374 clock time
[SCHEDULER ITER5 LR1]: 440067 words processed Mon Nov 16 19:38:12 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.280582.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.14002 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92845 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76492 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42464 clock time
[SCHEDULER ITER5 LR1]: 480051 words processed Mon Nov 16 19:38:27 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.280046.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18139 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93251 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79444 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42539 clock time
[SCHEDULER ITER5 LR1]: 520140 words processed Mon Nov 16 19:38:42 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.279298.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17428 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94212 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77082 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43341 clock time
[SCHEDULER ITER5 LR1]: 560132 words processed Mon Nov 16 19:38:57 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.278341.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17924 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93452 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78455 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43026 clock time
[SCHEDULER ITER5 LR1]: 600118 words processed Mon Nov 16 19:39:12 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.277074.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27450 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95277 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82452 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43800 clock time
[SCHEDULER ITER5 LR1]: 640090 words processed Mon Nov 16 19:39:27 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.275369.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16229 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93076 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78169 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42522 clock time
[SCHEDULER ITER5 LR1]: 680075 words processed Mon Nov 16 19:39:42 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.275114.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15877 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92924 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78210 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42575 clock time
[SCHEDULER ITER5 LR1]: 720043 words processed Mon Nov 16 19:39:56 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.274860.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.12358 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92467 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75768 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42370 clock time
[SCHEDULER ITER5 LR1]: 760012 words processed Mon Nov 16 19:40:11 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.274031.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15006 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92838 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77272 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42630 clock time
[SCHEDULER ITER5 LR1]: 800113 words processed Mon Nov 16 19:40:26 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.273616.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18233 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94496 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77598 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43450 clock time
[SCHEDULER ITER5 LR1]: 840089 words processed Mon Nov 16 19:40:41 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.272619.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21063 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94888 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78385 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43517 clock time
[SCHEDULER ITER5 LR1]: 880052 words processed Mon Nov 16 19:40:56 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.272217.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16136 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92998 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78300 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42459 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER5 LR1]: Displaying result:
[SCHEDULER ITER5 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 211.34935677039> <PPL_OOV 187.19131095214> <LOGP -2112291.7783632>
[SCHEDULER ITER5 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER5 LR1]: shuffling training file
===PEEK ON TEST 5===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER5 LR1]: 40087 words processed Mon Nov 16 19:41:07 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.266882.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.70246 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78859 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER5 LR1]: Displaying result:
[SCHEDULER ITER5 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 211.88666827405> <PPL_OOV 185.90353406678> <LOGP -187057.38065016>
[SCHEDULER ITER5 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 5===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER5 LR1]: 40095 words processed Mon Nov 16 19:41:20 2015.
	[SCHEDULER ITER5 LR1]: log prob per sample :-2.323979.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.72302 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79517 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER5 LR1]: Displaying result:
[SCHEDULER ITER5 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 216.72667354494> <PPL_OOV 194.77072809761> <LOGP -168875.2672087>
[SCHEDULER ITER5 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER5 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.5...

[SCHEDULER ITER6 LR1]: preparing parameters...
[SCHEDULER ITER6 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.5...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1904838
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1909695
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48027406
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48143739
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94185248
[SCHEDULER ITER6 LR1]: preparing parameters end.
[SCHEDULER ITER6 LR1]: preparing layers...
(19:41:31 2015-11-16)[nerv] info: create layer: recurrentL1
(19:41:31 2015-11-16)[nerv] info: create layer: sigmoidL1
(19:41:31 2015-11-16)[nerv] info: create layer: combinerL1
(19:41:31 2015-11-16)[nerv] info: create layer: outputL
(19:41:31 2015-11-16)[nerv] info: create layer: softmaxL
(19:41:31 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER6 LR1]: preparing layers end.
[SCHEDULER ITER6 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER6 LR1]: Initing TNN end.
===ITERATION 6 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER6 LR1]: 40092 words processed Mon Nov 16 19:41:46 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.262859.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30509 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95829 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82954 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44497 clock time
[SCHEDULER ITER6 LR1]: 80099 words processed Mon Nov 16 19:42:01 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.256861.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29071 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94976 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81911 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44514 clock time
[SCHEDULER ITER6 LR1]: 120004 words processed Mon Nov 16 19:42:16 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.251430.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.14338 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91591 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76243 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42779 clock time
[SCHEDULER ITER6 LR1]: 160114 words processed Mon Nov 16 19:42:31 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.252258.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25146 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94930 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79763 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44322 clock time
[SCHEDULER ITER6 LR1]: 200066 words processed Mon Nov 16 19:42:46 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.252740.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24557 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94297 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79544 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44001 clock time
[SCHEDULER ITER6 LR1]: 240045 words processed Mon Nov 16 19:43:00 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.248501.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13878 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92118 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75799 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42859 clock time
[SCHEDULER ITER6 LR1]: 280057 words processed Mon Nov 16 19:43:15 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.245658.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18186 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93093 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77498 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43733 clock time
[SCHEDULER ITER6 LR1]: 320106 words processed Mon Nov 16 19:43:30 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.242452.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23852 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94407 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80638 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43804 clock time
[SCHEDULER ITER6 LR1]: 360024 words processed Mon Nov 16 19:43:45 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.241240.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21118 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93112 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80305 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43131 clock time
[SCHEDULER ITER6 LR1]: 400089 words processed Mon Nov 16 19:44:00 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.239991.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26483 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94944 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81150 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44485 clock time
[SCHEDULER ITER6 LR1]: 440067 words processed Mon Nov 16 19:44:15 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.240005.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25938 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95053 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80400 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44342 clock time
[SCHEDULER ITER6 LR1]: 480051 words processed Mon Nov 16 19:44:30 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.240189.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22771 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94556 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78703 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43955 clock time
[SCHEDULER ITER6 LR1]: 520140 words processed Mon Nov 16 19:44:45 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.240002.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29153 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95971 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81080 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45685 clock time
[SCHEDULER ITER6 LR1]: 560132 words processed Mon Nov 16 19:45:00 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.239520.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21384 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93829 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79051 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43733 clock time
[SCHEDULER ITER6 LR1]: 600118 words processed Mon Nov 16 19:45:15 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.238317.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31952 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95527 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84495 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44292 clock time
[SCHEDULER ITER6 LR1]: 640090 words processed Mon Nov 16 19:45:30 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.236891.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15653 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92046 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77497 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42729 clock time
[SCHEDULER ITER6 LR1]: 680075 words processed Mon Nov 16 19:45:45 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.237217.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13630 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91738 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76375 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42763 clock time
[SCHEDULER ITER6 LR1]: 720043 words processed Mon Nov 16 19:46:00 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.237386.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25722 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94448 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80934 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43601 clock time
[SCHEDULER ITER6 LR1]: 760012 words processed Mon Nov 16 19:46:15 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.237187.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21321 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95477 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77299 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44531 clock time
[SCHEDULER ITER6 LR1]: 800113 words processed Mon Nov 16 19:46:30 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.237168.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25265 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97044 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79578 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43598 clock time
[SCHEDULER ITER6 LR1]: 840089 words processed Mon Nov 16 19:46:45 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.236424.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23587 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93803 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80866 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43496 clock time
[SCHEDULER ITER6 LR1]: 880052 words processed Mon Nov 16 19:47:00 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.236239.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20416 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92983 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79912 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43148 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER6 LR1]: Displaying result:
[SCHEDULER ITER6 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 193.89383590358> <PPL_OOV 172.33079535956> <LOGP -2078898.3448018>
[SCHEDULER ITER6 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER6 LR1]: shuffling training file
===PEEK ON TEST 6===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER6 LR1]: 40087 words processed Mon Nov 16 19:47:11 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.245922.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.70007 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77955 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER6 LR1]: Displaying result:
[SCHEDULER ITER6 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 202.3013471096> <PPL_OOV 177.03896783534> <LOGP -185308.31686527>
[SCHEDULER ITER6 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 6===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER6 LR1]: 40095 words processed Mon Nov 16 19:47:25 2015.
	[SCHEDULER ITER6 LR1]: log prob per sample :-2.304926.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.70143 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78097 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER6 LR1]: Displaying result:
[SCHEDULER ITER6 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 207.07732688932> <PPL_OOV 185.75783021617> <LOGP -167357.54027598>
[SCHEDULER ITER6 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER6 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.6...

[SCHEDULER ITER7 LR1]: preparing parameters...
[SCHEDULER ITER7 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.6...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46043903
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46048759
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92184772
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92301105
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94204599
[SCHEDULER ITER7 LR1]: preparing parameters end.
[SCHEDULER ITER7 LR1]: preparing layers...
(19:47:36 2015-11-16)[nerv] info: create layer: recurrentL1
(19:47:36 2015-11-16)[nerv] info: create layer: sigmoidL1
(19:47:36 2015-11-16)[nerv] info: create layer: combinerL1
(19:47:36 2015-11-16)[nerv] info: create layer: outputL
(19:47:36 2015-11-16)[nerv] info: create layer: softmaxL
(19:47:36 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER7 LR1]: preparing layers end.
[SCHEDULER ITER7 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER7 LR1]: Initing TNN end.
===ITERATION 7 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER7 LR1]: 40092 words processed Mon Nov 16 19:47:50 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.225906.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21939 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95368 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78896 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43900 clock time
[SCHEDULER ITER7 LR1]: 80099 words processed Mon Nov 16 19:48:05 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.224109.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16155 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93137 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77312 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42438 clock time
[SCHEDULER ITER7 LR1]: 120004 words processed Mon Nov 16 19:48:20 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.219821.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15757 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93223 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76813 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42718 clock time
[SCHEDULER ITER7 LR1]: 160114 words processed Mon Nov 16 19:48:35 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.222543.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26964 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96259 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81857 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43736 clock time
[SCHEDULER ITER7 LR1]: 200066 words processed Mon Nov 16 19:48:50 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.223103.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27159 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95979 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81056 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43991 clock time
[SCHEDULER ITER7 LR1]: 240045 words processed Mon Nov 16 19:49:05 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.220590.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23336 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95316 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78952 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43981 clock time
[SCHEDULER ITER7 LR1]: 280057 words processed Mon Nov 16 19:49:20 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.218902.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25931 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95635 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81907 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43567 clock time
[SCHEDULER ITER7 LR1]: 320106 words processed Mon Nov 16 19:49:35 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.215759.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35599 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98062 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85913 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44617 clock time
[SCHEDULER ITER7 LR1]: 360024 words processed Mon Nov 16 19:49:50 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.214424.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17280 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93334 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78062 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42810 clock time
[SCHEDULER ITER7 LR1]: 400089 words processed Mon Nov 16 19:50:05 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.212825.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21202 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95364 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79232 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43465 clock time
[SCHEDULER ITER7 LR1]: 440067 words processed Mon Nov 16 19:50:19 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.212838.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13401 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93181 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75747 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42555 clock time
[SCHEDULER ITER7 LR1]: 480051 words processed Mon Nov 16 19:50:34 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.213009.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22848 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95167 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79588 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43585 clock time
[SCHEDULER ITER7 LR1]: 520140 words processed Mon Nov 16 19:50:49 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.212825.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32416 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98163 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82410 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44985 clock time
[SCHEDULER ITER7 LR1]: 560132 words processed Mon Nov 16 19:51:04 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.212440.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28044 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96384 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81380 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44426 clock time
[SCHEDULER ITER7 LR1]: 600118 words processed Mon Nov 16 19:51:19 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.211160.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22035 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95101 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78978 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43636 clock time
[SCHEDULER ITER7 LR1]: 640090 words processed Mon Nov 16 19:51:33 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.209800.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13488 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92897 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76205 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42564 clock time
[SCHEDULER ITER7 LR1]: 680075 words processed Mon Nov 16 19:51:48 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.210009.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28582 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95791 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83462 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43566 clock time
[SCHEDULER ITER7 LR1]: 720043 words processed Mon Nov 16 19:52:02 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.210212.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13837 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93115 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76377 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42450 clock time
[SCHEDULER ITER7 LR1]: 760012 words processed Mon Nov 16 19:52:16 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.209773.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.12402 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92971 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75374 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42400 clock time
[SCHEDULER ITER7 LR1]: 800113 words processed Mon Nov 16 19:52:31 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.209791.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23713 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95444 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81132 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43479 clock time
[SCHEDULER ITER7 LR1]: 840089 words processed Mon Nov 16 19:52:46 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.208838.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24516 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95193 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81845 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43236 clock time
[SCHEDULER ITER7 LR1]: 880052 words processed Mon Nov 16 19:53:00 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.208673.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.12365 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92807 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75664 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42380 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER7 LR1]: Displaying result:
[SCHEDULER ITER7 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 181.46365030299> <PPL_OOV 161.72625619922> <LOGP -2053258.0870607>
[SCHEDULER ITER7 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER7 LR1]: shuffling training file
===PEEK ON TEST 7===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER7 LR1]: 40087 words processed Mon Nov 16 19:53:11 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.232519.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.73278 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80291 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER7 LR1]: Displaying result:
[SCHEDULER ITER7 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 196.00372584658> <PPL_OOV 171.15770244466> <LOGP -184098.86921264>
[SCHEDULER ITER7 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 7===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER7 LR1]: 40095 words processed Mon Nov 16 19:53:25 2015.
	[SCHEDULER ITER7 LR1]: log prob per sample :-2.291901.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.73647 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81498 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER7 LR1]: Displaying result:
[SCHEDULER ITER7 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 201.17781109485> <PPL_OOV 180.16302699681> <LOGP -166377.89981932>
[SCHEDULER ITER7 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER7 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.7...

[SCHEDULER ITER8 LR1]: preparing parameters...
[SCHEDULER ITER8 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.7...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1902204
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1907060
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48060548
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48176852
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94221898
[SCHEDULER ITER8 LR1]: preparing parameters end.
[SCHEDULER ITER8 LR1]: preparing layers...
(19:53:36 2015-11-16)[nerv] info: create layer: recurrentL1
(19:53:36 2015-11-16)[nerv] info: create layer: sigmoidL1
(19:53:36 2015-11-16)[nerv] info: create layer: combinerL1
(19:53:36 2015-11-16)[nerv] info: create layer: outputL
(19:53:36 2015-11-16)[nerv] info: create layer: softmaxL
(19:53:36 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER8 LR1]: preparing layers end.
[SCHEDULER ITER8 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER8 LR1]: Initing TNN end.
===ITERATION 8 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER8 LR1]: 40092 words processed Mon Nov 16 19:53:50 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.207277.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18732 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94024 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76316 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43873 clock time
[SCHEDULER ITER8 LR1]: 80099 words processed Mon Nov 16 19:54:05 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.205057.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23115 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93418 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80346 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43450 clock time
[SCHEDULER ITER8 LR1]: 120004 words processed Mon Nov 16 19:54:20 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.199802.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21246 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92980 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78834 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43447 clock time
[SCHEDULER ITER8 LR1]: 160114 words processed Mon Nov 16 19:54:35 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.200895.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16965 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93339 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76259 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43486 clock time
[SCHEDULER ITER8 LR1]: 200066 words processed Mon Nov 16 19:54:50 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.200972.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13680 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91749 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75626 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42786 clock time
[SCHEDULER ITER8 LR1]: 240045 words processed Mon Nov 16 19:55:05 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.196588.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15767 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92151 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76829 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42881 clock time
[SCHEDULER ITER8 LR1]: 280057 words processed Mon Nov 16 19:55:20 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.193553.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20250 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93715 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78089 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43662 clock time
[SCHEDULER ITER8 LR1]: 320106 words processed Mon Nov 16 19:55:35 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.190773.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23774 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94573 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79677 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43894 clock time
[SCHEDULER ITER8 LR1]: 360024 words processed Mon Nov 16 19:55:50 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.189543.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29901 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95124 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82161 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44773 clock time
[SCHEDULER ITER8 LR1]: 400089 words processed Mon Nov 16 19:56:05 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.188180.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28820 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95822 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82554 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44407 clock time
[SCHEDULER ITER8 LR1]: 440067 words processed Mon Nov 16 19:56:20 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.188437.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20832 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93312 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79124 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43457 clock time
[SCHEDULER ITER8 LR1]: 480051 words processed Mon Nov 16 19:56:35 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.188641.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16980 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94878 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75618 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42725 clock time
[SCHEDULER ITER8 LR1]: 520140 words processed Mon Nov 16 19:56:50 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.188369.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23302 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00438 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75628 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43583 clock time
[SCHEDULER ITER8 LR1]: 560132 words processed Mon Nov 16 19:57:04 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.187960.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18137 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98334 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74087 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42653 clock time
[SCHEDULER ITER8 LR1]: 600118 words processed Mon Nov 16 19:57:19 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.187648.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17801 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92123 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76644 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45502 clock time
[SCHEDULER ITER8 LR1]: 640090 words processed Mon Nov 16 19:57:33 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.186406.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.10467 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91617 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.73767 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42794 clock time
[SCHEDULER ITER8 LR1]: 680075 words processed Mon Nov 16 19:57:47 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.186378.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.10713 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91476 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74419 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42650 clock time
[SCHEDULER ITER8 LR1]: 720043 words processed Mon Nov 16 19:58:01 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.186701.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.11037 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91643 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74266 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42664 clock time
[SCHEDULER ITER8 LR1]: 760012 words processed Mon Nov 16 19:58:16 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.186947.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.12661 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91893 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75104 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42796 clock time
[SCHEDULER ITER8 LR1]: 800113 words processed Mon Nov 16 19:58:31 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.187097.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21660 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94289 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78433 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43984 clock time
[SCHEDULER ITER8 LR1]: 840089 words processed Mon Nov 16 19:58:46 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.186248.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19683 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93566 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78285 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43378 clock time
[SCHEDULER ITER8 LR1]: 880052 words processed Mon Nov 16 19:59:01 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.186156.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25341 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94768 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79334 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44486 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER8 LR1]: Displaying result:
[SCHEDULER ITER8 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 171.90531862971> <PPL_OOV 153.56059495327> <LOGP -2032341.6400566>
[SCHEDULER ITER8 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER8 LR1]: shuffling training file
===PEEK ON TEST 8===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER8 LR1]: 40087 words processed Mon Nov 16 19:59:13 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.223354.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.71911 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79349 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER8 LR1]: Displaying result:
[SCHEDULER ITER8 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 191.60219635223> <PPL_OOV 167.44708240131> <LOGP -183314.22931448>
[SCHEDULER ITER8 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 8===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER8 LR1]: 40095 words processed Mon Nov 16 19:59:26 2015.
	[SCHEDULER ITER8 LR1]: log prob per sample :-2.283762.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.69871 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77933 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER8 LR1]: Displaying result:
[SCHEDULER ITER8 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 197.01816659556> <PPL_OOV 176.5482345796> <LOGP -165728.64284451>
[SCHEDULER ITER8 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER8 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.8...

[SCHEDULER ITER9 LR1]: preparing parameters...
[SCHEDULER ITER9 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.8...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46045738
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46050594
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92220262
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92336581
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94237739
[SCHEDULER ITER9 LR1]: preparing parameters end.
[SCHEDULER ITER9 LR1]: preparing layers...
(19:59:37 2015-11-16)[nerv] info: create layer: recurrentL1
(19:59:37 2015-11-16)[nerv] info: create layer: sigmoidL1
(19:59:37 2015-11-16)[nerv] info: create layer: combinerL1
(19:59:37 2015-11-16)[nerv] info: create layer: outputL
(19:59:37 2015-11-16)[nerv] info: create layer: softmaxL
(19:59:37 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER9 LR1]: preparing layers end.
[SCHEDULER ITER9 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER9 LR1]: Initing TNN end.
===ITERATION 9 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER9 LR1]: 40092 words processed Mon Nov 16 19:59:52 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.180199.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26708 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96292 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81302 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43888 clock time
[SCHEDULER ITER9 LR1]: 80099 words processed Mon Nov 16 20:00:06 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.178767.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13075 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92752 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74942 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42306 clock time
[SCHEDULER ITER9 LR1]: 120004 words processed Mon Nov 16 20:00:21 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.174655.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16473 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93227 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76749 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42656 clock time
[SCHEDULER ITER9 LR1]: 160114 words processed Mon Nov 16 20:00:36 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.176386.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25677 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96181 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79631 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44032 clock time
[SCHEDULER ITER9 LR1]: 200066 words processed Mon Nov 16 20:00:51 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.177102.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16462 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93362 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77410 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42572 clock time
[SCHEDULER ITER9 LR1]: 240045 words processed Mon Nov 16 20:01:06 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.174905.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15192 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93082 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76764 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42522 clock time
[SCHEDULER ITER9 LR1]: 280057 words processed Mon Nov 16 20:01:21 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.171743.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19048 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94746 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77299 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43339 clock time
[SCHEDULER ITER9 LR1]: 320106 words processed Mon Nov 16 20:01:36 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.169278.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24449 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95465 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80753 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43522 clock time
[SCHEDULER ITER9 LR1]: 360024 words processed Mon Nov 16 20:01:50 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.168191.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.12187 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92806 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74736 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42414 clock time
[SCHEDULER ITER9 LR1]: 400089 words processed Mon Nov 16 20:02:05 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.166589.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28321 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96885 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81092 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44651 clock time
[SCHEDULER ITER9 LR1]: 440067 words processed Mon Nov 16 20:02:20 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.166948.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24516 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94979 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81487 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43194 clock time
[SCHEDULER ITER9 LR1]: 480051 words processed Mon Nov 16 20:02:35 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.167291.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27472 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95717 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82736 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43610 clock time
[SCHEDULER ITER9 LR1]: 520140 words processed Mon Nov 16 20:02:50 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.167079.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27591 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96438 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81894 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44149 clock time
[SCHEDULER ITER9 LR1]: 560132 words processed Mon Nov 16 20:03:05 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.166695.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25737 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95203 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81842 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43481 clock time
[SCHEDULER ITER9 LR1]: 600118 words processed Mon Nov 16 20:03:20 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.164905.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13899 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93008 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76359 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42472 clock time
[SCHEDULER ITER9 LR1]: 640090 words processed Mon Nov 16 20:03:35 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.163491.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.14391 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93196 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76617 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42411 clock time
[SCHEDULER ITER9 LR1]: 680075 words processed Mon Nov 16 20:03:49 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.163145.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.11384 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92420 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74906 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42278 clock time
[SCHEDULER ITER9 LR1]: 720043 words processed Mon Nov 16 20:04:04 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.163223.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23897 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95149 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80998 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43212 clock time
[SCHEDULER ITER9 LR1]: 760012 words processed Mon Nov 16 20:04:19 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.162981.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21179 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94529 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79619 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43125 clock time
[SCHEDULER ITER9 LR1]: 800113 words processed Mon Nov 16 20:04:33 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.163222.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16143 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94340 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76038 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43220 clock time
[SCHEDULER ITER9 LR1]: 840089 words processed Mon Nov 16 20:04:48 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.162394.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18125 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93797 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78528 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42716 clock time
[SCHEDULER ITER9 LR1]: 880052 words processed Mon Nov 16 20:05:03 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.162392.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25829 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95993 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80377 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43850 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER9 LR1]: Displaying result:
[SCHEDULER ITER9 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 162.33382952875> <PPL_OOV 145.38930025961> <LOGP -2010266.3742698>
[SCHEDULER ITER9 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER9 LR1]: shuffling training file
===PEEK ON TEST 9===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER9 LR1]: 40087 words processed Mon Nov 16 20:05:15 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.215174.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.71355 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79478 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER9 LR1]: Displaying result:
[SCHEDULER ITER9 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 187.88679957257> <PPL_OOV 164.45892821205> <LOGP -182669.61606603>
[SCHEDULER ITER9 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 9===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER9 LR1]: 40095 words processed Mon Nov 16 20:05:29 2015.
	[SCHEDULER ITER9 LR1]: log prob per sample :-2.276313.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.77046 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83022 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER9 LR1]: Displaying result:
[SCHEDULER ITER9 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 193.16650117439> <PPL_OOV 173.26413664884> <LOGP -165127.15215465>
[SCHEDULER ITER9 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER9 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.9...

[SCHEDULER ITER10 LR1]: preparing parameters...
[SCHEDULER ITER10 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.9...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1900407
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1905263
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48089502
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48205839
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94251708
[SCHEDULER ITER10 LR1]: preparing parameters end.
[SCHEDULER ITER10 LR1]: preparing layers...
(20:05:41 2015-11-16)[nerv] info: create layer: recurrentL1
(20:05:41 2015-11-16)[nerv] info: create layer: sigmoidL1
(20:05:41 2015-11-16)[nerv] info: create layer: combinerL1
(20:05:41 2015-11-16)[nerv] info: create layer: outputL
(20:05:41 2015-11-16)[nerv] info: create layer: softmaxL
(20:05:41 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER10 LR1]: preparing layers end.
[SCHEDULER ITER10 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER10 LR1]: Initing TNN end.
===ITERATION 10 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER10 LR1]: 40092 words processed Mon Nov 16 20:05:55 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.160846.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24036 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94857 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79273 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44562 clock time
[SCHEDULER ITER10 LR1]: 80099 words processed Mon Nov 16 20:06:09 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.160337.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18408 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92396 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78403 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42989 clock time
[SCHEDULER ITER10 LR1]: 120004 words processed Mon Nov 16 20:06:24 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.155624.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23261 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93341 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80356 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43498 clock time
[SCHEDULER ITER10 LR1]: 160114 words processed Mon Nov 16 20:06:39 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.156627.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23774 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94439 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80648 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43747 clock time
[SCHEDULER ITER10 LR1]: 200066 words processed Mon Nov 16 20:06:54 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.157317.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.14825 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91980 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76768 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42792 clock time
[SCHEDULER ITER10 LR1]: 240045 words processed Mon Nov 16 20:07:09 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.155176.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33637 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95815 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85622 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44382 clock time
[SCHEDULER ITER10 LR1]: 280057 words processed Mon Nov 16 20:07:24 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.151805.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35179 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96711 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85697 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44681 clock time
[SCHEDULER ITER10 LR1]: 320106 words processed Mon Nov 16 20:07:39 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.149324.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22708 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94164 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80375 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43729 clock time
[SCHEDULER ITER10 LR1]: 360024 words processed Mon Nov 16 20:07:54 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.148109.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22268 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96914 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77386 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43788 clock time
[SCHEDULER ITER10 LR1]: 400089 words processed Mon Nov 16 20:08:09 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.146601.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26354 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97100 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80064 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43718 clock time
[SCHEDULER ITER10 LR1]: 440067 words processed Mon Nov 16 20:08:24 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.146986.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16844 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92308 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78538 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42798 clock time
[SCHEDULER ITER10 LR1]: 480051 words processed Mon Nov 16 20:08:39 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.147458.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26427 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94276 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82543 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43878 clock time
[SCHEDULER ITER10 LR1]: 520140 words processed Mon Nov 16 20:08:54 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.147224.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26497 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95469 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81114 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44236 clock time
[SCHEDULER ITER10 LR1]: 560132 words processed Mon Nov 16 20:09:09 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.147223.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18126 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92630 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79152 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42998 clock time
[SCHEDULER ITER10 LR1]: 600118 words processed Mon Nov 16 20:09:24 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.145378.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16677 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92451 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78152 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42928 clock time
[SCHEDULER ITER10 LR1]: 640090 words processed Mon Nov 16 20:09:38 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.144720.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.14543 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92104 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76772 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42796 clock time
[SCHEDULER ITER10 LR1]: 680075 words processed Mon Nov 16 20:09:53 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.144278.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19397 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92990 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79319 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43395 clock time
[SCHEDULER ITER10 LR1]: 720043 words processed Mon Nov 16 20:10:08 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.144382.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22382 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93874 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80578 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43413 clock time
[SCHEDULER ITER10 LR1]: 760012 words processed Mon Nov 16 20:10:22 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.144462.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.12722 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.91642 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75957 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42827 clock time
[SCHEDULER ITER10 LR1]: 800113 words processed Mon Nov 16 20:10:36 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.144791.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17292 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93579 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76966 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43720 clock time
[SCHEDULER ITER10 LR1]: 840089 words processed Mon Nov 16 20:10:51 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.144007.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22642 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94658 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79795 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43718 clock time
[SCHEDULER ITER10 LR1]: 880052 words processed Mon Nov 16 20:11:06 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.144035.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21717 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96251 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77156 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44993 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER10 LR1]: Displaying result:
[SCHEDULER ITER10 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 155.32157700761> <PPL_OOV 139.37671121002> <LOGP -1993215.6354609>
[SCHEDULER ITER10 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER10 LR1]: shuffling training file
===PEEK ON TEST 10===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER10 LR1]: 40087 words processed Mon Nov 16 20:11:17 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.206112.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.69873 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78259 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER10 LR1]: Displaying result:
[SCHEDULER ITER10 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 184.80096290604> <PPL_OOV 161.06280623663> <LOGP -181922.61941708>
[SCHEDULER ITER10 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 10===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER10 LR1]: 40095 words processed Mon Nov 16 20:11:30 2015.
	[SCHEDULER ITER10 LR1]: log prob per sample :-2.268081.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.69868 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77935 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER10 LR1]: Displaying result:
[SCHEDULER ITER10 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 189.96938721225> <PPL_OOV 169.83162585427> <LOGP -164486.16952174>
[SCHEDULER ITER10 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER10 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.10...

[SCHEDULER ITER11 LR1]: preparing parameters...
[SCHEDULER ITER11 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.10...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46044887
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46049743
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92246758
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92363086
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94262965
[SCHEDULER ITER11 LR1]: preparing parameters end.
[SCHEDULER ITER11 LR1]: preparing layers...
(20:11:41 2015-11-16)[nerv] info: create layer: recurrentL1
(20:11:41 2015-11-16)[nerv] info: create layer: sigmoidL1
(20:11:41 2015-11-16)[nerv] info: create layer: combinerL1
(20:11:41 2015-11-16)[nerv] info: create layer: outputL
(20:11:41 2015-11-16)[nerv] info: create layer: softmaxL
(20:11:41 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER11 LR1]: preparing layers end.
[SCHEDULER ITER11 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER11 LR1]: Initing TNN end.
===ITERATION 11 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER11 LR1]: 40092 words processed Mon Nov 16 20:11:55 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.137039.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24793 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96238 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78565 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44301 clock time
[SCHEDULER ITER11 LR1]: 80099 words processed Mon Nov 16 20:12:10 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.138731.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21228 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94034 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79548 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42942 clock time
[SCHEDULER ITER11 LR1]: 120004 words processed Mon Nov 16 20:12:25 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.135105.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27656 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95557 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80949 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44057 clock time
[SCHEDULER ITER11 LR1]: 160114 words processed Mon Nov 16 20:12:40 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.137115.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28045 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96504 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80779 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44389 clock time
[SCHEDULER ITER11 LR1]: 200066 words processed Mon Nov 16 20:12:55 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.138343.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22558 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94877 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78820 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43608 clock time
[SCHEDULER ITER11 LR1]: 240045 words processed Mon Nov 16 20:13:09 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.135492.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17519 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93534 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77292 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42629 clock time
[SCHEDULER ITER11 LR1]: 280057 words processed Mon Nov 16 20:13:24 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.132313.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32819 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97650 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82577 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45015 clock time
[SCHEDULER ITER11 LR1]: 320106 words processed Mon Nov 16 20:13:39 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.130158.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34942 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97827 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83728 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45217 clock time
[SCHEDULER ITER11 LR1]: 360024 words processed Mon Nov 16 20:13:54 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.128993.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28891 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95936 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81657 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44191 clock time
[SCHEDULER ITER11 LR1]: 400089 words processed Mon Nov 16 20:14:09 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.127477.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24800 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95750 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79942 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43532 clock time
[SCHEDULER ITER11 LR1]: 440067 words processed Mon Nov 16 20:14:24 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.128128.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23082 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94445 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81337 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42869 clock time
[SCHEDULER ITER11 LR1]: 480051 words processed Mon Nov 16 20:14:39 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.128809.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24641 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95096 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80989 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43566 clock time
[SCHEDULER ITER11 LR1]: 520140 words processed Mon Nov 16 20:14:54 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.128769.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36388 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98005 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85747 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44825 clock time
[SCHEDULER ITER11 LR1]: 560132 words processed Mon Nov 16 20:15:09 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.128666.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18150 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93929 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77834 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42854 clock time
[SCHEDULER ITER11 LR1]: 600118 words processed Mon Nov 16 20:15:24 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.127160.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17267 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93180 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78464 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42593 clock time
[SCHEDULER ITER11 LR1]: 640090 words processed Mon Nov 16 20:15:39 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.126301.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16702 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93248 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77925 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42666 clock time
[SCHEDULER ITER11 LR1]: 680075 words processed Mon Nov 16 20:15:54 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.125962.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27773 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96086 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81539 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44200 clock time
[SCHEDULER ITER11 LR1]: 720043 words processed Mon Nov 16 20:16:09 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.126239.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34574 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96644 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85868 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44048 clock time
[SCHEDULER ITER11 LR1]: 760012 words processed Mon Nov 16 20:16:24 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.125843.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25474 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95045 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82331 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43228 clock time
[SCHEDULER ITER11 LR1]: 800113 words processed Mon Nov 16 20:16:39 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.126260.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.37667 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98417 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86995 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44942 clock time
[SCHEDULER ITER11 LR1]: 840089 words processed Mon Nov 16 20:16:54 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.125762.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27163 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95357 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81707 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43802 clock time
[SCHEDULER ITER11 LR1]: 880052 words processed Mon Nov 16 20:17:09 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.125916.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26090 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94947 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82002 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43615 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER11 LR1]: Displaying result:
[SCHEDULER ITER11 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 148.71364832114> <PPL_OOV 133.680351666> <LOGP -1976369.0350324>
[SCHEDULER ITER11 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER11 LR1]: shuffling training file
===PEEK ON TEST 11===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER11 LR1]: 40087 words processed Mon Nov 16 20:17:21 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.200361.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.78934 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84770 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER11 LR1]: Displaying result:
[SCHEDULER ITER11 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 181.46166137023> <PPL_OOV 158.99733526873> <LOGP -181460.56498772>
[SCHEDULER ITER11 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 11===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER11 LR1]: 40095 words processed Mon Nov 16 20:17:34 2015.
	[SCHEDULER ITER11 LR1]: log prob per sample :-2.262837.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.68128 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76927 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER11 LR1]: Displaying result:
[SCHEDULER ITER11 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 186.31886120305> <PPL_OOV 167.31899347048> <LOGP -164008.69715028>
[SCHEDULER ITER11 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER11 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.11...

[SCHEDULER ITER12 LR1]: preparing parameters...
[SCHEDULER ITER12 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.11...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1899123
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1903979
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48113072
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48229392
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94272505
[SCHEDULER ITER12 LR1]: preparing parameters end.
[SCHEDULER ITER12 LR1]: preparing layers...
(20:17:45 2015-11-16)[nerv] info: create layer: recurrentL1
(20:17:45 2015-11-16)[nerv] info: create layer: sigmoidL1
(20:17:45 2015-11-16)[nerv] info: create layer: combinerL1
(20:17:45 2015-11-16)[nerv] info: create layer: outputL
(20:17:45 2015-11-16)[nerv] info: create layer: softmaxL
(20:17:45 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER12 LR1]: preparing layers end.
[SCHEDULER ITER12 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER12 LR1]: Initing TNN end.
===ITERATION 12 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER12 LR1]: 40092 words processed Mon Nov 16 20:17:59 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.123412.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31655 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96784 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82706 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45205 clock time
[SCHEDULER ITER12 LR1]: 80099 words processed Mon Nov 16 20:18:14 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.129435.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26310 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94459 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82181 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43669 clock time
[SCHEDULER ITER12 LR1]: 120004 words processed Mon Nov 16 20:18:29 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.126273.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18871 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92782 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79320 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42744 clock time
[SCHEDULER ITER12 LR1]: 160114 words processed Mon Nov 16 20:18:44 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.127267.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22501 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94613 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79576 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43822 clock time
[SCHEDULER ITER12 LR1]: 200066 words processed Mon Nov 16 20:18:59 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.127589.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27943 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94986 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83544 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43845 clock time
[SCHEDULER ITER12 LR1]: 240045 words processed Mon Nov 16 20:19:14 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.125036.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29008 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95137 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83500 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44103 clock time
[SCHEDULER ITER12 LR1]: 280057 words processed Mon Nov 16 20:19:29 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.121050.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20525 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94523 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77971 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43764 clock time
[SCHEDULER ITER12 LR1]: 320106 words processed Mon Nov 16 20:19:44 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.118508.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19000 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94195 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77888 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43634 clock time
[SCHEDULER ITER12 LR1]: 360024 words processed Mon Nov 16 20:19:59 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.117107.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22844 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92906 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81314 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44605 clock time
[SCHEDULER ITER12 LR1]: 400089 words processed Mon Nov 16 20:20:14 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.115619.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21023 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94456 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79203 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43611 clock time
[SCHEDULER ITER12 LR1]: 440067 words processed Mon Nov 16 20:20:29 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.116089.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16962 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92561 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78853 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42775 clock time
[SCHEDULER ITER12 LR1]: 480051 words processed Mon Nov 16 20:20:44 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.116697.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30042 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95413 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84571 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44143 clock time
[SCHEDULER ITER12 LR1]: 520140 words processed Mon Nov 16 20:20:59 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.116334.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34376 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97422 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83921 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45307 clock time
[SCHEDULER ITER12 LR1]: 560132 words processed Mon Nov 16 20:21:14 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.116120.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26554 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94705 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83062 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43723 clock time
[SCHEDULER ITER12 LR1]: 600118 words processed Mon Nov 16 20:21:29 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.114022.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38901 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97015 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.88220 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45057 clock time
[SCHEDULER ITER12 LR1]: 640090 words processed Mon Nov 16 20:21:44 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.112655.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17404 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92716 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78821 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42924 clock time
[SCHEDULER ITER12 LR1]: 680075 words processed Mon Nov 16 20:21:59 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.111982.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23431 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94394 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80939 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43543 clock time
[SCHEDULER ITER12 LR1]: 720043 words processed Mon Nov 16 20:22:14 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.111916.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26652 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94442 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83704 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43485 clock time
[SCHEDULER ITER12 LR1]: 760012 words processed Mon Nov 16 20:22:29 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.111100.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20906 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93516 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80718 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42949 clock time
[SCHEDULER ITER12 LR1]: 800113 words processed Mon Nov 16 20:22:44 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.111543.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28087 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95649 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83307 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44227 clock time
[SCHEDULER ITER12 LR1]: 840089 words processed Mon Nov 16 20:22:59 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.111212.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18115 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93183 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78325 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43159 clock time
[SCHEDULER ITER12 LR1]: 880052 words processed Mon Nov 16 20:23:14 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.111385.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27892 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95288 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82366 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44261 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER12 LR1]: Displaying result:
[SCHEDULER ITER12 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 143.61331878081> <PPL_OOV 129.28305120291> <LOGP -1962865.8381873>
[SCHEDULER ITER12 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER12 LR1]: shuffling training file
===PEEK ON TEST 12===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER12 LR1]: 40087 words processed Mon Nov 16 20:23:26 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.200053.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.73371 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81521 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER12 LR1]: Displaying result:
[SCHEDULER ITER12 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 180.79468645492> <PPL_OOV 158.80950707114> <LOGP -181418.24970907>
[SCHEDULER ITER12 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 12===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER12 LR1]: 40095 words processed Mon Nov 16 20:23:40 2015.
	[SCHEDULER ITER12 LR1]: log prob per sample :-2.262970.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.80721 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86174 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER12 LR1]: Displaying result:
[SCHEDULER ITER12 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 186.12441685147> <PPL_OOV 167.44182066983> <LOGP -164032.20403992>
[SCHEDULER ITER12 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER12 LR1]: PPL did not improve, rejected, copying param file of last iter...

[SCHEDULER ITER13 LR1]: preparing parameters...
[SCHEDULER ITER13 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.12...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1899123
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1903979
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48113072
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48229392
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94272505
[SCHEDULER ITER13 LR1]: preparing parameters end.
[SCHEDULER ITER13 LR1]: preparing layers...
(20:23:50 2015-11-16)[nerv] info: create layer: recurrentL1
(20:23:50 2015-11-16)[nerv] info: create layer: sigmoidL1
(20:23:50 2015-11-16)[nerv] info: create layer: combinerL1
(20:23:50 2015-11-16)[nerv] info: create layer: outputL
(20:23:50 2015-11-16)[nerv] info: create layer: softmaxL
(20:23:50 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER13 LR1]: preparing layers end.
[SCHEDULER ITER13 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER13 LR1]: Initing TNN end.
===ITERATION 13 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER13 LR1]: 40092 words processed Mon Nov 16 20:24:05 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.124700.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28099 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96314 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81055 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44543 clock time
[SCHEDULER ITER13 LR1]: 80099 words processed Mon Nov 16 20:24:20 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.130431.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16269 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92640 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77226 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42814 clock time
[SCHEDULER ITER13 LR1]: 120004 words processed Mon Nov 16 20:24:35 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.126863.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24674 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93623 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81118 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43885 clock time
[SCHEDULER ITER13 LR1]: 160114 words processed Mon Nov 16 20:24:50 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.127641.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21975 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94661 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79415 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43594 clock time
[SCHEDULER ITER13 LR1]: 200066 words processed Mon Nov 16 20:25:04 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.128753.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13548 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92101 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76182 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42587 clock time
[SCHEDULER ITER13 LR1]: 240045 words processed Mon Nov 16 20:25:18 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.125405.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13980 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92411 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76064 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42991 clock time
[SCHEDULER ITER13 LR1]: 280057 words processed Mon Nov 16 20:25:33 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.121557.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26429 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95956 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80259 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44404 clock time
[SCHEDULER ITER13 LR1]: 320106 words processed Mon Nov 16 20:25:47 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.119057.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17185 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93824 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76845 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43400 clock time
[SCHEDULER ITER13 LR1]: 360024 words processed Mon Nov 16 20:26:02 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.117442.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18501 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93342 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79125 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42901 clock time
[SCHEDULER ITER13 LR1]: 400089 words processed Mon Nov 16 20:26:17 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.115856.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27431 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96218 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81362 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44619 clock time
[SCHEDULER ITER13 LR1]: 440067 words processed Mon Nov 16 20:26:32 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.116256.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19692 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93666 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78663 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43788 clock time
[SCHEDULER ITER13 LR1]: 480051 words processed Mon Nov 16 20:26:46 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.116761.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15725 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93335 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76437 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43067 clock time
[SCHEDULER ITER13 LR1]: 520140 words processed Mon Nov 16 20:27:01 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.116780.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18275 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94353 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77448 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43579 clock time
[SCHEDULER ITER13 LR1]: 560132 words processed Mon Nov 16 20:27:15 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.116520.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.12441 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92225 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75614 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42675 clock time
[SCHEDULER ITER13 LR1]: 600118 words processed Mon Nov 16 20:27:29 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.114349.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.13155 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92220 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76292 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42820 clock time
[SCHEDULER ITER13 LR1]: 640090 words processed Mon Nov 16 20:27:44 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.113011.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15483 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92821 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77413 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42679 clock time
[SCHEDULER ITER13 LR1]: 680075 words processed Mon Nov 16 20:27:58 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.112316.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.12659 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92263 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76012 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42610 clock time
[SCHEDULER ITER13 LR1]: 720043 words processed Mon Nov 16 20:28:13 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.112292.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23926 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94473 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81020 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43597 clock time
[SCHEDULER ITER13 LR1]: 760012 words processed Mon Nov 16 20:28:28 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.111595.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33803 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96596 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85226 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44719 clock time
[SCHEDULER ITER13 LR1]: 800113 words processed Mon Nov 16 20:28:43 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.112014.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29536 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96341 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83048 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44474 clock time
[SCHEDULER ITER13 LR1]: 840089 words processed Mon Nov 16 20:28:58 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.111276.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17275 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92896 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78724 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42721 clock time
[SCHEDULER ITER13 LR1]: 880052 words processed Mon Nov 16 20:29:13 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.111390.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.14769 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92803 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76710 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42597 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER13 LR1]: Displaying result:
[SCHEDULER ITER13 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 143.62007780591> <PPL_OOV 129.28060429933> <LOGP -1962858.1971088>
[SCHEDULER ITER13 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER13 LR1]: shuffling training file
===PEEK ON TEST 13===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER13 LR1]: 40087 words processed Mon Nov 16 20:29:24 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.199427.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.70902 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79208 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER13 LR1]: Displaying result:
[SCHEDULER ITER13 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 181.20405532305> <PPL_OOV 158.6828773782> <LOGP -181389.69341333>
[SCHEDULER ITER13 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 13===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER13 LR1]: 40095 words processed Mon Nov 16 20:29:37 2015.
	[SCHEDULER ITER13 LR1]: log prob per sample :-2.262494.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.68860 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77540 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER13 LR1]: Displaying result:
[SCHEDULER ITER13 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 186.32135953827> <PPL_OOV 167.22217261963> <LOGP -163990.15523657>
[SCHEDULER ITER13 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER13 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.13...

[SCHEDULER ITER14 LR1]: preparing parameters...
[SCHEDULER ITER14 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.13...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46041450
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46046306
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92267138
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92383441
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94281630
[SCHEDULER ITER14 LR1]: preparing parameters end.
[SCHEDULER ITER14 LR1]: preparing layers...
(20:29:49 2015-11-16)[nerv] info: create layer: recurrentL1
(20:29:49 2015-11-16)[nerv] info: create layer: sigmoidL1
(20:29:49 2015-11-16)[nerv] info: create layer: combinerL1
(20:29:49 2015-11-16)[nerv] info: create layer: outputL
(20:29:49 2015-11-16)[nerv] info: create layer: softmaxL
(20:29:49 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER14 LR1]: preparing layers end.
[SCHEDULER ITER14 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER14 LR1]: Initing TNN end.
===ITERATION 14 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER14 LR1]: 40092 words processed Mon Nov 16 20:30:04 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.106519.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30461 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97088 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82877 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44307 clock time
[SCHEDULER ITER14 LR1]: 80099 words processed Mon Nov 16 20:30:19 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.109678.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28269 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95321 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82989 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43324 clock time
[SCHEDULER ITER14 LR1]: 120004 words processed Mon Nov 16 20:30:34 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.106282.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30831 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95866 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84050 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43681 clock time
[SCHEDULER ITER14 LR1]: 160114 words processed Mon Nov 16 20:30:49 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.115532.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.41336 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99208 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87881 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45120 clock time
[SCHEDULER ITER14 LR1]: 200066 words processed Mon Nov 16 20:31:04 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.115626.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28454 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95420 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83684 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43619 clock time
[SCHEDULER ITER14 LR1]: 240045 words processed Mon Nov 16 20:31:19 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.114675.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21826 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94146 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80500 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43045 clock time
[SCHEDULER ITER14 LR1]: 280057 words processed Mon Nov 16 20:31:34 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.110440.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30548 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96596 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83778 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44140 clock time
[SCHEDULER ITER14 LR1]: 320106 words processed Mon Nov 16 20:31:49 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.107807.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26336 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96067 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81367 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43764 clock time
[SCHEDULER ITER14 LR1]: 360024 words processed Mon Nov 16 20:32:04 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.105960.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22322 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94159 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80968 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42895 clock time
[SCHEDULER ITER14 LR1]: 400089 words processed Mon Nov 16 20:32:19 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.104508.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26900 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95934 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82151 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43663 clock time
[SCHEDULER ITER14 LR1]: 440067 words processed Mon Nov 16 20:32:34 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.104912.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21978 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94521 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79773 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43335 clock time
[SCHEDULER ITER14 LR1]: 480051 words processed Mon Nov 16 20:32:49 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.105325.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29212 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95974 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83581 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43533 clock time
[SCHEDULER ITER14 LR1]: 520140 words processed Mon Nov 16 20:33:04 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.104824.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27934 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96269 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82311 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43878 clock time
[SCHEDULER ITER14 LR1]: 560132 words processed Mon Nov 16 20:33:19 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.104513.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26853 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95702 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81025 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43852 clock time
[SCHEDULER ITER14 LR1]: 600118 words processed Mon Nov 16 20:33:34 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.102293.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30978 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96431 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82626 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44532 clock time
[SCHEDULER ITER14 LR1]: 640090 words processed Mon Nov 16 20:33:49 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.100786.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29219 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96116 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81588 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44455 clock time
[SCHEDULER ITER14 LR1]: 680075 words processed Mon Nov 16 20:34:04 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.099982.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26772 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96005 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80443 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44164 clock time
[SCHEDULER ITER14 LR1]: 720043 words processed Mon Nov 16 20:34:19 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.099812.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19115 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93819 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78882 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42833 clock time
[SCHEDULER ITER14 LR1]: 760012 words processed Mon Nov 16 20:34:34 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.099011.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28878 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96103 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81949 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44438 clock time
[SCHEDULER ITER14 LR1]: 800113 words processed Mon Nov 16 20:34:49 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.099380.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26711 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97289 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80511 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43766 clock time
[SCHEDULER ITER14 LR1]: 840089 words processed Mon Nov 16 20:35:04 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.098603.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28103 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95753 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83225 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43645 clock time
[SCHEDULER ITER14 LR1]: 880052 words processed Mon Nov 16 20:35:18 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.098659.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.14217 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92867 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76140 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42639 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER14 LR1]: Displaying result:
[SCHEDULER ITER14 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 139.27471248492> <PPL_OOV 125.54833586369> <LOGP -1951031.5819951>
[SCHEDULER ITER14 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER14 LR1]: shuffling training file
===PEEK ON TEST 14===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER14 LR1]: 40087 words processed Mon Nov 16 20:35:29 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.197280.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.73178 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80545 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER14 LR1]: Displaying result:
[SCHEDULER ITER14 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 179.51505756206> <PPL_OOV 157.91130158393> <LOGP -181215.20116613>
[SCHEDULER ITER14 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 14===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER14 LR1]: 40095 words processed Mon Nov 16 20:35:43 2015.
	[SCHEDULER ITER14 LR1]: log prob per sample :-2.260409.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.77643 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83642 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER14 LR1]: Displaying result:
[SCHEDULER ITER14 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 184.73953147135> <PPL_OOV 166.37544753419> <LOGP -163827.54209865>
[SCHEDULER ITER14 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER14 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.14...

[SCHEDULER ITER15 LR1]: preparing parameters...
[SCHEDULER ITER15 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.14...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1897162
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1902018
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48135300
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48251597
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94290882
[SCHEDULER ITER15 LR1]: preparing parameters end.
[SCHEDULER ITER15 LR1]: preparing layers...
(20:35:55 2015-11-16)[nerv] info: create layer: recurrentL1
(20:35:55 2015-11-16)[nerv] info: create layer: sigmoidL1
(20:35:55 2015-11-16)[nerv] info: create layer: combinerL1
(20:35:55 2015-11-16)[nerv] info: create layer: outputL
(20:35:55 2015-11-16)[nerv] info: create layer: softmaxL
(20:35:55 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER15 LR1]: preparing layers end.
[SCHEDULER ITER15 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER15 LR1]: Initing TNN end.
===ITERATION 15 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER15 LR1]: 40092 words processed Mon Nov 16 20:36:10 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.094970.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33676 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00377 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82917 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44279 clock time
[SCHEDULER ITER15 LR1]: 80099 words processed Mon Nov 16 20:36:25 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.096740.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23522 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97287 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78941 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42880 clock time
[SCHEDULER ITER15 LR1]: 120004 words processed Mon Nov 16 20:36:40 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.092736.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18877 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96327 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76281 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42617 clock time
[SCHEDULER ITER15 LR1]: 160114 words processed Mon Nov 16 20:36:55 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.096468.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28721 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99112 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80849 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43680 clock time
[SCHEDULER ITER15 LR1]: 200066 words processed Mon Nov 16 20:37:10 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.097947.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.39574 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00460 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86012 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44525 clock time
[SCHEDULER ITER15 LR1]: 240045 words processed Mon Nov 16 20:37:25 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.095843.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22204 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96802 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78901 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42740 clock time
[SCHEDULER ITER15 LR1]: 280057 words processed Mon Nov 16 20:37:40 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.091781.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35603 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00636 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82275 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44904 clock time
[SCHEDULER ITER15 LR1]: 320106 words processed Mon Nov 16 20:37:55 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.089598.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32193 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00730 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80606 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44554 clock time
[SCHEDULER ITER15 LR1]: 360024 words processed Mon Nov 16 20:38:10 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.088098.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23263 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97232 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79392 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42845 clock time
[SCHEDULER ITER15 LR1]: 400089 words processed Mon Nov 16 20:38:25 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.086138.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26906 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99085 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79165 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43882 clock time
[SCHEDULER ITER15 LR1]: 440067 words processed Mon Nov 16 20:38:40 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.086957.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23976 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97762 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78951 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43257 clock time
[SCHEDULER ITER15 LR1]: 480051 words processed Mon Nov 16 20:38:55 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.087749.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28253 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98678 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81277 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43494 clock time
[SCHEDULER ITER15 LR1]: 520140 words processed Mon Nov 16 20:39:10 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.087660.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28787 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99517 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79902 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44089 clock time
[SCHEDULER ITER15 LR1]: 560132 words processed Mon Nov 16 20:39:25 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.087600.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23698 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97550 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78770 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43415 clock time
[SCHEDULER ITER15 LR1]: 600118 words processed Mon Nov 16 20:39:40 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.085650.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.40613 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00241 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87919 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44201 clock time
[SCHEDULER ITER15 LR1]: 640090 words processed Mon Nov 16 20:39:55 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.084364.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20778 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96883 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77841 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42818 clock time
[SCHEDULER ITER15 LR1]: 680075 words processed Mon Nov 16 20:40:10 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.083804.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19792 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96808 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77160 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42720 clock time
[SCHEDULER ITER15 LR1]: 720043 words processed Mon Nov 16 20:40:24 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.083820.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16935 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96247 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75649 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42640 clock time
[SCHEDULER ITER15 LR1]: 760012 words processed Mon Nov 16 20:40:39 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.083106.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18180 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96459 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76556 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42553 clock time
[SCHEDULER ITER15 LR1]: 800113 words processed Mon Nov 16 20:40:54 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.083643.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23116 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98128 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77902 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43571 clock time
[SCHEDULER ITER15 LR1]: 840089 words processed Mon Nov 16 20:41:09 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.083007.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21278 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96845 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78385 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42824 clock time
[SCHEDULER ITER15 LR1]: 880052 words processed Mon Nov 16 20:41:23 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.083226.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16957 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96438 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75418 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42622 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER15 LR1]: Displaying result:
[SCHEDULER ITER15 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 134.20503994822> <PPL_OOV 121.16819720447> <LOGP -1936695.1683318>
[SCHEDULER ITER15 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER15 LR1]: shuffling training file
===PEEK ON TEST 15===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER15 LR1]: 40087 words processed Mon Nov 16 20:41:34 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.191070.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.69805 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78138 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER15 LR1]: Displaying result:
[SCHEDULER ITER15 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 177.04541086517> <PPL_OOV 155.6829857727> <LOGP -180706.43817083>
[SCHEDULER ITER15 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 15===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER15 LR1]: 40095 words processed Mon Nov 16 20:41:48 2015.
	[SCHEDULER ITER15 LR1]: log prob per sample :-2.254691.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.70130 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78411 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER15 LR1]: Displaying result:
[SCHEDULER ITER15 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 182.18941462437> <PPL_OOV 163.97982399186> <LOGP -163362.94107867>
[SCHEDULER ITER15 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER15 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.15...

[SCHEDULER ITER16 LR1]: preparing parameters...
[SCHEDULER ITER16 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.15...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46037001
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46041857
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92288877
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92405166
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94301534
[SCHEDULER ITER16 LR1]: preparing parameters end.
[SCHEDULER ITER16 LR1]: preparing layers...
(20:41:59 2015-11-16)[nerv] info: create layer: recurrentL1
(20:41:59 2015-11-16)[nerv] info: create layer: sigmoidL1
(20:41:59 2015-11-16)[nerv] info: create layer: combinerL1
(20:41:59 2015-11-16)[nerv] info: create layer: outputL
(20:41:59 2015-11-16)[nerv] info: create layer: softmaxL
(20:41:59 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER16 LR1]: preparing layers end.
[SCHEDULER ITER16 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER16 LR1]: Initing TNN end.
===ITERATION 16 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER16 LR1]: 40092 words processed Mon Nov 16 20:42:14 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.083121.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30926 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96796 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83416 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44347 clock time
[SCHEDULER ITER16 LR1]: 80099 words processed Mon Nov 16 20:42:29 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.088097.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16645 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92932 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77414 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42582 clock time
[SCHEDULER ITER16 LR1]: 120004 words processed Mon Nov 16 20:42:44 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.083760.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.39067 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97397 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87610 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44716 clock time
[SCHEDULER ITER16 LR1]: 160114 words processed Mon Nov 16 20:42:59 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.085542.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30781 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96763 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83081 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44361 clock time
[SCHEDULER ITER16 LR1]: 200066 words processed Mon Nov 16 20:43:14 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.087662.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21723 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93918 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80622 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42914 clock time
[SCHEDULER ITER16 LR1]: 240045 words processed Mon Nov 16 20:43:28 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.086955.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16347 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92754 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77822 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42840 clock time
[SCHEDULER ITER16 LR1]: 280057 words processed Mon Nov 16 20:43:43 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.082877.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21826 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94714 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79300 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43659 clock time
[SCHEDULER ITER16 LR1]: 320106 words processed Mon Nov 16 20:43:58 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.080652.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20718 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94749 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78940 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43507 clock time
[SCHEDULER ITER16 LR1]: 360024 words processed Mon Nov 16 20:44:13 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.078907.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15673 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92901 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77143 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42760 clock time
[SCHEDULER ITER16 LR1]: 400089 words processed Mon Nov 16 20:44:28 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.076805.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32259 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97039 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83613 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44982 clock time
[SCHEDULER ITER16 LR1]: 440067 words processed Mon Nov 16 20:44:42 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.077248.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18092 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93803 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77965 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43069 clock time
[SCHEDULER ITER16 LR1]: 480051 words processed Mon Nov 16 20:44:57 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.077975.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21850 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94431 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79569 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43543 clock time
[SCHEDULER ITER16 LR1]: 520140 words processed Mon Nov 16 20:45:12 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.077521.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24428 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95404 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80277 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44158 clock time
[SCHEDULER ITER16 LR1]: 560132 words processed Mon Nov 16 20:45:27 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.077259.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25359 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95073 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81439 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43978 clock time
[SCHEDULER ITER16 LR1]: 600118 words processed Mon Nov 16 20:45:42 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.075564.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20381 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93713 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80241 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42965 clock time
[SCHEDULER ITER16 LR1]: 640090 words processed Mon Nov 16 20:45:57 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.074164.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29047 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95805 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82692 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44345 clock time
[SCHEDULER ITER16 LR1]: 680075 words processed Mon Nov 16 20:46:12 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.073495.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19910 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93637 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79610 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43185 clock time
[SCHEDULER ITER16 LR1]: 720043 words processed Mon Nov 16 20:46:27 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.073409.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24746 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94617 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82364 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43292 clock time
[SCHEDULER ITER16 LR1]: 760012 words processed Mon Nov 16 20:46:42 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.072589.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34254 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96533 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86051 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44387 clock time
[SCHEDULER ITER16 LR1]: 800113 words processed Mon Nov 16 20:46:57 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.072909.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.41324 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98715 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.88366 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45279 clock time
[SCHEDULER ITER16 LR1]: 840089 words processed Mon Nov 16 20:47:12 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.072386.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25974 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94508 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83031 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43469 clock time
[SCHEDULER ITER16 LR1]: 880052 words processed Mon Nov 16 20:47:27 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.072623.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19708 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93603 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79750 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42940 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER16 LR1]: Displaying result:
[SCHEDULER ITER16 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 130.82155308403> <PPL_OOV 118.24002290514> <LOGP -1926819.0836068>
[SCHEDULER ITER16 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER16 LR1]: shuffling training file
===PEEK ON TEST 16===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER16 LR1]: 40087 words processed Mon Nov 16 20:47:38 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.187912.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.70385 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79068 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER16 LR1]: Displaying result:
[SCHEDULER ITER16 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 176.00780059298> <PPL_OOV 154.44074852616> <LOGP -180419.64323953>
[SCHEDULER ITER16 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 16===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER16 LR1]: 40095 words processed Mon Nov 16 20:47:51 2015.
	[SCHEDULER ITER16 LR1]: log prob per sample :-2.251572.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.71377 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79789 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER16 LR1]: Displaying result:
[SCHEDULER ITER16 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 181.17022255751> <PPL_OOV 162.74880131209> <LOGP -163121.55282167>
[SCHEDULER ITER16 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER16 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.16...

[SCHEDULER ITER17 LR1]: preparing parameters...
[SCHEDULER ITER17 LR1]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.16...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1895307
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1900163
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48162572
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48278837
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94312867
[SCHEDULER ITER17 LR1]: preparing parameters end.
[SCHEDULER ITER17 LR1]: preparing layers...
(20:48:03 2015-11-16)[nerv] info: create layer: recurrentL1
(20:48:03 2015-11-16)[nerv] info: create layer: sigmoidL1
(20:48:03 2015-11-16)[nerv] info: create layer: combinerL1
(20:48:03 2015-11-16)[nerv] info: create layer: outputL
(20:48:03 2015-11-16)[nerv] info: create layer: softmaxL
(20:48:03 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER17 LR1]: preparing layers end.
[SCHEDULER ITER17 LR1]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER17 LR1]: Initing TNN end.
===ITERATION 17 LR 1.000000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER17 LR1]: 40092 words processed Mon Nov 16 20:48:17 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.075734.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27238 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98829 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79487 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43812 clock time
[SCHEDULER ITER17 LR1]: 80099 words processed Mon Nov 16 20:48:32 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.074042.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24662 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97035 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79780 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42866 clock time
[SCHEDULER ITER17 LR1]: 120004 words processed Mon Nov 16 20:48:47 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.069547.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34370 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99026 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84207 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43849 clock time
[SCHEDULER ITER17 LR1]: 160114 words processed Mon Nov 16 20:49:02 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.073792.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.37477 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01261 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82775 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45199 clock time
[SCHEDULER ITER17 LR1]: 200066 words processed Mon Nov 16 20:49:16 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.073678.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18163 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96440 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75995 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42618 clock time
[SCHEDULER ITER17 LR1]: 240045 words processed Mon Nov 16 20:49:30 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.071819.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18333 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96070 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76624 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42578 clock time
[SCHEDULER ITER17 LR1]: 280057 words processed Mon Nov 16 20:49:45 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.067970.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25319 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98351 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79003 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43534 clock time
[SCHEDULER ITER17 LR1]: 320106 words processed Mon Nov 16 20:50:00 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.066148.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34355 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00283 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83681 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44330 clock time
[SCHEDULER ITER17 LR1]: 360024 words processed Mon Nov 16 20:50:15 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.064714.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23665 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97473 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78616 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43134 clock time
[SCHEDULER ITER17 LR1]: 400089 words processed Mon Nov 16 20:50:30 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.062772.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25798 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98781 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79072 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43747 clock time
[SCHEDULER ITER17 LR1]: 440067 words processed Mon Nov 16 20:50:45 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.063663.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23909 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97682 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78809 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43342 clock time
[SCHEDULER ITER17 LR1]: 480051 words processed Mon Nov 16 20:51:00 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.064452.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20330 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96739 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77672 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42808 clock time
[SCHEDULER ITER17 LR1]: 520140 words processed Mon Nov 16 20:51:15 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.064445.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.37985 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01586 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83501 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45224 clock time
[SCHEDULER ITER17 LR1]: 560132 words processed Mon Nov 16 20:51:30 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.064322.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27297 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98557 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79801 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43799 clock time
[SCHEDULER ITER17 LR1]: 600118 words processed Mon Nov 16 20:51:45 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.062340.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33929 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99930 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82752 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44481 clock time
[SCHEDULER ITER17 LR1]: 640090 words processed Mon Nov 16 20:52:00 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.061531.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26143 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98059 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79720 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43557 clock time
[SCHEDULER ITER17 LR1]: 680075 words processed Mon Nov 16 20:52:15 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.060991.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30209 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99344 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80840 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44144 clock time
[SCHEDULER ITER17 LR1]: 720043 words processed Mon Nov 16 20:52:30 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.060957.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33596 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99923 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82105 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44480 clock time
[SCHEDULER ITER17 LR1]: 760012 words processed Mon Nov 16 20:52:45 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.060003.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27826 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98675 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79913 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43780 clock time
[SCHEDULER ITER17 LR1]: 800113 words processed Mon Nov 16 20:53:00 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.060353.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34891 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00902 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81952 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45237 clock time
[SCHEDULER ITER17 LR1]: 840089 words processed Mon Nov 16 20:53:15 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.060411.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22108 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97408 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77594 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43088 clock time
[SCHEDULER ITER17 LR1]: 880052 words processed Mon Nov 16 20:53:30 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.060802.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30403 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99124 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80942 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44023 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER17 LR1]: Displaying result:
[SCHEDULER ITER17 LR1]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 127.15444419997> <PPL_OOV 115.06947267974> <LOGP -1915845.8596768>
[SCHEDULER ITER17 LR1]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER17 LR1]: shuffling training file
===PEEK ON TEST 17===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER17 LR1]: 40087 words processed Mon Nov 16 20:53:41 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.184861.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.69809 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77810 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER17 LR1]: Displaying result:
[SCHEDULER ITER17 LR1]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 175.32009789052> <PPL_OOV 153.46425910208> <LOGP -180192.57737275>
[SCHEDULER ITER17 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 17===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER17 LR1]: 40095 words processed Mon Nov 16 20:53:54 2015.
	[SCHEDULER ITER17 LR1]: log prob per sample :-2.249517.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.80166 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84378 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER17 LR1]: Displaying result:
[SCHEDULER ITER17 LR1]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 180.31979996826> <PPL_OOV 161.69079166391> <LOGP -162912.62679993>
[SCHEDULER ITER17 LR1]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER17 LR1]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.17...

[SCHEDULER ITER18 LR0.6]: preparing parameters...
[SCHEDULER ITER18 LR0.6]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.17...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46031439
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46036295
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92315356
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92431616
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94325933
[SCHEDULER ITER18 LR0.6]: preparing parameters end.
[SCHEDULER ITER18 LR0.6]: preparing layers...
(20:54:05 2015-11-16)[nerv] info: create layer: recurrentL1
(20:54:05 2015-11-16)[nerv] info: create layer: sigmoidL1
(20:54:05 2015-11-16)[nerv] info: create layer: combinerL1
(20:54:05 2015-11-16)[nerv] info: create layer: outputL
(20:54:05 2015-11-16)[nerv] info: create layer: softmaxL
(20:54:05 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER18 LR0.6]: preparing layers end.
[SCHEDULER ITER18 LR0.6]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER18 LR0.6]: Initing TNN end.
===ITERATION 18 LR 0.600000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER18 LR0.6]: 40092 words processed Mon Nov 16 20:54:19 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.034218.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25745 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95504 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80661 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44200 clock time
[SCHEDULER ITER18 LR0.6]: 80099 words processed Mon Nov 16 20:54:34 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.031870.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31327 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95763 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84274 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43935 clock time
[SCHEDULER ITER18 LR0.6]: 120004 words processed Mon Nov 16 20:54:49 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.025285.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19025 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93110 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78589 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42993 clock time
[SCHEDULER ITER18 LR0.6]: 160114 words processed Mon Nov 16 20:55:04 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.025948.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26754 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95652 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81728 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43860 clock time
[SCHEDULER ITER18 LR0.6]: 200066 words processed Mon Nov 16 20:55:19 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.024900.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26959 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96784 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79937 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44687 clock time
[SCHEDULER ITER18 LR0.6]: 240045 words processed Mon Nov 16 20:55:34 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.021138.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26777 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97406 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79689 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43863 clock time
[SCHEDULER ITER18 LR0.6]: 280057 words processed Mon Nov 16 20:55:49 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.016731.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21745 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94592 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78846 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43716 clock time
[SCHEDULER ITER18 LR0.6]: 320106 words processed Mon Nov 16 20:56:04 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.014350.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.44575 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99327 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.89758 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45644 clock time
[SCHEDULER ITER18 LR0.6]: 360024 words processed Mon Nov 16 20:56:19 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.012541.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29842 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95430 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84021 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43770 clock time
[SCHEDULER ITER18 LR0.6]: 400089 words processed Mon Nov 16 20:56:34 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.009680.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19987 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94475 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77959 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43726 clock time
[SCHEDULER ITER18 LR0.6]: 440067 words processed Mon Nov 16 20:56:49 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.010105.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33034 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96528 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83960 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44646 clock time
[SCHEDULER ITER18 LR0.6]: 480051 words processed Mon Nov 16 20:57:04 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.010581.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26811 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95434 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81236 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44047 clock time
[SCHEDULER ITER18 LR0.6]: 520140 words processed Mon Nov 16 20:57:19 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.010123.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19916 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94413 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78156 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43676 clock time
[SCHEDULER ITER18 LR0.6]: 560132 words processed Mon Nov 16 20:57:34 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.009508.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16646 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92927 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77893 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42786 clock time
[SCHEDULER ITER18 LR0.6]: 600118 words processed Mon Nov 16 20:57:49 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.007130.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28794 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95431 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83818 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43863 clock time
[SCHEDULER ITER18 LR0.6]: 640090 words processed Mon Nov 16 20:58:04 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.005205.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24691 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94252 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82418 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43309 clock time
[SCHEDULER ITER18 LR0.6]: 680075 words processed Mon Nov 16 20:58:19 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.004151.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30513 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95557 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84603 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43733 clock time
[SCHEDULER ITER18 LR0.6]: 720043 words processed Mon Nov 16 20:58:34 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.003549.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24535 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94291 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82343 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43094 clock time
[SCHEDULER ITER18 LR0.6]: 760012 words processed Mon Nov 16 20:58:49 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.002349.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33777 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96807 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84990 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44530 clock time
[SCHEDULER ITER18 LR0.6]: 800113 words processed Mon Nov 16 20:59:04 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.002397.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28491 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96010 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83108 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44137 clock time
[SCHEDULER ITER18 LR0.6]: 840089 words processed Mon Nov 16 20:59:19 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.001577.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26981 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94970 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83140 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43478 clock time
[SCHEDULER ITER18 LR0.6]: 880052 words processed Mon Nov 16 20:59:34 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.001526.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26841 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94925 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83012 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43490 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER18 LR0.6]: Displaying result:
[SCHEDULER ITER18 LR0.6]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 110.94944312459> <PPL_OOV 100.36982641987> <LOGP -1860668.2920595>
[SCHEDULER ITER18 LR0.6]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER18 LR0.6]: shuffling training file
===PEEK ON TEST 18===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER18 LR0.6]: 40087 words processed Mon Nov 16 20:59:46 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.163278.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.84783 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.88318 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER18 LR0.6]: Displaying result:
[SCHEDULER ITER18 LR0.6]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 166.16167676808> <PPL_OOV 146.04731194544> <LOGP -178419.20481298>
[SCHEDULER ITER18 LR0.6]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 18===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER18 LR0.6]: 40095 words processed Mon Nov 16 21:00:00 2015.
	[SCHEDULER ITER18 LR0.6]: log prob per sample :-2.230708.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.77264 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83802 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER18 LR0.6]: Displaying result:
[SCHEDULER ITER18 LR0.6]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 170.55259243863> <PPL_OOV 153.42154597608> <LOGP -161230.97752031>
[SCHEDULER ITER18 LR0.6]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER18 LR0.6]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.18...

[SCHEDULER ITER19 LR0.36]: preparing parameters...
[SCHEDULER ITER19 LR0.36]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.18...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1892928
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1897784
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48183711
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48299967
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94329634
[SCHEDULER ITER19 LR0.36]: preparing parameters end.
[SCHEDULER ITER19 LR0.36]: preparing layers...
(21:00:12 2015-11-16)[nerv] info: create layer: recurrentL1
(21:00:12 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:00:12 2015-11-16)[nerv] info: create layer: combinerL1
(21:00:12 2015-11-16)[nerv] info: create layer: outputL
(21:00:12 2015-11-16)[nerv] info: create layer: softmaxL
(21:00:12 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER19 LR0.36]: preparing layers end.
[SCHEDULER ITER19 LR0.36]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER19 LR0.36]: Initing TNN end.
===ITERATION 19 LR 0.360000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER19 LR0.36]: 40092 words processed Mon Nov 16 21:00:27 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.997014.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.37699 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01214 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83925 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44752 clock time
[SCHEDULER ITER19 LR0.36]: 80099 words processed Mon Nov 16 21:00:42 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.994733.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22590 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97446 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77180 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42930 clock time
[SCHEDULER ITER19 LR0.36]: 120004 words processed Mon Nov 16 21:00:57 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.988085.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25920 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97689 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78876 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43313 clock time
[SCHEDULER ITER19 LR0.36]: 160114 words processed Mon Nov 16 21:01:12 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.988949.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28391 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99172 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79733 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43870 clock time
[SCHEDULER ITER19 LR0.36]: 200066 words processed Mon Nov 16 21:01:27 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.987750.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23944 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97421 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78807 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42972 clock time
[SCHEDULER ITER19 LR0.36]: 240045 words processed Mon Nov 16 21:01:42 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.983959.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27650 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98485 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79756 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43655 clock time
[SCHEDULER ITER19 LR0.36]: 280057 words processed Mon Nov 16 21:01:57 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.979621.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32363 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00628 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79778 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44894 clock time
[SCHEDULER ITER19 LR0.36]: 320106 words processed Mon Nov 16 21:02:12 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.977246.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30365 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00369 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79604 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44530 clock time
[SCHEDULER ITER19 LR0.36]: 360024 words processed Mon Nov 16 21:02:27 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.975444.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26700 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98481 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79095 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43630 clock time
[SCHEDULER ITER19 LR0.36]: 400089 words processed Mon Nov 16 21:02:42 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.972430.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24528 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98750 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77773 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43695 clock time
[SCHEDULER ITER19 LR0.36]: 440067 words processed Mon Nov 16 21:02:57 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.972825.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25762 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97900 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79388 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43285 clock time
[SCHEDULER ITER19 LR0.36]: 480051 words processed Mon Nov 16 21:03:12 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.973155.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.39802 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01075 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85441 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44901 clock time
[SCHEDULER ITER19 LR0.36]: 520140 words processed Mon Nov 16 21:03:27 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.972554.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27265 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99593 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78666 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44004 clock time
[SCHEDULER ITER19 LR0.36]: 560132 words processed Mon Nov 16 21:03:42 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.971809.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20244 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97249 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76500 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43149 clock time
[SCHEDULER ITER19 LR0.36]: 600118 words processed Mon Nov 16 21:03:56 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.969291.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17425 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96787 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75004 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42625 clock time
[SCHEDULER ITER19 LR0.36]: 640090 words processed Mon Nov 16 21:04:11 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.967195.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19563 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96958 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76280 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42895 clock time
[SCHEDULER ITER19 LR0.36]: 680075 words processed Mon Nov 16 21:04:26 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.965907.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17501 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96561 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75222 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42697 clock time
[SCHEDULER ITER19 LR0.36]: 720043 words processed Mon Nov 16 21:04:41 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.964968.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19445 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97205 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75933 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42914 clock time
[SCHEDULER ITER19 LR0.36]: 760012 words processed Mon Nov 16 21:04:56 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.963337.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29222 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99264 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79571 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44209 clock time
[SCHEDULER ITER19 LR0.36]: 800113 words processed Mon Nov 16 21:05:11 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.963206.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24557 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98569 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78092 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43640 clock time
[SCHEDULER ITER19 LR0.36]: 840089 words processed Mon Nov 16 21:05:26 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.962238.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26359 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97833 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80461 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43177 clock time
[SCHEDULER ITER19 LR0.36]: 880052 words processed Mon Nov 16 21:05:41 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-1.961986.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28655 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98580 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80948 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43586 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER19 LR0.36]: Displaying result:
[SCHEDULER ITER19 LR0.36]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 101.11776818014> <PPL_OOV 91.627273951145> <LOGP -1823876.640057>
[SCHEDULER ITER19 LR0.36]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER19 LR0.36]: shuffling training file
===PEEK ON TEST 19===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER19 LR0.36]: 40087 words processed Mon Nov 16 21:05:53 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-2.145398.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.80456 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84858 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER19 LR0.36]: Displaying result:
[SCHEDULER ITER19 LR0.36]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 159.60093901295> <PPL_OOV 140.12256441497> <LOGP -176936.66077397>
[SCHEDULER ITER19 LR0.36]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 19===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER19 LR0.36]: 40095 words processed Mon Nov 16 21:06:06 2015.
	[SCHEDULER ITER19 LR0.36]: log prob per sample :-2.214779.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.70569 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78041 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER19 LR0.36]: Displaying result:
[SCHEDULER ITER19 LR0.36]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 163.71076230308> <PPL_OOV 147.1341216716> <LOGP -159890.54046095>
[SCHEDULER ITER19 LR0.36]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER19 LR0.36]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.19...

[SCHEDULER ITER20 LR0.216]: preparing parameters...
[SCHEDULER ITER20 LR0.216]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.19...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46028677
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46033533
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92322350
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92438569
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94330677
[SCHEDULER ITER20 LR0.216]: preparing parameters end.
[SCHEDULER ITER20 LR0.216]: preparing layers...
(21:06:17 2015-11-16)[nerv] info: create layer: recurrentL1
(21:06:17 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:06:17 2015-11-16)[nerv] info: create layer: combinerL1
(21:06:17 2015-11-16)[nerv] info: create layer: outputL
(21:06:17 2015-11-16)[nerv] info: create layer: softmaxL
(21:06:17 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER20 LR0.216]: preparing layers end.
[SCHEDULER ITER20 LR0.216]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER20 LR0.216]: Initing TNN end.
===ITERATION 20 LR 0.216000===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER20 LR0.216]: 40092 words processed Mon Nov 16 21:06:31 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.971407.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22962 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94759 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79420 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43827 clock time
[SCHEDULER ITER20 LR0.216]: 80099 words processed Mon Nov 16 21:06:45 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.968297.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17542 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93152 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77037 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43042 clock time
[SCHEDULER ITER20 LR0.216]: 120004 words processed Mon Nov 16 21:07:00 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.961757.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20230 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93354 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78631 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43216 clock time
[SCHEDULER ITER20 LR0.216]: 160114 words processed Mon Nov 16 21:07:15 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.962674.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23618 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94806 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79761 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43949 clock time
[SCHEDULER ITER20 LR0.216]: 200066 words processed Mon Nov 16 21:07:30 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.961535.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21250 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93132 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80796 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42903 clock time
[SCHEDULER ITER20 LR0.216]: 240045 words processed Mon Nov 16 21:07:45 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.957763.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19982 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92943 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80018 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42891 clock time
[SCHEDULER ITER20 LR0.216]: 280057 words processed Mon Nov 16 21:08:00 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.953523.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26136 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95105 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81946 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43855 clock time
[SCHEDULER ITER20 LR0.216]: 320106 words processed Mon Nov 16 21:08:15 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.951224.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22527 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95061 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79067 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44015 clock time
[SCHEDULER ITER20 LR0.216]: 360024 words processed Mon Nov 16 21:08:30 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.949400.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31292 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96120 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82623 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44692 clock time
[SCHEDULER ITER20 LR0.216]: 400089 words processed Mon Nov 16 21:08:45 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.946355.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36310 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97948 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84314 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45700 clock time
[SCHEDULER ITER20 LR0.216]: 440067 words processed Mon Nov 16 21:09:00 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.946745.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26369 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94909 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81182 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44092 clock time
[SCHEDULER ITER20 LR0.216]: 480051 words processed Mon Nov 16 21:09:15 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.947007.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29088 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95335 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82959 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44103 clock time
[SCHEDULER ITER20 LR0.216]: 520140 words processed Mon Nov 16 21:09:30 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.946379.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26552 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95183 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82563 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43845 clock time
[SCHEDULER ITER20 LR0.216]: 560132 words processed Mon Nov 16 21:09:45 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.945623.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22786 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93792 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81791 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42946 clock time
[SCHEDULER ITER20 LR0.216]: 600118 words processed Mon Nov 16 21:10:00 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.943088.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25843 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94355 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82783 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43338 clock time
[SCHEDULER ITER20 LR0.216]: 640090 words processed Mon Nov 16 21:10:15 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.940800.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26906 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94591 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83241 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43544 clock time
[SCHEDULER ITER20 LR0.216]: 680075 words processed Mon Nov 16 21:10:30 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.939424.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20027 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93066 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80238 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43030 clock time
[SCHEDULER ITER20 LR0.216]: 720043 words processed Mon Nov 16 21:10:45 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.938325.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19832 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93140 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80032 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42895 clock time
[SCHEDULER ITER20 LR0.216]: 760012 words processed Mon Nov 16 21:11:00 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.936527.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18817 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93531 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78682 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42979 clock time
[SCHEDULER ITER20 LR0.216]: 800113 words processed Mon Nov 16 21:11:15 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.936323.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22231 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94653 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79684 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43774 clock time
[SCHEDULER ITER20 LR0.216]: 840089 words processed Mon Nov 16 21:11:30 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.935251.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19464 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93182 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79775 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43002 clock time
[SCHEDULER ITER20 LR0.216]: 880052 words processed Mon Nov 16 21:11:45 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-1.934865.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23933 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94265 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81283 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43417 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER20 LR0.216]: Displaying result:
[SCHEDULER ITER20 LR0.216]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 94.858763770931> <PPL_OOV 86.075078953778> <LOGP -1798640.7750352>
[SCHEDULER ITER20 LR0.216]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER20 LR0.216]: shuffling training file
===PEEK ON TEST 20===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER20 LR0.216]: 40087 words processed Mon Nov 16 21:11:57 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-2.131186.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.75590 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82386 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER20 LR0.216]: Displaying result:
[SCHEDULER ITER20 LR0.216]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 154.88722747527> <PPL_OOV 135.61386955113> <LOGP -175765.82763284>
[SCHEDULER ITER20 LR0.216]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 20===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER20 LR0.216]: 40095 words processed Mon Nov 16 21:12:11 2015.
	[SCHEDULER ITER20 LR0.216]: log prob per sample :-2.202088.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.74235 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81553 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER20 LR0.216]: Displaying result:
[SCHEDULER ITER20 LR0.216]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 158.87666734941> <PPL_OOV 142.46254184851> <LOGP -158856.96281008>
[SCHEDULER ITER20 LR0.216]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER20 LR0.216]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.20...

[SCHEDULER ITER21 LR0.1296]: preparing parameters...
[SCHEDULER ITER21 LR0.1296]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.20...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1891422
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1896278
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48186065
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48302281
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94330600
[SCHEDULER ITER21 LR0.1296]: preparing parameters end.
[SCHEDULER ITER21 LR0.1296]: preparing layers...
(21:12:22 2015-11-16)[nerv] info: create layer: recurrentL1
(21:12:22 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:12:22 2015-11-16)[nerv] info: create layer: combinerL1
(21:12:22 2015-11-16)[nerv] info: create layer: outputL
(21:12:22 2015-11-16)[nerv] info: create layer: softmaxL
(21:12:22 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER21 LR0.1296]: preparing layers end.
[SCHEDULER ITER21 LR0.1296]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER21 LR0.1296]: Initing TNN end.
===ITERATION 21 LR 0.129600===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER21 LR0.1296]: 40092 words processed Mon Nov 16 21:12:37 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.954227.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34756 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00467 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81957 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44675 clock time
[SCHEDULER ITER21 LR0.1296]: 80099 words processed Mon Nov 16 21:12:52 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.950706.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27143 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98442 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79071 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43554 clock time
[SCHEDULER ITER21 LR0.1296]: 120004 words processed Mon Nov 16 21:13:07 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.944022.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20431 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96757 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76389 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42821 clock time
[SCHEDULER ITER21 LR0.1296]: 160114 words processed Mon Nov 16 21:13:22 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.944942.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23465 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98528 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76677 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43513 clock time
[SCHEDULER ITER21 LR0.1296]: 200066 words processed Mon Nov 16 21:13:37 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.943798.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18373 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96675 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75395 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42719 clock time
[SCHEDULER ITER21 LR0.1296]: 240045 words processed Mon Nov 16 21:13:52 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.939964.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25409 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97913 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79033 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43266 clock time
[SCHEDULER ITER21 LR0.1296]: 280057 words processed Mon Nov 16 21:14:07 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.935737.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27576 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99447 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78164 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43937 clock time
[SCHEDULER ITER21 LR0.1296]: 320106 words processed Mon Nov 16 21:14:22 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.933468.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35426 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01180 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81053 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45017 clock time
[SCHEDULER ITER21 LR0.1296]: 360024 words processed Mon Nov 16 21:14:37 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.931656.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21980 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97378 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77168 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43218 clock time
[SCHEDULER ITER21 LR0.1296]: 400089 words processed Mon Nov 16 21:14:52 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.928579.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31833 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00297 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80294 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44639 clock time
[SCHEDULER ITER21 LR0.1296]: 440067 words processed Mon Nov 16 21:15:07 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.928992.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24081 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97941 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77876 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43484 clock time
[SCHEDULER ITER21 LR0.1296]: 480051 words processed Mon Nov 16 21:15:22 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.929176.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18611 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96436 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76267 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42682 clock time
[SCHEDULER ITER21 LR0.1296]: 520140 words processed Mon Nov 16 21:15:37 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.928482.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23616 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98585 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77081 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43720 clock time
[SCHEDULER ITER21 LR0.1296]: 560132 words processed Mon Nov 16 21:15:52 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.927679.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20601 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96832 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77303 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42811 clock time
[SCHEDULER ITER21 LR0.1296]: 600118 words processed Mon Nov 16 21:16:07 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.925138.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20391 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97032 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77028 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42722 clock time
[SCHEDULER ITER21 LR0.1296]: 640090 words processed Mon Nov 16 21:16:22 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.922796.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24838 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98380 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78104 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43485 clock time
[SCHEDULER ITER21 LR0.1296]: 680075 words processed Mon Nov 16 21:16:36 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.921362.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16326 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96331 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74818 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42500 clock time
[SCHEDULER ITER21 LR0.1296]: 720043 words processed Mon Nov 16 21:16:51 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.920138.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20506 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96921 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77065 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42829 clock time
[SCHEDULER ITER21 LR0.1296]: 760012 words processed Mon Nov 16 21:17:06 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.918226.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25844 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97623 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80184 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42974 clock time
[SCHEDULER ITER21 LR0.1296]: 800113 words processed Mon Nov 16 21:17:21 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.917948.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25590 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98707 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78588 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43778 clock time
[SCHEDULER ITER21 LR0.1296]: 840089 words processed Mon Nov 16 21:17:36 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.916767.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27524 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97933 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80926 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43237 clock time
[SCHEDULER ITER21 LR0.1296]: 880052 words processed Mon Nov 16 21:17:51 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-1.916267.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20955 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97582 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76386 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43003 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER21 LR0.1296]: Displaying result:
[SCHEDULER ITER21 LR0.1296]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 90.78547262985> <PPL_OOV 82.462162737312> <LOGP -1781329.3097165>
[SCHEDULER ITER21 LR0.1296]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER21 LR0.1296]: shuffling training file
===PEEK ON TEST 21===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER21 LR0.1296]: 40087 words processed Mon Nov 16 21:18:03 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-2.121687.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.74755 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81581 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER21 LR0.1296]: Displaying result:
[SCHEDULER ITER21 LR0.1296]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 152.04549072345> <PPL_OOV 132.75281765476> <LOGP -175002.49612076>
[SCHEDULER ITER21 LR0.1296]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 21===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER21 LR0.1296]: 40095 words processed Mon Nov 16 21:18:17 2015.
	[SCHEDULER ITER21 LR0.1296]: log prob per sample :-2.193534.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.79080 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83936 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER21 LR0.1296]: Displaying result:
[SCHEDULER ITER21 LR0.1296]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 155.85681868536> <PPL_OOV 139.4274434935> <LOGP -158167.12797675>
[SCHEDULER ITER21 LR0.1296]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER21 LR0.1296]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.21...

[SCHEDULER ITER22 LR0.07776]: preparing parameters...
[SCHEDULER ITER22 LR0.07776]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.21...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46028104
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46032959
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92322760
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92438976
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94329928
[SCHEDULER ITER22 LR0.07776]: preparing parameters end.
[SCHEDULER ITER22 LR0.07776]: preparing layers...
(21:18:29 2015-11-16)[nerv] info: create layer: recurrentL1
(21:18:29 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:18:29 2015-11-16)[nerv] info: create layer: combinerL1
(21:18:29 2015-11-16)[nerv] info: create layer: outputL
(21:18:29 2015-11-16)[nerv] info: create layer: softmaxL
(21:18:29 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER22 LR0.07776]: preparing layers end.
[SCHEDULER ITER22 LR0.07776]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER22 LR0.07776]: Initing TNN end.
===ITERATION 22 LR 0.077760===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER22 LR0.07776]: 40092 words processed Mon Nov 16 21:18:43 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.941979.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26998 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95849 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80843 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44462 clock time
[SCHEDULER ITER22 LR0.07776]: 80099 words processed Mon Nov 16 21:18:58 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.938250.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24674 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94153 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81465 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43493 clock time
[SCHEDULER ITER22 LR0.07776]: 120004 words processed Mon Nov 16 21:19:12 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.931563.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17270 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92859 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77460 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42850 clock time
[SCHEDULER ITER22 LR0.07776]: 160114 words processed Mon Nov 16 21:19:27 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.932540.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32325 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97095 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82620 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45205 clock time
[SCHEDULER ITER22 LR0.07776]: 200066 words processed Mon Nov 16 21:19:42 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.931450.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22387 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94297 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79414 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43599 clock time
[SCHEDULER ITER22 LR0.07776]: 240045 words processed Mon Nov 16 21:19:57 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.927571.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25087 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94717 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80457 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44078 clock time
[SCHEDULER ITER22 LR0.07776]: 280057 words processed Mon Nov 16 21:20:12 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.923315.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28819 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96121 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82465 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44073 clock time
[SCHEDULER ITER22 LR0.07776]: 320106 words processed Mon Nov 16 21:20:27 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.921082.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28432 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96028 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82644 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44158 clock time
[SCHEDULER ITER22 LR0.07776]: 360024 words processed Mon Nov 16 21:20:42 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.919259.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18644 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93340 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78701 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42970 clock time
[SCHEDULER ITER22 LR0.07776]: 400089 words processed Mon Nov 16 21:20:57 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.916177.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.42563 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99012 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.88633 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45547 clock time
[SCHEDULER ITER22 LR0.07776]: 440067 words processed Mon Nov 16 21:21:12 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.916615.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24377 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94346 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81526 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43426 clock time
[SCHEDULER ITER22 LR0.07776]: 480051 words processed Mon Nov 16 21:21:27 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.916756.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30678 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95800 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84641 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43868 clock time
[SCHEDULER ITER22 LR0.07776]: 520140 words processed Mon Nov 16 21:21:42 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.916061.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20650 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94582 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78724 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43664 clock time
[SCHEDULER ITER22 LR0.07776]: 560132 words processed Mon Nov 16 21:21:57 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.915241.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20045 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93540 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80025 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42992 clock time
[SCHEDULER ITER22 LR0.07776]: 600118 words processed Mon Nov 16 21:22:12 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.912721.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36492 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97455 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86344 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44664 clock time
[SCHEDULER ITER22 LR0.07776]: 640090 words processed Mon Nov 16 21:22:27 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.910376.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19528 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93380 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79227 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43230 clock time
[SCHEDULER ITER22 LR0.07776]: 680075 words processed Mon Nov 16 21:22:42 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.908921.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18505 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93262 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78906 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43041 clock time
[SCHEDULER ITER22 LR0.07776]: 720043 words processed Mon Nov 16 21:22:57 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.907630.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27341 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95004 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83331 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43541 clock time
[SCHEDULER ITER22 LR0.07776]: 760012 words processed Mon Nov 16 21:23:12 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.905650.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29667 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95535 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84302 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43935 clock time
[SCHEDULER ITER22 LR0.07776]: 800113 words processed Mon Nov 16 21:23:27 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.905321.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26400 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95929 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81147 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44161 clock time
[SCHEDULER ITER22 LR0.07776]: 840089 words processed Mon Nov 16 21:23:42 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.904079.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26143 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95320 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81042 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44227 clock time
[SCHEDULER ITER22 LR0.07776]: 880052 words processed Mon Nov 16 21:23:57 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-1.903519.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19051 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93774 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78244 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43316 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER22 LR0.07776]: Displaying result:
[SCHEDULER ITER22 LR0.07776]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 88.094386760042> <PPL_OOV 80.0732601848> <LOGP -1769461.0520283>
[SCHEDULER ITER22 LR0.07776]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER22 LR0.07776]: shuffling training file
===PEEK ON TEST 22===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER22 LR0.07776]: 40087 words processed Mon Nov 16 21:24:09 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-2.115979.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.84544 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87784 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER22 LR0.07776]: Displaying result:
[SCHEDULER ITER22 LR0.07776]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 150.34388392672> <PPL_OOV 131.1224071462> <LOGP -174560.10797298>
[SCHEDULER ITER22 LR0.07776]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 22===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER22 LR0.07776]: 40095 words processed Mon Nov 16 21:24:22 2015.
	[SCHEDULER ITER22 LR0.07776]: log prob per sample :-2.188293.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.69986 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78278 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER22 LR0.07776]: Displaying result:
[SCHEDULER ITER22 LR0.07776]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 153.99594513805> <PPL_OOV 137.63667528429> <LOGP -157753.03262785>
[SCHEDULER ITER22 LR0.07776]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER22 LR0.07776]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.22...

[SCHEDULER ITER23 LR0.046656]: preparing parameters...
[SCHEDULER ITER23 LR0.046656]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.22...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1890622
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1895476
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48184985
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48301204
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94328908
[SCHEDULER ITER23 LR0.046656]: preparing parameters end.
[SCHEDULER ITER23 LR0.046656]: preparing layers...
(21:24:33 2015-11-16)[nerv] info: create layer: recurrentL1
(21:24:33 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:24:33 2015-11-16)[nerv] info: create layer: combinerL1
(21:24:33 2015-11-16)[nerv] info: create layer: outputL
(21:24:33 2015-11-16)[nerv] info: create layer: softmaxL
(21:24:33 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER23 LR0.046656]: preparing layers end.
[SCHEDULER ITER23 LR0.046656]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER23 LR0.046656]: Initing TNN end.
===ITERATION 23 LR 0.046656===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER23 LR0.046656]: 40092 words processed Mon Nov 16 21:24:48 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.933322.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.43060 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02538 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85628 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45642 clock time
[SCHEDULER ITER23 LR0.046656]: 80099 words processed Mon Nov 16 21:25:03 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.929559.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22654 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97019 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78185 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42971 clock time
[SCHEDULER ITER23 LR0.046656]: 120004 words processed Mon Nov 16 21:25:18 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.923031.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32611 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99042 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82348 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43949 clock time
[SCHEDULER ITER23 LR0.046656]: 160114 words processed Mon Nov 16 21:25:33 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.924075.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27485 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98920 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79461 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43725 clock time
[SCHEDULER ITER23 LR0.046656]: 200066 words processed Mon Nov 16 21:25:48 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.923074.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17493 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96409 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75168 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42667 clock time
[SCHEDULER ITER23 LR0.046656]: 240045 words processed Mon Nov 16 21:26:03 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.919194.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20807 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96601 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77778 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42754 clock time
[SCHEDULER ITER23 LR0.046656]: 280057 words processed Mon Nov 16 21:26:18 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.914950.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38218 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01743 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82897 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45330 clock time
[SCHEDULER ITER23 LR0.046656]: 320106 words processed Mon Nov 16 21:26:33 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.912753.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34983 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01235 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81060 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45143 clock time
[SCHEDULER ITER23 LR0.046656]: 360024 words processed Mon Nov 16 21:26:48 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.910919.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31415 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99817 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80388 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44630 clock time
[SCHEDULER ITER23 LR0.046656]: 400089 words processed Mon Nov 16 21:27:03 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.907852.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38152 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01851 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82635 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45193 clock time
[SCHEDULER ITER23 LR0.046656]: 440067 words processed Mon Nov 16 21:27:18 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.908329.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24014 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97961 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78054 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43533 clock time
[SCHEDULER ITER23 LR0.046656]: 480051 words processed Mon Nov 16 21:27:32 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.908451.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17048 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96364 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75443 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42763 clock time
[SCHEDULER ITER23 LR0.046656]: 520140 words processed Mon Nov 16 21:27:47 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.907763.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32453 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00377 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81899 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44426 clock time
[SCHEDULER ITER23 LR0.046656]: 560132 words processed Mon Nov 16 21:28:02 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.906947.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19512 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96572 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77019 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42856 clock time
[SCHEDULER ITER23 LR0.046656]: 600118 words processed Mon Nov 16 21:28:17 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.904446.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19011 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96633 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76496 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42736 clock time
[SCHEDULER ITER23 LR0.046656]: 640090 words processed Mon Nov 16 21:28:32 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.902126.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29103 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99197 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79511 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44366 clock time
[SCHEDULER ITER23 LR0.046656]: 680075 words processed Mon Nov 16 21:28:47 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.900667.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27285 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98424 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80619 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43415 clock time
[SCHEDULER ITER23 LR0.046656]: 720043 words processed Mon Nov 16 21:29:02 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.899347.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27555 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98505 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79897 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43413 clock time
[SCHEDULER ITER23 LR0.046656]: 760012 words processed Mon Nov 16 21:29:16 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.897339.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16690 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96549 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74945 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42699 clock time
[SCHEDULER ITER23 LR0.046656]: 800113 words processed Mon Nov 16 21:29:31 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.896996.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21779 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97776 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76997 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43602 clock time
[SCHEDULER ITER23 LR0.046656]: 840089 words processed Mon Nov 16 21:29:45 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.895727.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16285 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96054 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75017 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42617 clock time
[SCHEDULER ITER23 LR0.046656]: 880052 words processed Mon Nov 16 21:30:00 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-1.895135.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16826 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96469 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74942 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42590 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER23 LR0.046656]: Displaying result:
[SCHEDULER ITER23 LR0.046656]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 86.370829580211> <PPL_OOV 78.540181305621> <LOGP -1761656.5837458>
[SCHEDULER ITER23 LR0.046656]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER23 LR0.046656]: shuffling training file
===PEEK ON TEST 23===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER23 LR0.046656]: 40087 words processed Mon Nov 16 21:30:11 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-2.112277.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.77059 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81826 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER23 LR0.046656]: Displaying result:
[SCHEDULER ITER23 LR0.046656]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 149.10919738157> <PPL_OOV 130.08618277319> <LOGP -174276.07534413>
[SCHEDULER ITER23 LR0.046656]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 23===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER23 LR0.046656]: 40095 words processed Mon Nov 16 21:30:24 2015.
	[SCHEDULER ITER23 LR0.046656]: log prob per sample :-2.184797.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.76768 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82157 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER23 LR0.046656]: Displaying result:
[SCHEDULER ITER23 LR0.046656]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 152.58447301765> <PPL_OOV 136.42030747027> <LOGP -157468.67681237>
[SCHEDULER ITER23 LR0.046656]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER23 LR0.046656]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.23...

[SCHEDULER ITER24 LR0.0279936]: preparing parameters...
[SCHEDULER ITER24 LR0.0279936]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.23...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46027630
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46032483
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92321690
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92437904
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94328313
[SCHEDULER ITER24 LR0.0279936]: preparing parameters end.
[SCHEDULER ITER24 LR0.0279936]: preparing layers...
(21:30:36 2015-11-16)[nerv] info: create layer: recurrentL1
(21:30:36 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:30:36 2015-11-16)[nerv] info: create layer: combinerL1
(21:30:36 2015-11-16)[nerv] info: create layer: outputL
(21:30:36 2015-11-16)[nerv] info: create layer: softmaxL
(21:30:36 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER24 LR0.0279936]: preparing layers end.
[SCHEDULER ITER24 LR0.0279936]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER24 LR0.0279936]: Initing TNN end.
===ITERATION 24 LR 0.027994===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER24 LR0.0279936]: 40092 words processed Mon Nov 16 21:30:50 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.927572.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29372 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96722 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81640 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44418 clock time
[SCHEDULER ITER24 LR0.0279936]: 80099 words processed Mon Nov 16 21:31:05 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.923793.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27562 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95174 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82158 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43672 clock time
[SCHEDULER ITER24 LR0.0279936]: 120004 words processed Mon Nov 16 21:31:20 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.917436.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25729 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94434 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82537 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43113 clock time
[SCHEDULER ITER24 LR0.0279936]: 160114 words processed Mon Nov 16 21:31:35 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.918508.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29215 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96581 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82217 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44249 clock time
[SCHEDULER ITER24 LR0.0279936]: 200066 words processed Mon Nov 16 21:31:49 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.917544.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16679 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93220 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77049 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42816 clock time
[SCHEDULER ITER24 LR0.0279936]: 240045 words processed Mon Nov 16 21:32:04 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.913702.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17291 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93194 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77446 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42967 clock time
[SCHEDULER ITER24 LR0.0279936]: 280057 words processed Mon Nov 16 21:32:19 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.909467.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29023 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96128 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82053 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44194 clock time
[SCHEDULER ITER24 LR0.0279936]: 320106 words processed Mon Nov 16 21:32:34 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.907301.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22057 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95197 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78918 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43668 clock time
[SCHEDULER ITER24 LR0.0279936]: 360024 words processed Mon Nov 16 21:32:49 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.905454.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36237 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96948 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86266 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44618 clock time
[SCHEDULER ITER24 LR0.0279936]: 400089 words processed Mon Nov 16 21:33:04 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.902393.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.39099 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98331 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87418 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45318 clock time
[SCHEDULER ITER24 LR0.0279936]: 440067 words processed Mon Nov 16 21:33:19 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.902894.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27378 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95025 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83149 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43587 clock time
[SCHEDULER ITER24 LR0.0279936]: 480051 words processed Mon Nov 16 21:33:33 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.902990.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15579 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93006 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77021 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42697 clock time
[SCHEDULER ITER24 LR0.0279936]: 520140 words processed Mon Nov 16 21:33:48 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.902279.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21845 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94832 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79380 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43759 clock time
[SCHEDULER ITER24 LR0.0279936]: 560132 words processed Mon Nov 16 21:34:03 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.901444.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18088 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93598 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78271 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42838 clock time
[SCHEDULER ITER24 LR0.0279936]: 600118 words processed Mon Nov 16 21:34:18 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.898944.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28395 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95327 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83804 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43478 clock time
[SCHEDULER ITER24 LR0.0279936]: 640090 words processed Mon Nov 16 21:34:33 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.896618.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26901 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95035 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82729 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43462 clock time
[SCHEDULER ITER24 LR0.0279936]: 680075 words processed Mon Nov 16 21:34:48 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.895142.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18574 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93844 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77808 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43477 clock time
[SCHEDULER ITER24 LR0.0279936]: 720043 words processed Mon Nov 16 21:35:03 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.893792.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27391 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95735 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81735 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44041 clock time
[SCHEDULER ITER24 LR0.0279936]: 760012 words processed Mon Nov 16 21:35:18 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.891750.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20482 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93922 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79458 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43129 clock time
[SCHEDULER ITER24 LR0.0279936]: 800113 words processed Mon Nov 16 21:35:33 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.891385.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24458 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95290 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81107 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43856 clock time
[SCHEDULER ITER24 LR0.0279936]: 840089 words processed Mon Nov 16 21:35:48 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.890073.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20478 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93956 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79600 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42966 clock time
[SCHEDULER ITER24 LR0.0279936]: 880052 words processed Mon Nov 16 21:36:02 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-1.889435.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16192 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93020 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77294 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42815 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER24 LR0.0279936]: Displaying result:
[SCHEDULER ITER24 LR0.0279936]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 85.22026591435> <PPL_OOV 77.514508595711> <LOGP -1756349.6518786>
[SCHEDULER ITER24 LR0.0279936]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER24 LR0.0279936]: shuffling training file
===PEEK ON TEST 24===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER24 LR0.0279936]: 40087 words processed Mon Nov 16 21:36:14 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-2.109803.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.76426 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83310 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER24 LR0.0279936]: Displaying result:
[SCHEDULER ITER24 LR0.0279936]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 148.18558701419> <PPL_OOV 129.38121442773> <LOGP -174081.54493649>
[SCHEDULER ITER24 LR0.0279936]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 24===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER24 LR0.0279936]: 40095 words processed Mon Nov 16 21:36:28 2015.
	[SCHEDULER ITER24 LR0.0279936]: log prob per sample :-2.182444.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.76095 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83160 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER24 LR0.0279936]: Displaying result:
[SCHEDULER ITER24 LR0.0279936]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 151.56327400662> <PPL_OOV 135.60786959211> <LOGP -157277.33372447>
[SCHEDULER ITER24 LR0.0279936]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER24 LR0.0279936]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.24...

[SCHEDULER ITER25 LR0.01679616]: preparing parameters...
[SCHEDULER ITER25 LR0.01679616]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.24...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1890306
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1895158
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48184112
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48300326
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94327911
[SCHEDULER ITER25 LR0.01679616]: preparing parameters end.
[SCHEDULER ITER25 LR0.01679616]: preparing layers...
(21:36:40 2015-11-16)[nerv] info: create layer: recurrentL1
(21:36:40 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:36:40 2015-11-16)[nerv] info: create layer: combinerL1
(21:36:40 2015-11-16)[nerv] info: create layer: outputL
(21:36:40 2015-11-16)[nerv] info: create layer: softmaxL
(21:36:40 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER25 LR0.01679616]: preparing layers end.
[SCHEDULER ITER25 LR0.01679616]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER25 LR0.01679616]: Initing TNN end.
===ITERATION 25 LR 0.016796===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER25 LR0.01679616]: 40092 words processed Mon Nov 16 21:36:55 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.923208.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27808 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99055 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79319 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43951 clock time
[SCHEDULER ITER25 LR0.01679616]: 80099 words processed Mon Nov 16 21:37:10 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.919417.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23524 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97744 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77503 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43228 clock time
[SCHEDULER ITER25 LR0.01679616]: 120004 words processed Mon Nov 16 21:37:25 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.913209.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19035 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96580 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75638 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42841 clock time
[SCHEDULER ITER25 LR0.01679616]: 160114 words processed Mon Nov 16 21:37:40 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.914297.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25164 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98748 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77835 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43606 clock time
[SCHEDULER ITER25 LR0.01679616]: 200066 words processed Mon Nov 16 21:37:55 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.913380.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36925 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00198 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84568 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44147 clock time
[SCHEDULER ITER25 LR0.01679616]: 240045 words processed Mon Nov 16 21:38:10 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.909582.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32865 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99385 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82956 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43906 clock time
[SCHEDULER ITER25 LR0.01679616]: 280057 words processed Mon Nov 16 21:38:25 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.905394.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30278 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99811 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80327 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44108 clock time
[SCHEDULER ITER25 LR0.01679616]: 320106 words processed Mon Nov 16 21:38:40 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.903267.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31148 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99837 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81722 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43881 clock time
[SCHEDULER ITER25 LR0.01679616]: 360024 words processed Mon Nov 16 21:38:55 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.901437.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18041 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96556 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75637 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42611 clock time
[SCHEDULER ITER25 LR0.01679616]: 400089 words processed Mon Nov 16 21:39:10 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.898384.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22891 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98562 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76707 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43703 clock time
[SCHEDULER ITER25 LR0.01679616]: 440067 words processed Mon Nov 16 21:39:25 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.898922.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17740 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96629 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75729 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42587 clock time
[SCHEDULER ITER25 LR0.01679616]: 480051 words processed Mon Nov 16 21:39:40 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.899016.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33944 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99705 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83188 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44089 clock time
[SCHEDULER ITER25 LR0.01679616]: 520140 words processed Mon Nov 16 21:39:55 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.898314.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35601 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01071 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83057 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44649 clock time
[SCHEDULER ITER25 LR0.01679616]: 560132 words processed Mon Nov 16 21:40:10 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.897483.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31315 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98899 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82788 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43626 clock time
[SCHEDULER ITER25 LR0.01679616]: 600118 words processed Mon Nov 16 21:40:25 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.895000.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20881 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97175 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77197 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42846 clock time
[SCHEDULER ITER25 LR0.01679616]: 640090 words processed Mon Nov 16 21:40:40 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.892683.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35071 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99863 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84076 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43990 clock time
[SCHEDULER ITER25 LR0.01679616]: 680075 words processed Mon Nov 16 21:40:55 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.891213.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28306 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98603 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81047 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43297 clock time
[SCHEDULER ITER25 LR0.01679616]: 720043 words processed Mon Nov 16 21:41:10 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.889857.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24383 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97628 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79443 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42965 clock time
[SCHEDULER ITER25 LR0.01679616]: 760012 words processed Mon Nov 16 21:41:25 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.887813.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23900 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97564 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79127 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42940 clock time
[SCHEDULER ITER25 LR0.01679616]: 800113 words processed Mon Nov 16 21:41:40 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.887451.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30064 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00949 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78820 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45058 clock time
[SCHEDULER ITER25 LR0.01679616]: 840089 words processed Mon Nov 16 21:41:55 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.886122.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29066 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00731 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78502 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44161 clock time
[SCHEDULER ITER25 LR0.01679616]: 880052 words processed Mon Nov 16 21:42:10 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-1.885470.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27025 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99326 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79034 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43514 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER25 LR0.01679616]: Displaying result:
[SCHEDULER ITER25 LR0.01679616]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 84.428540798804> <PPL_OOV 76.809572863182> <LOGP -1752661.3698032>
[SCHEDULER ITER25 LR0.01679616]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER25 LR0.01679616]: shuffling training file
===PEEK ON TEST 25===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER25 LR0.01679616]: 40087 words processed Mon Nov 16 21:42:22 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-2.108055.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.84361 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87344 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER25 LR0.01679616]: Displaying result:
[SCHEDULER ITER25 LR0.01679616]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 147.48955179622> <PPL_OOV 128.86335181656> <LOGP -173937.96837325>
[SCHEDULER ITER25 LR0.01679616]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 25===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER25 LR0.01679616]: 40095 words processed Mon Nov 16 21:42:36 2015.
	[SCHEDULER ITER25 LR0.01679616]: log prob per sample :-2.180677.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.73914 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80862 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER25 LR0.01679616]: Displaying result:
[SCHEDULER ITER25 LR0.01679616]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 150.77220031057> <PPL_OOV 134.99308858218> <LOGP -157131.77874203>
[SCHEDULER ITER25 LR0.01679616]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER25 LR0.01679616]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.25...

[SCHEDULER ITER26 LR0.010077696]: preparing parameters...
[SCHEDULER ITER26 LR0.010077696]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.25...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46027486
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46032336
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92321123
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92437338
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94327574
[SCHEDULER ITER26 LR0.010077696]: preparing parameters end.
[SCHEDULER ITER26 LR0.010077696]: preparing layers...
(21:42:47 2015-11-16)[nerv] info: create layer: recurrentL1
(21:42:47 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:42:47 2015-11-16)[nerv] info: create layer: combinerL1
(21:42:47 2015-11-16)[nerv] info: create layer: outputL
(21:42:47 2015-11-16)[nerv] info: create layer: softmaxL
(21:42:47 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER26 LR0.010077696]: preparing layers end.
[SCHEDULER ITER26 LR0.010077696]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER26 LR0.010077696]: Initing TNN end.
===ITERATION 26 LR 0.010078===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER26 LR0.010077696]: 40092 words processed Mon Nov 16 21:43:02 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.920393.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28153 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96072 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81616 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44630 clock time
[SCHEDULER ITER26 LR0.010077696]: 80099 words processed Mon Nov 16 21:43:17 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.916572.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19306 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93521 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78438 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42983 clock time
[SCHEDULER ITER26 LR0.010077696]: 120004 words processed Mon Nov 16 21:43:32 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.910485.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30470 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95864 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82799 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44355 clock time
[SCHEDULER ITER26 LR0.010077696]: 160114 words processed Mon Nov 16 21:43:47 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.911575.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30842 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96489 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83005 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44568 clock time
[SCHEDULER ITER26 LR0.010077696]: 200066 words processed Mon Nov 16 21:44:02 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.910704.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25513 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94238 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82516 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43332 clock time
[SCHEDULER ITER26 LR0.010077696]: 240045 words processed Mon Nov 16 21:44:17 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.906925.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18064 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93152 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77941 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43142 clock time
[SCHEDULER ITER26 LR0.010077696]: 280057 words processed Mon Nov 16 21:44:32 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.902777.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22353 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94530 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79585 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43698 clock time
[SCHEDULER ITER26 LR0.010077696]: 320106 words processed Mon Nov 16 21:44:47 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.900686.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20239 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94432 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78143 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43656 clock time
[SCHEDULER ITER26 LR0.010077696]: 360024 words processed Mon Nov 16 21:45:02 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.898858.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18606 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93249 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78490 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43095 clock time
[SCHEDULER ITER26 LR0.010077696]: 400089 words processed Mon Nov 16 21:45:17 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.895803.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21919 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94961 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78914 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43940 clock time
[SCHEDULER ITER26 LR0.010077696]: 440067 words processed Mon Nov 16 21:45:31 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.896372.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16197 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93134 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77086 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42857 clock time
[SCHEDULER ITER26 LR0.010077696]: 480051 words processed Mon Nov 16 21:45:45 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.896467.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16589 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93048 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77382 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42891 clock time
[SCHEDULER ITER26 LR0.010077696]: 520140 words processed Mon Nov 16 21:46:00 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.895771.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22682 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95144 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79498 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43805 clock time
[SCHEDULER ITER26 LR0.010077696]: 560132 words processed Mon Nov 16 21:46:15 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.894951.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20550 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93912 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78845 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43555 clock time
[SCHEDULER ITER26 LR0.010077696]: 600118 words processed Mon Nov 16 21:46:30 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.892485.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31142 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95919 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84282 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44207 clock time
[SCHEDULER ITER26 LR0.010077696]: 640090 words processed Mon Nov 16 21:46:45 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.890172.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24941 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94833 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80967 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43841 clock time
[SCHEDULER ITER26 LR0.010077696]: 680075 words processed Mon Nov 16 21:47:00 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.888707.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23265 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94233 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79921 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43991 clock time
[SCHEDULER ITER26 LR0.010077696]: 720043 words processed Mon Nov 16 21:47:15 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.887352.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17209 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93380 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76914 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43137 clock time
[SCHEDULER ITER26 LR0.010077696]: 760012 words processed Mon Nov 16 21:47:30 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.885304.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16540 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92808 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77617 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42964 clock time
[SCHEDULER ITER26 LR0.010077696]: 800113 words processed Mon Nov 16 21:47:45 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.884942.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27983 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96469 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81050 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44758 clock time
[SCHEDULER ITER26 LR0.010077696]: 840089 words processed Mon Nov 16 21:48:00 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.883602.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24576 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94721 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80543 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44016 clock time
[SCHEDULER ITER26 LR0.010077696]: 880052 words processed Mon Nov 16 21:48:15 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-1.882941.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21524 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94225 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78659 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43695 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER26 LR0.010077696]: Displaying result:
[SCHEDULER ITER26 LR0.010077696]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.927606218813> <PPL_OOV 76.363419682672> <LOGP -1750309.5269079>
[SCHEDULER ITER26 LR0.010077696]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER26 LR0.010077696]: shuffling training file
===PEEK ON TEST 26===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER26 LR0.010077696]: 40087 words processed Mon Nov 16 21:48:26 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-2.106879.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.69749 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77993 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER26 LR0.010077696]: Displaying result:
[SCHEDULER ITER26 LR0.010077696]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.9921749249> <PPL_OOV 128.49749497309> <LOGP -173836.18692982>
[SCHEDULER ITER26 LR0.010077696]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 26===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER26 LR0.010077696]: 40095 words processed Mon Nov 16 21:48:39 2015.
	[SCHEDULER ITER26 LR0.010077696]: log prob per sample :-2.179472.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.73884 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80380 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER26 LR0.010077696]: Displaying result:
[SCHEDULER ITER26 LR0.010077696]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 150.22176488574> <PPL_OOV 134.5693666043> <LOGP -157031.07232141>
[SCHEDULER ITER26 LR0.010077696]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER26 LR0.010077696]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.26...

[SCHEDULER ITER27 LR0.0060466176]: preparing parameters...
[SCHEDULER ITER27 LR0.0060466176]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.26...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1890181
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1895031
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48183648
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48299860
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94327301
[SCHEDULER ITER27 LR0.0060466176]: preparing parameters end.
[SCHEDULER ITER27 LR0.0060466176]: preparing layers...
(21:48:50 2015-11-16)[nerv] info: create layer: recurrentL1
(21:48:50 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:48:50 2015-11-16)[nerv] info: create layer: combinerL1
(21:48:50 2015-11-16)[nerv] info: create layer: outputL
(21:48:50 2015-11-16)[nerv] info: create layer: softmaxL
(21:48:50 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER27 LR0.0060466176]: preparing layers end.
[SCHEDULER ITER27 LR0.0060466176]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER27 LR0.0060466176]: Initing TNN end.
===ITERATION 27 LR 0.006047===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER27 LR0.0060466176]: 40092 words processed Mon Nov 16 21:49:05 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.918667.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29422 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00092 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78707 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44337 clock time
[SCHEDULER ITER27 LR0.0060466176]: 80099 words processed Mon Nov 16 21:49:20 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.914790.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35351 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99792 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83304 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44106 clock time
[SCHEDULER ITER27 LR0.0060466176]: 120004 words processed Mon Nov 16 21:49:35 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.908774.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23195 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97666 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77214 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43076 clock time
[SCHEDULER ITER27 LR0.0060466176]: 160114 words processed Mon Nov 16 21:49:50 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.909865.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.39998 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01865 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83745 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45010 clock time
[SCHEDULER ITER27 LR0.0060466176]: 200066 words processed Mon Nov 16 21:50:05 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.909025.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31667 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99391 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80850 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43958 clock time
[SCHEDULER ITER27 LR0.0060466176]: 240045 words processed Mon Nov 16 21:50:20 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.905239.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26999 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98911 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78049 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43980 clock time
[SCHEDULER ITER27 LR0.0060466176]: 280057 words processed Mon Nov 16 21:50:35 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.901119.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36454 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01645 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81049 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45290 clock time
[SCHEDULER ITER27 LR0.0060466176]: 320106 words processed Mon Nov 16 21:50:50 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.899053.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32652 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00931 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79700 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45002 clock time
[SCHEDULER ITER27 LR0.0060466176]: 360024 words processed Mon Nov 16 21:51:05 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.897228.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19376 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96873 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76098 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42723 clock time
[SCHEDULER ITER27 LR0.0060466176]: 400089 words processed Mon Nov 16 21:51:20 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.894165.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25800 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99187 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77881 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43971 clock time
[SCHEDULER ITER27 LR0.0060466176]: 440067 words processed Mon Nov 16 21:51:35 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.894754.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28452 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98619 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80073 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43625 clock time
[SCHEDULER ITER27 LR0.0060466176]: 480051 words processed Mon Nov 16 21:51:50 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.894850.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23347 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97912 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77243 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43373 clock time
[SCHEDULER ITER27 LR0.0060466176]: 520140 words processed Mon Nov 16 21:52:05 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.894156.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33581 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01141 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80417 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45120 clock time
[SCHEDULER ITER27 LR0.0060466176]: 560132 words processed Mon Nov 16 21:52:20 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.893343.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20813 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97371 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76401 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43140 clock time
[SCHEDULER ITER27 LR0.0060466176]: 600118 words processed Mon Nov 16 21:52:35 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.890889.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29087 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99380 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79704 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43893 clock time
[SCHEDULER ITER27 LR0.0060466176]: 640090 words processed Mon Nov 16 21:52:50 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.888577.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21954 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97326 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77919 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42738 clock time
[SCHEDULER ITER27 LR0.0060466176]: 680075 words processed Mon Nov 16 21:53:05 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.887115.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20186 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97038 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76083 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43493 clock time
[SCHEDULER ITER27 LR0.0060466176]: 720043 words processed Mon Nov 16 21:53:20 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.885766.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18237 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97200 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74578 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43147 clock time
[SCHEDULER ITER27 LR0.0060466176]: 760012 words processed Mon Nov 16 21:53:35 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.883712.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20059 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97405 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75778 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42910 clock time
[SCHEDULER ITER27 LR0.0060466176]: 800113 words processed Mon Nov 16 21:53:50 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.883352.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23181 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98830 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76422 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43700 clock time
[SCHEDULER ITER27 LR0.0060466176]: 840089 words processed Mon Nov 16 21:54:04 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.882003.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17650 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96847 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74779 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42717 clock time
[SCHEDULER ITER27 LR0.0060466176]: 880052 words processed Mon Nov 16 21:54:19 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-1.881337.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21879 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97505 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77039 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43100 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER27 LR0.0060466176]: Displaying result:
[SCHEDULER ITER27 LR0.0060466176]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.611310989666> <PPL_OOV 76.082052253075> <LOGP -1748819.2565264>
[SCHEDULER ITER27 LR0.0060466176]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER27 LR0.0060466176]: shuffling training file
===PEEK ON TEST 27===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER27 LR0.0060466176]: 40087 words processed Mon Nov 16 21:54:31 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-2.106093.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.75428 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81034 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER27 LR0.0060466176]: Displaying result:
[SCHEDULER ITER27 LR0.0060466176]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.66521733895> <PPL_OOV 128.2457381726> <LOGP -173765.97968168>
[SCHEDULER ITER27 LR0.0060466176]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 27===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER27 LR0.0060466176]: 40095 words processed Mon Nov 16 21:54:45 2015.
	[SCHEDULER ITER27 LR0.0060466176]: log prob per sample :-2.178726.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.70404 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78149 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER27 LR0.0060466176]: Displaying result:
[SCHEDULER ITER27 LR0.0060466176]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.878892758> <PPL_OOV 134.29600411411> <LOGP -156965.93357189>
[SCHEDULER ITER27 LR0.0060466176]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER27 LR0.0060466176]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.27...

[SCHEDULER ITER28 LR0.00362797056]: preparing parameters...
[SCHEDULER ITER28 LR0.00362797056]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.27...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46027363
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46032213
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92320760
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92436970
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94327115
[SCHEDULER ITER28 LR0.00362797056]: preparing parameters end.
[SCHEDULER ITER28 LR0.00362797056]: preparing layers...
(21:54:57 2015-11-16)[nerv] info: create layer: recurrentL1
(21:54:57 2015-11-16)[nerv] info: create layer: sigmoidL1
(21:54:57 2015-11-16)[nerv] info: create layer: combinerL1
(21:54:57 2015-11-16)[nerv] info: create layer: outputL
(21:54:57 2015-11-16)[nerv] info: create layer: softmaxL
(21:54:57 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER28 LR0.00362797056]: preparing layers end.
[SCHEDULER ITER28 LR0.00362797056]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER28 LR0.00362797056]: Initing TNN end.
===ITERATION 28 LR 0.003628===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER28 LR0.00362797056]: 40092 words processed Mon Nov 16 21:55:12 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.917576.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.37494 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98013 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85753 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45018 clock time
[SCHEDULER ITER28 LR0.00362797056]: 80099 words processed Mon Nov 16 21:55:27 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.913671.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31013 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95996 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82251 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44370 clock time
[SCHEDULER ITER28 LR0.00362797056]: 120004 words processed Mon Nov 16 21:55:42 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.907684.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34703 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96673 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84843 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44506 clock time
[SCHEDULER ITER28 LR0.00362797056]: 160114 words processed Mon Nov 16 21:55:57 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.908779.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33791 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97029 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84254 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44572 clock time
[SCHEDULER ITER28 LR0.00362797056]: 200066 words processed Mon Nov 16 21:56:12 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.907960.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17533 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92923 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77688 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42957 clock time
[SCHEDULER ITER28 LR0.00362797056]: 240045 words processed Mon Nov 16 21:56:26 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.904162.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15009 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92707 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76067 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42718 clock time
[SCHEDULER ITER28 LR0.00362797056]: 280057 words processed Mon Nov 16 21:56:41 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.900061.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20334 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94680 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77593 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43721 clock time
[SCHEDULER ITER28 LR0.00362797056]: 320106 words processed Mon Nov 16 21:56:56 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.898018.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19358 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94287 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77484 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43528 clock time
[SCHEDULER ITER28 LR0.00362797056]: 360024 words processed Mon Nov 16 21:57:11 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.896201.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22177 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93655 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78661 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44282 clock time
[SCHEDULER ITER28 LR0.00362797056]: 400089 words processed Mon Nov 16 21:57:26 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.893131.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27341 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96345 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80394 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44369 clock time
[SCHEDULER ITER28 LR0.00362797056]: 440067 words processed Mon Nov 16 21:57:41 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.893731.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15873 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92865 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76925 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42799 clock time
[SCHEDULER ITER28 LR0.00362797056]: 480051 words processed Mon Nov 16 21:57:55 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.893827.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.14938 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92560 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76483 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42915 clock time
[SCHEDULER ITER28 LR0.00362797056]: 520140 words processed Mon Nov 16 21:58:10 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.893133.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19809 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94384 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77838 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43647 clock time
[SCHEDULER ITER28 LR0.00362797056]: 560132 words processed Mon Nov 16 21:58:24 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.892323.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.14647 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92543 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76529 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42637 clock time
[SCHEDULER ITER28 LR0.00362797056]: 600118 words processed Mon Nov 16 21:58:39 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.889876.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24640 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94950 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80546 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43907 clock time
[SCHEDULER ITER28 LR0.00362797056]: 640090 words processed Mon Nov 16 21:58:54 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.887566.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24333 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95018 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80145 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43933 clock time
[SCHEDULER ITER28 LR0.00362797056]: 680075 words processed Mon Nov 16 21:59:09 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.886103.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22660 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93899 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80709 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43428 clock time
[SCHEDULER ITER28 LR0.00362797056]: 720043 words processed Mon Nov 16 21:59:24 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.884762.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20967 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93770 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79890 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42994 clock time
[SCHEDULER ITER28 LR0.00362797056]: 760012 words processed Mon Nov 16 21:59:39 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.882705.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34439 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96422 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85748 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44249 clock time
[SCHEDULER ITER28 LR0.00362797056]: 800113 words processed Mon Nov 16 21:59:54 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.882343.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31165 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96704 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83053 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44860 clock time
[SCHEDULER ITER28 LR0.00362797056]: 840089 words processed Mon Nov 16 22:00:09 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.880989.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29123 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95247 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84056 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43621 clock time
[SCHEDULER ITER28 LR0.00362797056]: 880052 words processed Mon Nov 16 22:00:24 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-1.880322.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29170 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95471 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83438 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43746 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER28 LR0.00362797056]: Displaying result:
[SCHEDULER ITER28 LR0.00362797056]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.411191347458> <PPL_OOV 75.904331078529> <LOGP -1747875.1087491>
[SCHEDULER ITER28 LR0.00362797056]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER28 LR0.00362797056]: shuffling training file
===PEEK ON TEST 28===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER28 LR0.00362797056]: 40087 words processed Mon Nov 16 22:00:36 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-2.105555.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.77824 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82478 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER28 LR0.00362797056]: Displaying result:
[SCHEDULER ITER28 LR0.00362797056]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.48378228665> <PPL_OOV 128.07182003966> <LOGP -173717.39871181>
[SCHEDULER ITER28 LR0.00362797056]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 28===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER28 LR0.00362797056]: 40095 words processed Mon Nov 16 22:00:49 2015.
	[SCHEDULER ITER28 LR0.00362797056]: log prob per sample :-2.178284.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.78609 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83157 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER28 LR0.00362797056]: Displaying result:
[SCHEDULER ITER28 LR0.00362797056]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.70634636213> <PPL_OOV 134.12966304144> <LOGP -156926.23172345>
[SCHEDULER ITER28 LR0.00362797056]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER28 LR0.00362797056]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.28...

[SCHEDULER ITER29 LR0.002176782336]: preparing parameters...
[SCHEDULER ITER29 LR0.002176782336]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.28...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1890155
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1895005
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48183478
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48299687
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94326991
[SCHEDULER ITER29 LR0.002176782336]: preparing parameters end.
[SCHEDULER ITER29 LR0.002176782336]: preparing layers...
(22:01:00 2015-11-16)[nerv] info: create layer: recurrentL1
(22:01:00 2015-11-16)[nerv] info: create layer: sigmoidL1
(22:01:00 2015-11-16)[nerv] info: create layer: combinerL1
(22:01:00 2015-11-16)[nerv] info: create layer: outputL
(22:01:00 2015-11-16)[nerv] info: create layer: softmaxL
(22:01:00 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER29 LR0.002176782336]: preparing layers end.
[SCHEDULER ITER29 LR0.002176782336]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER29 LR0.002176782336]: Initing TNN end.
===ITERATION 29 LR 0.002177===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER29 LR0.002176782336]: 40092 words processed Mon Nov 16 22:01:14 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.916882.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21352 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97794 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75575 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43721 clock time
[SCHEDULER ITER29 LR0.002176782336]: 80099 words processed Mon Nov 16 22:01:29 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.912963.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31080 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98620 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81424 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43868 clock time
[SCHEDULER ITER29 LR0.002176782336]: 120004 words processed Mon Nov 16 22:01:44 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.906983.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20362 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96404 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76834 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42775 clock time
[SCHEDULER ITER29 LR0.002176782336]: 160114 words processed Mon Nov 16 22:01:59 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.908085.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30572 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99605 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80354 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44404 clock time
[SCHEDULER ITER29 LR0.002176782336]: 200066 words processed Mon Nov 16 22:02:13 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.907277.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17040 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95668 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75424 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42687 clock time
[SCHEDULER ITER29 LR0.002176782336]: 240045 words processed Mon Nov 16 22:02:28 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.903480.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19665 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96169 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76820 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42899 clock time
[SCHEDULER ITER29 LR0.002176782336]: 280057 words processed Mon Nov 16 22:02:43 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.899390.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35797 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00178 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83534 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44724 clock time
[SCHEDULER ITER29 LR0.002176782336]: 320106 words processed Mon Nov 16 22:02:58 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.897358.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.37460 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00756 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83764 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45078 clock time
[SCHEDULER ITER29 LR0.002176782336]: 360024 words processed Mon Nov 16 22:03:12 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.895550.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16885 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95677 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75628 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42850 clock time
[SCHEDULER ITER29 LR0.002176782336]: 400089 words processed Mon Nov 16 22:03:27 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.892479.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26094 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98884 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77536 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44776 clock time
[SCHEDULER ITER29 LR0.002176782336]: 440067 words processed Mon Nov 16 22:03:41 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.893085.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16530 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95764 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75238 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42697 clock time
[SCHEDULER ITER29 LR0.002176782336]: 480051 words processed Mon Nov 16 22:03:55 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.893185.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16141 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95691 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75050 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42806 clock time
[SCHEDULER ITER29 LR0.002176782336]: 520140 words processed Mon Nov 16 22:04:10 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.892489.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21031 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97574 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76257 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43645 clock time
[SCHEDULER ITER29 LR0.002176782336]: 560132 words processed Mon Nov 16 22:04:24 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.891675.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.15918 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95901 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.74692 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42864 clock time
[SCHEDULER ITER29 LR0.002176782336]: 600118 words processed Mon Nov 16 22:04:38 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.889232.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16672 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95919 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.75390 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42737 clock time
[SCHEDULER ITER29 LR0.002176782336]: 640090 words processed Mon Nov 16 22:04:53 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.886925.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19147 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96142 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76958 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42897 clock time
[SCHEDULER ITER29 LR0.002176782336]: 680075 words processed Mon Nov 16 22:05:08 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.885457.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23279 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96863 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79242 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43133 clock time
[SCHEDULER ITER29 LR0.002176782336]: 720043 words processed Mon Nov 16 22:05:23 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.884124.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23083 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96896 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79257 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42977 clock time
[SCHEDULER ITER29 LR0.002176782336]: 760012 words processed Mon Nov 16 22:05:38 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.882065.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32647 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99360 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81520 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44613 clock time
[SCHEDULER ITER29 LR0.002176782336]: 800113 words processed Mon Nov 16 22:05:53 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.881700.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31276 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00368 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79691 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44927 clock time
[SCHEDULER ITER29 LR0.002176782336]: 840089 words processed Mon Nov 16 22:06:08 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.880344.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30257 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99428 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79632 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44632 clock time
[SCHEDULER ITER29 LR0.002176782336]: 880052 words processed Mon Nov 16 22:06:23 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-1.879675.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28460 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98816 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79735 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44172 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER29 LR0.002176782336]: Displaying result:
[SCHEDULER ITER29 LR0.002176782336]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.283901114873> <PPL_OOV 75.791502900064> <LOGP -1747274.5585906>
[SCHEDULER ITER29 LR0.002176782336]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER29 LR0.002176782336]: shuffling training file
===PEEK ON TEST 29===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER29 LR0.002176782336]: 40087 words processed Mon Nov 16 22:06:34 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-2.105165.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.68228 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76352 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER29 LR0.002176782336]: Displaying result:
[SCHEDULER ITER29 LR0.002176782336]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.37737062437> <PPL_OOV 127.94693234979> <LOGP -173682.47282062>
[SCHEDULER ITER29 LR0.002176782336]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 29===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER29 LR0.002176782336]: 40095 words processed Mon Nov 16 22:06:48 2015.
	[SCHEDULER ITER29 LR0.002176782336]: log prob per sample :-2.178008.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.82802 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86294 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER29 LR0.002176782336]: Displaying result:
[SCHEDULER ITER29 LR0.002176782336]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.61642875592> <PPL_OOV 134.02237108393> <LOGP -156900.59743237>
[SCHEDULER ITER29 LR0.002176782336]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER29 LR0.002176782336]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.29...

[SCHEDULER ITER30 LR0.0013060694016]: preparing parameters...
[SCHEDULER ITER30 LR0.0013060694016]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.29...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46027283
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46032133
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92320596
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92436806
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94326944
[SCHEDULER ITER30 LR0.0013060694016]: preparing parameters end.
[SCHEDULER ITER30 LR0.0013060694016]: preparing layers...
(22:07:00 2015-11-16)[nerv] info: create layer: recurrentL1
(22:07:00 2015-11-16)[nerv] info: create layer: sigmoidL1
(22:07:00 2015-11-16)[nerv] info: create layer: combinerL1
(22:07:00 2015-11-16)[nerv] info: create layer: outputL
(22:07:00 2015-11-16)[nerv] info: create layer: softmaxL
(22:07:00 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER30 LR0.0013060694016]: preparing layers end.
[SCHEDULER ITER30 LR0.0013060694016]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER30 LR0.0013060694016]: Initing TNN end.
===ITERATION 30 LR 0.001306===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER30 LR0.0013060694016]: 40092 words processed Mon Nov 16 22:07:15 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.916462.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34544 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96984 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86168 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44426 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 80099 words processed Mon Nov 16 22:07:30 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.912531.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27213 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94216 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84102 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43109 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 120004 words processed Mon Nov 16 22:07:45 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.906550.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23417 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93593 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81632 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43257 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 160114 words processed Mon Nov 16 22:08:00 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.907654.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22314 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94462 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79974 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43743 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 200066 words processed Mon Nov 16 22:08:15 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.906847.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25451 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94013 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83491 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43064 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 240045 words processed Mon Nov 16 22:08:30 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.903052.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20747 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93575 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79404 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43532 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 280057 words processed Mon Nov 16 22:08:45 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.898971.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27105 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95182 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82865 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43897 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 320106 words processed Mon Nov 16 22:09:00 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.896943.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34224 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96947 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85967 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44502 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 360024 words processed Mon Nov 16 22:09:15 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.895141.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33006 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95999 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85005 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44759 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 400089 words processed Mon Nov 16 22:09:30 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.892069.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30006 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96226 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84317 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44114 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 440067 words processed Mon Nov 16 22:09:45 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.892680.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19921 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93372 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79921 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43055 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 480051 words processed Mon Nov 16 22:10:00 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.892783.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21803 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94176 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80586 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43038 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 520140 words processed Mon Nov 16 22:10:15 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.892086.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.40756 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98216 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.89247 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45274 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 560132 words processed Mon Nov 16 22:10:30 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.891271.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36687 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96626 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.88119 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44352 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 600118 words processed Mon Nov 16 22:10:45 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.888832.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27742 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94694 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84809 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43235 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 640090 words processed Mon Nov 16 22:11:00 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.886525.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21550 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93323 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81656 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42993 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 680075 words processed Mon Nov 16 22:11:15 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.885052.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23887 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94026 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82176 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43158 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 720043 words processed Mon Nov 16 22:11:30 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.883724.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20587 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93406 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80840 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42978 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 760012 words processed Mon Nov 16 22:11:45 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.881662.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22949 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93788 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82359 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42909 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 800113 words processed Mon Nov 16 22:12:00 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.881296.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27679 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95527 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82797 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44197 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 840089 words processed Mon Nov 16 22:12:15 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.879938.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19541 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93559 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79710 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42903 clock time
[SCHEDULER ITER30 LR0.0013060694016]: 880052 words processed Mon Nov 16 22:12:30 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-1.879269.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24382 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94244 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82279 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43304 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER30 LR0.0013060694016]: Displaying result:
[SCHEDULER ITER30 LR0.0013060694016]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.204123746308> <PPL_OOV 75.72049201999> <LOGP -1746896.1306508>
[SCHEDULER ITER30 LR0.0013060694016]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER30 LR0.0013060694016]: shuffling training file
===PEEK ON TEST 30===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER30 LR0.0013060694016]: 40087 words processed Mon Nov 16 22:12:41 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-2.104864.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.77509 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83242 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER30 LR0.0013060694016]: Displaying result:
[SCHEDULER ITER30 LR0.0013060694016]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.28149529838> <PPL_OOV 127.85129289029> <LOGP -173655.70338512>
[SCHEDULER ITER30 LR0.0013060694016]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 30===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER30 LR0.0013060694016]: 40095 words processed Mon Nov 16 22:12:54 2015.
	[SCHEDULER ITER30 LR0.0013060694016]: log prob per sample :-2.177800.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.74251 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81400 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER30 LR0.0013060694016]: Displaying result:
[SCHEDULER ITER30 LR0.0013060694016]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.53856157397> <PPL_OOV 133.94261488579> <LOGP -156881.52870888>
[SCHEDULER ITER30 LR0.0013060694016]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER30 LR0.0013060694016]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.30...

[SCHEDULER ITER31 LR0.00078364164096]: preparing parameters...
[SCHEDULER ITER31 LR0.00078364164096]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.30...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1890138
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1894988
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48183411
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48299621
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94326897
[SCHEDULER ITER31 LR0.00078364164096]: preparing parameters end.
[SCHEDULER ITER31 LR0.00078364164096]: preparing layers...
(22:13:05 2015-11-16)[nerv] info: create layer: recurrentL1
(22:13:05 2015-11-16)[nerv] info: create layer: sigmoidL1
(22:13:05 2015-11-16)[nerv] info: create layer: combinerL1
(22:13:05 2015-11-16)[nerv] info: create layer: outputL
(22:13:05 2015-11-16)[nerv] info: create layer: softmaxL
(22:13:05 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER31 LR0.00078364164096]: preparing layers end.
[SCHEDULER ITER31 LR0.00078364164096]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER31 LR0.00078364164096]: Initing TNN end.
===ITERATION 31 LR 0.000784===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER31 LR0.00078364164096]: 40092 words processed Mon Nov 16 22:13:20 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.916210.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.40506 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01801 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85923 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45082 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 80099 words processed Mon Nov 16 22:13:35 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.912266.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28071 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98005 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80760 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43510 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 120004 words processed Mon Nov 16 22:13:50 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.906285.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25788 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97473 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79618 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43233 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 160114 words processed Mon Nov 16 22:14:05 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.907390.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26915 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98494 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79994 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43797 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 200066 words processed Mon Nov 16 22:14:20 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.906581.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.19876 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96263 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77290 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42787 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 240045 words processed Mon Nov 16 22:14:35 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.902782.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20136 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96436 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77429 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42846 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 280057 words processed Mon Nov 16 22:14:50 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.898708.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.40144 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01699 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84361 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45199 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 320106 words processed Mon Nov 16 22:15:05 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.896684.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29865 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99708 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80316 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44505 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 360024 words processed Mon Nov 16 22:15:20 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.894884.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33351 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99734 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82273 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44557 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 400089 words processed Mon Nov 16 22:15:35 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.891812.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38013 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01644 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82973 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45382 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 440067 words processed Mon Nov 16 22:15:50 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.892423.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33348 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99718 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82221 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44417 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 480051 words processed Mon Nov 16 22:16:05 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.892530.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27665 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98281 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80641 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43546 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 520140 words processed Mon Nov 16 22:16:20 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.891831.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29448 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99765 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80550 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44067 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 560132 words processed Mon Nov 16 22:16:35 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.891016.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33687 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99367 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84515 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43717 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 600118 words processed Mon Nov 16 22:16:50 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.888579.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29289 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98187 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82346 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43299 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 640090 words processed Mon Nov 16 22:17:05 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.886273.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35123 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99584 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85155 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43911 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 680075 words processed Mon Nov 16 22:17:20 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.884796.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33479 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99230 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84343 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43837 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 720043 words processed Mon Nov 16 22:17:35 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.883469.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38145 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00395 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85538 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44442 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 760012 words processed Mon Nov 16 22:17:50 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.881407.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34510 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00165 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82612 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44485 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 800113 words processed Mon Nov 16 22:18:05 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.881039.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32317 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99593 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82885 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44008 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 840089 words processed Mon Nov 16 22:18:20 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.879681.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34847 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.00002 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83212 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44547 clock time
[SCHEDULER ITER31 LR0.00078364164096]: 880052 words processed Mon Nov 16 22:18:35 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-1.879010.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33226 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.99649 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82293 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44610 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER31 LR0.00078364164096]: Displaying result:
[SCHEDULER ITER31 LR0.00078364164096]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.153548020008> <PPL_OOV 75.6753877988> <LOGP -1746655.5789522>
[SCHEDULER ITER31 LR0.00078364164096]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER31 LR0.00078364164096]: shuffling training file
===PEEK ON TEST 31===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER31 LR0.00078364164096]: 40087 words processed Mon Nov 16 22:18:47 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-2.104630.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.81431 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85736 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER31 LR0.00078364164096]: Displaying result:
[SCHEDULER ITER31 LR0.00078364164096]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.19240725317> <PPL_OOV 127.77935275787> <LOGP -173635.55417925>
[SCHEDULER ITER31 LR0.00078364164096]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 31===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER31 LR0.00078364164096]: 40095 words processed Mon Nov 16 22:19:01 2015.
	[SCHEDULER ITER31 LR0.00078364164096]: log prob per sample :-2.177652.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.83611 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87156 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER31 LR0.00078364164096]: Displaying result:
[SCHEDULER ITER31 LR0.00078364164096]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.46985212575> <PPL_OOV 133.88550747495> <LOGP -156867.86805413>
[SCHEDULER ITER31 LR0.00078364164096]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER31 LR0.00078364164096]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.31...

[SCHEDULER ITER32 LR0.000470184984576]: preparing parameters...
[SCHEDULER ITER32 LR0.000470184984576]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.31...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46027284
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46032134
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92320569
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92436778
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94326910
[SCHEDULER ITER32 LR0.000470184984576]: preparing parameters end.
[SCHEDULER ITER32 LR0.000470184984576]: preparing layers...
(22:19:12 2015-11-16)[nerv] info: create layer: recurrentL1
(22:19:12 2015-11-16)[nerv] info: create layer: sigmoidL1
(22:19:12 2015-11-16)[nerv] info: create layer: combinerL1
(22:19:12 2015-11-16)[nerv] info: create layer: outputL
(22:19:12 2015-11-16)[nerv] info: create layer: softmaxL
(22:19:12 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER32 LR0.000470184984576]: preparing layers end.
[SCHEDULER ITER32 LR0.000470184984576]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER32 LR0.000470184984576]: Initing TNN end.
===ITERATION 32 LR 0.000470===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER32 LR0.000470184984576]: 40092 words processed Mon Nov 16 22:19:26 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.916048.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26171 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95883 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80566 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44503 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 80099 words processed Mon Nov 16 22:19:41 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.912091.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25652 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94291 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82405 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43543 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 120004 words processed Mon Nov 16 22:19:56 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.906112.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23081 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93504 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81599 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43010 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 160114 words processed Mon Nov 16 22:20:11 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.907220.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34214 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96863 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85944 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44583 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 200066 words processed Mon Nov 16 22:20:25 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.906412.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.16548 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92498 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77632 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42840 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 240045 words processed Mon Nov 16 22:20:40 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.902609.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23239 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93688 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81926 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43210 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 280057 words processed Mon Nov 16 22:20:55 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.898541.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36319 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97568 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86179 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44741 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 320106 words processed Mon Nov 16 22:21:10 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.896520.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.39319 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98049 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87338 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45371 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 360024 words processed Mon Nov 16 22:21:25 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.894722.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29980 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95150 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84758 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43743 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 400089 words processed Mon Nov 16 22:21:40 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.891648.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.39247 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97758 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.88607 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45068 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 440067 words processed Mon Nov 16 22:21:55 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.892260.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38344 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96975 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.88268 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44904 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 480051 words processed Mon Nov 16 22:22:10 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.892369.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33034 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95767 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86209 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44241 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 520140 words processed Mon Nov 16 22:22:25 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.891668.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36735 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97720 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86818 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45053 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 560132 words processed Mon Nov 16 22:22:40 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.890854.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35055 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96264 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87301 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44420 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 600118 words processed Mon Nov 16 22:22:55 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.888417.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23806 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94077 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82419 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43074 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 640090 words processed Mon Nov 16 22:23:10 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.886112.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31034 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95704 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84121 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44555 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 680075 words processed Mon Nov 16 22:23:25 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.884632.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24948 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94052 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81975 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43799 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 720043 words processed Mon Nov 16 22:23:39 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.883305.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.17391 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.92658 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78791 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43073 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 760012 words processed Mon Nov 16 22:23:54 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.881243.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27463 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94608 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83725 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43739 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 800113 words processed Mon Nov 16 22:24:09 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.880875.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30047 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96044 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84378 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44122 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 840089 words processed Mon Nov 16 22:24:24 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.879517.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.23193 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93924 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81849 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43294 clock time
[SCHEDULER ITER32 LR0.000470184984576]: 880052 words processed Mon Nov 16 22:24:39 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-1.878846.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36561 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96971 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.87415 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44640 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER32 LR0.000470184984576]: Displaying result:
[SCHEDULER ITER32 LR0.000470184984576]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.120575096429> <PPL_OOV 75.646683025421> <LOGP -1746502.4147988>
[SCHEDULER ITER32 LR0.000470184984576]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER32 LR0.000470184984576]: shuffling training file
===PEEK ON TEST 32===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER32 LR0.000470184984576]: 40087 words processed Mon Nov 16 22:24:51 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-2.104462.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.86504 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.89189 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER32 LR0.000470184984576]: Displaying result:
[SCHEDULER ITER32 LR0.000470184984576]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.13419513463> <PPL_OOV 127.72879043581> <LOGP -173621.38574441>
[SCHEDULER ITER32 LR0.000470184984576]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 32===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER32 LR0.000470184984576]: 40095 words processed Mon Nov 16 22:25:05 2015.
	[SCHEDULER ITER32 LR0.000470184984576]: log prob per sample :-2.177560.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.81832 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86510 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER32 LR0.000470184984576]: Displaying result:
[SCHEDULER ITER32 LR0.000470184984576]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.43029704938> <PPL_OOV 133.84950308333> <LOGP -156859.25245411>
[SCHEDULER ITER32 LR0.000470184984576]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER32 LR0.000470184984576]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.32...

[SCHEDULER ITER33 LR0.0002821109907456]: preparing parameters...
[SCHEDULER ITER33 LR0.0002821109907456]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.32...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1890129
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1894979
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48183403
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48299612
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94326883
[SCHEDULER ITER33 LR0.0002821109907456]: preparing parameters end.
[SCHEDULER ITER33 LR0.0002821109907456]: preparing layers...
(22:25:17 2015-11-16)[nerv] info: create layer: recurrentL1
(22:25:17 2015-11-16)[nerv] info: create layer: sigmoidL1
(22:25:17 2015-11-16)[nerv] info: create layer: combinerL1
(22:25:17 2015-11-16)[nerv] info: create layer: outputL
(22:25:17 2015-11-16)[nerv] info: create layer: softmaxL
(22:25:17 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER33 LR0.0002821109907456]: preparing layers end.
[SCHEDULER ITER33 LR0.0002821109907456]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER33 LR0.0002821109907456]: Initing TNN end.
===ITERATION 33 LR 0.000282===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER33 LR0.0002821109907456]: 40092 words processed Mon Nov 16 22:25:32 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.915948.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.37873 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.05257 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80758 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44690 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 80099 words processed Mon Nov 16 22:25:47 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.911974.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30407 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02275 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79752 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42885 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 120004 words processed Mon Nov 16 22:26:02 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.905997.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36776 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03898 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81471 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44061 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 160114 words processed Mon Nov 16 22:26:17 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.907108.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38599 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.05030 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82585 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43966 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 200066 words processed Mon Nov 16 22:26:32 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.906303.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38039 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04046 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82876 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43840 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 240045 words processed Mon Nov 16 22:26:47 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.902497.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30417 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02875 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78821 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43547 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 280057 words processed Mon Nov 16 22:27:02 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.898435.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32106 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03941 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78453 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43937 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 320106 words processed Mon Nov 16 22:27:17 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.896415.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.41842 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.06297 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82368 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45179 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 360024 words processed Mon Nov 16 22:27:32 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.894619.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30476 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02500 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79460 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43229 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 400089 words processed Mon Nov 16 22:27:47 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.891544.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32098 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03828 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79381 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43872 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 440067 words processed Mon Nov 16 22:28:02 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.892156.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33244 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03205 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80692 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43591 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 480051 words processed Mon Nov 16 22:28:17 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.892267.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30932 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03028 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79401 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43615 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 520140 words processed Mon Nov 16 22:28:32 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.891565.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32332 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03982 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79328 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43977 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 560132 words processed Mon Nov 16 22:28:47 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.890751.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.37965 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04381 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82266 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44419 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 600118 words processed Mon Nov 16 22:29:02 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.888314.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27468 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02018 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78183 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43007 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 640090 words processed Mon Nov 16 22:29:17 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.886009.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28080 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02242 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78578 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42957 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 680075 words processed Mon Nov 16 22:29:32 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.884528.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38817 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04515 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83239 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43952 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 720043 words processed Mon Nov 16 22:29:47 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.883201.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31120 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02977 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79603 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43441 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 760012 words processed Mon Nov 16 22:30:02 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.881140.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.40845 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04757 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85140 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44013 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 800113 words processed Mon Nov 16 22:30:17 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.880772.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.43033 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.06615 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83252 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45343 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 840089 words processed Mon Nov 16 22:30:32 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.879414.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38990 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04882 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81922 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44482 clock time
[SCHEDULER ITER33 LR0.0002821109907456]: 880052 words processed Mon Nov 16 22:30:47 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-1.878742.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33591 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03636 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79804 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43945 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER33 LR0.0002821109907456]: Displaying result:
[SCHEDULER ITER33 LR0.0002821109907456]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.098446122277> <PPL_OOV 75.628616853786> <LOGP -1746405.9867466>
[SCHEDULER ITER33 LR0.0002821109907456]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER33 LR0.0002821109907456]: shuffling training file
===PEEK ON TEST 33===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER33 LR0.0002821109907456]: 40087 words processed Mon Nov 16 22:30:59 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-2.104346.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.77699 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83693 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER33 LR0.0002821109907456]: Displaying result:
[SCHEDULER ITER33 LR0.0002821109907456]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.11020664253> <PPL_OOV 127.69438835985> <LOGP -173611.74248268>
[SCHEDULER ITER33 LR0.0002821109907456]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 33===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER33 LR0.0002821109907456]: 40095 words processed Mon Nov 16 22:31:12 2015.
	[SCHEDULER ITER33 LR0.0002821109907456]: log prob per sample :-2.177502.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.69313 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77424 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER33 LR0.0002821109907456]: Displaying result:
[SCHEDULER ITER33 LR0.0002821109907456]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.42017349093> <PPL_OOV 133.82837137992> <LOGP -156854.1947054>
[SCHEDULER ITER33 LR0.0002821109907456]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER33 LR0.0002821109907456]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.33...

[SCHEDULER ITER34 LR0.00016926659444736]: preparing parameters...
[SCHEDULER ITER34 LR0.00016926659444736]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.33...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46027263
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46032113
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92320528
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92436737
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94326866
[SCHEDULER ITER34 LR0.00016926659444736]: preparing parameters end.
[SCHEDULER ITER34 LR0.00016926659444736]: preparing layers...
(22:31:23 2015-11-16)[nerv] info: create layer: recurrentL1
(22:31:23 2015-11-16)[nerv] info: create layer: sigmoidL1
(22:31:23 2015-11-16)[nerv] info: create layer: combinerL1
(22:31:23 2015-11-16)[nerv] info: create layer: outputL
(22:31:23 2015-11-16)[nerv] info: create layer: softmaxL
(22:31:23 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER34 LR0.00016926659444736]: preparing layers end.
[SCHEDULER ITER34 LR0.00016926659444736]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER34 LR0.00016926659444736]: Initing TNN end.
===ITERATION 34 LR 0.000169===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER34 LR0.00016926659444736]: 40092 words processed Mon Nov 16 22:31:38 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.915888.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.31501 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96571 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83968 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44268 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 80099 words processed Mon Nov 16 22:31:53 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.911900.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20880 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93825 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79305 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43009 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 120004 words processed Mon Nov 16 22:32:08 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.905924.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22612 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93986 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79659 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43551 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 160114 words processed Mon Nov 16 22:32:23 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.907036.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36022 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.97928 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84043 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45583 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 200066 words processed Mon Nov 16 22:32:38 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.906236.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.35291 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96520 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.86192 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44393 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 240045 words processed Mon Nov 16 22:32:53 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.902428.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25233 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94695 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80849 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43660 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 280057 words processed Mon Nov 16 22:33:08 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.898370.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.25398 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95385 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80628 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44084 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 320106 words processed Mon Nov 16 22:33:23 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.896351.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24582 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95318 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80501 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43923 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 360024 words processed Mon Nov 16 22:33:38 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.894555.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.28258 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95523 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82277 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44227 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 400089 words processed Mon Nov 16 22:33:53 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.891480.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36689 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.98049 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84764 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45670 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 440067 words processed Mon Nov 16 22:34:08 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.892093.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26349 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94672 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83279 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43581 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 480051 words processed Mon Nov 16 22:34:23 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.892205.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32187 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.95803 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85425 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44249 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 520140 words processed Mon Nov 16 22:34:38 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.891502.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21497 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94684 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79061 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43922 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 560132 words processed Mon Nov 16 22:34:53 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.890689.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20648 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93731 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79647 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43295 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 600118 words processed Mon Nov 16 22:35:08 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.888252.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32881 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96399 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85276 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44176 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 640090 words processed Mon Nov 16 22:35:23 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.885947.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.22332 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93926 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80819 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43313 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 680075 words processed Mon Nov 16 22:35:38 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.884465.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.20387 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93689 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79714 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43075 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 720043 words processed Mon Nov 16 22:35:53 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.883138.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18220 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93174 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78885 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42894 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 760012 words processed Mon Nov 16 22:36:08 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.881077.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18784 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93433 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78833 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43050 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 800113 words processed Mon Nov 16 22:36:23 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.880709.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30512 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.96310 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83496 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44920 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 840089 words processed Mon Nov 16 22:36:38 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.879351.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.21311 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.94756 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79267 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42964 clock time
[SCHEDULER ITER34 LR0.00016926659444736]: 880052 words processed Mon Nov 16 22:36:53 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-1.878679.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.18584 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:4.93586 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78086 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43228 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER34 LR0.00016926659444736]: Displaying result:
[SCHEDULER ITER34 LR0.00016926659444736]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.084734172296> <PPL_OOV 75.617639172754> <LOGP -1746347.382207>
[SCHEDULER ITER34 LR0.00016926659444736]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER34 LR0.00016926659444736]: shuffling training file
===PEEK ON TEST 34===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER34 LR0.00016926659444736]: 40087 words processed Mon Nov 16 22:37:05 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-2.104262.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.87126 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.89181 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER34 LR0.00016926659444736]: Displaying result:
[SCHEDULER ITER34 LR0.00016926659444736]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.10281367216> <PPL_OOV 127.66974230171> <LOGP -173604.83233734>
[SCHEDULER ITER34 LR0.00016926659444736]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 34===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER34 LR0.00016926659444736]: 40095 words processed Mon Nov 16 22:37:19 2015.
	[SCHEDULER ITER34 LR0.00016926659444736]: log prob per sample :-2.177462.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.72227 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79652 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER34 LR0.00016926659444736]: Displaying result:
[SCHEDULER ITER34 LR0.00016926659444736]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.42345695287> <PPL_OOV 133.81556769051> <LOGP -156851.12982923>
[SCHEDULER ITER34 LR0.00016926659444736]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER34 LR0.00016926659444736]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.34...

[SCHEDULER ITER35 LR0.00010155995666842]: preparing parameters...
[SCHEDULER ITER35 LR0.00010155995666842]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.34...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 1 from 1890128
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 1894978
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 48183383
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 48299592
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 5 from 94326857
[SCHEDULER ITER35 LR0.00010155995666842]: preparing parameters end.
[SCHEDULER ITER35 LR0.00010155995666842]: preparing layers...
(22:37:31 2015-11-16)[nerv] info: create layer: recurrentL1
(22:37:31 2015-11-16)[nerv] info: create layer: sigmoidL1
(22:37:31 2015-11-16)[nerv] info: create layer: combinerL1
(22:37:31 2015-11-16)[nerv] info: create layer: outputL
(22:37:31 2015-11-16)[nerv] info: create layer: softmaxL
(22:37:31 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER ITER35 LR0.00010155995666842]: preparing layers end.
[SCHEDULER ITER35 LR0.00010155995666842]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER ITER35 LR0.00010155995666842]: Initing TNN end.
===ITERATION 35 LR 0.000102===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf...
batch_size:	10	chunk_size	15
[SCHEDULER ITER35 LR0.00010155995666842]: 40092 words processed Mon Nov 16 22:37:45 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.915850.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33207 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04389 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78303 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44128 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 80099 words processed Mon Nov 16 22:38:00 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.911855.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33355 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02912 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80455 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43041 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 120004 words processed Mon Nov 16 22:38:15 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.905880.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30232 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02599 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78229 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43275 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 160114 words processed Mon Nov 16 22:38:30 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.906992.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38664 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.05347 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80821 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44600 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 200066 words processed Mon Nov 16 22:38:45 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.906196.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.38234 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04419 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.81367 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44010 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 240045 words processed Mon Nov 16 22:39:00 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.902388.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26780 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02234 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76412 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43073 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 280057 words processed Mon Nov 16 22:39:15 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.898334.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36686 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04969 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79937 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44360 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 320106 words processed Mon Nov 16 22:39:30 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.896314.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.42629 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.06315 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82181 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.45150 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 360024 words processed Mon Nov 16 22:39:45 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.894518.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34636 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03667 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80494 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43541 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 400089 words processed Mon Nov 16 22:40:00 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.891443.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.44342 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.06249 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84518 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44768 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 440067 words processed Mon Nov 16 22:40:15 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.892056.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.29859 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02699 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78824 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43088 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 480051 words processed Mon Nov 16 22:40:30 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.892169.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.24346 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.01535 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76011 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42743 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 520140 words processed Mon Nov 16 22:40:45 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.891466.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.42121 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.05888 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.83472 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44584 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 560132 words processed Mon Nov 16 22:41:00 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.890653.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.30812 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03046 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.78805 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43131 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 600118 words processed Mon Nov 16 22:41:15 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.888215.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26956 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02105 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77205 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42864 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 640090 words processed Mon Nov 16 22:41:30 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.885910.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.26360 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02018 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.76931 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42902 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 680075 words processed Mon Nov 16 22:41:45 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.884429.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.36289 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04015 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.82012 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43538 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 720043 words processed Mon Nov 16 22:42:00 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.883100.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.32433 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03437 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79409 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43365 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 760012 words processed Mon Nov 16 22:42:15 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.881041.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.27074 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.02328 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77017 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.42960 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 800113 words processed Mon Nov 16 22:42:30 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.880673.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.34223 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.04314 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.79919 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43864 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 840089 words processed Mon Nov 16 22:42:45 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.879315.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.33968 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.03254 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80739 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.43238 clock time
[SCHEDULER ITER35 LR0.00010155995666842]: 880052 words processed Mon Nov 16 22:43:00 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-1.878643.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:13.46555 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_update:5.06507 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.85735 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_backpropagate:2.44679 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER35 LR0.00010155995666842]: Displaying result:
[SCHEDULER ITER35 LR0.00010155995666842]: LMResult status of rnn: <SEN_CN 42068> <W_CN 887521> <PPL_NET 83.07766142557> <PPL_OOV 75.611283415282> <LOGP -1746313.4479971>
[SCHEDULER ITER35 LR0.00010155995666842]: Doing on /home/slhome/txh18/workspace/nerv/play/dagL_test/train_fn_shuf end.
[SCHEDULER ITER35 LR0.00010155995666842]: shuffling training file
===PEEK ON TEST 35===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER35 LR0.00010155995666842]: 40087 words processed Mon Nov 16 22:43:12 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-2.104206.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.74793 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.80520 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER35 LR0.00010155995666842]: Displaying result:
[SCHEDULER ITER35 LR0.00010155995666842]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.09855796542> <PPL_OOV 127.65294525175> <LOGP -173600.12209541>
[SCHEDULER ITER35 LR0.00010155995666842]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.
===VALIDATION 35===
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER ITER35 LR0.00010155995666842]: 40095 words processed Mon Nov 16 22:43:25 2015.
	[SCHEDULER ITER35 LR0.00010155995666842]: log prob per sample :-2.177435.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.70810 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.77909 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER ITER35 LR0.00010155995666842]: Displaying result:
[SCHEDULER ITER35 LR0.00010155995666842]: LMResult status of rnn: <SEN_CN 3370> <W_CN 70390> <PPL_NET 149.42787770488> <PPL_OOV 133.80838513334> <LOGP -156849.41038012>
[SCHEDULER ITER35 LR0.00010155995666842]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.valid.txt.adds end.
[SCHEDULER ITER35 LR0.00010155995666842]: PPL improves, saving net to file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.35...

===VALIDATION PPL record===
<ITER3 LR1.00000 train:219.110 valid:237.806 test:229.721> 
<ITER4 LR1.00000 train:213.497 valid:210.507 test:200.650> 
<ITER5 LR1.00000 train:187.191 valid:194.771 test:185.904> 
<ITER6 LR1.00000 train:172.331 valid:185.758 test:177.039> 
<ITER7 LR1.00000 train:161.726 valid:180.163 test:171.158> 
<ITER8 LR1.00000 train:153.561 valid:176.548 test:167.447> 
<ITER9 LR1.00000 train:145.389 valid:173.264 test:164.459> 
<ITER10 LR1.00000 train:139.377 valid:169.832 test:161.063> 
<ITER11 LR1.00000 train:133.680 valid:167.319 test:158.997> 
<ITER12 LR1.00000 train:129.283 valid:167.442 test:158.810> 
<ITER13 LR1.00000 train:129.281 valid:167.222 test:158.683> 
<ITER14 LR1.00000 train:125.548 valid:166.375 test:157.911> 
<ITER15 LR1.00000 train:121.168 valid:163.980 test:155.683> 
<ITER16 LR1.00000 train:118.240 valid:162.749 test:154.441> 
<ITER17 LR1.00000 train:115.069 valid:161.691 test:153.464> 
<ITER18 LR0.60000 train:100.370 valid:153.422 test:146.047> 
<ITER19 LR0.36000 train:91.627 valid:147.134 test:140.123> 
<ITER20 LR0.21600 train:86.075 valid:142.463 test:135.614> 
<ITER21 LR0.12960 train:82.462 valid:139.427 test:132.753> 
<ITER22 LR0.07776 train:80.073 valid:137.637 test:131.122> 
<ITER23 LR0.04666 train:78.540 valid:136.420 test:130.086> 
<ITER24 LR0.02799 train:77.515 valid:135.608 test:129.381> 
<ITER25 LR0.01680 train:76.810 valid:134.993 test:128.863> 
<ITER26 LR0.01008 train:76.363 valid:134.569 test:128.497> 
<ITER27 LR0.00605 train:76.082 valid:134.296 test:128.246> 
<ITER28 LR0.00363 train:75.904 valid:134.130 test:128.072> 
<ITER29 LR0.00218 train:75.792 valid:134.022 test:127.947> 
<ITER30 LR0.00131 train:75.720 valid:133.943 test:127.851> 
<ITER31 LR0.00078 train:75.675 valid:133.886 test:127.779> 
<ITER32 LR0.00047 train:75.647 valid:133.850 test:127.729> 
<ITER33 LR0.00028 train:75.629 valid:133.828 test:127.694> 
<ITER34 LR0.00017 train:75.618 valid:133.816 test:127.670> 
<ITER35 LR0.00010 train:75.611 valid:133.808 test:127.653> 

===FINAL TEST===
[SCHEDULER FINAL_TEST]: preparing parameters...
[SCHEDULER FINAL_TEST]: loading parameter from file /home/slhome/txh18/workspace/nerv/play/dagL_test/params.35...
reading chunk 0 from 0
metadata: return {type="nerv.LinearTransParam",id="ltp_ih"}

reading chunk 1 from 46027263
metadata: return {type="nerv.BiasParam",id="bp_h"}

reading chunk 2 from 46032113
metadata: return {type="nerv.LinearTransParam",id="ltp_ho"}

reading chunk 3 from 92320518
metadata: return {type="nerv.BiasParam",id="bp_o"}

reading chunk 4 from 92436727
metadata: return {type="nerv.LinearTransParam",id="ltp_hh"}

reading chunk 5 from 94326857
[SCHEDULER FINAL_TEST]: preparing parameters end.
[SCHEDULER FINAL_TEST]: preparing layers...
(22:43:36 2015-11-16)[nerv] info: create layer: recurrentL1
(22:43:36 2015-11-16)[nerv] info: create layer: sigmoidL1
(22:43:36 2015-11-16)[nerv] info: create layer: combinerL1
(22:43:36 2015-11-16)[nerv] info: create layer: outputL
(22:43:36 2015-11-16)[nerv] info: create layer: softmaxL
(22:43:36 2015-11-16)[nerv] info: create layer: selectL1
[SCHEDULER FINAL_TEST]: preparing layers end.
[SCHEDULER FINAL_TEST]: Generate and initing TNN ...
<input>	selectL1	0
selectL1	recurrentL1	0
recurrentL1	sigmoidL1	0
sigmoidL1	combinerL1	0
combinerL1	recurrentL1	1
combinerL1	outputL	0
outputL	softmaxL	0
<input>	softmaxL	0
softmaxL	<output>	0
recurrentL1	#dim_in:	2	#dim_out:	1	#i_conns_p:	2	#o_conns_p	1
outputL	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
combinerL1	#dim_in:	1	#dim_out:	2	#i_conns_p:	1	#o_conns_p	2
sigmoidL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	1	#o_conns_p	1
selectL1	#dim_in:	1	#dim_out:	1	#i_conns_p:	0	#o_conns_p	1
softmaxL	#dim_in:	2	#dim_out:	1	#i_conns_p:	1	#o_conns_p	0
TNN initing storage	selectL1	->	recurrentL1
TNN initing storage	recurrentL1	->	sigmoidL1
TNN initing storage	sigmoidL1	->	combinerL1
TNN initing storage	combinerL1	->	recurrentL1
TNN initing storage	combinerL1	->	outputL
TNN initing storage	outputL	->	softmaxL
[SCHEDULER FINAL_TEST]: Initing TNN end.
[LOG]LMSeqReader: opening file /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds...
batch_size:	10	chunk_size	15
[SCHEDULER FINAL_TEST]: 40087 words processed Mon Nov 16 22:43:43 2015.
	[SCHEDULER FINAL_TEST]: log prob per sample :-2.104206.
	 [global_conf.timer]: time spent on most_out_loop_lmprocessfile:5.78324 clock time
	 [global_conf.timer]: time spent on tnn_actual_layer_propagate:3.84086 clock time
[LOG]LMSeqReader: file expires, closing.
[SCHEDULER FINAL_TEST]: Displaying result:
[SCHEDULER FINAL_TEST]: LMResult status of rnn: <SEN_CN 3761> <W_CN 78669> <PPL_NET 146.09855762739> <PPL_OOV 127.65294490737> <LOGP -173600.12199883>
[SCHEDULER FINAL_TEST]: Doing on /home/slhome/txh18/workspace/nerv/nerv/nerv/examples/lmptb/PTBdata/ptb.test.txt.adds end.