Run python -m unittest seq2seq.test.pipeline_test on win7

[fanjingwei]

when i run python -m unittest seq2seq.test.pipeline_test on win7 after 1 step,there is an "Permission denied" error, is the "ResourceWarning: unclosed file <_io.BufferedRandom name=6>" warning case this error?
2017-08-31 22:07:39.700066: W C:\tf_jenkins\home\workspace\rel-win\M\windows\PY\35\tensorflow\core\platform\cpu_feature_guard.cc:45] The TensorFlow li
brary wasn't compiled to use AVX instructions, but these are available on your machine and could speed up CPU computations.
INFO:tensorflow:Saving checkpoints for 1 into C:\Users\ADMINI~1\AppData\Local\Temp\tmpl_zx4mgr\model.ckpt.
INFO:tensorflow:Prediction followed by Target @ Step 1

SEQUENCE_END a a a 泣
c c c c SEQUENCE_END

c c c c c
泣 泣 泣 泣 SEQUENCE_END

====================================================================================================

INFO:tensorflow:loss = 1.94618, step = 1
INFO:tensorflow:Performing full trace on next step.
INFO:tensorflow:Captured full trace at step 11
INFO:tensorflow:Saved run_metadata to C:\Users\ADMINI1\AppData\Local\Temp\tmpl_zx4mgr\run_meta
INFO:tensorflow:Saved timeline to C:\Users\ADMINI1\AppData\Local\Temp\tmpl_zx4mgr\timeline.json
WARNING:tensorflow:From E:\git\seq2seq\seq2seq\training\hooks.py:133: write_op_log (from tensorflow.contrib.tfprof.tfprof_logger) is deprecated and wi
ll be removed after 2018-01-01.
Instructions for updating:
Use tf.profiler.write_op_log. go/tfprof
INFO:tensorflow:Saved op log to C:\Users\ADMINI1\AppData\Local\Temp\tmpl_zx4mgr
INFO:tensorflow:Saving checkpoints for 50 into C:\Users\ADMINI1\AppData\Local\Temp\tmpl_zx4mgr\model.ckpt.
INFO:tensorflow:Loss for final step: 1.93593.
INFO:tensorflow:Evaluating model now.
INFO:tensorflow:Creating AttentionSeq2Seq in mode=eval
INFO:tensorflow:
AttentionSeq2Seq:
attention.class: AttentionLayerBahdanau
attention.params: {num_units: 10}
bridge.class: seq2seq.models.bridges.ZeroBridge
bridge.params: {}
decoder.class: seq2seq.decoders.AttentionDecoder
decoder.params:
rnn_cell:
cell_class: GRUCell
cell_params: {num_units: 8}
embedding.dim: 10
embedding.init_scale: 0.04
embedding.share: false
encoder.class: seq2seq.encoders.BidirectionalRNNEncoder
encoder.params:
rnn_cell:
cell_class: GRUCell
cell_params: {num_units: 8}
inference.beam_search.beam_width: 0
inference.beam_search.choose_successors_fn: choose_top_k
inference.beam_search.length_penalty_weight: 0.0
optimizer.clip_embed_gradients: 0.1
optimizer.clip_gradients: 5.0
optimizer.learning_rate: 0.0001
optimizer.lr_decay_rate: 0.99
optimizer.lr_decay_steps: 100
optimizer.lr_decay_type: ''
optimizer.lr_min_learning_rate: 1.0e-12
optimizer.lr_staircase: false
optimizer.lr_start_decay_at: 0
optimizer.lr_stop_decay_at: 2147483647
optimizer.name: Adam
optimizer.params: {}
optimizer.sync_replicas: 0
optimizer.sync_replicas_to_aggregate: 0
source.max_seq_len: 50
source.reverse: true
target.max_seq_len: 50
vocab_source: C:\Users\ADMINI1\AppData\Local\Temp\tmpx283xxm9
vocab_target: C:\Users\ADMINI1\AppData\Local\Temp\tmpyhe62_cm

INFO:tensorflow:Creating vocabulary lookup table of size 7
INFO:tensorflow:Creating vocabulary lookup table of size 7
INFO:tensorflow:Creating BidirectionalRNNEncoder in mode=eval
INFO:tensorflow:
BidirectionalRNNEncoder:
init_scale: 0.04
rnn_cell:
cell_class: GRUCell
cell_params: {num_units: 8}
dropout_input_keep_prob: 1.0
dropout_output_keep_prob: 1.0
num_layers: 1
residual_combiner: add
residual_connections: false
residual_dense: false

INFO:tensorflow:Creating AttentionLayerBahdanau in mode=eval
INFO:tensorflow:
AttentionLayerBahdanau: {num_units: 10}

INFO:tensorflow:Creating AttentionDecoder in mode=eval
INFO:tensorflow:
AttentionDecoder:
init_scale: 0.04
max_decode_length: 100
rnn_cell:
cell_class: GRUCell
cell_params: {num_units: 8}
dropout_input_keep_prob: 1.0
dropout_output_keep_prob: 1.0
num_layers: 1
residual_combiner: add
residual_connections: false
residual_dense: false

INFO:tensorflow:Creating ZeroBridge in mode=eval
INFO:tensorflow:
ZeroBridge: {}

INFO:tensorflow:Starting evaluation at 2017-08-31-14:09:07
INFO:tensorflow:Restoring parameters from C:\Users\ADMINI1\AppData\Local\Temp\tmpl_zx4mgr\model.ckpt-50
2017-08-31 22:09:09.336193: W C:\tf_jenkins\home\workspace\rel-win\M\windows\PY\35\tensorflow\core\kernels\queue_base.cc:303] _25_dev_input_fn/paralle
l_read_1/common_queue: Skipping cancelled dequeue attempt with queue not closed
sys:1: ResourceWarning: unclosed file <_io.BufferedRandom name=9>
sys:1: ResourceWarning: unclosed file <_io.BufferedRandom name=10>
2017-08-31 22:09:11.446314: W C:\tf_jenkins\home\workspace\rel-win\M\windows\PY\35\tensorflow\core\framework\op_kernel.cc:1192] Unknown: PermissionErr
or: [Errno 13] Permission denied: 'C:\Users\ADMINI1\AppData\Local\Temp\tmpaq6c50c1'
EC:\Program Files\Anaconda3\lib\unittest\case.py:628: ResourceWarning: unclosed file <_io.BufferedRandom name=3>
outcome.errors.clear()
C:\Program Files\Anaconda3\lib\unittest\case.py:628: ResourceWarning: unclosed file <_io.BufferedRandom name=4>
outcome.errors.clear()
C:\Program Files\Anaconda3\lib\unittest\case.py:628: ResourceWarning: unclosed file <_io.BufferedRandom name=5>
outcome.errors.clear()
C:\Program Files\Anaconda3\lib\unittest\case.py:628: ResourceWarning: unclosed file <_io.BufferedRandom name=6>
outcome.errors.clear()
C:\Program Files\Anaconda3\lib\unittest\case.py:628: ResourceWarning: unclosed file <_io.BufferedRandom name=7>
outcome.errors.clear()
C:\Program Files\Anaconda3\lib\unittest\case.py:628: ResourceWarning: unclosed file <_io.BufferedRandom name=8>
outcome.errors.clear()

======================================================================
ERROR: test_train_infer (seq2seq.test.pipeline_test.PipelineTest)
Tests training and inference scripts.

Traceback (most recent call last):
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1327, in _do_call
return fn(*args)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1306, in _run_fn
status, run_metadata)
File "C:\Program Files\Anaconda3\lib\contextlib.py", line 66, in exit
next(self.gen)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework\errors_impl.py", line 466, in raise_exception_on_not_ok_status
pywrap_tensorflow.TF_GetCode(status))
tensorflow.python.framework.errors_impl.UnknownError: PermissionError: [Errno 13] Permission denied: 'C:\Users\ADMINI~1\AppData\Local\Temp\tmpaq
6c50c1'
[[Node: bleu/value = PyFunc[Tin=[DT_STRING, DT_STRING], Tout=[DT_FLOAT], token="pyfunc_0", _device="/job:localhost/replica:0/task:0/cpu:0"](b
leu/Identity, bleu/Identity_1)]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "E:\git\seq2seq\seq2seq\test\pipeline_test.py", line 148, in test_train_infer
train_script.main([])
File "E:\git\seq2seq\bin\train.py", line 272, in main
schedule=FLAGS.schedule)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\learn_runner.py", line 209, in run
return _execute_schedule(experiment, schedule)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\learn_runner.py", line 46, in _execute_schedule
return task()
File "E:\git\seq2seq\seq2seq\contrib\experiment.py", line 112, in continuous_train_and_eval
hooks=self._eval_hooks)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\util\deprecation.py", line 296, in new_func
return func(*args, **kwargs)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\estimators\estimator.py", line 546, in evaluate
log_progress=log_progress)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\estimators\estimator.py", line 858, in _evaluate_model
config=self._session_config)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training\evaluation.py", line 182, in _evaluate_once
session.run(eval_ops, feed_dict)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training\monitored_session.py", line 518, in run
run_metadata=run_metadata)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training\monitored_session.py", line 862, in run
run_metadata=run_metadata)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training\monitored_session.py", line 818, in run
return self._sess.run(*args, **kwargs)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training\monitored_session.py", line 972, in run
run_metadata=run_metadata)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training\monitored_session.py", line 818, in run
return self._sess.run(*args, **kwargs)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 895, in run
run_metadata_ptr)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1124, in _run
feed_dict_tensor, options, run_metadata)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1321, in _do_run
options, run_metadata)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\session.py", line 1340, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.UnknownError: PermissionError: [Errno 13] Permission denied: 'C:\Users\ADMINI~1\AppData\Local\Temp\tmpaq
6c50c1'
[[Node: bleu/value = PyFunc[Tin=[DT_STRING, DT_STRING], Tout=[DT_FLOAT], token="pyfunc_0", _device="/job:localhost/replica:0/task:0/cpu:0"](b
leu/Identity, bleu/Identity_1)]]

Caused by op 'bleu/value', defined at:
File "C:\Program Files\Anaconda3\lib\runpy.py", line 184, in _run_module_as_main
"main", mod_spec)
File "C:\Program Files\Anaconda3\lib\runpy.py", line 85, in run_code
exec(code, run_globals)
File "C:\Program Files\Anaconda3\lib\unittest_main.py", line 18, in
main(module=None)
File "C:\Program Files\Anaconda3\lib\unittest\main.py", line 94, in init
self.runTests()
File "C:\Program Files\Anaconda3\lib\unittest\main.py", line 255, in runTests
self.result = testRunner.run(self.test)
File "C:\Program Files\Anaconda3\lib\unittest\runner.py", line 176, in run
test(result)
File "C:\Program Files\Anaconda3\lib\unittest\suite.py", line 84, in call
return self.run(*args, **kwds)
File "C:\Program Files\Anaconda3\lib\unittest\suite.py", line 122, in run
test(result)
File "C:\Program Files\Anaconda3\lib\unittest\suite.py", line 84, in call
return self.run(*args, **kwds)
File "C:\Program Files\Anaconda3\lib\unittest\suite.py", line 122, in run
test(result)
File "C:\Program Files\Anaconda3\lib\unittest\suite.py", line 84, in call
return self.run(*args, **kwds)
File "C:\Program Files\Anaconda3\lib\unittest\suite.py", line 122, in run
test(result)
File "C:\Program Files\Anaconda3\lib\unittest\case.py", line 648, in call
return self.run(*args, **kwds)
File "C:\Program Files\Anaconda3\lib\unittest\case.py", line 600, in run
testMethod()
File "E:\git\seq2seq\seq2seq\test\pipeline_test.py", line 148, in test_train_infer
train_script.main([])
File "E:\git\seq2seq\bin\train.py", line 272, in main
schedule=FLAGS.schedule)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\learn_runner.py", line 209, in run
return _execute_schedule(experiment, schedule)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\learn_runner.py", line 46, in _execute_schedule
return task()
File "E:\git\seq2seq\seq2seq\contrib\experiment.py", line 112, in continuous_train_and_eval
hooks=self._eval_hooks)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\util\deprecation.py", line 296, in new_func
return func(*args, **kwargs)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\estimators\estimator.py", line 546, in evaluate
log_progress=log_progress)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\estimators\estimator.py", line 832, in _evaluate_model
model_fn_results = self._get_eval_ops(features, labels, metrics)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\estimators\estimator.py", line 1199, in _get_eval_ops
metrics, features, labels, model_fn_ops.predictions))
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\contrib\learn\python\learn\estimators\estimator.py", line 271, in _make_metrics_ops
result[name] = metric.create_metric_ops(features, labels, predictions)
File "E:\git\seq2seq\seq2seq\metrics\metric_specs.py", line 124, in create_metric_ops
name="value")
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\script_ops.py", line 203, in py_func
input=inp, token=token, Tout=Tout, name=name)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\gen_script_ops.py", line 36, in _py_func
name=name)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 767, in apply_op
op_def=op_def)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework\ops.py", line 2630, in create_op
original_op=self._default_original_op, op_def=op_def)
File "C:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework\ops.py", line 1204, in init
self._traceback = self._graph._extract_stack() # pylint: disable=protected-access

UnknownError (see above for traceback): PermissionError: [Errno 13] Permission denied: 'C:\Users\ADMINI~1\AppData\Local\Temp\tmpaq6c50c1'
[[Node: bleu/value = PyFunc[Tin=[DT_STRING, DT_STRING], Tout=[DT_FLOAT], token="pyfunc_0", _device="/job:localhost/replica:0/task:0/cpu:0"](b
leu/Identity, bleu/Identity_1)]]

---

Ran 2 tests in 114.668s

FAILED (errors=1)

[harishdamera]

I got similar issue. May I know how did you solved this?

[fanjingwei]

I still did not solved this, and i find the same error on linux too

[FutureShaper]

Same issue on Windows 10.

[brucebismarck]

Same on windows 10

[jerryff]

same in win10

[woonsangcho]

same issue in win 10

[gigibang]

same issue in win 7

[neerajks]

Has anybody faced been able to get around this error.

[morenoh149]

looks like a permission issue. looks like a resource was not released before another process tried to access it. Look into what the resource is and why it's not being released.

[vicdxxx]

do this kind of change can bypass it in bleu.py:
#with open(hypothesis_file.name, "r") as read_pred:
with open("F:/Datasets/NLP/test.txt", "r") as read_pred:

  bleu_out = subprocess.check_output(
      bleu_cmd, stdin=hypothesis_file, stderr=subprocess.STDOUT)
      #bleu_cmd, stdin=read_pred, stderr=subprocess.STDOUT)

[newmluser]

what is that test.txt file.
did any one get the solution to this isse=ue

[deltahell]

change in bleu.py

with open(hypothesis_file.name, "r") as read_pred:

with hypothesis_file as read_pred:
Its worked for me.

hypothesis_file is create by python tempfile, its alerady file object;