2019-04-18 13:38:31.348890: W tensorflow/core/framework/allocator.cc:108] Allocation of 4300832256 exceeds 10% of system memory.

[adarshraj576]

During running this repo, I am not able to complete my model training due to this error. First this warning comes and then later my terminal stops executing this code by giving the error Segmentation fault: Core dumped. Any kind of help will be highly valuable. Kindly guide me. Thanks in advance.

[juharris]

Looks like it ran out of memory. You can try decreasing _MAX_BATCH_SIZE here: https://github.com/Maluuba/qgen-workshop/blob/master/qgen/data.py#L12
You can try setting it to a half of what it currently is or even lower if you keep getting similar errors.