wikitext training » overfit on wikitext.

but definetly improves on Lambada.