Custom Training Loops for RL/GAN

[dennybritz]

Add support for custom training loops to easily train GANs and RL algorithms. Two ideas on how to to implement this:

• Make it part of the model and use SessionRunHooks to execute different train ops
• Subclass Estimator with a custom MonitoredSession

Need to look into these options in more details.

[dennybritz]

Idea: Have a TrainingRegime (or something like that) abstraction that defines how the loss or losses are being handled. Each regime is associated with a MonitoredSession loop.