Control tags not in tokenizer

[lhallee]

Curious how we can prepend control tags for conditional generation. I noticed the control tags are not in the tokenizer, so how could we input them to the model?

[ddofer]

+1 - An example of usage with the control tags would be very helpful