Get the inner representation at inference time

[Vincent717]

Hi,

Would it be possible to get the inner representation of a sequence (i.e., only the output of the encoder) at inference time?

I know we can get the output of the whole model from task DecodeText, but it seems like there is no way to get only the output of the encoder, but not go through the decoder.

Thanks.