Controlling the decoding behavior

[ZhanqiuHu]

Hi team! Thanks for the great work.

The Controlling the decoding behavior section of your blog has some nice demos, and the section also mentions that "One can also adjust the decoding hyperparameters to control the decoding behavior, shifting it from more left-to-right like an AR model to more random-order generation."

I was wondering how these hyperparameters are configured?

Thanks!

[jiacheng-ye]

Hi Zhanqiu, for your reference, the hyperparameters are as follows:

# these parameters are mostly kept still
temperature=0.2,
top_p=0.95,
diffusion_steps=256,
diffusion_max_length=256,

# the left gif
alg="maskgit_plus",
alg_temp=0,

# the middle gif
alg="maskgit_plus",
alg_temp=0.001,

# the right gif
alg="origin",
alg_temp=0,