[PyTorch] Fix CP implementation with FP8 (#1483)

* commit some debug code

Signed-off-by: Xiaowei Ren <[email protected]>

* add more debug info

Signed-off-by: Xiaowei Ren <[email protected]>

* debug code commit and typo fix

Signed-off-by: Xiaowei Ren <[email protected]>

* a typo fix

Signed-off-by: Xiaowei Ren <[email protected]>

* remove debug info

Signed-off-by: Xiaowei Ren <[email protected]>

* do not return lse

Signed-off-by: Xiaowei Ren <[email protected]>

* add amax_per_step for quantizers of CP

Signed-off-by: Xiaowei Ren <[email protected]>

* fix FP8 + CP

Signed-off-by: Xiaowei Ren <[email protected]>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* bug fix

Signed-off-by: Xiaowei Ren <[email protected]>

* bug fix

Signed-off-by: Xiaowei Ren <[email protected]>

* dtype fix

Signed-off-by: Xiaowei Ren <[email protected]>

* bug fix

Signed-off-by: Xiaowei Ren <[email protected]>

---------

Signed-off-by: Xiaowei Ren <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Xiaowei Ren <[email protected]>