[Task]: Throughput in benchmarking

[ashwinvaidya17]

What is the motivation for this task?

Match previous design

Describe the solution you'd like

Restore torch, lightning, OpenVINO throughput in the new benchmarking design.

Additional context

No response

[ashwinvaidya17]

Saving for later: https://pytorch.org/tnt/stable/utils/generated/torchtnt.utils.flops.FlopTensorDispatchMode.html#torchtnt.utils.flops.FlopTensorDispatchMode

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.