[Feature] Add benchmark for AMD accelerators

[NellyWhads]

AMD accelerators do not have competitive training and inference performance with NVIDIA accelerators. This lack of performance, in part, could be significantly improved with kernel level optimizations for pytorch.

This benchmark could serve as a community driven development accelerator to bridge this performance gap.

[simonguozirui]

Hi Nelly, thanks for taking an interest in the KernelBench project and the suggestion.

We recently spoke with the AMD team. A good first goal is to add HiP (AMD equivalent of CUDA) support as a KernelBench backend.

See efforts such as #37 to integrate AMD accelerators as a backend for KernelBench. We welcome contributors from AMD and beyond (from the community).

[ai-nikolai]

@simonguozirui - great initiative, is there any news on progress with the PR?

Also, would it be worth considering external file compilation (i.e. not in-line)? I would be open to contribute to a next generation of the paper, if you guys are interested. Thanks.