posts/bf16-in-golang

[giscus[bot]]

posts/bf16-in-golang

BF16 in the Go Programming Language In the era of large language models, low-precision floating-point numbers are no strangers to developers, with BF16 being one of the most widely supported low-precision floating-point formats. This article will introduce how to use BF16 in the Go programming language.

https://gorse.io/posts/bf16-in-golang.html

[janpfeifer]

Great article, thanks!

Just for the record, you'll find another BFloat16 wrapper implementation for Go in github.com/gomlx/gopjrt. You can't operate them directly, just print and convert back/forth to float32.

But it is just a basic type for GoMLX which in turn allows one to operate on them very efficiently using XLA (with JIT compilation, SIMD or even GPU/TPU support). There is also a native Go backend to it, but much slower and doesn't support SIMD yet -- but I'm going to attempt to use GoAT for that soon 😃