Linux aarch64 wheel

[cretz]

Is your feature request related to a problem? Please describe.

The Linux aarch64 wheel on the builds needs to be tested and confirm it works. Unfortunately it takes a really long time to build in CI (disabled except on main merge).

[cretz]

Also, we can't run protoc in this environment because https://pypi.org/project/protoc-wheel-0 does not have a Linux aarch64 wheel. We need to make sure we don't try to install it if possible.

[cretz]

Can now set runs-on: buildjet-4vcpu-ubuntu-2204-arm since we now have a runner