Build from source failing from main on my Mac

[joestein]

I am trying to build from the main branch and I am on a Mac and did the brew install from docs and running

 make build

and I get an error

[ 95%] Linking CXX executable ../../bin/grpc-server
ld: warning: ignoring duplicate libraries: '../../common/libcommon.a', '../../libllama.a', '/Users/jstein/dev/github/LocalAI/backend/cpp/grpc/installed_packages/lib/libabsl_flags.a'
ld: Undefined symbols:
  void absl::lts_20230802::log_internal::LogMessage::CopyToEncodedBuffer<(absl::lts_20230802::log_internal::LogMessage::StringType)0>(std::__1::basic_string_view<char, std::__1::char_traits<char>>), referenced from:
      libhw_grpc_proto.a[3](backend.pb.cc.o)
  absl::lts_20230802::cord_internal::InitializeCordRepExternal(std::__1::basic_string_view<char, std::__1::char_traits<char>>, absl::lts_20230802::cord_internal::CordRepExternal*), referenced from:
      grpc::ProtoBufferReader::ReadCord(absl::lts_20230802::Cord*, int) in libhw_grpc_proto.a[2](backend.grpc.pb.cc.o)
      grpc::ProtoBufferReader::ReadCord(absl::lts_20230802::Cord*, int) in libhw_grpc_proto.a[2](backend.grpc.pb.cc.o)
      grpc::ProtoBufferReader::ReadCord(absl::lts_20230802::Cord*, int) in libhw_grpc_proto.a[2](backend.grpc.pb.cc.o)
      grpc::ProtoBufferReader::ReadCord(absl::lts_20230802::Cord*, int) in libhw_grpc_proto.a[2](backend.grpc.pb.cc.o)
  google::protobuf::internal::ArenaStringPtr::Set(std::__1::basic_string_view<char, std::__1::char_traits<char>>, google::protobuf::Arena*), referenced from:
      BackendServiceImpl::Health(grpc::ServerContext*, backend::HealthMessage const*, backend::Reply*) in grpc-server.cpp.o
      BackendServiceImpl::LoadModel(grpc::ServerContext*, backend::ModelOptions const*, backend::Result*) in grpc-server.cpp.o
      BackendServiceImpl::LoadModel(grpc::ServerContext*, backend::ModelOptions const*, backend::Result*) in grpc-server.cpp.o
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[4]: *** [bin/grpc-server] Error 1
make[3]: *** [examples/grpc-server/CMakeFiles/grpc-server.dir/all] Error 2
make[2]: *** [all] Error 2
make[1]: *** [grpc-server] Error 2
make: *** [backend/cpp/llama/grpc-server] Error 2

I then tried

make BUILD_GRPC_FOR_BACKEND_LLAMA=true build

Even though I don't know what this does I saw it in the documentation so I tried it.

I would like to know what BUILD_GRPC_FOR_BACKEND_LLAMA=true does but it errored too.

[ 95%] Linking CXX executable ../../bin/grpc-server
ld: warning: ignoring duplicate libraries: '../../common/libcommon.a', '../../libllama.a', '/Users/jstein/dev/github/LocalAI/backend/cpp/grpc/installed_packages/lib/libabsl_flags.a'
ld: Undefined symbols:
  void absl::lts_20230802::log_internal::LogMessage::CopyToEncodedBuffer<(absl::lts_20230802::log_internal::LogMessage::StringType)0>(std::__1::basic_string_view<char, std::__1::char_traits<char>>), referenced from:
      libhw_grpc_proto.a[3](backend.pb.cc.o)
  absl::lts_20230802::cord_internal::InitializeCordRepExternal(std::__1::basic_string_view<char, std::__1::char_traits<char>>, absl::lts_20230802::cord_internal::CordRepExternal*), referenced from:
      grpc::ProtoBufferReader::ReadCord(absl::lts_20230802::Cord*, int) in libhw_grpc_proto.a[2](backend.grpc.pb.cc.o)
      grpc::ProtoBufferReader::ReadCord(absl::lts_20230802::Cord*, int) in libhw_grpc_proto.a[2](backend.grpc.pb.cc.o)
      grpc::ProtoBufferReader::ReadCord(absl::lts_20230802::Cord*, int) in libhw_grpc_proto.a[2](backend.grpc.pb.cc.o)
      grpc::ProtoBufferReader::ReadCord(absl::lts_20230802::Cord*, int) in libhw_grpc_proto.a[2](backend.grpc.pb.cc.o)
  google::protobuf::internal::ArenaStringPtr::Set(std::__1::basic_string_view<char, std::__1::char_traits<char>>, google::protobuf::Arena*), referenced from:
      BackendServiceImpl::Health(grpc::ServerContext*, backend::HealthMessage const*, backend::Reply*) in grpc-server.cpp.o
      BackendServiceImpl::LoadModel(grpc::ServerContext*, backend::ModelOptions const*, backend::Result*) in grpc-server.cpp.o
      BackendServiceImpl::LoadModel(grpc::ServerContext*, backend::ModelOptions const*, backend::Result*) in grpc-server.cpp.o
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[4]: *** [bin/grpc-server] Error 1
make[3]: *** [examples/grpc-server/CMakeFiles/grpc-server.dir/all] Error 2
make[2]: *** [all] Error 2
make[1]: *** [grpc-server] Error 2
make: *** [backend/cpp/llama/grpc-server] Error 2

[tauven]

I had the same error, what helped was to uninstall protobuff via brew.
Perhaps I also had to uninstall abseil....
As I understand it, "make BUILD_GRPC_FOR_BACKEND_LLAMA=true build" builds its own version of protobuff.

I had a similar problem after I had installed conda on the system. Unfortunately, I can no longer say exactly what helped, but maybe this will help you...

[joestein]

I tried that didn't help. I also did brew link --overwrite protobuf and that didn't work either