[Bug]: Request Response IO for python SDK pickle error

[zaibon]

What happened?

I'm trying to use the RequestResponseIO with the python SDK.
I've made my test by re-implementing the test from https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/requestresponse_it_test.py

You can find test test code and error logs at https://gist.github.com/zaibon/a5d6df6d8192a3ba6e72496e8d2531f4

Running the code raises a pickle error due to the usage of _abc._abc_data that comes from the Caller class itself:

beam/sdks/python/apache_beam/io/requestresponse.py

Line 117 in 202fa56

abc.ABC,

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam YAML
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Infrastructure
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[zgseed]

Same issue here. Any update for this bug?

[liferoad]

Can you try --pickle_library=cloudpickle?