[SPARK-36771][PYTHON][3.2] Fix pop of Categorical Series

[xinrong-meng]

What changes were proposed in this pull request?

Fix pop of Categorical Series to be consistent with the latest pandas (1.3.2) behavior.

This is a backport of #34052.

Why are the changes needed?

As databricks/koalas#2198, pandas API on Spark behaves differently from pandas on pop of Categorical Series.

Does this PR introduce any user-facing change?

Yes, results of pop of Categorical Series change.

From

>>> psser = ps.Series(["a", "b", "c", "a"], dtype="category")
>>> psser
0    a                                                                          
1    b
2    c
3    a
dtype: category
Categories (3, object): ['a', 'b', 'c']
>>> psser.pop(0)
0
>>> psser
1    b
2    c
3    a
dtype: category
Categories (3, object): ['a', 'b', 'c']
>>> psser.pop(3)
0
>>> psser
1    b
2    c
dtype: category
Categories (3, object): ['a', 'b', 'c']

To

>>> psser = ps.Series(["a", "b", "c", "a"], dtype="category")
>>> psser
0    a                                                                          
1    b
2    c
3    a
dtype: category
Categories (3, object): ['a', 'b', 'c']
>>> psser.pop(0)
'a'
>>> psser
1    b
2    c
3    a
dtype: category
Categories (3, object): ['a', 'b', 'c']
>>> psser.pop(3)
'a'
>>> psser
1    b
2    c
dtype: category
Categories (3, object): ['a', 'b', 'c']

How was this patch tested?

Unit tests.

[xinrong-meng]

CC @ueshin @HyukjinKwon @itholic

[ueshin]

LGTM, pending tests.

[SparkQA]

Test build #143487 has finished for PR 34063 at commit e9d11ff.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47998/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47998/

[ueshin]

Thanks! merging to branch-3.2.