You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
But in the spark the maximal size of any array is equal to java.lang.Integer.MAX_VALUES - 15 and any attempt to create an array of the bigger size will throw an exception:
Refactoring of all the code in list.rs and drop the support of arrow LargeList. It will simplify an existing code and also simplify resolving of the #1042
Additional context
I can try to make a refactoring and check if tests are passed.
The text was updated successfully, but these errors were encountered:
What is the problem the feature request solves?
At the moment Comet is trying to support both
List
andLargeList
for handling array functions:But in the spark the maximal size of any array is equal to
java.lang.Integer.MAX_VALUES - 15
and any attempt to create an array of the bigger size will throw an exception:Describe the potential solution
Refactoring of all the code in
list.rs
and drop the support of arrowLargeList
. It will simplify an existing code and also simplify resolving of the #1042Additional context
I can try to make a refactoring and check if tests are passed.
The text was updated successfully, but these errors were encountered: