Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Concat error while testing "array_repeat" #1347

Open
jatin510 opened this issue Jan 28, 2025 · 1 comment
Open

Concat error while testing "array_repeat" #1347

jatin510 opened this issue Jan 28, 2025 · 1 comment
Labels
bug Something isn't working

Comments

@jatin510
Copy link
Contributor

jatin510 commented Jan 28, 2025

Describe the bug

while testing the array_repeat, getting error for following statement:

checkSparkAnswerAndOperator(sql("SELECT array_repeat(_2, _4) from t1 where _4 is null"))

getting this error while trying to pass null to the count argument

- array_repeat *** FAILED *** (5 seconds, 334 milliseconds)
  org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 2.0 failed 1 times, most recent failure: Lost task 0.0 in stage 2.0 (TID 2) (192.168.1.20 executor driver): org.apache.comet.CometNativeException: Compute error: concat requires input of at least one array
	at org.apache.comet.Native.executePlan(Native Method)
	at org.apache.comet.CometExecIterator.$anonfun$getNextBatch$1(CometExecIterator.scala:127)
	at org.apache.comet.CometExecIterator.$anonfun$getNextBatch$1$adapted(CometExecIterator.scala:125)
	at org.apache.comet.vector.NativeUtil.getNextBatch(NativeUtil.scala:157)
	at org.apache.comet.CometExecIterator.getNextBatch(CometExecIterator.scala:125)
	at org.apache.comet.CometExecIterator.hasNext(CometExecIterator.scala:146)
	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.cometcolumnartorow_nextBatch_0$(Unknown Source)
	at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.processNext(Unknown Source)
	at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
	at org.apache.spark.sql.execution.WholeStageCodegenExec$$anon$1.hasNext(WholeStageCodegenExec.scala:760)
	at scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:460)
	at scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:460)
	at org.apache.spark.util.Iterators$.size(Iterators.scala:29)
	at org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1953)
	at org.apache.spark.rdd.RDD.$anonfun$count$1(RDD.scala:1269)
	at org.apache.spark.rdd.RDD.$anonfun$count$1$adapted(RDD.scala:1269)
	at org.apache.spark.SparkContext.$anonfun$runJob$5(SparkContext.scala:2303)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:92)
	at org.apache.spark.TaskContext.runTaskWithListeners(TaskContext.scala:161)
	at org.apache.spark.scheduler.Task.run(Task.scala:139)
	at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:554)
	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1529)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:557)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:842)

Steps to reproduce

No response

Expected behavior

It should run the test successfully, when trying to pass null in count argument

Additional context

No response

@jatin510 jatin510 added the bug Something isn't working label Jan 28, 2025
@jatin510
Copy link
Contributor Author

#1205

found this bug while testing array_repeat

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant