Skip to content

[CELEBORN-1839] PartitionsSorter.getSortedFileInfo should not block the handleOpenStream thread #7025

[CELEBORN-1839] PartitionsSorter.getSortedFileInfo should not block the handleOpenStream thread

[CELEBORN-1839] PartitionsSorter.getSortedFileInfo should not block the handleOpenStream thread #7025

Triggered via pull request January 23, 2025 03:05
Status Failure
Total duration 1h 15m 41s
Artifacts 36

sbt.yml

on: pull_request
Matrix: mr
Matrix: openapi-codegen-check
Matrix: service
Matrix: spark2
Matrix: spark3

Annotations

72 errors
mr (11)
Process completed with exit code 1.
mr (8)
Process completed with exit code 1.
service (8, 2.13.5)
Process completed with exit code 1.
service (8, 2.12.15)
Process completed with exit code 1.
service (11, 2.13.5)
Process completed with exit code 1.
service (11, 2.12.15)
Process completed with exit code 1.
service (17, 2.13.5)
Process completed with exit code 1.
service (17, 2.12.15)
Process completed with exit code 1.
spark2 (8, 2.4, 2.11.12)
SparkContext has been shutdown
spark2 (8, 2.4, 2.11.12)
sleep interrupted
spark2 (8, 2.4, 2.11.12)
sleep interrupted
spark2 (8, 2.4, 2.11.12)
sleep interrupted
spark2 (8, 2.4, 2.11.12)
Process completed with exit code 1.
spark2 (8, 2.4, 2.12.10)
SparkContext has been shutdown
spark2 (8, 2.4, 2.12.10)
Process completed with exit code 1.
spark3 (3.3, 17, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.3, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 11, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.5, 11, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 17, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.5, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.5, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.2, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.1, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.1, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 17, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.0, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.2, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.2, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.3, 17, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.3, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.5, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
spark3 (3.3, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 17, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.1, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.3, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.3, 11, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 11, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
spark3 (3.5, 11, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.5, 11, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.2, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.0, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.0, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.4, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.2, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.2, 8, 2.12, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 17, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 8, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
spark3 (3.5, 8, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.5, 8, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 17, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
spark3 (3.5, 17, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.5, 17, 2.12, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 8, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
spark3 (3.5, 8, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.4, 8, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.4, 11, 2.13, org.apache.spark.shuffle.sort.io.LocalDiskShuffleDataIO)
Process completed with exit code 1.
spark3 (3.5, 17, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
spark3 (3.5, 17, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Job 1 cancelled because SparkContext was shut down
spark3 (3.5, 17, 2.13, org.apache.spark.shuffle.celeborn.CelebornShuffleDataIO)
Process completed with exit code 1.

Artifacts

Produced during runtime
Name Size
mr-java-11-unit-test-log Expired
182 MB
mr-java-8-unit-test-log Expired
187 MB
service-java-11-scala-2.12.15-unit-test-log Expired
670 KB
service-java-11-scala-2.13.5-unit-test-log Expired
692 KB
service-java-17-scala-2.12.15-unit-test-log Expired
693 KB
service-java-17-scala-2.13.5-unit-test-log Expired
666 KB
service-java-8-scala-2.12.15-unit-test-log Expired
716 KB
service-java-8-scala-2.13.5-unit-test-log Expired
679 KB
spark-2.4-java-8-scala-2.11.12-unit-test-log Expired
3.77 MB
spark-2.4-java-8-scala-2.12.10-unit-test-log Expired
3.9 MB
spark-3.0-java-11-scala-2.12.10-unit-test-log Expired
5.36 MB
spark-3.0-java-8-scala-2.12.10-unit-test-log Expired
5.97 MB
spark-3.1-java-11-scala-2.12.10-unit-test-log Expired
5.57 MB
spark-3.1-java-8-scala-2.12.10-unit-test-log Expired
5.39 MB
spark-3.2-java-11-scala-2.12.15-unit-test-log Expired
5.41 MB
spark-3.2-java-11-scala-2.13.5-unit-test-log Expired
5.77 MB
spark-3.2-java-8-scala-2.12.15-unit-test-log Expired
5.94 MB
spark-3.2-java-8-scala-2.13.5-unit-test-log Expired
5.48 MB
spark-3.3-java-11-scala-2.12.15-unit-test-log Expired
5.64 MB
spark-3.3-java-11-scala-2.13.5-unit-test-log Expired
5.5 MB
spark-3.3-java-17-scala-2.12.15-unit-test-log Expired
5.78 MB
spark-3.3-java-17-scala-2.13.5-unit-test-log Expired
5.39 MB
spark-3.3-java-8-scala-2.12.15-unit-test-log Expired
5.59 MB
spark-3.3-java-8-scala-2.13.5-unit-test-log Expired
5.98 MB
spark-3.4-java-11-scala-2.12.17-unit-test-log Expired
5.64 MB
spark-3.4-java-11-scala-2.13.5-unit-test-log Expired
5.88 MB
spark-3.4-java-17-scala-2.12.17-unit-test-log Expired
5.79 MB
spark-3.4-java-17-scala-2.13.5-unit-test-log Expired
5.83 MB
spark-3.4-java-8-scala-2.12.17-unit-test-log Expired
5.59 MB
spark-3.4-java-8-scala-2.13.5-unit-test-log Expired
5.7 MB
spark-3.5-java-11-scala-2.12.18-unit-test-log Expired
5.38 MB
spark-3.5-java-11-scala-2.13.5-unit-test-log Expired
5.5 MB
spark-3.5-java-17-scala-2.12.18-unit-test-log Expired
5.96 MB
spark-3.5-java-17-scala-2.13.5-unit-test-log Expired
5.67 MB
spark-3.5-java-8-scala-2.12.18-unit-test-log Expired
5.69 MB
spark-3.5-java-8-scala-2.13.5-unit-test-log Expired
5.42 MB