[jira] [Commented] (SPARK-41311) Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

2023-01-02 Thread Immanuel Buder (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-41311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17653682#comment-17653682
 ] 

Immanuel Buder commented on SPARK-41311:


working on this

> Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space
> ---
>
> Key: SPARK-41311
> URL: https://issues.apache.org/jira/browse/SPARK-41311
> Project: Spark
>  Issue Type: Sub-task
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: Immanuel Buder
>Priority: Minor
>
> Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* in 
> [QueryExecutionErrorsSuite.scala|https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18be]
>  to trigger the error from user space. The current test uses non-user-facing 
> class FileSystemBasedCheckpointFileManager directly to trigger the error. 
> (see 
> [https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680]
>  )
> Done when: the test uses user-facing APIs as much as possible.
> Proposed solution: rewrite the test following the example of 
> [https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641]
> See [https://github.com/apache/spark/pull/38782#discussion_r1033013064] for 
> more context



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-41311) Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

2022-11-28 Thread Immanuel Buder (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-41311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Immanuel Buder updated SPARK-41311:
---
Description: 
Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* in 
[QueryExecutionErrorsSuite.scala|https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18be]
 to trigger the error from user space. The current test uses non-user-facing 
class FileSystemBasedCheckpointFileManager directly to trigger the error. (see 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680]
 )

Done when: the test uses user-facing APIs as much as possible.

Proposed solution: rewrite the test following the example of 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641]

See [https://github.com/apache/spark/pull/38782#discussion_r1033013064] for 
more context

  was:
Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* in 
[QueryExecutionErrorsSuite.scala|https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18be]
 to trigger the error from user space. The current test uses non-user-facing 
class FileSystemBasedCheckpointFileManager to trigger the error. (see 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680]
 )

Done when: the test uses user-facing APIs as much as possible.

Proposed solution: rewrite the test following the example of 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641]

See [https://github.com/apache/spark/pull/38782#discussion_r1033013064] for 
more context


> Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space
> ---
>
> Key: SPARK-41311
> URL: https://issues.apache.org/jira/browse/SPARK-41311
> Project: Spark
>  Issue Type: Sub-task
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: Immanuel Buder
>Priority: Minor
>
> Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* in 
> [QueryExecutionErrorsSuite.scala|https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18be]
>  to trigger the error from user space. The current test uses non-user-facing 
> class FileSystemBasedCheckpointFileManager directly to trigger the error. 
> (see 
> [https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680]
>  )
> Done when: the test uses user-facing APIs as much as possible.
> Proposed solution: rewrite the test following the example of 
> [https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641]
> See [https://github.com/apache/spark/pull/38782#discussion_r1033013064] for 
> more context



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-41311) Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

2022-11-28 Thread Immanuel Buder (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-41311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Immanuel Buder updated SPARK-41311:
---
Description: 
Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* in 
[QueryExecutionErrorsSuite.scala|https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18be]
 to trigger the error from user space. The current test uses non-user-facing 
class FileSystemBasedCheckpointFileManager to trigger the error. (see 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680]
 )

Done when: the test uses user-facing APIs as much as possible.

Proposed solution: rewrite the test following the example of 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641]

See [https://github.com/apache/spark/pull/38782#discussion_r1033013064] for 
more context

  was:
Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* to trigger the 
error from user space. The current test uses non-user-facing class 
FileSystemBasedCheckpointFileManager to trigger the error. (see 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680]
 )

Done when: the test uses user-facing APIs as much as possible.

Proposed solution: rewrite the test following the example of 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641]

See [https://github.com/apache/spark/pull/38782#discussion_r1033013064] for 
more context


> Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space
> ---
>
> Key: SPARK-41311
> URL: https://issues.apache.org/jira/browse/SPARK-41311
> Project: Spark
>  Issue Type: Sub-task
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: Immanuel Buder
>Priority: Minor
>
> Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* in 
> [QueryExecutionErrorsSuite.scala|https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18be]
>  to trigger the error from user space. The current test uses non-user-facing 
> class FileSystemBasedCheckpointFileManager to trigger the error. (see 
> [https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680]
>  )
> Done when: the test uses user-facing APIs as much as possible.
> Proposed solution: rewrite the test following the example of 
> [https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641]
> See [https://github.com/apache/spark/pull/38782#discussion_r1033013064] for 
> more context



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-41311) Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

2022-11-28 Thread Immanuel Buder (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-41311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Immanuel Buder updated SPARK-41311:
---
Description: 
Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* to trigger the 
error from user space. The current test uses non-user-facing class 
FileSystemBasedCheckpointFileManager to trigger the error. (see 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680]
 )

Done when: the test uses user-facing APIs as much as possible.

Proposed solution: rewrite the test following the example of 
[https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641]

See [https://github.com/apache/spark/pull/38782#discussion_r1033013064] for 
more context

> Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space
> ---
>
> Key: SPARK-41311
> URL: https://issues.apache.org/jira/browse/SPARK-41311
> Project: Spark
>  Issue Type: Sub-task
>  Components: SQL
>Affects Versions: 3.4.0
>Reporter: Immanuel Buder
>Priority: Minor
>
> Rewrite the test for error class *RENAME_SRC_PATH_NOT_FOUND* to trigger the 
> error from user space. The current test uses non-user-facing class 
> FileSystemBasedCheckpointFileManager to trigger the error. (see 
> [https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR680]
>  )
> Done when: the test uses user-facing APIs as much as possible.
> Proposed solution: rewrite the test following the example of 
> [https://github.com/apache/spark/pull/38782/files/bea17e4fa61a06ff566b0ff1c3fcc39fa1100912#diff-b1989c7e0e4b50291fb7bdd2993da387102c669a47fe6e2077b23b37d78b18beR641]
> See [https://github.com/apache/spark/pull/38782#discussion_r1033013064] for 
> more context



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-41311) Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the error from user space

2022-11-28 Thread Immanuel Buder (Jira)
Immanuel Buder created SPARK-41311:
--

 Summary: Rewrite test RENAME_SRC_PATH_NOT_FOUND to trigger the 
error from user space
 Key: SPARK-41311
 URL: https://issues.apache.org/jira/browse/SPARK-41311
 Project: Spark
  Issue Type: Sub-task
  Components: SQL
Affects Versions: 3.4.0
Reporter: Immanuel Buder






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org