[
https://issues.apache.org/jira/browse/HIVE-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098147#comment-14098147
]
Brock Noland commented on HIVE-7739:
------------------------------------
Yeah I see what you are saying. My thought was that until we have a bunch of,
perhaps the majority, of the tests enabled, the most common case will be
running tests which we are not sure if they should be added to
spark.query.files. Finding tests which currently pass is then the following
process:
* add the tests to spark.query.files
* run the tests with -Dqfile
* remove the ones that don't pass because they do something we don't yet support
as opposed to just running the tests with -Dqfile.
My thought on how to handle your use case is:
from itests dir:
{noformat}
mvn test ... -Dqfile="$(perl -pe 's@\\ *\n@@g'
src/test/resources/testconfiguration.properties | awk -F= '/spark.query.files=/
{print $2}')"
{noformat}
I am open to both options. Thoughts?
> TestSparkCliDriver should not use includeQueryFiles
> ---------------------------------------------------
>
> Key: HIVE-7739
> URL: https://issues.apache.org/jira/browse/HIVE-7739
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Brock Noland
> Assignee: Brock Noland
> Attachments: HIVE-7739.1-spark.patch
>
>
> By using includesQueryFile TestSparkCliDriver cannot be used by -Dqfile or
> -Dqfile_regex. These options are very useful so let's remove it.
> spark.query.files in testconfiguration.properties will still be used when run
> via the pre-commit tests to generate -Dqfiles
--
This message was sent by Atlassian JIRA
(v6.2#6252)