Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/23010
But we may forget to filter null values when we write sql. The following
function protects this situation and writes the value of null partitions as
__HIVE_DEFAULT_PARTITION__
def
Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/23010
@cloud-fan, Thanks for review, Do you mean we should filter out invalid
partitions in sql before write?
---
-
To unsubscribe,
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23010
The root cause is, `DynamicPartitionDataWriter` treats null and empty
string as different partition values, and creates new files. However, null and
empty string are converted to
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/23010
cc @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99576/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23010
**[Test build #99576 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99576/testReport)**
for PR 23010 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/23010
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23010
**[Test build #99576 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99576/testReport)**
for PR 23010 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98715/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23010
**[Test build #98715 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98715/testReport)**
for PR 23010 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23010
**[Test build #98715 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98715/testReport)**
for PR 23010 at commit
17 matches
Mail list logo
