Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
Thanks @gatorsmile. Sure, let me open a smaller one and cc you.
I know one reference in R:
```R
> d <- "col1,col2
+ 1,3
+ 2,4"
> df <- read.csv(text=d,
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/16611
This sounds fine to me, but we have to split this PR to multiple smaller
one with more test cases. For example, we can start it from the SQL interface.
Do you know how the other systems
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
Hi @gatorsmile, WDYT about this PR? I was looking through my old PRs to
close or update. I wonder if you think it looks fine to go ahead to you.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81385/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #81385 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81385/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #81385 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81385/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
gentle ping ...
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #79041 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79041/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79041/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #79041 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79041/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79040/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #79040 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79040/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #79040 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79040/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
gentle ping ...
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
gentle ping @rxin
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75359/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #75359 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75359/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #75359 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75359/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
@rxin, please let me know if there is anything you are not sure of. I will
double check. I am fine with closing too if you are not sure of the
implementation for now.
---
If your project is
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73905/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #73905 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73905/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #73905 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73905/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
@rxin, does this sounds okay to you?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73042/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #73042 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73042/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73041/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #73041 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73041/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73039/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #73039 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73039/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
Per 2f78cc7, I ran a build with Scala 2.10 as well.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #73042 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73042/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #73041 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73041/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #73039 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73039/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
Sure, I will rebase and update.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/16611
For SQL, rather than "array", can we follow Python, e.g.
```
CREATE TEMPORARY TABLE tableA USING csv
OPTIONS (nullValue ['NA', 'null'], ...)
```
---
If your project is set up for
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
@rxin, does that look okay to you? I am worried if
> **SQL** - array-like form of integer, decimal, string and boolean
sounds okay to you.
---
If your project is set up
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71788/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71788 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71788/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71782/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71788 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71788/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71782 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71782/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71782 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71782/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71771/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71771 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71771/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71771 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71771/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71650/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71650 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71650/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71649/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71649 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71649/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71650 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71650/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71649 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71649/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71601/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71601 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71601/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71601 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71601/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71600/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71600 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71600/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71600 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71600/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71590/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71590 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71590/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
I just added DDL support with some more tests with fixed PR description.
Could you please take another look and see if it makes sense?
---
If your project is set up for it, you can reply to
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
Ah, sure. Let me give a shot.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
I didn't mean to not support this in R and DDL syntax for this..
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user rxin commented on the issue:
https://github.com/apache/spark/pull/16611
Rather than just submitting code, can you put down the interfaces concisely
either in a doc or the pr description? As @falaki said, we need this to work in
DDL too. It is possible to just extend the
Github user falaki commented on the issue:
https://github.com/apache/spark/pull/16611
@HyukjinKwon as I laid out in the JIRA a major problem with this approach
for specifying multiple options is that it won't work in DDL. What is wrong
with having a numbered list. E.g.: `nullValue1,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71504/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71504 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71504/testReport)**
for PR 16611 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71504 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71504/testReport)**
for PR 16611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16611
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/71499/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71499 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71499/testReport)**
for PR 16611 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16611
(cc @falaki too.)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16611
**[Test build #71499 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/71499/testReport)**
for PR 16611 at commit
93 matches
Mail list logo
