[jira] [Created] (SPARK-29934) Dataset support GraphX

2019-11-17 Thread darion yaphet (Jira)
darion yaphet created SPARK-29934: - Summary: Dataset support GraphX Key: SPARK-29934 URL: https://issues.apache.org/jira/browse/SPARK-29934 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21265) Cache method could specified name

2017-06-30 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-21265: -- Component/s: (was: Spark Core) > Cache method could specified name >

[jira] [Created] (SPARK-21265) Cache method could specified name

2017-06-30 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21265: - Summary: Cache method could specified name Key: SPARK-21265 URL: https://issues.apache.org/jira/browse/SPARK-21265 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-21233) Support pluggable offset storage

2017-06-28 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066179#comment-16066179 ] darion yaphet edited comment on SPARK-21233 at 6/28/17 9:14 AM: Hi

[jira] [Comment Edited] (SPARK-21233) Support pluggable offset storage

2017-06-28 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066179#comment-16066179 ] darion yaphet edited comment on SPARK-21233 at 6/28/17 9:13 AM:

[jira] [Comment Edited] (SPARK-21233) Support pluggable offset storage

2017-06-28 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066179#comment-16066179 ] darion yaphet edited comment on SPARK-21233 at 6/28/17 9:13 AM:

[jira] [Commented] (SPARK-21233) Support pluggable offset storage

2017-06-28 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066179#comment-16066179 ] darion yaphet commented on SPARK-21233: --- [Sean Owen|sro...@gmail.com] In Kafka-0.8 it's using

[jira] [Created] (SPARK-21233) Support pluggable offset storage

2017-06-27 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21233: - Summary: Support pluggable offset storage Key: SPARK-21233 URL: https://issues.apache.org/jira/browse/SPARK-21233 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-21191) DataFrame Row StructType check duplicate name

2017-06-23 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21191: - Summary: DataFrame Row StructType check duplicate name Key: SPARK-21191 URL: https://issues.apache.org/jira/browse/SPARK-21191 Project: Spark Issue Type:

[jira] [Updated] (SPARK-21116) Support map_contains function

2017-06-16 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-21116: -- Summary: Support map_contains function (was: Support MapKeyContains function) > Support

[jira] [Updated] (SPARK-21116) Support MapKeyContains function

2017-06-16 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-21116: -- Description: map_contains(map , key) Check whether the map contains the key . Returns true if

[jira] [Updated] (SPARK-21116) Support MapKeyContains function

2017-06-16 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-21116: -- Description: map_contains(map , key) Check whether the map contains the key . Returns true if

[jira] [Created] (SPARK-21116) Support MapKeyContains function

2017-06-16 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21116: - Summary: Support MapKeyContains function Key: SPARK-21116 URL: https://issues.apache.org/jira/browse/SPARK-21116 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-21104) Support sort with index when parse LibSVM Record

2017-06-15 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051388#comment-16051388 ] darion yaphet commented on SPARK-21104: --- we should make sure the array is in ordered instead of

[jira] [Commented] (SPARK-21104) Support sort with index when parse LibSVM Record

2017-06-15 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16050267#comment-16050267 ] darion yaphet commented on SPARK-21104: --- The feature sort by index is not necessary . So I add a

[jira] [Updated] (SPARK-21104) Support sort with index when parse LibSVM Record

2017-06-15 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-21104: -- Description: When I'm loading LibSVM from HDFS , I found feature index should be in ascending

[jira] [Created] (SPARK-21104) Support sort with index when parse LibSVM Record

2017-06-15 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21104: - Summary: Support sort with index when parse LibSVM Record Key: SPARK-21104 URL: https://issues.apache.org/jira/browse/SPARK-21104 Project: Spark Issue

[jira] [Updated] (SPARK-21073) Support map_keys and map_values functions in DataSet

2017-06-13 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-21073: -- Summary: Support map_keys and map_values functions in DataSet (was: Support map_keys and

[jira] [Updated] (SPARK-21073) Support map_keys and map_values in DataSet

2017-06-13 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-21073: -- Summary: Support map_keys and map_values in DataSet (was: Support map_keys and map_values in

[jira] [Created] (SPARK-21073) Support map_keys and map_values in DataSet and DataFrame

2017-06-13 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21073: - Summary: Support map_keys and map_values in DataSet and DataFrame Key: SPARK-21073 URL: https://issues.apache.org/jira/browse/SPARK-21073 Project: Spark

[jira] [Updated] (SPARK-21066) LibSVM load just one input file

2017-06-12 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-21066: -- Description: Currently when we using SVM to train dataset we found the input files limit only

[jira] [Created] (SPARK-21066) LibSVM load just one input file

2017-06-12 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21066: - Summary: LibSVM load just one input file Key: SPARK-21066 URL: https://issues.apache.org/jira/browse/SPARK-21066 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-21032) Support add_years and add_days functions

2017-06-11 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046187#comment-16046187 ] darion yaphet commented on SPARK-21032: --- Yes it seems have implement this functions . Should we add

[jira] [Created] (SPARK-21032) Support add_years and add_days functions

2017-06-09 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21032: - Summary: Support add_years and add_days functions Key: SPARK-21032 URL: https://issues.apache.org/jira/browse/SPARK-21032 Project: Spark Issue Type: New

[jira] [Created] (SPARK-21015) Check field name is not null and empty in GenericRowWithSchema

2017-06-08 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21015: - Summary: Check field name is not null and empty in GenericRowWithSchema Key: SPARK-21015 URL: https://issues.apache.org/jira/browse/SPARK-21015 Project: Spark

[jira] [Created] (SPARK-21014) Support get fields with schema name

2017-06-08 Thread darion yaphet (JIRA)
darion yaphet created SPARK-21014: - Summary: Support get fields with schema name Key: SPARK-21014 URL: https://issues.apache.org/jira/browse/SPARK-21014 Project: Spark Issue Type: New

[jira] [Closed] (SPARK-20968) Support separator in Tokenizer

2017-06-04 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed SPARK-20968. - Resolution: Fixed > Support separator in Tokenizer > -- > >

[jira] [Created] (SPARK-20968) Support separator in Tokenizer

2017-06-02 Thread darion yaphet (JIRA)
darion yaphet created SPARK-20968: - Summary: Support separator in Tokenizer Key: SPARK-20968 URL: https://issues.apache.org/jira/browse/SPARK-20968 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-20740) Expose UserDefinedType make sure could extends it

2017-05-15 Thread darion yaphet (JIRA)
darion yaphet created SPARK-20740: - Summary: Expose UserDefinedType make sure could extends it Key: SPARK-20740 URL: https://issues.apache.org/jira/browse/SPARK-20740 Project: Spark Issue

[jira] [Updated] (SPARK-20675) Support Index to skip when retrieval disk structure in CoGroupedRDD

2017-05-09 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-20675: -- Description: CoGroupedRDD's compute() will retrieval each StreamBuffer(a disk structure

[jira] [Created] (SPARK-20675) Support Index to skip when retrieval disk structure in CoGroupedRDD

2017-05-09 Thread darion yaphet (JIRA)
darion yaphet created SPARK-20675: - Summary: Support Index to skip when retrieval disk structure in CoGroupedRDD Key: SPARK-20675 URL: https://issues.apache.org/jira/browse/SPARK-20675 Project:

[jira] [Closed] (SPARK-20610) Support a function get DataFrame/DataSet from Transformer

2017-05-05 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed SPARK-20610. - Resolution: Won't Fix > Support a function get DataFrame/DataSet from Transformer >

[jira] [Created] (SPARK-20610) Support a function get DataFrame/DataSet from Transformer

2017-05-05 Thread darion yaphet (JIRA)
darion yaphet created SPARK-20610: - Summary: Support a function get DataFrame/DataSet from Transformer Key: SPARK-20610 URL: https://issues.apache.org/jira/browse/SPARK-20610 Project: Spark

[jira] [Created] (SPARK-20469) Add a method to display DataFrame schema in PipelineStage

2017-04-26 Thread darion yaphet (JIRA)
darion yaphet created SPARK-20469: - Summary: Add a method to display DataFrame schema in PipelineStage Key: SPARK-20469 URL: https://issues.apache.org/jira/browse/SPARK-20469 Project: Spark

[jira] [Closed] (SPARK-20276) ScheduleExecutorService control sleep interval

2017-04-10 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed SPARK-20276. - Resolution: Won't Fix > ScheduleExecutorService control sleep interval >

[jira] [Commented] (SPARK-20276) ScheduleExecutorService control sleep interval

2017-04-10 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962630#comment-15962630 ] darion yaphet commented on SPARK-20276: --- thanks for you response :)

[jira] [Created] (SPARK-20276) ScheduleExecutorService control sleep interval

2017-04-10 Thread darion yaphet (JIRA)
darion yaphet created SPARK-20276: - Summary: ScheduleExecutorService control sleep interval Key: SPARK-20276 URL: https://issues.apache.org/jira/browse/SPARK-20276 Project: Spark Issue

[jira] [Created] (SPARK-19794) Release HDFS Client after read/write checkpoint

2017-03-02 Thread darion yaphet (JIRA)
darion yaphet created SPARK-19794: - Summary: Release HDFS Client after read/write checkpoint Key: SPARK-19794 URL: https://issues.apache.org/jira/browse/SPARK-19794 Project: Spark Issue

[jira] [Created] (SPARK-18064) Spark SQL can't load default config file

2016-10-23 Thread darion yaphet (JIRA)
darion yaphet created SPARK-18064: - Summary: Spark SQL can't load default config file Key: SPARK-18064 URL: https://issues.apache.org/jira/browse/SPARK-18064 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-18047) Spark worker port should be greater than 1023

2016-10-21 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-18047: -- Description: The port numbers in the range from 0 to 1023 are the well-known ports (system

[jira] [Created] (SPARK-18047) Spark worker port should be greater than 1023

2016-10-21 Thread darion yaphet (JIRA)
darion yaphet created SPARK-18047: - Summary: Spark worker port should be greater than 1023 Key: SPARK-18047 URL: https://issues.apache.org/jira/browse/SPARK-18047 Project: Spark Issue Type: