[
https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-5682:
Comment: was deleted
(was: Steps were added to encode and decode the data, the performance will not
be
[
https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-5682:
Comment: was deleted
(was: The solution relied on hadoop API and maybe downgrade the performance．
The AES
[
https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-5682:
Comment: was deleted
(was: Since the encrypted shuffle in spark is focus on the common module, it
maybe
[
https://issues.apache.org/jira/browse/SPARK-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281296#comment-15281296
]
hujiayin commented on SPARK-15174:
--
[~ihalsema]I just tested this case in my environment with the latest
[
https://issues.apache.org/jira/browse/SPARK-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-15174:
-
Comment: was deleted
(was: I could fix it.)
> DataFrame does not have correct number of rows after
[
https://issues.apache.org/jira/browse/SPARK-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273805#comment-15273805
]
hujiayin edited comment on SPARK-15174 at 5/12/16 4:09 AM:
---
I could fix it.
[
https://issues.apache.org/jira/browse/SPARK-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-14623:
-
Description:
It relates to https://issues.apache.org/jira/browse/SPARK-7445
Map the labels to 0/1.
For
[
https://issues.apache.org/jira/browse/SPARK-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273805#comment-15273805
]
hujiayin commented on SPARK-15174:
--
@Ian Hellstrom, I think the issue is caused by "if
[
https://issues.apache.org/jira/browse/SPARK-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270161#comment-15270161
]
hujiayin edited comment on SPARK-14772 at 5/4/16 6:04 AM:
--
@holdenk, I had a
[
https://issues.apache.org/jira/browse/SPARK-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270161#comment-15270161
]
hujiayin commented on SPARK-14772:
--
@holdenk, I have a code for this issue and was busy with the other
[
https://issues.apache.org/jira/browse/SPARK-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-14772:
-
Comment: was deleted
(was: I can submit a code to fix this issue and I'm testing it.)
> Python ML
[
https://issues.apache.org/jira/browse/SPARK-14772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253035#comment-15253035
]
hujiayin commented on SPARK-14772:
--
I can submit a code to fix this issue and I'm testing it.
> Python
[
https://issues.apache.org/jira/browse/SPARK-14712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247141#comment-15247141
]
hujiayin edited comment on SPARK-14712 at 4/19/16 3:59 AM:
---
Hi Gayathri, I
[
https://issues.apache.org/jira/browse/SPARK-14712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247141#comment-15247141
]
hujiayin commented on SPARK-14712:
--
Hi Murali, I think self has the numFeatures and numClasses defined
[
https://issues.apache.org/jira/browse/SPARK-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244061#comment-15244061
]
hujiayin edited comment on SPARK-14623 at 4/16/16 8:24 AM:
---
Hi Joseph, I think
[
https://issues.apache.org/jira/browse/SPARK-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244061#comment-15244061
]
hujiayin commented on SPARK-14623:
--
Hi Joseph, I think it is similar as the combination of StringIndexer
[
https://issues.apache.org/jira/browse/SPARK-14523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242661#comment-15242661
]
hujiayin commented on SPARK-14523:
--
We can add ARIMA to Spark.
> Feature parity for Statistics ML with
[
https://issues.apache.org/jira/browse/SPARK-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-14623:
-
Description:
It relates to https://issues.apache.org/jira/browse/SPARK-7445
Map the labels to 0/1.
For
[
https://issues.apache.org/jira/browse/SPARK-14622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240550#comment-15240550
]
hujiayin commented on SPARK-14622:
--
I think it is also better to maintain the number of lost executors.
hujiayin created SPARK-14623:
Summary: add label binarizer
Key: SPARK-14623
URL: https://issues.apache.org/jira/browse/SPARK-14623
Project: Spark
Issue Type: Improvement
Components:
[
https://issues.apache.org/jira/browse/SPARK-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-7445:
Comment: was deleted
(was: If no one works on it, I'd like to submit a code for this issue.)
>
[
https://issues.apache.org/jira/browse/SPARK-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238799#comment-15238799
]
hujiayin commented on SPARK-7445:
-
If no one works on it, I'd like to submit a code for this issue.
>
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-4036:
Attachment: crf-spark.zip
latest CRF codes
> Add Conditional Random Fields (CRF) algorithm to Spark MLlib
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-4036:
Comment: was deleted
(was: latest CRF codes)
> Add Conditional Random Fields (CRF) algorithm to Spark
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059266#comment-15059266
]
hujiayin commented on SPARK-4036:
-
Hi Andrew,
With your latest template file sent to me, I think your case
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010353#comment-15010353
]
hujiayin edited comment on SPARK-4036 at 12/7/15 8:10 AM:
--
Hi Sasaki,
I'm not
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044223#comment-15044223
]
hujiayin commented on SPARK-4036:
-
Hi Andrew,
The code is implemented by Scala and integrated with Spark.
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044223#comment-15044223
]
hujiayin edited comment on SPARK-4036 at 12/7/15 1:00 AM:
--
Hi Andrew,
The code
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010353#comment-15010353
]
hujiayin edited comment on SPARK-4036 at 11/19/15 7:09 AM:
---
Hi Sasaki,
I'm not
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-4036:
Comment: was deleted
(was: ok)
> Add Conditional Random Fields (CRF) algorithm to Spark MLlib
>
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-4036:
Comment: was deleted
(was: ok)
> Add Conditional Random Fields (CRF) algorithm to Spark MLlib
>
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-4036:
Comment: was deleted
(was: ok)
> Add Conditional Random Fields (CRF) algorithm to Spark MLlib
>
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15013097#comment-15013097
]
hujiayin commented on SPARK-4036:
-
ok
> Add Conditional Random Fields (CRF) algorithm to Spark MLlib
>
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15013098#comment-15013098
]
hujiayin commented on SPARK-4036:
-
ok
> Add Conditional Random Fields (CRF) algorithm to Spark MLlib
>
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15013096#comment-15013096
]
hujiayin commented on SPARK-4036:
-
ok
> Add Conditional Random Fields (CRF) algorithm to Spark MLlib
>
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15013095#comment-15013095
]
hujiayin commented on SPARK-4036:
-
ok
> Add Conditional Random Fields (CRF) algorithm to Spark MLlib
>
[
https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010353#comment-15010353
]
hujiayin commented on SPARK-4036:
-
Hi Sasaki,
I'm not sure if you worked on it as the jira is still open.
[
https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975993#comment-14975993
]
hujiayin commented on SPARK-11200:
--
sparkscore found it happened since commit number cf2e0ae7 and
[
https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-11200:
-
Comment: was deleted
(was: sparkscore found it happened since commit number cf2e0ae7 and resolved
[
https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-11200:
-
Affects Version/s: (was: 1.5.1)
1.6.0
> NettyRpcEnv endless message "cannot
[
https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966119#comment-14966119
]
hujiayin edited comment on SPARK-11200 at 10/22/15 2:37 AM:
Hi Sean,
I think
[
https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966119#comment-14966119
]
hujiayin edited comment on SPARK-11200 at 10/21/15 2:13 AM:
Hi Sean,
I think
[
https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966119#comment-14966119
]
hujiayin commented on SPARK-11200:
--
Hi Sean,
I think it doesn't relate to environment since version 1.4
hujiayin created SPARK-11200:
Summary: NettyRpcEnv endless message "cannot send ${message}
because RpcEnv is closed"
Key: SPARK-11200
URL: https://issues.apache.org/jira/browse/SPARK-11200
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-11200:
-
Description:
The endless messages "cannot send ${message}because RpcEnv is closed" are pop
up after
[
https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-11200:
-
Description:
The endless messages "cannot send ${message}because RpcEnv is closed" are pop
up after
[
https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-6724:
Comment: was deleted
(was: ok, : ))
> Model import/export for FPGrowth
>
[
https://issues.apache.org/jira/browse/SPARK-10329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-10329:
-
Comment: was deleted
(was: ok, I will try to fix it today)
Cost RDD in k-means|| initialization is not
[
https://issues.apache.org/jira/browse/SPARK-10329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721799#comment-14721799
]
hujiayin commented on SPARK-10329:
--
ok, I will try to fix it today
Cost RDD in
[
https://issues.apache.org/jira/browse/SPARK-10329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718039#comment-14718039
]
hujiayin commented on SPARK-10329:
--
Hi Xiangrui,
I'll try to fix it in 1.6.
Cost RDD
[
https://issues.apache.org/jira/browse/SPARK-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-9779:
Description:
When I try to open the web-UI from AM in yarn-cluster mode, I meet the HTTP500
error as
[
https://issues.apache.org/jira/browse/SPARK-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-9779:
Description:
When I try to open the web-UI from AM in yarn-cluster mode, I meet the HTTP500
error as
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679782#comment-14679782
]
hujiayin commented on SPARK-5837:
-
yes, I've tried all the setting above. The issue just
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-5837:
Comment: was deleted
(was: The master doesn't have this problem. The other parts works well except
the
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679817#comment-14679817
]
hujiayin commented on SPARK-5837:
-
The master doesn't have this problem. The other parts
hujiayin created SPARK-9779:
---
Summary: HTTP500 revisit when open web-UI in yarn-cluster
yarn-client mode (1.2-1.3)
Key: SPARK-9779
URL: https://issues.apache.org/jira/browse/SPARK-9779
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679818#comment-14679818
]
hujiayin commented on SPARK-5837:
-
The master doesn't have this problem. The other parts
[
https://issues.apache.org/jira/browse/SPARK-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679730#comment-14679730
]
hujiayin commented on SPARK-5837:
-
Hi Sean,
I meet this problem on spark 1.2 1.2.1 1.2.2
[
https://issues.apache.org/jira/browse/SPARK-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642144#comment-14642144
]
hujiayin commented on SPARK-9129:
-
ok : )
Integrate convolutional deep belief networks
hujiayin created SPARK-9129:
---
Summary: Integrate convolutional deep belief networks for visual
recognition tasks
Key: SPARK-9129
URL: https://issues.apache.org/jira/browse/SPARK-9129
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616264#comment-14616264
]
hujiayin commented on SPARK-6724:
-
Can I take a look at this issue?
Model import/export
[
https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616275#comment-14616275
]
hujiayin commented on SPARK-6724:
-
ok, : )
Model import/export for FPGrowth
[
https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-6724:
Comment: was deleted
(was: Can I take a look at this issue?)
Model import/export for FPGrowth
[
https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611527#comment-14611527
]
hujiayin edited comment on SPARK-5682 at 7/2/15 6:10 AM:
-
Steps
[
https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611527#comment-14611527
]
hujiayin edited comment on SPARK-5682 at 7/2/15 6:03 AM:
-
Steps
[
https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611527#comment-14611527
]
hujiayin edited comment on SPARK-5682 at 7/2/15 6:02 AM:
-
steps
[
https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611527#comment-14611527
]
hujiayin commented on SPARK-5682:
-
steps were added to encode and decode the data, the
[
https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611553#comment-14611553
]
hujiayin commented on SPARK-5682:
-
Since the encrypted shuffle in spark is focus on the
[
https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611328#comment-14611328
]
hujiayin commented on SPARK-5682:
-
The solution relied on hadoop API and maybe downgrade
[
https://issues.apache.org/jira/browse/SPARK-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hujiayin updated SPARK-8370:
Comment: was deleted
(was: Does the datasource has size limitation)
Add API for data sources to register
70 matches
Mail list logo
