[GitHub] [spark] viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-05 Thread GitBox
viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-562363790 Let me check if it is also reproducible with big partition number + iteration on existing

[GitHub] [spark] viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-01 Thread GitBox
viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-560187625 That's good point! I checked the alpha value during fitting for 5 partitions. At th

[GitHub] [spark] viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-01 Thread GitBox
viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-560187625 That's good point! I checked the alpha value during fitting for 5 partitions. At th

[GitHub] [spark] viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-11-30 Thread GitBox
viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-560061826 I ran the test shown in the description. With the number of partitions as 1 to 50:

[GitHub] [spark] viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-11-30 Thread GitBox
viirya edited a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-560061826 I ran the test shown in the description. With the number of partitions increasing from 1: