somebody else has also encountered such problem:
http://mail-archives.apache.org/mod_mbox/spark-user/201404.mbox/%3cafc0d60983129f4f9fbad571aa422c9a5af8f...@mail-mbx1.ad.renci.org%3E
2014-06-17 12:31 GMT+08:00 Andrew Ash and...@andrewash.com:
Hi qingyang,
This looks like an issue with the
Yep but no real resolution nor advances on this topic, since finally we've
chosen to stick with a compatible version of Mesos (0.14.1 ftm).
But I'm still convince it has to do with native libs clash :-s
aℕdy ℙetrella
about.me/noootsab
[image: aℕdy ℙetrella on about.me]
http://about.me/noootsab
here is the core stack info:
-
(gdb) bt
#0 0x7fc0153fc925 in raise () from /lib64/libc.so.6
#1 0x7fc0153fe105 in abort () from /lib64/libc.so.6
#2 0x7fc014d78405 in os::abort(bool) ()
from /home/zjw/jdk1.7/jdk1.7.0_51/jre/lib/amd64/server/libjvm.so
#3
I didn't get that error on Mac either:
java version 1.7.0_55
Java(TM) SE Runtime Environment (build 1.7.0_55-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.55-b03, mixed mode)
Darwin TYus-MacBook-Pro.local 12.5.0 Darwin Kernel Version 12.5.0: Sun Sep
29 13:33:47 PDT 2013;
Hi,
Just found it occasionally
https://issues.apache.org/jira/browse/SPARK-1471
Best,
--
Nan Zhu
Matt/Ryan,
Did you make any headway on this? My team is running into this also.
Doesn't happen on smaller datasets. Our input set is about 10 GB but we
generate 100s of GBs in the flow itself.
-Suren
On Fri, Jun 6, 2014 at 5:19 PM, Ryan Compton compton.r...@gmail.com wrote:
Just ran into
Hi all,
My name is Michael Giannakopoulos and I am a recent M.Sc. graduate
from University of Toronto majoring in Computer Science. I would like to
contribute in the development of this open source project. Is it possible
to work
under the supervision of a mentor? I specialize in Data Analytics,
Hi,
I am an intern at PalantirTech and we are building some stuff on top of
MLlib. In Particular, GLM is of great interest to us. Though
GeneralizedLinearModel in MLlib 1.0.0 has some important GLMs such as
Logistic Regression, Linear Regression, some other important GLMs like
Poisson Regression
I got stuck on this one too after did git pull from master.
Have not been able to resolve it yet =(
- Henry
On Wed, Jun 11, 2014 at 6:51 AM, Yijie Shen henry.yijies...@gmail.com wrote:
Thx Qiuzhuang, the problems disappeared after I add assembly jar at the head
of list dependencies in
Hi folks,
I am implementing a regression model for count data which uses LBFGS for
parameter estimation. Following the patterns in mllib.regression, I created an
object PoissonRegressionModelWithLBFGS, which creates a new instance of class
PoissonRegressionModelWithLBFGS and invokes the run
Hi Xiaokai,
I think MLLib is definitely interested in supporting additional GLMs. I'm
not aware of anybody working on this at the moment.
-Sandy
On Tue, Jun 17, 2014 at 5:00 PM, Xiaokai Wei x...@palantir.com wrote:
Hi,
I am an intern at PalantirTech and we are building some stuff on top
Cool, so maybe when we swith to Snappy instead of LZF, we can workaround the
bug until the LZF upstream fix it, right?
In addition, is it valuable to add support for other compression codecs such
as LZ4? We observed 5% end-to-end improvement using LZ4 vs Snappy in
Terasort (Hadoop MR).
--
View
Hi Gang,
This is a bug, and I'm the one who did it :) Just add the comment to your PR.
Thanks.
Sincerely,
DB Tsai
---
My Blog: https://www.dbtsai.com
LinkedIn: https://www.linkedin.com/in/dbtsai
On Tue, Jun 17, 2014 at 7:13 PM, Gang Bai
It is actually pluggable. You can implement new compression codecs and just
change the config variable to use those.
On Tuesday, June 17, 2014, gchen chenguanch...@gmail.com wrote:
Cool, so maybe when we swith to Snappy instead of LZF, we can workaround
the
bug until the LZF upstream fix it,
Hi Xiaokai,
Also take a look through Xiangrui's slides from HadoopSummit a few weeks
back: http://www.slideshare.net/xrmeng/m-llib-hadoopsummit The roadmap
starting at slide 51 will probably be interesting to you.
Andrew
On Tue, Jun 17, 2014 at 7:37 PM, Sandy Ryza sandy.r...@cloudera.com
Out of curiosity - are you guys using speculation, shuffle
consolidation, or any other non-default option? If so that would help
narrow down what's causing this corruption.
On Tue, Jun 17, 2014 at 10:40 AM, Surendranauth Hiraman
suren.hira...@velos.io wrote:
Matt/Ryan,
Did you make any headway
16 matches
Mail list logo
