Unsubscribe

Unsubscribe

Unsubscribe

-- Bibudh Lahiri, PhD Principal Researcher, Artificial Intelligence Accenture Services Pvt Ltd Unitech Infospace, DLF SEZ Sector 21, Gurugram, Haryana 122016

Unsubscribe

Unsubscribe

unsubscribe

unsubscribe

Unsubscribe

Unsubscribe -- Bibudh Lahiri Senior Data Scientist, Impetus Technolgoies 720 University Avenue, Suite 130 Los Gatos, CA 95129 http://knowthynumbers.blogspot.com/

unsubscribe

unsubscribe -- Bibudh Lahiri Senior Data Scientist, Impetus Technolgoies 720 University Avenue, Suite 130 Los Gatos, CA 95129 http://knowthynumbers.blogspot.com/

Unsubscribe

Unsubscribe -- Bibudh Lahiri Senior Data Scientist, Impetus Technolgoies 720 University Avenue, Suite 130 Los Gatos, CA 95129 http://knowthynumbers.blogspot.com/

How long should logistic regression take on this data?

g. Any ballpark about how long it should take? Are there some known benchmarks for logistic regression? -- Bibudh Lahiri Senior Data Scientist, Impetus Technolgoies 720 University Avenue, Suite 130 Los Gatos, CA 95129 http://knowthynumbers.blogspot.com/

Alternative to groupByKey() + mapValues() for non-commutative, non-associative aggregate?

r associative, since combining "29:1 30:1" and "32:1 110:1" to "32:1 110:1 29:1 30:1" is not going to work. Can someone suggest some faster alternative to the combination of groupByKey() and mapValues() for this? Thanks Bibudh -- Bibudh Lahiri Senior D

Re: EOFException while reading from HDFS

;dav...@databricks.com> wrote: > The Spark package you are using is packaged with Hadoop 2.6, but the > HDFS is Hadoop 1.0.4, they are not compatible. > > On Tue, Apr 26, 2016 at 11:18 AM, Bibudh Lahiri <bibudhlah...@gmail.com> > wrote: > > Hi, > > I am tr

EOFException while reading from HDFS

LASSPATH="/usr/local/hadoop-1.0.4/bin/hadoop" but none of it seems to work. However, the following command works from 172.26.49.55 and gives the directory listing: /usr/local/hadoop-1.0.4/bin/hadoop fs -ls hdfs://172.26.49.156:54310/ Any suggestion? Thanks Bibudh -- Bibudh Lahiri Data Scientist, Impetus Technolgoies 5300 Stevens Creek Blvd San Jose, CA 95129 http://knowthynumbers.blogspot.com/

Can this performance be improved?

re are 2.8*1024/32 = 89 blocks. The ~4 minute time means it is processing about 50k records per second per core/task. Does this performance look typical or is there room for improvement? Thanks Bibudh -- Bibudh Lahiri Data Scientist, Impetus Technolgoies 5300 Stevens Creek Blvd San Jose, CA

Re: Old hostname pops up while running Spark app

.net.UnknownHostException: IMPETUS-1466 ... 38 more On Tue, Apr 12, 2016 at 5:53 PM, Ted Yu <yuzhih...@gmail.com> wrote: > FYI > > > https://documentation.cpanel.net/display/CKB/How+To+Clear+Your+DNS+Cache#HowToClearYourDNSCache-MacOS > ®10.10 > https://www.whatsmydns.net/fl

Old hostname pops up while running Spark app

being picked up from? -- Bibudh Lahiri Data Scientist, Impetus Technolgoies 5300 Stevens Creek Blvd San Jose, CA 95129 http://knowthynumbers.blogspot.com/