Yes, I would only onto 1 slave which would execute your task. Why you need download files to other slaves which not execute your task?
On Sun, Oct 4, 2015 at 6:27 AM, Rodrick Brown <rodr...@orchardplatform.com> wrote: > It downloads but only onto 1 slave how do others get around this? I would > think the files would be placed on all slaves. > > Sent from Outlook <http://aka.ms/Ox5hz3> > > > > > On Sat, Oct 3, 2015 at 4:43 AM -0700, "haosdent" <haosd...@gmail.com> > wrote: > > Hi, @Rodrick Sorry for could not understand your problem here. Do you mean >> your job depends on files on hdfs and it could not download in slaves after >> you execute spark-submit? >> >> On Sat, Oct 3, 2015 at 5:07 AM, Rodrick Brown <rodr...@orchard-app.com> >> wrote: >> >>> For some reason my jobs are not being copied to all the slaves when >>> they’re download from hdfs am I missing something obvious? >>> They only seem to be copied to the node where the job is submitted. >>> >>> -- >>> >>> [image: Orchard Platform] <http://www.orchardplatform.com/> >>> >>> Rodrick Brown / DevOPs Engineer >>> +1 917 445 6839 / rodr...@orchardplatform.com >>> <char...@orchardplatform.com> >>> >>> Orchard Platform >>> 101 5th Avenue, 4th Floor, New York, NY 10003 >>> http://www.orchardplatform.com >>> >>> Orchard Blog <http://www.orchardplatform.com/blog/> | Marketplace >>> Lending Meetup <http://www.meetup.com/Peer-to-Peer-Lending-P2P/> >>> >>> >>> *NOTICE TO RECIPIENTS*: This communication is confidential and intended >>> for the use of the addressee only. If you are not an intended recipient of >>> this communication, please delete it immediately and notify the sender >>> by return email. Unauthorized reading, dissemination, distribution or >>> copying of this communication is prohibited. This communication does not >>> constitute >>> an offer to sell or a solicitation of an indication of interest to purchase >>> any loan, security or any other financial product or instrument, nor is it >>> an offer to sell or a solicitation of an indication of interest to purchase >>> any products or services to any persons who are prohibited from receiving >>> such information under applicable law. The contents of this communication >>> may not be accurate or complete and are subject to change without notice. >>> As such, Orchard App, Inc. (including its subsidiaries and affiliates, >>> "Orchard") makes no representation regarding the accuracy or >>> completeness of the information contained herein. The intended recipient is >>> advised to consult its own professional advisors, including those >>> specializing in legal, tax and accounting matters. Orchard does not >>> provide legal, tax or accounting advice. >>> >> >> >> >> -- >> Best Regards, >> Haosdent Huang >> > > *NOTICE TO RECIPIENTS*: This communication is confidential and intended > for the use of the addressee only. If you are not an intended recipient of > this communication, please delete it immediately and notify the sender by > return email. Unauthorized reading, dissemination, distribution or copying > of this communication is prohibited. This communication does not constitute > an offer to sell or a solicitation of an indication of interest to purchase > any loan, security or any other financial product or instrument, nor is it > an offer to sell or a solicitation of an indication of interest to purchase > any products or services to any persons who are prohibited from receiving > such information under applicable law. The contents of this communication > may not be accurate or complete and are subject to change without notice. > As such, Orchard App, Inc. (including its subsidiaries and affiliates, > "Orchard") makes no representation regarding the accuracy or completeness > of the information contained herein. The intended recipient is advised to > consult its own professional advisors, including those specializing in > legal, tax and accounting matters. Orchard does not provide legal, tax or > accounting advice. > -- Best Regards, Haosdent Huang
