thanks guys. anybody knows what generates the log like " myuser_20140716143232_d76043ed-1c4b-42a0-bf0a-2816377a6a2a.log" ? I checked our application code, it doesn't generate this, looks from hive.
On Fri, Jul 18, 2014 at 12:28 AM, Andre Araujo <ara...@pythian.com> wrote: > Make sure the directory you specify has the sticky bit set, otherwise > users will have permission problems: > > chmod 1777 <dir> > > > On 18 July 2014 14:19, Satish Mittal <satish.mit...@inmobi.com> wrote: > >> You can configure the following property in >> $HIVE_HOME/conf/hive-log4j.properties: >> >> hive.log.dir=<your location> >> >> The default value of this property is ${java.io.tmpdir}/${user.name}. >> >> Thanks, >> Satish >> >> >> On Thu, Jul 17, 2014 at 11:58 PM, Yang <teddyyyy...@gmail.com> wrote: >> >>> we just moved to hadoop2.0 (HDP2.1 distro). it turns out that the new >>> hive version generates a lot of logs into /tmp/ and is quickly creating the >>> danger of running out of our /tmp/ space. >>> >>> >>> I see these 2 different logs : >>> >>> [myuser@mybox ~]$ ls -lt /tmp/myuser/ >>> total 1988 >>> -rw-rw-r-- 1 myuser myuser 191687 2014-07-17 11:17 hive.log >>> -rw-rw-r-- 1 myuser myuser 14472 2014-07-16 14:43 >>> myuser_20140716143232_d76043ed-1c4b-42a0-bf0a-2816377a6a2a.log >>> -rw-rw-r-- 1 myuser myuser 14260 2014-07-16 14:04 >>> myuser_20140716135353_de698da0-807f-4e3b-8b97-5af5064b55f2.log >>> -rw-rw-r-- 1 myuser myuser 14254 2014-07-16 13:42 >>> myuser_20140716133838_208329bd-77bb-4981-a2e9-e747647d0704.log >>> >>> >>> >>> from the doc at >>> https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-ErrorLogs >>> I can see that "per Hive session basis in /tmp/<user.name>/, but can be >>> configured in hive-site.xml >>> <https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration> >>> with >>> the hive.querylog.location property.", >>> but I tried to pass it to -hiveconf >>> hive.querylog.location=/tmp/mycustomlogdir/ >>> , doesn't seem to work; the hive.log location is not changed by this >>> approach either. >>> >>> so how can I change the location of both the logs , by some per-script >>> params ? (i.e. we can't afford to change the system hive-site.xml or >>> /etc/hive/conf etc) >>> >>> Thanks a lot >>> Yang >>> >> >> >> _____________________________________________________________ >> The information contained in this communication is intended solely for >> the use of the individual or entity to whom it is addressed and others >> authorized to receive it. It may contain confidential or legally privileged >> information. If you are not the intended recipient you are hereby notified >> that any disclosure, copying, distribution or taking any action in reliance >> on the contents of this information is strictly prohibited and may be >> unlawful. If you have received this communication in error, please notify >> us immediately by responding to this email and then delete it from your >> system. The firm is neither liable for the proper and complete transmission >> of the information contained in this communication nor for any delay in its >> receipt. > > > > > -- > André Araújo > Big Data Consultant/Solutions Architect > The Pythian Group - Australia - www.pythian.com > > Office (calls from within Australia): 1300 366 021 x1270 > Office (international): +61 2 8016 7000 x270 *OR* +1 613 565 8696 x1270 > Mobile: +61 410 323 559 > Fax: +61 2 9805 0544 > IM: pythianaraujo @ AIM/MSN/Y! or ara...@pythian.com @ GTalk > > “Success is not about standing at the top, it's the steps you leave behind.” > — Iker Pou (rock climber) > > -- > > > >