Hi ypeng, Have you tried --showWarnings=false argument?
On Thu, Dec 29, 2022 at 1:03 AM ypeng <[email protected]> wrote: > Hello, > > I issued the simple query in beeline to Hive 3.1, which always gets > multi-lines of unuseful logs such as the following. > > 0: jdbc:hive2://> select * from books order by price desc limit 30; > > 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN > parse.RowResolver: Found duplicate column alias in RR: books.id => > {books, id, _col0: int} adding books.id => {books, id, _col5: int} > > 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN > parse.RowResolver: Found duplicate column alias in RR: books.name => > {books, name, _col1: string} adding books.name => {books, name, _col7: > string} > > 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN > parse.RowResolver: Found duplicate column alias in RR: books.lang => > {books, lang, _col2: struct<eng:int,chn:int>} adding books.lang => {books, > lang, _col9: struct<eng:int,chn:int>} > > 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN > parse.RowResolver: Found duplicate column alias in RR: books.types => > {books, types, _col3: array<string>} adding books.types => {books, types, > _col11: array<string>} > > 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN > parse.RowResolver: Found duplicate column alias in RR: books.price => > {books, price, _col4: float} adding books.price => {books, price, _col13: > float} > > 22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN > ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in > the future versions. Consider using a different execution engine (i.e. > spark, tez) or using Hive 1.X releases. > > Query ID = pyh_20221229165113_c8e5cbf6-6b36-46a5-bd9a-d2ed2108045d > > Total jobs = 1 > > Launching Job 1 out of 1 > > Number of reduce tasks determined at compile time: 1 > > In order to change the average load for a reducer (in bytes): > > set hive.exec.reducers.bytes.per.reducer=<number> > > In order to limit the maximum number of reducers: > > set hive.exec.reducers.max=<number> > > In order to set a constant number of reducers: > > set mapreduce.job.reduces=<number> > > 22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN > impl.MetricsSystemImpl: JobTracker metrics system already initialized! > > 22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN > mapreduce.JobResourceUploader: Hadoop command-line option parsing not > performed. Implement the Tool interface and execute your application with > ToolRunner to remedy this. > > Job running in-process (local Hadoop) > > 22/12/29 16:51:15 [pool-20-thread-1]: WARN impl.MetricsSystemImpl: > JobTracker metrics system already initialized! > > 2022-12-29 16:51:16,034 Stage-1 map = 100%, reduce = 100% > > Ended Job = job_local124633243_0001 > > MapReduce Jobs Launched: > > Stage-Stage-1: HDFS Read: 54790 HDFS Write: 0 SUCCESS > > Total MapReduce CPU Time Spent: 0 msec > > OK > > > > > How can I disable them entirely? I am already using beeline --silent=true. > > > Thank you. > > >
