Hello,
I issued the simple query in beeline to Hive 3.1, which always gets
multi-lines of unuseful logs such as the following.
0: jdbc:hive2://> select * from books order by price desc limit 30;
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.id => {books,
id, _col0: int} adding books.id => {books, id, _col5: int}
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.name =>
{books, name, _col1: string} adding books.name => {books, name, _col7:
string}
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.lang =>
{books, lang, _col2: struct<eng:int,chn:int>} adding books.lang => {books,
lang, _col9: struct<eng:int,chn:int>}
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.types =>
{books, types, _col3: array<string>} adding books.types => {books, types,
_col11: array<string>}
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.price =>
{books, price, _col4: float} adding books.price => {books, price, _col13:
float}
22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN ql.Driver:
Hive-on-MR is deprecated in Hive 2 and may not be available in the future
versions. Consider using a different execution engine (i.e. spark, tez) or
using Hive 1.X releases.
Query ID = pyh_20221229165113_c8e5cbf6-6b36-46a5-bd9a-d2ed2108045d
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN
impl.MetricsSystemImpl: JobTracker metrics system already initialized!
22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN
mapreduce.JobResourceUploader: Hadoop command-line option parsing not
performed. Implement the Tool interface and execute your application with
ToolRunner to remedy this.
Job running in-process (local Hadoop)
22/12/29 16:51:15 [pool-20-thread-1]: WARN impl.MetricsSystemImpl:
JobTracker metrics system already initialized!
2022-12-29 16:51:16,034 Stage-1 map = 100%, reduce = 100%
Ended Job = job_local124633243_0001
MapReduce Jobs Launched:
Stage-Stage-1: HDFS Read: 54790 HDFS Write: 0 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
OK
How can I disable them entirely? I am already using beeline --silent=true.
Thank you.
