See
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/139/changes>
Changes:
[sershe] Merge trunk ADDENDUM
[prasanthj] HIVE-10129: LLAP: Fix ordering of execution modes
[gunther] HIVE-10144: merge brought in file blocking github sync (Gunther
Hagleitner)
[sershe] HIVE-10128 : LLAP: BytesBytesMultiHashMap does not allow concurrent
read-only access (Sergey Shelukhin)
[sseth] HIVE-10104. LLAP: Generate consistent splits and locations for the same
split across jobs. (Siddharth Seth)
[sershe] HIVE-10092 : LLAP: improve how buffers are locked for split (Sergey
Shelukhin)
[prasanthj] HIVE-10081: LLAP: Make the low-level IO threadpool configurable
(Prasanth Jayachandran)
[sershe] HIVE-10103 : LLAP: Cancelling tasks fails to stop cache filling
threads (Sergey Shelukhin)
[vikram] HIVE-10201: Hive LLAP needs refactoring of the configuration class
(Vikram Dixit K, reviewed by Siddharth Seth)
[vikram] Revert HIVE-10201. Missed files.
[vikram] HIVE-10201: Hive LLAP needs refactoring of the configuration class
(Vikram Dixit K, reviewed by Siddharth Seth)
[gunther] HIVE-10162: LLAP: Avoid deserializing the plan > 1 times in a single
thread (Gunther Hagleitner)
[prasanthj] HIVE-10158: LLAP: Varchar columns are not handled in encoded
readers (Prasanth Jayachandran)
[gopalv] HIVE-10218: LLAP: Loglevel for daemons as a startup option (Gopal V)
[prasanthj] HIVE-10224: LLAP: Clean up encoded ORC tree readers after trunk
merge (Prasanth Jayachandran)
[sershe] HIVE-10196 : LLAP: start fetching earlier (Sergey Shelukhin)
[sershe] HIVE-10161 : LLAP: ORC file contains compression buffers larger than
bufferSize (OR reader has a bug) (Sergey Shelukhin)
[sershe] HIVE-10219 : BytesBytesMultiHashMap::clear() can't be concurrently
used with reads (Sergey Shelukhin)
[sseth] HIVE-10025. LLAP: Send heartbeats for queued work. (Siddharth Seth)
[prasanthj] HIVE-10248: LLAP: Fix merge conflicts related to HIVE-10067
(Prasanth Jayachandran)
[sershe] HIVE-10219 : BytesBytesMultiHashMap::clear() can't be concurrently
used with reads ADDENDUM (Sergey Shelukhin)
[prasanthj] HIVE-10258: LLAP: orc_llap test fails again (Prasanth Jayachandran)
[prasanthj] HIVE-10259: LLAP: Explain plan diff in llap_partitioned.q test case
(Prasanth Jayachandran)
[sseth] HIVE-10245. LLAP: Make use of the timed version of getDagStatus in
TezJobMonitor. (Siddharth Seth)
[sseth] HIVE-10279. LLAP: Allow the runtime to check whether a task can run to
completion. (Siddharth Seth)
[sseth] HIVE-10295. LLAP: Fix timeouts for tasks which stay in the pending
queue. (Siddharth Seth)
[sershe] HIVE-10298 : LLAP: Cache cleaner throws Negative sleep exception
(Sergey Shelukhin)
[sershe] HIVE-10154 : LLAP: GC issues 1 (Sergey Shelukhin)
[gopalv] HIVE-10012: LLAP: Dynamic refresh and blacklisting for daemons (gopalv)
[sershe] HIVE-10336 : LLAP: small improvement to unlocking cache data (Sergey
Shelukhin)
[sershe] HIVE-10334 : LLAP: Self-joins with the cache enabled (Sergey Shelukhin)
[sershe] HIVE-10333 : LLAP: NPE due to failure to find position (Sergey
Shelukhin)
[sershe] HIVE-10329 : Hadoop reflectionutils has issues (Sergey Shelukhin,
reviewed by Vikram Dixit K)
[sershe] HIVE-10329 : Hadoop reflectionutils has issues (Sergey Shelukhin,
reviewed by Vikram Dixit K) ADDENDUM
[prasanthj] LLAP: Name IO elevator threads (Prasanth Jayachandran)
[prasanthj] HIVE-10358: LLAP: Tez in-place UI gets misaligned when state is
TERMINATING (Prasanth Jayachandran)
[prasanthj] HIVE-10028: LLAP: Create a fixed size execution queue for daemons
(Prasanth Jayachandran)
[prasanthj] HIVE-10397: LLAP: Implement Tez SplitSizeEstimator for Orc
(Prasanth Jayachandran)
[sseth] HIVE-10405. LLAP: Provide runtime information to daemons to decide on
preemption order. (Siddharth Seth)
[prasanthj] LLAP: NPE caused by HIVE-10397 (Prasanth Jayachandran)
[sseth] LLAP: Avoid fetching data multiple times in case of broadcast.
(Siddharth Seth)
[sseth] HIVE-10408. Fix NPE in scheduler in case of rejected tasks. (Siddharth
Seth)
[sseth] HIVE-10424. LLAP: Factor known capacity into scheduling decisions.
(Siddharth Seth)
[sseth] HIVE-10475. LLAP: Minor fixes after tez api enhancements for dag
completion. (Siddharth Seth)
[sershe] HIVE-20217 : LLAP: Support caching of uncompressed ORC data (Sergey
Shelukhin)
[gopalv] HIVE-10498: LLAP: Resolve everything in llap-daemon-site.xml (Gopal V)
[j.prasanth.j] HIVE-10470: LLAP: NPE in IO when returning 0 rows with no
projection (Prasanth Jayachandran)
[sseth] HIVE-9911. LLAP: Clean up structures and intermediate data when a query
completes. (Siddharth Seth)
[sseth] HIVE-10480. Fix an issue with initial heartbeats which lead to
serialization errors and work timing out. (Siddharth Seth)
[j.prasanth.j] HIVE-10558: LLAP: Add test case for all row groups selection
with no column projection (Prasanth Jayachandran)
[sseth] HIVE-10560. Check if the dirWatcher is setup when trying to unregister
a DAG. (Siddharth Seth)
[sershe] HIVE-10482 : LLAP: AsertionError cannot allocate when reading from orc
(Sergey Shelukhin)
[sershe] HIVE-10633 : LLAP: remove default GC setting from runLlapDaemon
(Sergey Shelukhin)
[j.prasanth.j] Revert "LLAP: NPE caused by HIVE-10397 (Prasanth Jayachandran)"
[j.prasanth.j] Revert "HIVE-10397: LLAP: Implement Tez SplitSizeEstimator for
Orc (Prasanth Jayachandran)"
[j.prasanth.j] LLAP: Implement Tez SplitSizeEstimator for Orc (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-10429: LLAP: Abort hive tez processor on interrupts
(Prasanth Jayachandran reviewed by Gunther Hagleitner)
[sseth] HIVE-10663. LLAP: Update tez dependency. (Siddharth Seth)
[sseth] HIVE-10682. LLAP: Make use of the task runner which allows killing
tasks. (Siddharth Seth)
[sseth] HIVE-10683. LLAP: Add a mechanism for daemons to inform the AM about
killed tasks. (Siddharth Seth)
[sseth] HIVE-10652. LLAP: AM task communication retry is too long. (Siddharth
Seth)
[sseth] HIVE-10652 addendum. Remove unused imports introduced in earlier commit
(Siddharth Seth)
[sseth] HIVE-10700. LLAP: Log additional debug information in the scheduler.
(Siddharth Seth)
[j.prasanth.j] HIVE-10662: LLAP: Wait queue pre-emption (Prasanth Jayachandran)
[sseth] HIVE-10730. LLAP: fix guava stopwatch conflict. (Siddharth Seth)
[j.prasanth.j] Revert "HIVE-10730. LLAP: fix guava stopwatch conflict.
(Siddharth Seth)"
[j.prasanth.j] HIVE-10730. LLAP: fix guava stopwatch conflict. (Siddharth Seth)
[j.prasanth.j] HIVE-10744: LLAP: dags get stuck in yet another way (Prasanth
Jayachandran)
[sseth] HIVE-10756. LLAP: Misc changes to daemon scheduling. (Siddharth Seth)
[j.prasanth.j] HIVE-10759: LLAP: Add aging to wait queue tasks (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-10764: LLAP: Wait queue scheduler goes into tight loop
(Prasanth Jayachandran)
[j.prasanth.j] Revert "HIVE-10764: LLAP: Wait queue scheduler goes into tight
loop (Prasanth Jayachandran)"
[sseth] HIVE-10767. LLAP: Improve the way task finishable information is
processed. (Siddharth Seth)
[sseth] HIVE-10763. LLAP: Provide current attempt start time for wait queue
ordering. (Siddharth Seth)
[sseth] LLAP: NPE when calling abort on the TezProcessor. (Siddharth Seth)
[sseth] HIVE-10758. LLAP: Modify running / wait queues on on fragment finishable
[sershe] HIVE-10653 : LLAP: registry logs strange lines on daemons (Sergey
Shelukhin)
[sershe] HIVE-10777 : LLAP: add pre-fragment and per-table cache details
(Sergey Shelukhin)
[sseth] HIVE-10846. LLAP: preemption in AM due to failures / out of order
scheduling. (Siddharth Seth)
[sseth] HIVE-10842. Fix a deadlock in handling of finishable state change
notifications. (Siddharth Seth)
[sershe] HIVE-10871 : LLAP: bug in split processing in IO elevator causes
duplicate rows (Sergey Shelukhin)
[sershe] HIVE-10778 : LLAP: Utilities::gWorkMap needs to be cleaned in
HiveServer2 (Sergey Shelukhin, reviewed by Vikram Dixit K)
[sseth] HIVE-10425. LLAP: Limit number of threads used to communicate with a
[sseth] HIVE-10886. LLAP: Fixes to TaskReporter after recent Tez changes.
(Siddharth Seth)
[sershe] HIVE-10889 : LLAP: HIVE-10778 has NPE (Sergey Shelukhin)
[sershe] HIVE-10894 : LLAP: make sure the branch builds on hadoop-1 (Sergey
Shelukhin)
[sershe] HIVE-10896 : LLAP: the return of the stuck DAG (Sergey Shelukhin)
[sershe] HIVE-9814 : LLAP: JMX web-service end points for monitoring & metrics
(Gopal V, Sergey Shelukhin)
[sershe] HIVE-10913 : LLAP: cache QF counters have a wrong value for consumer
time (Sergey Shelukhin)
[sershe] HIVE-10913 : LLAP: cache QF counters have a wrong value for consumer
time (Sergey Shelukhin) ADDENDUM
[sershe] HIVE-10914 : LLAP: fix hadoop-1 build for good by removing llap-server
from hadoop-1 build (Sergey Shelukhin)
[sershe] HIVE-10914 : LLAP: fix hadoop-1 build for good by removing llap-server
from hadoop-1 build - FIX (Sergey Shelukhin)
[sershe] HIVE-10920 : LLAP: elevator reads some useless data even if all RGs
are eliminated by SARG (Sergey Shelukhin)
[sseth] HIVE-10779. LLAP: Daemons should shutdown in case of fatal errors.
(Siddharth Seth)
[sershe] HIVE-10942 : LLAP: expose what's running on the daemon thru JMX
(Sergey Shelukhin)
[sershe] HIVE-10827 : LLAP: support parallel query compilation in HS2 (Sergey
Shelukhin)
[sershe] HIVE-10946 : LLAP: recent optimization introduced wrong assert to
elevator causing test to faill (Sergey Shelukhin)
[gopalv] HIVE-10960: LLAP: Allow finer control of startup options for LLAP
(gopalv)
[sseth] HIVE-10961. LLAP: Fix ShuffleHandler + Submit work init race condition.
(Siddharth Seth)
[sershe] HIVE-10872 : LLAP: make sure tests pass #1 (Sergey Shelukhin)
[gopalv] HIVE-11003: LLAP: Fix LLAP startup issues due to heap rounding errors
(gopalv)
[sershe] HIVE-11012 : LLAP: fix some tests in the branch and revert incorrectly
committed changed out files (from HIVE-11014) (Sergey Shelukhin)
[sseth] HIVE-10762. LLAP: Kill any fragments running in a daemon when a query
completes. (Siddharth Seth)
[vikram] HIVE-10647: Hive on LLAP: Limit HS2 from overwhelming LLAP (Vikram
Dixit K, reviewed by Gunther Hagleitner)
[sershe] HIVE-11014 : LLAP: some MiniTez tests have result changes compared to
master (Sergey Shelukhin)
[sershe] HIVE-11017 : LLAP: disable the flaky TestLlapTaskSchedulerService test
(Sergey Shelukhin)
[gopalv] HIVE-10981: LLAP: Accept --hiveconf parameters for the
LlapServiceDriver (gopalv)
[vikram] HIVE-11009: LLAP: fix TestMiniTezCliDriverLocal on the branch (Vikram
Dixit K, reviewed by Sergey Shelukhin)
[sershe] HIVE-11156 : LLAP: Cache arena size rounding (Sergey Shelukhin)
[sershe] HIVE-11015 : LLAP: MiniTez tez_smb_main, tez_bmj_schema_evolution fail
with NPE (Sergey Shelukhin, reviewed by Vikram Dixit K)
[j.prasanth.j] HIVE-11173: Fair ordering of fragments in wait queue (Prasanth
Jayachandran)
[sershe] HIVE-11169 : LLAP: more out file changes compared to master (Sergey
Shelukhin)
[sershe] HIVE-11177 : LLAP: spark out file changes compared to master (Sergey
Shelukhin)
[sershe] HIVE-11011 : LLAP: test auto_sortmerge_join_5 on MiniTez fails with
NPE (Sergey Shelukhin, reviewed by Vikram Dixit K)
[j.prasanth.j] HIVE-11186: Remove unused LlapUtils class from ql.io.orc
(Prasanth Jayachandran)
[sershe] HIVE-11213 : LLAP: more out file changes compared to master (Sergey
Shelukhin)
[sershe] HIVE-11222 : LLAP: occasional NPE in parallel queries in ORC reader
(Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[sershe] HIVE-11200 : LLAP: Cache BuddyAllocator throws NPE (Sergey Shelukhin)
[sseth] HIVE-11260. LLAP: Fix NPE in AMReporter. (Siddharth Seth)
[sershe] HIVE-10535 : LLAP: Cleanup map join cache when a query completes
(Sergey Shelukhin, reviewed by Siddharth Seth)
[sseth] HIVE-11273. LLAP: Register for finishable state change notifications
when adding a task instead of when scheduling it. (Siddharth Seth)
[sseth] HIVE-11263. LLAP: TaskExecutorService state is not cleaned up.
(Siddharth Seth)
[gopalv] HIVE-10930: LLAP: Set java.io.tmpdir correctly for LLAP Slider
instance (Gopal V)
[sseth] HIVE-11322. Fix API usage in plugins to match changes made in TEZ-2004
(Siddharth Seth)
[sseth] HIVE-11350. Fix API usage in plugins to match changes made in TEZ-2005.
(Siddharth Seth)
[sershe] HIVE-11259 : LLAP: clean up ORC dependencies part 1 (Sergey Shelukhin,
reviewed by Prasanth Jayachandran)
[sershe] HIVE-11305 : LLAP: Hybrid Map-join cache returns invalid data (Sergey
Shelukhin, reviewed by Gopal V)
[sseth] HIVE-11393. LLAP: Fix API usage to work with evolving Tez APIs -
TEZ-{2651,2652,2653}. (Siddharth Seth)
[sershe] HIVE-11479 : LLAP: ORC-related refactoring changes broke something
(Sergey Shelukhin)
[sseth] HIVE-11522. LLAP: Fix API usage to work with evolving Tez APIs -
TEZ-2678. (Siddharth Seth)
[sershe] HIVE-11385 : LLAP: clean up ORC dependencies - move encoded reader
path into a separate package and reader (Sergey Shelukhin, reviewed by Prasanth
Jayachandran)
[sershe] HIVE-11295 : LLAP: clean up ORC dependencies on object pools (Sergey
Shelukhin, reviewed by Prasanth Jayachandran)
[sseth] HIVE-11272. LLAP: Execution order within LLAP daemons should consider
query-specific priority assigned to fragments. (Siddharth Seth)
[sershe] HIVE-10535 : LLAP: move EncodedTreeReaderFactory, TreeReaderFactory
bits that rely on orc.encoded, and StreamUtils if needed, to orc.encoded
package (Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[sseth] HIVE-11612. Allow wait queue comparator to be specified as a classname.
(Siddharth Seth)
[sseth] HIVE-11148. LLAP: fix TestLlapTaskSchedulerService flakiness.
(Siddharth Seth)
[sershe] HIVE-11641 : LLAP: switch the branch to Tez master from branch (Sergey
Shelukhin)
[sershe] HIVE-11655 : clean build on the branch appears to be broken (Sergey
Shelukhin)
[sershe] HIVE-11661 : LLAP: update some out files (Sergey Shelukhin)
[sershe] HIVE-11661 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM
[sershe] HIVE-11661 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM 2
[j.prasanth.j] HIVE-11674: LLAP: Update tez version to fix build
[sseth] HIVE-11660. LLAP: TestTaskExecutorService, TestLlapTaskSchedulerService
are flaky. Also fixes a real scheduling issue in LlapTaskSchedulerService.
(Siddharth Seth)
[j.prasanth.j] HIVE-9900: LLAP: Integrate MiniLLAPCluster into tests (Prasanth
Jayachandran reviewed by Siddharth Seth)
[sershe] HIVE-11729 : LLAP: update to use Tez 0.8 (Sergey Sheluhkin)
[j.prasanth.j] HIVE-11732: LLAP: MiniLlapCluster integration broke hadoop-1
build (Prasanth Jayachandran reviewed by Sergey Shelukhin)
[j.prasanth.j] HIVE-11773: LLAP: Create webapp/llap directory for
MiniLlapCluster
[j.prasanth.j] HIVE-11803: LLAP: MiniLlapCluster tests are slow
[sseth] HIVE-11805. LLAP: TaskCommunicator should not register MultiMRInput
Inputs for state updates. (Siddharth Seth)
[j.prasanth.j] HIVE-11810: LLAP: Exception is ignored if MiniLlap cluster fails
to start
[j.prasanth.j] HIVE-11811: Merge conflict addendum patch (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11818: LLAP: Rerunning MiniLlap does not start as web app
port is used (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11811: Merge conflict addendum patch2 (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-11776: LLAP: Generate golden files for all MiniLlapCluster
tests (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11854: LLAP: Analyze and fix vectorization tests (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-11867: LLAP: Generate join0.q golden file for java 8
(Prasanth Jayachandran)
[j.prasanth.j] HIVE-11869: LLAP: constprog_dpp.q,explainuser_1.q showing
explain diff (Prasanth Jaychandran)
[sershe] HIVE-11851 : LLAP: Test failures - file.splitmetainfo file not found
(Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[j.prasanth.j] LLAP: Remove fileformat_mix.q.out as it is not part of tez test
suite (Prasanth Jayachandran)
[sershe] HIVE-11851 : LLAP: Test failures - file.splitmetainfo file not found
(Sergey Shelukhin) ADDENDUM
[sershe] HIVE-11873 : LLAP: Plan is different for insert1.q (Sergey Shelukhin)
[j.prasanth.j] HIVE-11876: LLAP: Update errata.txt for HIVE-11871 (Prasanth
Jayachandran)
[j.prasanth.j] HIVE-11872: LLAP: Partition column value different for
identity_project_remove_skip.q (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11877: LLAP: Fix ordering difference in
acid_vectorization_partition.q (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11874: LLAP: Fix auto_join_nulls.q,auto_sortmerge_join_6.q
test diffs (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11884: LLAP: Fix discrepancies with
metadata_only_queries_with_filters.q (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11885: LLAP: Remove unused/old golden files (Prasanth
Jayachandran)
[sershe] HIVE-11868 : LLAP: Fix unionDistinct_1.q and union_view.q (Sergey
Shelukhin)
[sershe] HIVE-11886 : LLAP: merge master into branch (Sergey Shelukhin)
ADDENDUM SPARK TESTS
[j.prasanth.j] HIVE-11853: LLAP: Fix tests related to stats difference
(Prasanth Jayachandran)
[j.prasanth.j] HIVE-11893: LLAP: Update llap golden files after master merge
(Prasanth Jayachandran)
[j.prasanth.j] HIVE-11904: LLAP: Typo in webapps causing initialization error
for MiniLlap tests (Prasanth Jayachandran)
[j.prasanth.j] HIVE-11905: LLAP: Update golden files for orc_llap and
llapdecider tests (Prasanth Jayachandran)
[j.prasanth.j] HIVE-9898: LLAP: Sort out issues with UGI and cached FileSystems
(Prasanth Jayachandran)
[j.prasanth.j] HIVE-11963: Llap: Disable web app for mini llap tests (Prasanth
Jayachandran reviewed by Sergey Shelukhin)
[sershe] HIVE-11978 : LLAP: NPE in Expr toString (Sergey Shelukhin)
[j.prasanth.j] HIVE-11923: allow qtests to run via a single client session for
tez and llap (Siddharth Seth reviewed by Prasanth Jayachandran)
[sershe] HIVE-12001 : LLAP: update some out files (Sergey Shelukhin)
[sershe] HIVE-12013 : LLAP: disable most llap tests before merge (Sergey
Shelukhin)
[sershe] HIVE-12034 : HIVE-4243 broke things for llap branch (Sergey Shelukhin)
[sershe] HIVE-12034 : HIVE-4243 broke things for llap branch (Sergey Shelukhin)
ADDENDUM
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin)
[sseth] HIVE-12043. Fix UGI usage in IO elevator threads. (Siddharth Seth)
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM2
[sershe] HIVE-12066 : Add javadoc for methods added to public APIs (Sergey
Shelukhin)
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM3
[sershe] HIVE-12073 : LLAP: disable session reuse for MiniTez cluster (Sergey
Shelukhin)
[sershe] HIVE-12042 : LLAP: update some out files (Sergey Shelukhin) ADDENDUM4
[j.prasanth.j] HIVE-12081: LLAP: Make explainuser_1.q test consistent (Prasanth
Jayachandran)
[sershe] HIVE-12078 : LLAP: document config settings (Sergey Shelukhin)
[sershe] HIVE-12153 : LLAP: update errata for bad branch commits (Sergey
Shelukhin)
[sershe] HIVE-12153 : LLAP: update errata for bad branch commits (Sergey
Shelukhin) ADDENDUM
[sershe] HIVE-12048 : metastore file metadata cache should not be used when
deltas are present (Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[chengxiang] HIVE-11533 : Loop optimization for SIMD in integer comparisons.
(Teddy Choi, reviewed by ChengXiang Li)
[omalley] HIVE-11212. Implement compound types for vectorization.
[Jimmy Xiang] HIVE-12058: Change hive script to record errors when calling
hbase fails (Yongzhi via Jimmy)
[pxiong] HIVE-11894: CBO: Calcite Operator To Hive Operator (Calcite Return
Path): correct table column name in CTAS queries (Pengcheng Xiong, reviewed by
Ashutosh Chauhan)
[Ashutosh Chauhan] HIVE-12010 : Tests should use FileSystem based stats
collection mechanism (Ashutosh Chauhan via Pengcheng Xiong)
[gopalv] HIVE-12090: Dead-code: Vectorized map-join runs Murmurhash twice
(Gopal V, reviewed by Matt McCline)
[sershe] HIVE-11923 : allow qtests to run via a single client session for tez
and llap (Siddharth Seth/Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[gopalv] HIVE-11882: Fetch optimizer should stop source files traversal once it
exceeds the hive.fetch.task.conversion.threshold (Illya Yalovyy, via Gopal V)
[gopalv] HIVE-11578: Fix NPE in ExplainWork (Rajesh Balamohan, via Gopal V)
[harisankar] HIVE-12076 : WebHCat listing jobs after the given JobId even when
templeton.jobs.listorder is set to lexicographicaldesc ( Kiran Kumar Kolli,
reviewed by Hari Subramaniyan)
[sershe] HIVE-11856 : allow split strategies to run on threadpool (Sergey
Shelukhin, reviewed by Vikram Dixit K)
[vgumashta] HIVE-11499: Datanucleus leaks classloaders when used using embedded
metastore with HiveServer2 with UDFs (Vaibhav Gumashta reviewed by Thejas Nair)
[Szehon Ho] HIVE-12168 : Addendum to HIVE-12038 (Szehon, reviewed by Sergey)
[sershe] HIVE-12166 : LLAP: Cache read error at 1000 Gb scale tests (Sergey
Shelukhin, reviewed by Gopal V)
[Szehon Ho] HIVE-10755 : Rework on HIVE-5193 to enhance the column oriented
table access (Aihua Xu, reviewed by Daniel Dai)
[jdere] HIVE-11892: UDTF run in local fetch task does not return rows forwarded
during GenericUDTF.close() (Jason Dere, reviewed by Ashutosh Chauhan)
[Szehon Ho] HIVE-12082 : Null comparison for greatest and least operator
(Szehon, reviewed by Xuefu)
[sershe] HIVE-12053 : Stats performance regression caused by HIVE-11786 (Chaoyu
Tang, reviewed by Siddharth Seth)
[mmccline] HIVE-12180 : Use MapJoinDesc::isHybridHashJoin() instead of the
HiveConf lookup in Vectorizer (Wei Zheng, reviewed by Matt McCline)
[sershe] HIVE-12060 : LLAP: create separate variable for llap tests (Sergey
Shelukhin, reviewed by Vikram Dixit K)
[sershe] HIVE-11822 : vectorize NVL UDF (Takanobu Asanuma, reviewed by Gopal V)
[sershe] HIVE-12062 : enable HBase metastore file metadata cache for tez tests
(Sergey Shelukhin, reviewed by Alan Gates)
[Chao Sun] HIVE-11785: Support escaping carriage return and new line for
LazySimpleSerDe (Aihua Xu, reviewed by Chao Sun)
[thejas] HIVE-11768 : java.io.DeleteOnExitHook leaks memory on long running
Hive Server2 Instances (Navis Ryu via Thejas Nair)
[sershe] HIVE-11676 : implement metastore API to do file footer PPD (Sergey
Shelukhin, reviewed by Alan Gates)
[sershe] HIVE-12198 : LLAP: reader failures when querying uncompressed data
(Sergey Shelukhin, reviewed by Vikram Dixit K)
[sershe] HIVE-12057 : ORC sarg is logged too much (Sergey Shelukhin, reviewed
by Ashutosh Chauhan)
[khorgath] HIVE-12083 : HIVE-10965 introduces thrift error if partNames or
colNames are empty (Sushanth Sowmyan, reviewed by Thejas Nair)
[Ashutosh Chauhan] HIVE-12164 : Remove jdbc stats collection mechanism
(Ashutosh Chauhan via Pengcheng Xiong)
[Sergio Pena] HIVE-12188: DoAs does not work properly in non-kerberos secured
HS2 (Chaoyu Tang, reviewed by Sergio Pena)
[chinnaraol] HIVE-12026 : Add test case to check permissions when truncating
partition
[pxiong] HIVE-12210: Fix a few failing tests: testCliDriver_udf_explode and
testCliDriver_udtf_explode (Aleksei S via Pengcheng Xiong)
[Jimmy Xiang] HIVE-12200 INSERT INTO table using a select statement w/o a FROM
clause fails (Jimmy, reviewed by Chaoyu)
[sershe] HIVE-11565 : LLAP: Some counters are incorrect (Siddharth Seth,
reviewed by Sergey Shelukhin)
[jdere] HIVE-12179: Add option to not add spark-assembly.jar to Hive classpath
(Jason Dere, reviewed by Ashutosh Chauhan)
[vikram] HIVE-11829: Create test for HIVE-11216 (Vikram Dixit K, reviewed by
Jason Dere)
[Xuefu Zhang] HIVE-12218: Unable to create a like table for an hbase backed
table (Chaoyu via Xuefu)
[Alan Gates] HIVE-12170 normalize HBase metastore connection configuration
(gates, reviewed by Sergey Shelukhin)
[Jimmy Xiang] HIVE-12225: LineageCtx should release all resources at clear
(Jimmy, reviewed by Szehon)
[pxiong] HIVE-11895: CBO: Calcite Operator To Hive Operator (Calcite Return
Path): fix udaf_percentile_approx_23.q (Pengcheng Xiong, reviewed by Ashutosh
Chauhan)
[gunther] HIVE-12201: Tez settings need to be shown in set -v output when
execution engine is tez. (Gunther Hagleitner)
[gunther] HIVE-12204: Tez queries stopped running with
ApplicationNotRunningException (Vikram Dixit K via Gunther Hagleitner)
[Xuefu Zhang] HIVE-11710: Beeline embedded mode doesn't output query progress
after setting any session property (Aihua via Xuefu)
[j.prasanth.j] HIVE-11807: Set ORC buffer size in relation to set stripe size
(Owen O'Malley reviewed by Gopal V)
[thejas] HIVE-11901 : StorageBasedAuthorizationProvider requires write
permission on table for SELECT statements (Chengbing Liu via Thejas Nair)
[jcamacho] HIVE-11954: Extend logic to choose side table in MapJoin Conversion
algorithm (Jesus Camacho Rodriguez, reviewed by Laljo John Pullokkaran)
[Jimmy Xiang] HIVE-12187: Release plan once a query is executed
[Ashutosh Chauhan] HIVE-12224 : Remove HOLD_DDLTIME (Ashutosh Chauhan via
Pengcheng Xiong)
[harisankar] HIVE-12084 : Hive queries with ORDER BY and large LIMIT fails with
OutOfMemoryError Java heap space (Hari Subramaniyan, reviewed by Laljo John
Pullokkaran)
[sershe] HIVE-12061 : add file type support to file metadata by expr call
(Sergey Shelukhin, reviewed by Alan Gates)
[sershe] HIVE-12178 : LLAP: NPE in LRFU policy (Sergey Shelukhin, reviewed by
Prasanth Jayachandran)
[sershe] HIVE-11591 : upgrade thrift to 0.9.3 and change generation to use
undated annotations (Sergey Shelukhin, reviewed by Alan Gates)
[sershe] HIVE-12253 : revert HIVE-12061 (Sergey Shelukhin, reviewed by Prasanth
Jayachandran)
[Ashutosh Chauhan] HIVE-11755 :Incorrect method called with Kerberos enabled in
AccumuloStorageHandler (Josh Elser via Brock Noland)
[Ashutosh Chauhan] HIVE-12039 : Fix TestSSL#testSSLVersion (Vaibhav Gumashta
via Ashutosh Chauhan)
[Ashutosh Chauhan] HIVE-12059 : Clean up reference to deprecated constants in
AvroSerdeUtils (Aaron Dossett via Ashutosh Chauhan)
[Ashutosh Chauhan] HIVE-12239 : Constants in
hive.common.metrics.common.MetricsConstant are not final (Aleksei Statkevich
via Ashutosh Chauhan)
[Ashutosh Chauhan] HIVE-11688 : OrcRawRecordMerger does not close primary
reader if not fully consumed (Sudheesh Katkam via Prasanth J)
[ekoifman] HIVE-11540 - Too many delta files during Compaction - OOM (Eugene
Koifman, reviewed by Alan Gates)
[daijy] HIVE-12262: Session log dir cannot be created in some cases (Daniel
Dai, reviewed by Thejas Nair)
[Ferdinand Xu] HIVE-12234: Beeline quit tries to connect again if no existing
connections(Ferdinand Xu, reviewed by Szehon Ho)
[Chao Sun] HIVE-12189: The list in pushdownPreds of ppd.ExprWalkerInfo should
not be allowed to grow very large (Yongzhi Chen, reviewed by Chao Sun)
[thejas] HIVE-12261 : schematool version info exit status should depend on
compatibility, not equality (Thejas Nair, reviewed by Sushanth Sowmyan)
[thejas] HIVE-12261 - adding more comments
[j.prasanth.j] HIVE-12246: Orc FileDump fails with Missing CLI jar (Prasanth
Jayachandran reviewed by Ferdinand Xu)
[j.prasanth.j] HIVE-12260: Fix TestColumnStatistics and TestJsonFileDump test
failures in master (Prasanth Jayachandran reviewed by Thejas Nair)
[Aihua Xu] HIVE-12213 Investigating the test failure
TestHCatClient.testTableSchemaPropagation (Aleksei Statkevich via Aihua Xu)
[khorgath] HIVE-9013 : Hive set command exposes metastore db password (Binglin
Chang, reviewed by Thejas Nair, Sushanth Sowmyan)
[j.prasanth.j] HIVE-11523: org.apache.hadoop.hive.ql.io.orc.FileDump should
handle errors (Prasanth Jayachandran reviewed by Ashutosh Chauhan)
[Alan Gates] HIVE-11378 Remove hadoop-1 support from master branch (gates,
reviewed by Ashutosh Chauhan and Sergey Shelukhin)
[Ashutosh Chauhan] HIVE-10807 : Invalidate basic stats for insert queries if
autogather=false (Ashutosh Chauhan via Gopal V)
[ctang] HIVE-12259: Command containing semicolon is broken in Beeline (Chaoyu
Tang, reviewed by Ferdinand Xu)
[Jimmy Xiang] HIVE-11973: IN operator fails when the column type is DATE
(Yongzhi via Jimmy)
[Szehon Ho] HIVE-12250 Zookeeper connection leaks in Hive's HBaseHandler
(Naveen, reviewed by Aihua and Szehon)
[Szehon Ho] HIVE-11489 : Jenkins PreCommit-HIVE-SPARK-Build fails with
TestCliDriver.initializationError (Szehon, reviewed by Sergio Pena)
[sershe] HIVE-12061 : add file type support to file metadata by expr call
(Sergey Shelukhin, reviewed by Alan Gates)
[sershe] HIVE-12227 : LLAP: better column vector object pools (Sergey
Shelukhin, reviewed by Gopal V)
[j.prasanth.j] HIVE-11497: Make sure --orcfiledump utility includes
OrcRecordUpdate.AcidStats (Prasanth Jayachandran reviewed by Eugene Koifman)
[gopalv] HIVE-11306: Add a bloom-1 filter to reduce Hybrid MapJoin spills (Wei
Zheng, reviewed by Gopal V)
[Jimmy Xiang] HIVE-12265: Generate lineage info only if requested (Jimmy,
reviewed by Chao)
[Jimmy Xiang] HIVE-12268: Context leaks deleteOnExit paths (Jimmy, reviewed by
Szehon)
[Ashutosh Chauhan] HIVE-12237 : Use slf4j as logging facade
[Jimmy Xiang] HIVE-12278: Skip logging lineage for explain queries (Jimmy,
reviewed by Chaoyu)
[Alan Gates] HIVE-11564 HBaseSchemaTool should be able to list objects (gates
reviewed by Daniel Dai)
[ekoifman] HIVE-12276 Fix messages in InvalidTable (Eugene Koifman, reviewed by
Jason Dere)
[ctang] HIVE-12245: Support column comments for an HBase backed table (Chaoyu
Tang, reviewed by Jimmy Xiang)
[daijy] HIVE-12282: beeline - update command printing in verbose mode (Daniel
Dai, reviewed by Thejas Nair, Lefty Leverenz)
[pxiong] CBO: Calcite Operator To Hive Operator (Calcite Return Path) :
columnPruner prunes everything when union is the last operator before FS
(Pengcheng Xiong, reviewed by Ashutosh Chauhan)
[pxiong] HIVE-12291: Master: Update errata.txt for HIVE-12272 (Pengcheng Xiong)
[khorgath] HIVE-11988 : security issue with hive & ranger for import table
command (Sushanth Sowmyan, reviewed by Thejas Nair)
[sseth] HIVE-12256. Move LLAP registry into llap-client module. (Siddharth
Seth, reviewed by Gopal V)
[dmtolpeko] HIVE-11881: Supporting HPL/SQL Packages Dmitry Tolpeko reviewed by
Alan Gates
[pxiong] HIVE-12277: Hive macro results on macro_duplicate.q different after
adding ORDER BY (Pengcheng Xiong, reviewed by Jason Dere)
[Szehon Ho] HIVE-12280 : HiveConnection does not try other HS2 after failure
for service discovery (Szehon, reviewed by Jimmy Xiang and Thejas)
[sershe] HIVE-12294 : log line "Duplicate ID <number> in column ID list"
appears in the logs (Sergey Shelukhin, reviewed by Vikram Dixit K)
[sershe] HIVE-11985 : don't store type names in metastore when metastore type
names are not used (Sergey Shelukhin, reviewed by Ashutosh Chauhan)
[sershe] HIVE-11616 : DelegationTokenSecretManager reuses the same objectstore,
which has concurrency issues (Cody Fu/Sergey Shelukhin, reviewed by Chaoyu Tang)
[vikram] HIVE-11356: SMB join on tez fails when one of the tables is empty
(Vikram Dixit K, reviewed by Gunther Hagleitner)
[vikram] HIVE-12249: Improve logging with tez (Vikram Dixit K, reviewed by
Sergey Shelukhin)
[harisankar] HIVE-7723 : Explain plan for complex query with lots of partitions
is slow due to in-efficient collection used to find a matching ReadEntity (Hari
Subramaniyan, reviewed by Ashutosh Chauhan)
[Ashutosh Chauhan] HIVE-11582 : Remove conf variable
hive.mapred.supports.subdirectories (Chetna Chaudhari via Ashutosh Chauhan)
[mmccline] HIVE-12290 Native Vector ReduceSink (Matt McCline, reviewed by Gopal
V)
[Chao Sun] HIVE-12215: Exchange partition does not show outputs field for
post/pre execute hooks (Aihua Xu, reviewed by Xuefu Zhang)
[harisankar] HIVE-11634 : Support partition pruning for IN(STRUCT(partcol,
nonpartcol..)...) (Hari Subramaniyan, reviewed by Laljo John Pullokkaran)
[sershe] HIVE-12292 : revert the if removal from HIVE-12237 (Sergey Shelukhin,
reviewed by Ashutosh Chauhan)
[sershe] HIVE-12295 : change some logs from info to debug (Sergey Shelukhin,
reviewed by Ashutosh Chauhan)
[sershe] HIVE-12171 : LLAP: BuddyAllocator failures when querying uncompressed
data (Sergey Shelukhin, reviewed by Gopal V)
[Alan Gates] HIVE-12318 qtest failing due to NPE in logStats (Jimmmy Xiang via
gates)
[Alan Gates] HIVE-11293 HiveConnection.setAutoCommit(true) throws exception
(Michał Węgrzyn and Alan Gates, reviewed by Thejas Nair)
[Alan Gates] HIVE-11966 JDBC Driver parsing error when reading principal from
ZooKeeper (Vaibhav Gumashta via Alan Gates)
[Alan Gates] HIVE-11718 JDBC ResultSet.setFetchSize(0) returns no results
(Aleksei Statkevich via Alan Gates)
[Szehon Ho] HIVE-12235 : Improve beeline logging for dynamic service discovery
(Szehon, reviewed by Vaibhav Gumashta)
[gopalv] HIVE-12209: Vectorize simple UDFs with null arguments (Gopal V,
reviewed by Sergey Shelukhin)
[gopalv] HIVE-12281: Vectorized MapJoin - use Operator::isLogDebugEnabled
(Gopal V, reviewed by Matt McCline)
[gopalv] HIVE-12238: Vectorization: Thread-safety errors in VectorUDFDate
(Gopal V, reviewed by Gunther Hagleitner)
[ekoifman] HIVE-12266 When client exists abnormally, it doesn't release ACID
locks (Wei Zheng, via Eugene Koifman)
[ekoifman] HIVE-12202 NPE thrown when reading legacy ACID delta files(Elliot
West via Eugene Koifman)
[Jimmy Xiang] HIVE-12287: Lineage for lateral view shows wrong dependencies
(Jimmy, reviewed by Chao)
[pxiong] HIVE-12273: Improve user level explain (Pengcheng Xiong, reviewed by
Ashutosh Chauhan, Laljo John Pullokkaran, Eugene Koifman, Prasanth Jayachandran
and Wei Zheng)
[ekoifman] HIVE-12202 NPE thrown when reading legacy ACID delta files(missed a
file)(Elliot West via Eugene Koifman)
[pxiong] HIVE-12297: CBO: Calcite Operator To Hive Operator (Calcite Return
Path) : dealing with '$' in typeInfo (Pengcheng Xiong, reviewed by Ashutosh
Chauhan)
[pxiong] HIVE-12305: CBO: Calcite Operator To Hive Operator (Calcite Return
Path): UDAF can not pull up constant expressions (Pengcheng Xiong, reviewed by
Ashutosh Chauhan )
[jdere] HIVE-12206: ClassNotFound Exception during query compilation with Tez
and Union query and GenericUDFs (Jason Dere, reviewed by Ashutosh Chauhan)
[Xuefu Zhang] HIVE-12063: Pad Decimal numbers with trailing zeros to the scale
of the column (reviewed by Szehon)
[daijy] HIVE-12327: WebHCat e2e tests TestJob_1 and TestJob_2 fail (Daniel Dai,
reviewed by Thejas Nair)
[Jimmy Xiang] HIVE-12317: Emit current database in lineage info (Jimmy,
reviewed by Yongzhi)
[mmccline] Revert inadvertant addition of HiveConf.java.orig file
[jdere] HIVE-12333: tez_union_with_udf.q added to wrong section in
testconfiguration.properties (Jason Dere, reviewed by Chinna Lalam)
[jcamacho] HIVE-12223: Filter on Grouping__ID does not work properly (Jesus
Camacho Rodriguez, reviewed by Ashutosh Chauhan)
[Aihua Xu] HIVE-12304 "drop database cascade" needs to unregister functions
[ekoifman] HIVE-12252 Streaming API HiveEndPoint can be created w/o
partitionVals for partitioned table (Wei Zheng via Eugene Koifman)
[pxiong] HIVE-12156: expanding view doesn't quote reserved keyword (Pengcheng
Xiong, reviewed by Laljo John Pullokkaran)
[harisankar] HIVE-12340 : ExecDriver.execute() unnecessarily sets METASTOREPWD
to HIVE (Hari Subramaniyan, reviewed by Sushanth Sowmyan)
[mmccline] HIVE-12230 custom UDF configure() not called in Vectorization mode
(Matt McCline, reviewd by Jason Dere)
[Ashutosh Chauhan] HIVE-12164 : non-ascii characters shows improper with insert
into (Aleksei Statkevich via Xuefu Zhang)
[Ashutosh Chauhan] HIVE-12207 : Query fails when non-ascii characters are used
in string literals (Aleksei Statkevich via Ashutosh Chauhan)
[Ashutosh Chauhan] HIVE-12320 :
hive.metastore.disallow.incompatible.col.type.changes should be true by default
(Ashutosh Chauhan via Jason Dere)
[gopalv] HIVE-12315: Fix Vectorized double divide by zero (Gopal V, reviewed by
Matt McCline)
[gopalv] HIVE-12288: Bloom-1 filters for Vectorized map-joins (Gopal V,
reviewed by Matt McCline)
[ctang] HIVE-12346:Internally used variables in HiveConf should not be settable
via command (Chaoyu Tang, reviewed by Xuefu Zhang)
[jcamacho] HIVE-12344: Wrong types inferred for SemiJoin generation in CBO
(Jesus Camacho Rodriguez, reviewed by Laljo John Pullokkaran)
[jcamacho] HIVE-11726: Pushed IN predicates to the metastore (Jesus Camacho
Rodriguez, reviewed by Hari Sankar Sivarama Subramaniyan)
[omalley] HIVE-12345 : Followup for HIVE-9013 : Hidden conf vars still visible
through beeline (Sushanth Sowmyan, reviewed by Thejas Nair)
[omalley] HIVE-12310: Update memory estimation login in TopNHash (Hari
Subramaniyan, reviewed by Thejas Nair)
[omalley] HIVE-12325 : Turn hive.map.groupby.sorted on by default (Chetna
Chaudhari via Ashutosh Chauhan)
[omalley] HIVE-12306: fix hbase_queries.q failure (Chaoyu Tang, reviewed by
Jimmy Xiang)
[omalley] HIVE-12263 : Hive SchemaTool does not tolerate leading spaces in JDBC
url (Chen Xin Yu via Ashutosh Chauhan)
[omalley] HIVE-12232 : BucketingSortingReduceSinkOptimizer throws IOB exception
for duplicate columns
[omalley] HIVE-12358: Categorize vectorization benchmarks into arithmetic,
comparison, logic(Teddy Choi, reviewed by Ashutosh Chauhan, Ferdinand Xu)
[omalley] HIVE-12311 : explain CTAS fails if the table already exists (Gunther
Hagleitner via Ashutosh Chauhan)
[omalley] HIVE-12312 : Excessive logging in PPD code (Carter Shanklin via
Ashutosh Chauhan)
[omalley] HIVE-12354 : MapJoin with double keys is slow on MR (Sergey
Shelukhin, reviewed by Prasanth Jayachandran)
[omalley] HIVE-11201 : HCatalog is ignoring user specified avro schema in the
table definition (Bing Li via Ashutosh Chauhan)
[omalley] HIVE-12364 : Distcp job fails when run under Tez (Prasanth J via
Ashutosh Chauhan)
[omalley] HIVE-7575 GetTables thrift call is very slow (Navis via Aihua Xu,
reviewed by Szehon Ho, Aihua Xu)
[omalley] HIVE-12309 : TableScan should colStats when available for better data
size estimate (Ashutosh Chauhan via Prasanth J)
[omalley] HIVE-12363: Incorrect results with orc ppd across ORC versions (Gopal
V, reviewed by Prasanth Jayachandran)
[omalley] HIVE-12186 : Upgrade Hive to Calcite 1.5 (Jesus Camacho Rodriguez via
Ashutosh Chauhan)
[omalley] HIVE-12208: Vectorized JOIN NPE on dynamically partitioned hash-join
+ map-join (Gunther Hagleitner, reviewed by Matt McCline)
[omalley] HIVE-12365: Added resource path is sent to cluster as an empty string
when externally removed (Chaoyu Tang, reviewed by Xuefu Zhang)
[omalley] HIVE-12080: Support auto type widening (int->bigint & float->double)
for Parquet table (Mohammad Kamrul Islam, reviewed by Sergio Pena, Ryan Blue)
[omalley] HIVE-12385 : schematool failed on MySQL (Sergey Shelukhin, reviewed
by Ashutosh Chauhan)
[omalley] HIVE-12395: Turn off CBO for
hive.support.special.characters.tablename tests until feature is complete
(Pengcheng Xiong, reviewed by Ashutosh Chauhan)
[omalley] HIVE-12289 : Make sure slf4j-log4j12 jar is not in classpath
(Ashutosh Chauhan via Prasanth J)
[omalley] HIVE-11525: Tez Bucket pruning (Gopal V, reviewed by Sergey Shelukhin)
[omalley] HIVE-12391: SkewJoinOptimizer might not kick in if columns are
renamed after TableScanOperator (Jesus Camacho Rodriguez, reviewed by Ashutosh
Chauhan)
[omalley] HIVE-11955 : Add costing for join-groupby transpose rule (Ashutosh
Chauhan via Jesus Camacho Rodriguez)
[omalley] HIVE-12396 : BucketingSortingReduceSinkOptimizer may still throw IOB
exception for duplicate columns (Ashutosh Chauhan via Jesus Camacho Rodriguez)
[omalley] HIVE-11120: Generic interface for file format validation (Prasanth
Jayachandran reviewed by Xuefu Zhang)
[omalley] HIVE-12407: Check fetch property to determine if a SortLimit contains
a limit operation (Jesus Camacho Rodriguez, reviewed by Ashutosh Chauhan)
[omalley] HIVE-1841 : datanucleus.fixedDatastore should be true and autoCreate
should be false by default (Ashutosh Chauhan via Sushanth Sowmyan)
[omalley] HIVE-12402: Split hive.root.logger separately to make it compatible
with log4j1.x (Prasanth Jayachandran reviewed by Sergey Shelukhin)
[omalley] HIVE-12196 NPE when converting bad timestamp value (Aihua Xu,
reviewed by Chaoyu Tang)
[omalley] HIVE-12378: Exception on HBaseSerDe.serialize binary field (Yongzhi
Chen, reviewed by Jimmy Xiang)
[omalley] HIVE-11488: Add sessionId and queryId info to HS2 log (Aihua Xu,
reviewed by Szehon Ho)
[omalley] HIVE-11948 Investigate TxnHandler and CompactionTxnHandler to see
where we improve concurrency(Eugene Koifman, reviewed by Alan Gates)
[omalley] HIVE-12271 : Add metrics around HS2 query execution and job
submission for Hive (Szehon, reviewed by Jimmy Xiang)
[omalley] Bug: HIVE-12384 - Union Operator may produce incorrect result on TEZ
(Laljo John Pullokkaran reviewed by Sergey Shelukhin, Ashutosh Chauhan)
[omalley] HIVE-11777 : implement an option to have single ETL strategy for
multiple directories (Sergey Shelukhin, reviewed by Prasanth Jayachandran)
[omalley] Bug: HIVE-12384.1 - Union Operator may produce incorrect result on
TEZ; missed test config update (Laljo John Pullokkaran reviewed by Sergey
Shelukhin, Ashutosh Chauhan)
[omalley] HIVE-12054. Create vectorized ORC write method. (omalley reviewed by
prasanthj)
[omalley] HIVE-11981: ORC Schema Evolution Issues (Vectorized, ACID, and
Non-Vectorized) (Matt McCline, reviewed by Prasanth J)
[omalley] HIVE-12388 : GetTables cannot get external tables when TABLE type
argument is given (Navis and Szehon, via Aihua)
[omalley] HIVE-12430. Remove remaining reference to the hadoop-2 profile.
(Siddharth Seth, reviewed by Sergey Shelukhin)
[omalley] HIVE-12434: Merge branch 'spark' to master
[omalley] Revert "HIVE-12330: Fix precommit Spark test part2 (Sergio Pena,
reviewd by Szehon Ho)"
[omalley] HIVE-11422: Join a ACID table with non-ACID table fail with MR
[omalley] HIVE-12418: HiveHBaseTableInputFormat.getRecordReader() causes
Zookeeper connection leak. (Naveen Gangam via Aihua Xu)
[omalley] HIVE-12443 Hive Streaming should expose encoding and serdes for
testing (Alan Gates, reviewed by Eugene Koifman)
[omalley] HIVE-12405 : Comparison bug in
HiveSplitGenerator.InputSplitComparator#compare() (Aleksei Statkevich via Gopal
V)
[omalley] HIVE-12417 : Support for exclamation mark missing in regexp (Olaf
Flebbe, reviewed by Sergey Shelukhin)
[omalley] HIVE-12300 : deprecate MR in Hive 2.0 (Sergey Shelukhin, reviewed by
Sushanth Sowmyan)
[omalley] HIVE-12319 : Remove HadoopShims::getHadoopConfNames() (Aleksei
Statkevich via Ashutosh Chauhan)
[omalley] HIVE-12450: OrcFileMergeOperator does not use correct compression
buffer size (Prasanth Jayachandran reviewed by Sergey Shelukhin)
[omalley] HIVE-11684: Implement limit pushdown through outer join in CBO (Jesus
Camacho Rodriguez, reviewed by Laljo John Pullokkaran)
[omalley] HIVE-12437: SMB join in tez fails when one of the tables is empty
(Vikram Dixit K, reviewed by Siddharth Seth)
[omalley] HIVE-12017: Do not disable CBO by default when number of joins in a
query is equal or less than 1 (Jesus Camacho Rodriguez, reviewed by Ashutosh
Chauhan)
[omalley] HIVE-12436 : Default hive.metastore.schema.verification to true
(Ashutosh Chauhan via Sushanth Sowmyan)
[omalley] HIVE-12472: Add test case for HIVE-10592 (Prasanth Jayachandran
reviewed by Ashutosh Chauhan)
[omalley] HIVE-12389 CompactionTxnHandler.cleanEmptyAbortedTxns() should
safeguard against huge IN clauses (Eugene Koifman, reviewed by Jason Dere)
[omalley] HIVE-12409 make sure SessionState.initTxnMgr() is thread safe (Eugene
Koifman, reviewed by Jason Dere)
[omalley] HIVE-12456: QueryId can't be stored in the configuration of the
SessionState since multiple queries can run in a single session (Aihua Xu,
reviewed by Mohit)
[omalley] HIVE-12489 : Analyze for partition fails if partition value has
special characters (Thomas Friedrich via Ashutosh Chauhan)
[omalley] HIVE-12406: HIVE-9500 introduced incompatible change to
LazySimpleSerDe public interface (Aihua Xu, reviewed by Szehon Ho)
[omalley] HIVE-12411: Remove counter based stats collection mechanism
(Pengcheng Xiong, reviewed by Ashutosh Chauhan)
[omalley] HIVE-12509: Regenerate q files after HIVE-12017 went in (Jesus
Camacho Rodriguez, reviewed by Ashutosh Chauhan)
[omalley] HIVE-12175: Upgrade Kryo version to 3.0.x (Prasanth Jayachandran
reviewed by Ashutosh Chauhan)
[omalley] HIVE-9599 : remove derby, datanucleus and other not related to jdbc
client classes from hive-jdbc-standalone.jar (Ashutosh Chauhan via Thejas Nair)
[omalley] HIVE-12331 : Remove hive.enforce.bucketing & hive.enforce.sorting
configs (Ashutosh Chauhan via Jason Dere)
[omalley] HIVE-12329 :Turn on limit pushdown optimization by default (Ashutosh
Chauhan via Prasanth J)
[omalley] HIVE-12399: Filter out NULLs in the Native Vector MapJoin operators.
(Matt McCline via Gopal V)
[omalley] HIVE-12463: VectorMapJoinFastKeyStore has Array OOB errors (Gopal V,
reviewed by Sergey Shelukhin)
[omalley] HIVE-12469 : Bump Commons-Collections dependency from 3.2.1 to 3.2.2.
to address vulnerability (Ashutosh Chauhan via Sergio Pena, Reuben Kuhnert)
[omalley] HIVE-12520 : Fix schema_evol* tests on master (Ashutosh Chauhan via
Prasanth J)
[omalley] HIVE-12498: ACID: Setting
OrcRecordUpdater.OrcOptions.tableProperties() has no effect (Prasanth
Jayachandran reviewed by Eugene Koifman)
[omalley] HIVE-12487 : Fix broken MiniLlap tests (Aleksei Statkevich via
Ashutosh Chauhan)
[omalley] HIVE-12473 : DPP: UDFs on the partition column side does not evaluate
correctly (Sergey Shelukhin, reviewed by Gopal V)
[omalley] HIVE-8396 : Hive CliDriver command splitting can be broken when
comments are present (Elliot West, reviewed by Sergey Shelukhin)
[omalley] HIVE-12476: Metastore NPE on Oracle with Direct SQL (Jason Dere,
reviewed by Sushanth Sowmyan)
[omalley] HIVE-12501 : LLAP: don't use read(ByteBuffer) in IO (Sergey
Shelukhin, reviewed by Prasanth Jayachandran)
[omalley] HIVE-12503 : GBY-Join transpose rule may go in infinite loop
(Ashutosh Chauhan via Jesus Camacho Rodriguez)
[omalley] HIVE-12496 : Open ServerTransport After MetaStore Initialization
(Nemon Lou via Ashutosh Chauhan)
[omalley] HIVE-12307 - Streaming API TransactionBatch.close() must abort any
remaining transactions in the batch(Eugene Koifman, reviewed by Alan Gates)
[omalley] HIVE-12465: Hive might produce wrong results when (outer) joins are
merged (Jesus Camacho Rodriguez, reviewed by Ashutosh Chauhan)
[omalley] HIVE-12008: Hive queries failing when using count(*) on column in
view (Yongzhi Chen, reviewed by Szehon ho)
[omalley] HIVE-12338: Add webui to HiveServer2 (Jimmy, reviewed by Mohit,
Szehon, Lefty)
[omalley] HIVE-12497: Remove HADOOP_CLIENT_OPTS from hive script (Prasanth
Jayachandran reviewed by Gopal V)
[sershe] HIVE-12490 : Metastore: Mysql ANSI_QUOTES is not there for some cases
(Sergey Shelukhin, reviewed by Ashutosh Chauhan)
[sershe] HIVE-12462 : DPP: DPP optimizers need to run on the TS predicate not
FIL (Gopal V and Sergey Shelukhin, reviewed by Sergey Shelukhin and Gopal V)
[Xuefu Zhang] HIVE-12184: DESCRIBE of fully qualified table fails when db and
table name match and non-default database is in use (Naveen via Xuefu)
[Xuefu Zhang] HIVE-12512: Include driver logs in execution-level Operation logs
(Mohit via Xuefu)
[jdere] HIVE-12522: Wrong FS error during Tez merge files when warehouse and
scratchdir are on different FS (Jason Dere, reviewed by Prasanth Jayachandran)
------------------------------------------
[...truncated 310 lines...]
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommandExecutor.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommandExecutor.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHCommand.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHResult.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncCommand.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/RSyncResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/NonZeroExitCodeException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHCommand.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/AbstractSSHResult.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/ssh/SSHExecutionException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/AbortDroneException.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/LocalCommandFactory.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ExecutionPhase.java
A
ptest2/src/main/java/org/apache/hive/ptest/execution/TestsFailedException.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/PrepPhase.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/LocalCommand.java
A ptest2/src/main/java/org/apache/hive/ptest/execution/ReportingPhase.java
A ptest2/src/main/java/org/apache/hive/ptest/api
A ptest2/src/main/java/org/apache/hive/ptest/api/Status.java
A ptest2/src/main/java/org/apache/hive/ptest/api/server
A ptest2/src/main/java/org/apache/hive/ptest/api/server/TestExecutor.java
A ptest2/src/main/java/org/apache/hive/ptest/api/server/Test.java
A ptest2/src/main/java/org/apache/hive/ptest/api/server/TestLogger.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/server/ExecutionController.java
A ptest2/src/main/java/org/apache/hive/ptest/api/request
A ptest2/src/main/java/org/apache/hive/ptest/api/request/TestListRequest.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStartRequest.java
A ptest2/src/main/java/org/apache/hive/ptest/api/request/TestLogRequest.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStatusRequest.java
A ptest2/src/main/java/org/apache/hive/ptest/api/request/TestStopRequest.java
A ptest2/src/main/java/org/apache/hive/ptest/api/client
A ptest2/src/main/java/org/apache/hive/ptest/api/client/PTestClient.java
A ptest2/src/main/java/org/apache/hive/ptest/api/response
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestLogResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStatusResponse.java
A ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStatus.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStopResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestListResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/GenericResponse.java
A
ptest2/src/main/java/org/apache/hive/ptest/api/response/TestStartResponse.java
A ptest2/pom.xml
A ptest2/README.md
Checked out revision 1717399.
+ cd ptest2
+ mvn clean package -DskipTests -Drat.numUnapprovedLicenses=1000
-Dmaven.repo.local=<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/.m2>
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building hive-ptest 1.0
[INFO] ------------------------------------------------------------------------
Downloading:
http://repo.maven.apache.org/maven2/net/schmizz/sshj/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
Downloading:
http://repo.springsource.org/milestone/net/schmizz/sshj/maven-metadata.xml
Downloading:
http://people.apache.org/~brock/approvals-maven-repository/net/schmizz/sshj/maven-metadata.xml
790/790 B
Downloading:
https://repository.apache.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
Downloaded:
http://repo.maven.apache.org/maven2/net/schmizz/sshj/maven-metadata.xml (790 B
at 1.1 KB/sec)
Downloading:
http://repository.apache.org/snapshots/net/schmizz/sshj/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
398/398 B
398/398 B 398/398 B
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
(398 B at 0.1 KB/sec)
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/maven-metadata.xml
(398 B at 0.2 KB/sec)
[WARNING] Could not transfer metadata net.schmizz:sshj/maven-metadata.xml
from/to apache-snapshots
(https://repository.apache.org/content/repositories/snapshots): peer not
authenticated
Downloading:
http://repo.springsource.org/milestone/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
Downloading:
http://people.apache.org/~brock/approvals-maven-repository/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
Downloading:
http://repository.apache.org/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
2/2 KB
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
(2 KB at 20.8 KB/sec)
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
2/2 KB
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.9.1-SNAPSHOT/maven-metadata.xml
(2 KB at 17.4 KB/sec)
[WARNING] Could not transfer metadata
net.schmizz:sshj:0.9.1-SNAPSHOT/maven-metadata.xml from/to apache-snapshots
(https://repository.apache.org/content/repositories/snapshots): peer not
authenticated
Downloading:
http://repo.springsource.org/milestone/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading:
http://people.apache.org/~brock/approvals-maven-repository/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading:
https://repository.apache.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
Downloading:
http://repository.apache.org/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
2/2 KB
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
(2 KB at 25.1 KB/sec)
Downloading:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
2/2 KB
Downloaded:
https://oss.sonatype.org/content/repositories/snapshots/net/schmizz/sshj/0.10.1-SNAPSHOT/maven-metadata.xml
(2 KB at 41.8 KB/sec)
[WARNING] Could not transfer metadata
net.schmizz:sshj:0.10.1-SNAPSHOT/maven-metadata.xml from/to apache-snapshots
(https://repository.apache.org/content/repositories/snapshots): peer not
authenticated
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ hive-ptest ---
[INFO]
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @
hive-ptest ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-ptest ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 62 source files to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/classes>
[WARNING] Note:
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/src/main/java/org/apache/hive/ptest/execution/JIRAService.java>
uses unchecked or unsafe operations.
[WARNING] Note: Recompile with -Xlint:unchecked for details.
[INFO]
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @
hive-ptest ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 17 resources
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @
hive-ptest ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 24 source files to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/test-classes>
[INFO]
[INFO] --- maven-surefire-plugin:2.10:test (default-test) @ hive-ptest ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- apache-rat-plugin:0.9:check (verify.rat) @ hive-ptest ---
[INFO] 51 implicit excludes (use -debug for more details).
[INFO] Exclude: .idea/
[INFO] Exclude: .git/
[INFO] Exclude: .gitignore
[INFO] Exclude: velocity.log
[INFO] Exclude: README.md
[INFO] Exclude: **/*.approved.txt
[INFO] Exclude: **/.settings/*
[INFO] Exclude: src/test/resources/
[INFO] Exclude: **/.classpath
[INFO] Exclude: **/.project
[INFO] Exclude: **/target/**
[INFO] 95 resources included (use -debug for more details)
[INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0
approved: 95 licence.
[INFO]
[INFO] --- maven-war-plugin:2.3:war (default-war) @ hive-ptest ---
[INFO] Packaging webapp
[INFO] Assembling webapp [hive-ptest] in
[<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/hive-ptest-1.0]>
[INFO] Processing war project
[INFO] Copying webapp resources
[<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/src/main/webapp]>
[INFO] Webapp assembled in [719 msecs]
[INFO] Building war:
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/hive-ptest-1.0.war>
[INFO] Packaging classes
[INFO] Building jar:
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/hive-ptest-1.0-classes.jar>
[INFO]
[INFO] --- maven-dependency-plugin:2.8:copy-dependencies (copy-dependencies) @
hive-ptest ---
[INFO] Copying spring-core-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-core-3.2.1.RELEASE.jar>
[INFO] Copying sshj-0.8.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/sshj-0.8.1.jar>
[INFO] Copying hamcrest-core-1.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/hamcrest-core-1.1.jar>
[INFO] Copying guice-3.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/guice-3.0.jar>
[INFO] Copying ec2-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/ec2-1.7.3.jar>
[INFO] Copying jackson-core-asl-1.9.12.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jackson-core-asl-1.9.12.jar>
[INFO] Copying jclouds-bouncycastle-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-bouncycastle-1.7.3.jar>
[INFO] Copying jsch.agentproxy.sshj-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.sshj-0.0.7.jar>
[INFO] Copying commons-logging-1.1.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-logging-1.1.1.jar>
[INFO] Copying jsch.agentproxy.usocket-nc-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.usocket-nc-0.0.7.jar>
[INFO] Copying httpcore-4.2.4.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/httpcore-4.2.4.jar>
[INFO] Copying spring-webmvc-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-webmvc-3.2.1.RELEASE.jar>
[INFO] Copying mockito-all-1.9.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/mockito-all-1.9.0.jar>
[INFO] Copying jsch.agentproxy.usocket-jna-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.usocket-jna-0.0.7.jar>
[INFO] Copying commons-io-2.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-io-2.1.jar>
[INFO] Copying log4j-1.2.17.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/log4j-1.2.17.jar>
[INFO] Copying junit-4.10.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/junit-4.10.jar>
[INFO] Copying xml-apis-1.0.b2.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/xml-apis-1.0.b2.jar>
[INFO] Copying commons-lang-2.5.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-lang-2.5.jar>
[INFO] Copying httpclient-4.2.5.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/httpclient-4.2.5.jar>
[INFO] Copying sts-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/sts-1.7.3.jar>
[INFO] Copying rocoto-6.2.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/rocoto-6.2.jar>
[INFO] Copying jclouds-log4j-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-log4j-1.7.3.jar>
[INFO] Copying aopalliance-1.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/aopalliance-1.0.jar>
[INFO] Copying jsr311-api-1.1.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsr311-api-1.1.1.jar>
[INFO] Copying jclouds-sshj-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-sshj-1.7.3.jar>
[INFO] Copying commons-cli-1.2.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-cli-1.2.jar>
[INFO] Copying aws-ec2-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/aws-ec2-1.7.3.jar>
[INFO] Copying jsch.agentproxy.core-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.core-0.0.7.jar>
[INFO] Copying jackson-mapper-asl-1.9.12.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jackson-mapper-asl-1.9.12.jar>
[INFO] Copying bcpkix-jdk15on-1.49.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/bcpkix-jdk15on-1.49.jar>
[INFO] Copying jsr250-api-1.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsr250-api-1.0.jar>
[INFO] Copying spring-aop-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-aop-3.2.1.RELEASE.jar>
[INFO] Copying bcprov-ext-jdk15on-1.49.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/bcprov-ext-jdk15on-1.49.jar>
[INFO] Copying jsch.agentproxy.connector-factory-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.connector-factory-0.0.7.jar>
[INFO] Copying spring-web-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-web-3.2.1.RELEASE.jar>
[INFO] Copying commons-collections-3.2.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-collections-3.2.1.jar>
[INFO] Copying jclouds-compute-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-compute-1.7.3.jar>
[INFO] Copying ApprovalsJava-013.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/ApprovalsJava-013.jar>
[INFO] Copying jclouds-scriptbuilder-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-scriptbuilder-1.7.3.jar>
[INFO] Copying spring-beans-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-beans-3.2.1.RELEASE.jar>
[INFO] Copying jclouds-slf4j-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-slf4j-1.7.3.jar>
[INFO] Copying slf4j-api-1.6.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/slf4j-api-1.6.1.jar>
[INFO] Copying javax.inject-1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/javax.inject-1.jar>
[INFO] Copying spring-expression-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-expression-3.2.1.RELEASE.jar>
[INFO] Copying jsch.agentproxy.pageant-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.pageant-0.0.7.jar>
[INFO] Copying slf4j-log4j12-1.6.1.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/slf4j-log4j12-1.6.1.jar>
[INFO] Copying jclouds-core-1.7.3.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jclouds-core-1.7.3.jar>
[INFO] Copying jsch.agentproxy.sshagent-0.0.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jsch.agentproxy.sshagent-0.0.7.jar>
[INFO] Copying guava-15.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/guava-15.0.jar>
[INFO] Copying jna-3.4.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/jna-3.4.0.jar>
[INFO] Copying gson-2.2.4.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/gson-2.2.4.jar>
[INFO] Copying platform-3.4.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/platform-3.4.0.jar>
[INFO] Copying guice-assistedinject-3.0.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/guice-assistedinject-3.0.jar>
[INFO] Copying velocity-1.7.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/velocity-1.7.jar>
[INFO] Copying commons-codec-1.6.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/commons-codec-1.6.jar>
[INFO] Copying spring-context-3.2.1.RELEASE.jar to
<http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/HIVE-TRUNK-JAVA8/ws/hive/build/ptest2/target/lib/spring-context-3.2.1.RELEASE.jar>
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 31.357s
[INFO] Finished at: Tue Dec 01 06:02:19 EST 2015
[INFO] Final Memory: 21M/56M
[INFO] ------------------------------------------------------------------------
+ set +e
+ optionalArgs=()
+ [[ -n '' ]]
+ java -cp 'target/hive-ptest-1.0-classes.jar:target/lib/*'
org.apache.hive.ptest.api.client.PTestClient --endpoint
http://ec2-174-129-184-35.compute-1.amazonaws.com:8181/hive-ptest-1.0/
--logsEndpoint http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/
--command testStart --profile trunkjava8-mr2 --password c0mmit --outputDir
target/ --testHandle HIVE-TRUNK-JAVA8-139
2015-12-01 13:12:40,832 ERROR TestExecutor.run:138 Error executing
HIVE-TRUNK-JAVA8-139 java.lang.NullPointerException: branch
at
com.google.common.base.Preconditions.checkNotNull(Preconditions.java:209)
at
org.apache.hive.ptest.execution.conf.TestConfiguration.<init>(TestConfiguration.java:101)
at
org.apache.hive.ptest.execution.conf.TestConfiguration.fromInputStream(TestConfiguration.java:276)
at
org.apache.hive.ptest.execution.conf.TestConfiguration.fromFile(TestConfiguration.java:284)
at
org.apache.hive.ptest.api.server.TestExecutor.run(TestExecutor.java:110)
Logs are located:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/HIVE-TRUNK-JAVA8-139
Exception in thread "main" java.lang.RuntimeException: 404 Not Found
at
org.apache.hive.ptest.api.client.PTestClient.downloadTestResults(PTestClient.java:181)
at
org.apache.hive.ptest.api.client.PTestClient.testStart(PTestClient.java:129)
at
org.apache.hive.ptest.api.client.PTestClient.main(PTestClient.java:312)
+ ret=1
+ cd target/
+ [[ -f test-results.tar.gz ]]
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
