Thanks for reaching out to us, Jyotsna. Let me make sure I understand what your setup and the issue you are experiencing. It sounds like the setup looks like this.
Browser -> Third party service "thirdeye-services" -> HiveServer2 -> Tez Since you are showing logs and screenshots of the successful Tez Job. My initial thought is that HiveServer2 was able to successfully and correctly get the results from Tez. That would make me believe that either the connection between the browser to the third party service "thirdeye-services" isn't working (perhaps browser compatibility issue, security issue, or service issue) or the connection between the third party service "thirdeye-services" to HiveServer2 issue (issue retrieving results from HiveServer2). Since our expertise is only with the Tez portion of the setup and that the Tez portion of the setup seems to be working, the Tez community won't be the best at addressing this issue. My recommendation would be try the query in a different browser as a simple test (Chrome, Firefox) checking with third party "thirdeye-services" browser compatibility. If you have access to the thirdparty-services logs or logs to the HiveServer2 logs those will be helpful in debugging. When reaching out to the thirdeye-services support or HiveServer2 please reference these logs to get the best support from the community. The hive user list is [email protected] and I have don't have a support contact for the thirdparty software thirdeye-services that seems to be part of this setup. Thanks again for reaching to the Tez Community. Regards, jeagles On Mon, Mar 19, 2018 at 6:47 AM, Jyotsna G <[email protected]> wrote: > Hi, > We are making a rest URI request which hits Hive server 2 and translates > in to a hive query on TEZ. > > Sample uri: > slc00yeb.us.oracle.com:8989/thirdeye-services/v1.0/OSCS/quer > y/OSCSRecords.json?COMP_FAMILY=FMW&COMP_NAME=WLS&COMPTYPE1_ > FIRST=RC1&COMPTYPE1_SECOND=RC2&COMPTYPE2_FIRST=manifest. > publish.label.WLS_GENERIC:carb-manifest:12.2.1.3.0- > 170722.1880245:pom&COMPTYPE2_SECOND=manifest.publish.label. > WLS_GENERIC:carb-manifest:12.2.1.3.0-170726.1880744:pom& > RELEASE_FIRST=12.2.1.3.0&RELEASE_SECOND=12.2.1.3.0&COMPTYPE=MANIFEST > > Hadoop version : 2.4.0 > Hive:1.2.2 > Tez : 5.4.0 > > All my queries run fine in HIVE CLI , also via standalone program > connecting to hive via JDBC ODBC connection and returns hive query results, > but only when I hit the rest URL, results are not returned. > > I have enabled the below settings for tez > > tez.session.am.dag.submit.timeout.secs 90 > > tez.am.mode.session : true > tez.am.container.reuse.enable: true > tez.allow.disabled.timeline-domains : true > tez.yarn.ats.enabled : true > tez.use.cluster.hadoop-libs : true > > The url on the browser keeps spinning without the json response, even > after the tez job on yarn cluster has finished successfully. Attached Tez > job diagnosis screenshot. > > From the dag log : > > 2018-03-19 11:34:36,367 INFO [AsyncDispatcher event handler] impl.DAGImpl: > dag_1521448362533_0019_1 transitioned from RUNNING to SUCCEEDED > 2018-03-19 11:34:36,368 INFO [AsyncDispatcher event handler] > app.DAGAppMaster: DAG completed, dagId=dag_1521448362533_0019_1, > dagState=SUCCEEDED > > {"entity":"dag_1521448362533_0019_1","entitytype":"TEZ_DAG_I > D","events":[{"ts":1521459276335,"eventtype":"DAG_FINISHED"} > ],"otherinfo":{"startTime":1521459269619,"endTime": > 1521459276335,"timeTaken":6716,"status":"SUCCEEDED"," > diagnostics":"","counters":{"counterGroups":[{"counterGroup > Name":"org.apache.tez.common.counters.DAGCounter","counterG > roupDisplayName":"org.apache.tez.common.counters.DAGCounter > ","counters":[{"counterName":"NUM_SUCCEEDED_TASKS"," > counterDisplayName":"NUM_SUCCEEDED_TASKS","counterValue > ":2},{"counterName":"TOTAL_LAUNCHED_TASKS","counterDisplayName":"TOTAL_ > LAUNCHED_TASKS","counterValue":2},{"counterName":"DATA_LOCAL_TASKS"," > counterDisplayName":"DATA_LOCAL_TASKS","counterValue":1} > ]},{"counterGroupName":"org.apache.tez.common.counters.Fil > eSystemCounter","counterGroupDisplayName":"File System > Counters","counters":[{"counterName":"FILE_BYTES_READ"," > counterDisplayName":"FILE_BYTES_READ","counterValue":41993}, > {"counterName":"FILE_BYTES_WRITTEN","counterDisplayName": > "FILE_BYTES_WRITTEN","counterValue":83954},{" > counterName":"FILE_READ_OPS","counterDisplayName":"FILE_ > READ_OPS","counterValue":0},{"counterName":"FILE_LARGE_READ_ > OPS","counterDisplayName":"FILE_LARGE_READ_OPS","counterValu > e":0},{"counterName":"FILE_WRITE_OPS","counterDisplayName":"FILE_WRIT > E_OPS","counterValue":0},{"counterName":"HDFS_BYTES_READ" > ,"counterDisplayName":"HDFS_BYTES_READ","counterValue": > 59231},{"counterName":"HDFS_BYTES_WRITTEN","counterDisplayName":"HDFS_ > BYTES_WRITTEN","counterValue":39631},{"counterName":"HDFS_ > READ_OPS","counterDisplayName":"HDFS_READ_OPS"," > counterValue":5},{"counterName":"HDFS_LARGE_READ_OPS"," > counterDisplayName":"HDFS_LARGE_READ_OPS","counterValue" > :0},{"counterName":"HDFS_WRITE_OPS","counterDisplayName":"HDFS_WRIT > E_OPS","counterValue":2}]},{"counterGroupName":"org.apache. > tez.common.counters.TaskCounter","counterGroupDisplayName":" > org.apache.tez.common.counters.TaskCounter","counters":[{"counterName":" > REDUCE_INPUT_GROUPS","counterDisplayName":"REDUCE_ > INPUT_GROUPS","counterValue":190},{"counterName":"REDUCE_INPUT_RECORDS"," > counterDisplayName":"REDUCE_INPUT_RECORDS","counterValue": > 191},{"counterName":"COMBINE_INPUT_RECORDS","counterDisplayName":"COMBINE_ > INPUT_RECORDS","counterValue":0},{"counterName":"SPILLED_ > RECORDS","counterDisplayName":"SPILLED_RECORDS","counterValu > e":382},{"counterName":"NUM_SHUFFLED_INPUTS","counterDisplayName":"NUM_ > SHUFFLED_INPUTS","counterValue":1},{"counterName":"NUM_SKIPPED_INPUTS"," > counterDisplayName":"NUM_SKIPPED_INPUTS","counterValue" > :0},{"counterName":"NUM_FAILED_SHUFFLE_INPUTS","counte > rDisplayName":"NUM_FAILED_SHUFFLE_INPUTS","counterValue" > :0},{"counterName":"MERGED_MAP_OUTPUTS","counterDisplayName":"MERGED_ > MAP_OUTPUTS","counterValue":1},{"counterName":"GC_TIME_ > MILLIS","counterDisplayName":"GC_TIME_MILLIS","counterValue" > :84},{"counterName":"CPU_MILLISECONDS","counterDisplayName": > "CPU_MILLISECONDS","counterValue":5520},{"counterName":"PHYSICAL_MEMORY_ > BYTES","counterDisplayName":"PHYSICAL_MEMORY_BYTES"," > counterValue":661254144},{"counterName":"VIRTUAL_MEMORY_ > BYTES","counterDisplayName":"VIRTUAL_MEMORY_BYTES"," > counterValue":4294270976},{"counterName":"COMMITTED_HEAP_ > BYTES","counterDisplayName":"COMMITTED_HEAP_BYTES","counterV > alue":402653184},{"counterName":"INPUT_RECORDS_PROCESSED","c > ounterDisplayName":"INPUT_RECORDS_PROCESSED","counterValue": > 8445},{"counterName":"OUTPUT_RECORDS","counterDisplayName": > "OUTPUT_RECORDS","counterValue":191},{"counterName":"OUTPUT_BYTES","c > ounterDisplayName":"OUTPUT_BYTES","counterValue":41350},{" > counterName":"OUTPUT_BYTES_WITH_OVERHEAD","counterDisplayNam > e":"OUTPUT_BYTES_WITH_OVERHEAD","counterValue": > 41957},{"counterName":"OUTPUT_BYTES_PHYSICAL"," > counterDisplayName":"OUTPUT_BYTES_PHYSICAL","counterValue" > :41961},{"counterName":"ADDITIONAL_SPILLS_BYTES_ > WRITTEN","counterDisplayName":"ADDITIONAL_SPILLS_BYTES_WRITT > EN","counterValue":41961},{"counterName":"ADDITIONAL_SPILL > S_BYTES_READ","counterDisplayName":"ADDITIONAL_SPILLS_BYTES_ > READ","counterValue":41961},{"counterName":"ADDITIONAL_SPILL > _COUNT","counterDisplayName":"ADDITIONAL_SPILL_COUNT","count > erValue":0},{"counterName":"SHUFFLE_BYTES","counterDisplay > Name":"SHUFFLE_BYTES","counterValue":41961},{" > counterName":"SHUFFLE_BYTES_DECOMPRESSED","counterDisplayNam > e":"SHUFFLE_BYTES_DECOMPRESSED","counterValue":41957},{"counterName":" > SHUFFLE_BYTES_TO_MEM","counterDisplayName":"SHUFFLE_ > BYTES_TO_MEM","counterValue":41961},{"counterName":" > SHUFFLE_BYTES_TO_DISK","counterDisplayName":"SHUFFLE_ > BYTES_TO_DISK","counterValue":0},{"counterName":"SHUFFLE_ > BYTES_DISK_DIRECT","counterDisplayName":"SHUFFLE_BYTES_DISK_ > DIRECT","counterValue":0},{"counterName":"NUM_MEM_TO_DISK_ME > RGES","counterDisplayName":"NUM_MEM_TO_DISK_MERGES","counter > Value":0},{"counterName":"NUM_DISK_TO_DISK_MERGES","counterD > isplayName":"NUM_DISK_TO_DISK_MERGES","counterValue":0}]},{" > counterGroupName":"HIVE","counterGroupDisplayName":"HIVE"," > counters":[{"counterName":"CREATED_FILES","counterDisplay > Name":"CREATED_FILES","counterValue":1},{"counterName > ":"DESERIALIZE_ERRORS","counterDisplayName":"DESERIALI > ZE_ERRORS","counterValue":0},{"counterName":"RECORDS_IN_Map_ > 1","counterDisplayName":"RECORDS_I > > > But the json response isnt coming. What am I missing here? > > Thanks, > Jyotsna > > >
