ramabme commented on pull request #7300:
URL: https://github.com/apache/pinot/pull/7300#issuecomment-898649318
Add an initial implementation of debug endpoint to get information about the
minion PinotTasks queued and information about the subtasks running under each
PinotTask batch.
The endpoint has a verbositylevel. By default we print only high level
summary for completed tasks. For incomplete subtasks prints more detail. If
verbositylevel is set to >=10 , prints for all tasks.
An example output with default verbosity - the first and the third PinotTask
are completed tasks with only high level info ,
{
"Task_RealtimeToOfflineSegmentsTask_1628833546894": {
"subTaskInfos": null,
"subTaskCount": {
"waiting": 0,
"error": 0,
"total": 1,
"running": 0,
"completed": 1
},
"startTime": "2021-08-12 22:46:12 PDT",
"taskState": "COMPLETED",
"executionStartTime": "2021-08-12 22:46:12 PDT"
},
"Task_RealtimeToOfflineSegmentsTask_1628833651118": {
"subTaskInfos": [
{
"startTime": "2021-08-12 22:47:57 PDT",
"info": "",
"taskConfig": {
"configs": {
"uploadURL": "http://localhost:18998/segments";,
"downloadURL":
"http://localhost:18998/segments/mytable/mytable__0__5__20210813T0544Z,http://localhost:18998/segments/mytable/mytable__1__5__20210813T0544Z";,
"windowStartMs": "1388707200000",
"segmentName":
"mytable__0__5__20210813T0544Z,mytable__1__5__20210813T0544Z",
"windowEndMs": "1388793600000",
"tableName": "mytable_REALTIME"
},
"taskType": "RealtimeToOfflineSegmentsTask"
},
"state": "RUNNING",
"participant": "Minion_192.168.1.21_9514",
"finishTime": null,
"taskId": "Task_RealtimeToOfflineSegmentsTask_1628833651118_0"
}
],
"subTaskCount": {
"waiting": 0,
"error": 0,
"total": 1,
"running": 1,
"completed": 0
},
"startTime": "2021-08-12 22:47:57 PDT",
"taskState": "IN_PROGRESS",
"executionStartTime": "2021-08-12 22:47:57 PDT"
},
"Task_RealtimeToOfflineSegmentsTask_1628833502672": {
"subTaskInfos": null,
"subTaskCount": {
"waiting": 0,
"error": 0,
"total": 1,
"running": 0,
"completed": 1
},
"startTime": "2021-08-12 22:45:14 PDT",
"taskState": "COMPLETED",
"executionStartTime": "2021-08-12 22:45:14 PDT"
}
}
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
