Srikanth Sundarrajan created FALCON-796:
-------------------------------------------

             Summary: Enable users to triage data processing issues through 
falcon
                 Key: FALCON-796
                 URL: https://issues.apache.org/jira/browse/FALCON-796
             Project: Falcon
          Issue Type: Improvement
            Reporter: Srikanth Sundarrajan


Falcon has a wealth of information that can help users to triage issues 
relating to their pipelines, but this information is not available in a 
consumable form to the users. Here is a suggestion to solve for this issue to 
some extent.

In a typical usage scenario, users may find that their data has not been 
generated and that would require them to walk up the dependency tree to 
identify the root cause. Luckily all this information is available within 
Falcon and can be surfaced. 

A mock of how this would look:

*falcon instance -type feed -name FEED-abc -start 2014-10-01T00:00Z -end 
2014-10-01T00:00Z  -triage*
{noformat}
FEED-abc/2014-10-01T00:00Z MISSING
  + PROCESS-def/2014-10-02T04:00Z WAITING
    + FEED-ghi/2014-10-01T00:00Z MISSING
      + PROCESS-mno/2014-10-01T01:30Z  RUNNING
    + FEED-ghi/2014-10-01T01:00Z MISSING
      + PROCESS-mno/2014-10-01T02:30Z  FAILED
    + FEED-ghi/*                 AVAIALBLE
    + FEED-jkl/*                 AVAILABLE
{noformat}

*falcon instance -type feed -name FEED-abc -start 2014-09-01T00:00Z -end 
2014-09-01T00:00Z  -triage*
{noformat}
FEED-abc/2014-09-01T00:00Z AVAILABLE
{noformat}

*falcon instance -type process -name PROCESS-def -start 2014-10-01T00:00Z -end 
2014-10-01T00:00Z  -triage*
{noformat}
PROCESS-def/2014-10-02T04:00Z WAITING
  + FEED-ghi/2014-10-01T00:00Z MISSING
    + PROCESS-mno/2014-10-01T01:30Z  RUNNING
  + FEED-ghi/2014-10-01T01:00Z MISSING
    + PROCESS-mno/2014-10-01T02:30Z  FAILED
  + FEED-ghi/*                 AVAIALBLE
  + FEED-jkl/*                 AVAILABLE
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to