Here are my thoughts on Adam's list
- (1) is already patch available and has some minor code review comments. I think it will be available very soon. - (2) We are still working to support monitoring in backend. After that we will add it to the UI dashboard as well. - (3) Can be added to UI dashboard if these cases are not solved as of now. - (4) This is an excellent suggestion. Another way is to have a pipeline view of your system but that gives only processes and not feeds. We need to leverage groups feature more. - (5) Can you please explain it in more detail? You want only size, hdfs location etc. or something more? There is more exciting stuff like entity lineage <https://issues.apache.org/jira/browse/FALCON-256>(already committed) and instance triage <https://issues.apache.org/jira/browse/FALCON-796>(in progress) which is under works in backend and will be available in UI after that. *P.S. *To see how we are thinking about monitoring dashboard you can take a look at the POC that I did at https://github.com/ajayyadav/falcon-dashboard Currently this works on mocked API calls and we are working to provide the backend APIs in falcon as of now. On Sun, Jan 11, 2015 at 6:13 AM, Srikanth Sundarrajan <[email protected]> wrote: > [email protected] > [email protected] > > Thanks for the feedback, we as a community are absolutely committed to > making a UI that greatly simplifies administration, management and > operations through Falcon. To this effect we wanted to create Falcon > Administration & Management console. There are bunch of jiras already filed > to enable various use cases relating to this. > > Will try and spend some time to piece them together and put forth for > consideration. I would also like to point out that I am aware of some > efforts from @Kenneth Ho (management features), @Sanjeev Tripurari > (operations features) and @Ajay Yadav (operations features) in this regard > and perhaps they can chime in and provide their thoughts. > > Regards > Srikanth Sundarrajan > > > Date: Sat, 10 Jan 2015 20:34:12 +0100 > > Subject: Any roadmap for Falcon Web UI enhancements ? > > From: [email protected] > > To: [email protected] > > > > Hi, > > > > I have been extensively using Falcon for several months and I found it > very > > useful! > > > > Once you adopt Falcon, however, and define tens of feeds and processes, > it > > becomes a bit inconvenient to track down what happens with your processes > > using the current Falcon Web UI (yes, you can use Oozie Web UI for that) > > and corresponding feeds. > > > > I am curious if there is any roadmap for Falcon Web UI enhancements. > > Use-cases that I would find useful include: > > > > 1. Being able to search feeds/processes by name, tag and status ( > > https://issues.apache.org/jira/secure/attachment/12686141/landing.png > > provides search-box and drop-down lists, but a whole patch seems to be > too > > huge to be committed soon) > > > > 2. Being able to come to the office at 8 AM and after a quick look know > > what processes aren't done yet (and feeds aren't delivered). > > > > This could be achieved e.g. by adding a date of the last > > successful/failed/running instance for each process on the process list > and > > an intuitive icon. Being able to distinguish between daily and hourly > feeds > > would be useful here. > > > > 3. Being able to sorting of the list of feeds/processes in some way e.g. > by > > name, status, owner, type or something that makes sense > > > > Currently, you will not find a feed/process on the long list without > > pressing CTRL+F first. > > > > 4. Instead of having a flat list, it would be able to see be useful to > see > > groups of feeds, if you use the <groups> tags in their XML definition > > > > 5. Being able to quickly learn more about my feed from other source of > > information e.g. Hive Metastore or HDFS. > > > > A simple integration with HUE could give some benefits and wouldn't be > time > > consuming e.g. if a feed is backed by a Hive table, then there could be a > > link to HUE webpage that shows that table i.e. the same idea as with > "Logs" > > link next to the process instance that points to Oozie. Obviously this > > feature would be displayed only if somebody configures HUE for Falcon. > > > > -- > > > > Probably everyone can come up with some other ideas... > > > > Please let me know if these features are valid for Falcon. I do realize > > that the core idea of Falcon is to simplify data management and > scheduling, > > but it would be nice if Falcon provides a bit more feature-rich Web UI > > instead of delegating to other tools (such as Oozie, CLI). > > > > Cheers! > > Adam > >
