Profiles Gone in Web UI: The great profile heist

2016-05-31 Thread John Omernik
I am scratching my head at this one... I made some minor changes to my drill-env.sh to enable gclogging, and was using the profiles in the webui just fine. Due to some previously mentioned issues, I've had to restart drill bits due to GC issues etc. Now, while my profiles directory still exists,

Re: Profiles Gone in Web UI: The great profile heist

2016-05-31 Thread Abdel Hakim Deneche
are you storing the profiles in a local folder or in nfs ? On Tue, May 31, 2016 at 12:49 PM, John Omernik wrote: > I am scratching my head at this one... I made some minor changes to my > drill-env.sh to enable gclogging, and was using the profiles in the webui > just fine. Due to some previous

Re: Profiles Gone in Web UI: The great profile heist

2016-05-31 Thread Jacques Nadeau
Odds are one of your profiles is corrupt. Last I checked, there was a bug that a corrupt profile would cause no profiles to show up in list. Check if any of your profiles are zero bytes and delete them. The UI should really handle this. -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, May 31

Re: Profiles Gone in Web UI: The great profile heist

2016-06-01 Thread John Omernik
It's in mapr fs via nfs. On Tuesday, May 31, 2016, Abdel Hakim Deneche wrote: > are you storing the profiles in a local folder or in nfs ? > > On Tue, May 31, 2016 at 12:49 PM, John Omernik > wrote: > > > I am scratching my head at this one... I made some minor changes to my > > drill-env.sh to

Re: Profiles Gone in Web UI: The great profile heist

2016-06-01 Thread John Omernik
I will walk through and look for the corrupt profile. This could be the result of my "cluster in a bad state problem" (actually, it IS the result of that, I have Ben doing testing to recreate the issue). Is there a JIRA for this ? I agree the UI should handle this. On Tuesday, May 31, 2016, Jacqu

Re: Profiles Gone in Web UI: The great profile heist

2016-06-01 Thread John Omernik
Abdel and Jacques - It is absolutely a bad profile, however, Jacques, it was not a empty file profile, instead, it was a profile where the write didn't complete (likely due to my bad cluster state post). I was able to reproduce it synthetically like this, say you had a profile that ended similar

Re: Profiles Gone in Web UI: The great profile heist

2016-06-01 Thread Krystal Nguyen
Looks like a jira was opened a while back (status is unresolved) regarding similar issue you are seeing: https://issues.apache.org/jira/browse/DRILL-2593 On Wed, Jun 1, 2016 at 5:52 AM, John Omernik wrote: > Abdel and Jacques - > > It is absolutely a bad profile, however, Jacques, it was not a e

Re: Profiles Gone in Web UI: The great profile heist

2016-06-01 Thread John Omernik
Thank you, I +1ed the JIRA, and added my user list comments. This should be easily reproducible and fixable. On Wed, Jun 1, 2016 at 11:17 AM, Krystal Nguyen wrote: > Looks like a jira was opened a while back (status is unresolved) regarding > similar issue you are seeing: > https://issues.apac