shanyu zhao created SLIDER-1090:
-----------------------------------

             Summary: Speed up SliderClient and AM by reading metainfo from 
accompany file
                 Key: SLIDER-1090
                 URL: https://issues.apache.org/jira/browse/SLIDER-1090
             Project: Slider
          Issue Type: Bug
    Affects Versions: Slider 0.90.2, Slider 0.81
            Reporter: shanyu zhao


Today both SliderClient and SliderAM read package metainfo from HDFS. This 
requires downloading the whole package from HDFS. If package size is big 
(~200MB), this operation wastes tens of seconds in starting up the application.

To speed up the operation of reading metainfo, we can read from an accompany 
xml/json file if it exists in the same HDFS folder as the zip package. If the 
accompany file does not exist, it falls back to the old way of downloading the 
zip package.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to