[GitHub] [carbondata] Pickupolddriver commented on issue #3611: [CARBONDATA-3692] Support NoneCompression during loading data.
Pickupolddriver commented on issue #3611: [CARBONDATA-3692] Support NoneCompression during loading data. URL: https://github.com/apache/carbondata/pull/3611#issuecomment-585017763 > Can you please explain the scenario where no-compression would be beneficial? This NoneCompress Compressor will improve the speed of loading data from Flink to OBS File by trade-off space and IO in some cases. For example: when loading data from Flink to OBS, data needs to be compressed by Flink to temporary files and then decompressed by OBS. After adding the NoneCompressor, users can use the NoneCompressor load data without compress first and then decompress the temporary files. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [carbondata] Pickupolddriver commented on issue #3611: [CARBONDATA-3692] Support NoneCompression during loading data.
Pickupolddriver commented on issue #3611: [CARBONDATA-3692] Support NoneCompression during loading data. URL: https://github.com/apache/carbondata/pull/3611#issuecomment-586201467 > @Pickupolddriver : Agree that it can improve the loading speed. But data will be 3x bigger. So, storage cost on OBS will be 3x more! Data would be processed after loaded to OBS. So if we could provide a NonCompressor, it could avoid the data being compressed and then uncompressed. And the uncompressed data would be deleted after processed in OBS. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
