Re: Resizing Image with Scrimage in Spark

2016-10-17 Thread Sean Owen
It pretty much means what it says. Objects you send across machines must be serializable, and the object from the library is not. You can write a wrapper object that is serializable and knows how to serialize it. Or ask the library dev to consider making this object serializable. On Mon, Oct 17,

Resizing Image with Scrimage in Spark

2016-10-17 Thread Adline Dsilva
Hi All, I have a Hive Table which contains around 500 million photos(Profile picture of Users) stored as hex string and total size of the table is 5TB. I'm trying to make a solution where images can be retrieved in real-time. Current Solution, Resize the images, index it along the user