fixed it by installing python 2.7 64bit including all dependencies that are
needed in 64b.
a python dictionary will be capped by the 32b limit, therefore you need
more than 64b to allow bigger dictionaries.
total ram used in the process is ~2.5GB
Ori.
On Sun, Oct 23, 2016 at 5:58 PM, Mohamed Oun <mohamed...@gmail.com> wrote:
> Hello, I'm now having the same problem as Abraham. The same MemoryError
> that occurs with the Misc. crew data. I downloaded the package from the
> website, and also tried the one on Github. both same problem.
> This is what's thrown at me, always at the same stage:
>
> Traceback (most recent call last):
> File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 3072, in <module>
> run()
> File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 2958, in run
> castLists()
> File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1641, in castLists
> doCast(f, roleid, rolename)
> File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1563, in doCast
> pid = CACHE_PID.addUnique(name.strip(), miscData)
> File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1017, in addUnique
> else: return self.add(key, miscData)
> File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 1010, in add
> self[key] = c
> File "C:\Python27\Lib\site-packages\imdb\Scripts\imdbpy2sql.py", line
> 922, in __setitem__
> dict.__setitem__(self, key, counter)
> MemoryError
>
>
>
>
>
> On Wed, Sep 28, 2016 at 10:47 PM, Abraham Whiskas <
> abrahamwhis...@outlook.com> wrote:
>
>> Hi i'm trying to import the text files into MySQL, however i am getting
>> this error:
>>
>>
>> Traceback (most recent call last):
>> File "C:\Python27\Scripts\imdbpy2sql.py", line 3072, in <module>
>> run()
>> File "C:\Python27\Scripts\imdbpy2sql.py", line 2958, in run
>> castLists()
>> File "C:\Python27\Scripts\imdbpy2sql.py", line 1641, in castLists
>> doCast(f, roleid, rolename)
>> File "C:\Python27\Scripts\imdbpy2sql.py", line 1563, in doCast
>> pid = CACHE_PID.addUnique(name.strip(), miscData)
>> File "C:\Python27\Scripts\imdbpy2sql.py", line 1017, in addUnique
>> else: return self.add(key, miscData)
>> File "C:\Python27\Scripts\imdbpy2sql.py", line 1010, in add
>> self[key] = c
>> File "C:\Python27\Scripts\imdbpy2sql.py", line 922, in __setitem__
>> dict.__setitem__(self, key, counter)
>> MemoryError
>>
>>
>> At first i thought it was an error resulting from the a DB limitation so
>> i tried to use the csv option, and the error was still thrown, so it
>> should be a limitation of python on my environment.
>>
>> I'm running this on an Windows 10 64 bits Pro, with an i7 with SSD and
>> 16gb ram, so it's not a RAM problem, however the python i have installed
>> is 32 bits, which i think is the reason due to memory allocation limits.
>>
>> Any ideas on how to get the data loaded to the DB?
>>
>> Thanks
>> ------------------------------------------------------------
>> ------------------
>> _______________________________________________
>> Imdbpy-help mailing list
>> Imdbpy-help@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>>
>
>
>
> --
> *Best Regards, *
> *Mohamed Oun*
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, SlashDot.org! http://sdm.link/slashdot
> _______________________________________________
> Imdbpy-help mailing list
> Imdbpy-help@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/imdbpy-help
>
>
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Imdbpy-help mailing list
Imdbpy-help@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-help