Indeed, when I tried to re run it on my Windows PC at home it also found
Nan.
The problem appears to be when I download the data using the script, since
I tried it with the data I downloaded from the Linux server and It ran fine.
Best
On Sat, Nov 17, 2012 at 11:44 AM, Leon Palafox <[email protected]> wrote:
> Hey guys,
>
> I think I figured out the problem, well, sorta, I downloaded everything on
> my ubuntu server, and everything worked fine and dandy, the problem seem to
> ve when I was running on my windows machine.
>
> That's odd
>
> Its on win32 and python 2.7
>
> Greets
>
>
> On Sat, Nov 17, 2012 at 3:43 AM, Jake Vanderplas <
> [email protected]> wrote:
>
>> If npy files do in fact work cross-platform, then I'm baffled. Any
>> ideas about what could be causing these NaNs in Leon's script? The files
>> on the website haven't been modified since they were put online.
>>
>> Here's a more compact version of the NaN checking:
>>
>> >>> import numpy as np
>> >>> data = np.load('sdss_photoz.npy')
>> >>> np.sum([np.isnan(data[col]) for col in data.dtype.names])
>> 0
>>
>> Leon, what version of numpy are you using?
>> Jake
>>
>>
>>
>> On 11/16/2012 08:22 AM, Nelle Varoquaux wrote:
>>
>>
>>
>>
>> On 16 November 2012 17:14, Robert Kern <[email protected]> wrote:
>>
>>> On Fri, Nov 16, 2012 at 4:03 PM, Nelle Varoquaux
>>> <[email protected]> wrote:
>>> >> Hi Leon,
>>> >> When I run your script, I get no instances of NaN in the data.
>>> >>
>>> >> I wonder if it's a problem with storing the data as a npy file. I
>>> asked
>>> >> around last spring and everybody seemed to think that the format is
>>> >> compatible across platforms and numpy versions, but I may be wrong.
>>> Does
>>> >> anybody know?
>>> >
>>> > I think numpy relies on pickle for those. These are plateform dependant
>>> > (32bits vers 64bits), and python version dependant. Pickle is not a
>>> safe way
>>> > to store data, thought I never had problems on my personal computers.
>>> > Saving as txt is more reliable.
>>>
>>> The NPY file format only uses pickle for object arrays, which this
>>> isn't. Otherwise, it records floats in standard IEEE-754 binary format
>>> with enough header information to reconstruct it portably across
>>> platforms. I see no NaNs, myself.
>>>
>>
>> OK. Good to know :)
>>
>> Cheers,
>> N
>>
>>
>>>
>>> --
>>> Robert Kern
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Monitor your physical, virtual and cloud infrastructure from a single
>>> web console. Get in-depth insight into apps, servers, databases, vmware,
>>> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
>>> Pricing starts from $795 for 25 servers or applications!
>>> http://p.sf.net/sfu/zoho_dev2dev_nov
>>> _______________________________________________
>>> Scikit-learn-general mailing list
>>> [email protected]
>>> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Monitor your physical, virtual and cloud infrastructure from a single
>> web console. Get in-depth insight into apps, servers, databases, vmware,
>> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
>> Pricing starts from $795 for 25 servers or
>> applications!http://p.sf.net/sfu/zoho_dev2dev_nov
>>
>>
>>
>> _______________________________________________
>> Scikit-learn-general mailing
>> [email protected]https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>>
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Monitor your physical, virtual and cloud infrastructure from a single
>> web console. Get in-depth insight into apps, servers, databases, vmware,
>> SAP, cloud infrastructure, etc. Download 30-day Free Trial.
>> Pricing starts from $795 for 25 servers or applications!
>> http://p.sf.net/sfu/zoho_dev2dev_nov
>> _______________________________________________
>> Scikit-learn-general mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>>
>>
>
>
> --
> Leon Palafox, M.Sc
> PhD Candidate
> Iba Laboratory
> +81-3-5841-8436
> University of Tokyo
> Tokyo, Japan.
>
>
>
--
Leon Palafox, M.Sc
PhD Candidate
Iba Laboratory
+81-3-5841-8436
University of Tokyo
Tokyo, Japan.
------------------------------------------------------------------------------
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
_______________________________________________
Scikit-learn-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
