subject:"\[julia\-users\] How to load data from a \*.mat file on all workers in Julia 0.4.5 without require\(\)\?"

Re: [julia-users] How to load data from a *.mat file on all workers in Julia 0.4.5 without require()?

2016-04-13 Thread 'Jhan Jar' via julia-users


Thanks Tim,

The second link helped me figure out the issue(s)/bug(s).
Really appreciate you guys!

On Tuesday, April 12, 2016 at 3:54:58 PM UTC+5, Tim Holy wrote:
>
> This is covered is multiple previous posts to the mailing list. 
>
> https://groups.google.com/forum/#!searchin/julia-users/@everywhere$20using/julia-users/5Xf7duBT6WI/Q8sCr44qBwAJ
>  
> https://groups.google.com/d/msg/julia-users/KKscQCby0GM/cOr2Dr3aAAAJ 
>
> Best, 
> --Tim 
>
> On Tuesday, April 12, 2016 03:41:48 AM 'Jhan Jar' via julia-users wrote: 
> > Hi, 
> > 
> > In Julia 0.3.5, the following loaded data on all workers: 
> > 
> > addprocs(3) 
> > require("data_loading_script.jl") 
> > 
> > Contents of my data_loading_script.jl were akin to: 
> > 
> > using MAT 
> > source_file = matopen(data_filename) 
> > 
> > var1 = read(source_file, "var1"); 
> > var2 = read(source_file, "var2") 
> > . 
> > . 
> > varN = read(source_file, "varN") 
> > 
> > close(source_file) 
> > 
> > Now, to make it work without require() in Julia 0.4.5 I changed 
> > data_loading_script.jl 
> > to: 
> >   @everywhere begin 
> > using MAT 
> > source_file = matopen(data_filename) 
> > 
> > var1 = read(source_file, "var1"); 
> > var2 = read(source_file, "var2") 
> > . 
> > . 
> > varN = read(source_file, "varN") 
> > 
> > close(source_file) 
> >   end 
> > 
> > And when I do a include("data_loading_script.jl"), the data/vars get 
> loaded 
> > on all workers, but the REPL displays: 
> > 
> > WARNING: replacing module MAT 
> > WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype, 
> > HDF5.HD 
> > F5Dataset}, Type{Bool}) in module MAT_HDF5 at 
> > C:\Users\XYZ\.julia\v0.4\MAT\src\MA 
> > T_HDF5.jl:565 overwritten in module MAT_HDF5 at 
> > C:\Users\XYZ\.julia\v0.4\MAT\src\ 
> > MAT_HDF5.jl:565. 
> > WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype, 
> > HDF5.HD 
> > F5Dataset}, Type{Array{Bool, N<:Any}}) in module MAT_HDF5 at 
> > C:\Users\XYZ\.julia\ 
> > v0.4\MAT\src\MAT_HDF5.jl:569 overwritten in module MAT_HDF5 at 
> > C:\Users\XYZ\.juli 
> > a\v0.4\MAT\src\MAT_HDF5.jl:569. 
> > WARNING: replacing module MAT 
> > WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype, 
> > HDF5.HD 
> > F5Dataset}, Type{Bool}) in module MAT_HDF5 at 
> > C:\Users\XYZ\.julia\v0.4\MAT\src\MA 
> > T_HDF5.jl:565 overwritten in module MAT_HDF5 at 
> > C:\Users\XYZ\.julia\v0.4\MAT\src\ 
> > MAT_HDF5.jl:565. 
> > WARNING: Method definition readWARNING: replacing module MAT 
> > (Union{HDF5.HDF5Group, HDF5WARNING: Method definition 
> > read.(HDF5DatatypeUnion, { 
> > HDF5HDF5..HDF5DatasetHDF5Group}, , HDF5Type.{HDF5DatatypeArray, 
> {HDF5Bool., 
> > HDF5 
> > DatasetN<:}Any, }Type}{)Bool in module MAT_HDF5} at 
> > C:\Users\XYZ\.julia\v0.4\MAT\ 
> > src\MAT_HDF5.jl:569) overwritten in module MAT_HDF5 in module MAT_HDF5 
> at 
> > C:\Use 
> > rs\XYZ\.julia\v0.4\MAT\src\MAT_HDF5.jl:569 at 
> > C:\Users\XYZ\.julia\v0.4\MAT\src\MAT 
> > _HDF5.jl:565. 
> >  overwritten in module MAT_HDF5 at 
> > C:\Users\XYZ\.julia\v0.4\MAT\src\MAT_HDF5.jl:5 
> > 65. 
> > WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype, 
> > HDF5.HD 
> > F5Dataset}, Type{Array{Bool, N<:Any}}) in module MAT_HDF5 at 
> > C:\Users\XYZ\.julia\ 
> > v0.4\MAT\src\MAT_HDF5.jl:569 overwritten in module MAT_HDF5 at 
> > C:\Users\XYZ\.juli 
> > a\v0.4\MAT\src\MAT_HDF5.jl:569. 
> > 
> > 
> > What am I doing wrong? 
> > 
> > Thanks. 
>
>

Re: [julia-users] How to load data from a *.mat file on all workers in Julia 0.4.5 without require()?

2016-04-12 Thread Tim Holy

This is covered is multiple previous posts to the mailing list.
https://groups.google.com/forum/#!searchin/julia-users/@everywhere$20using/julia-users/5Xf7duBT6WI/Q8sCr44qBwAJ
https://groups.google.com/d/msg/julia-users/KKscQCby0GM/cOr2Dr3aAAAJ

Best,
--Tim

On Tuesday, April 12, 2016 03:41:48 AM 'Jhan Jar' via julia-users wrote:
> Hi,
> 
> In Julia 0.3.5, the following loaded data on all workers:
> 
> addprocs(3)
> require("data_loading_script.jl")
> 
> Contents of my data_loading_script.jl were akin to:
> 
> using MAT
> source_file = matopen(data_filename)
> 
> var1 = read(source_file, "var1");
> var2 = read(source_file, "var2")
> .
> .
> varN = read(source_file, "varN")
> 
> close(source_file)
> 
> Now, to make it work without require() in Julia 0.4.5 I changed
> data_loading_script.jl
> to:
>   @everywhere begin
> using MAT
> source_file = matopen(data_filename)
> 
> var1 = read(source_file, "var1");
> var2 = read(source_file, "var2")
> .
> .
> varN = read(source_file, "varN")
> 
> close(source_file)
>   end
> 
> And when I do a include("data_loading_script.jl"), the data/vars get loaded
> on all workers, but the REPL displays:
> 
> WARNING: replacing module MAT
> WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype,
> HDF5.HD
> F5Dataset}, Type{Bool}) in module MAT_HDF5 at
> C:\Users\XYZ\.julia\v0.4\MAT\src\MA
> T_HDF5.jl:565 overwritten in module MAT_HDF5 at
> C:\Users\XYZ\.julia\v0.4\MAT\src\
> MAT_HDF5.jl:565.
> WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype,
> HDF5.HD
> F5Dataset}, Type{Array{Bool, N<:Any}}) in module MAT_HDF5 at
> C:\Users\XYZ\.julia\
> v0.4\MAT\src\MAT_HDF5.jl:569 overwritten in module MAT_HDF5 at
> C:\Users\XYZ\.juli
> a\v0.4\MAT\src\MAT_HDF5.jl:569.
> WARNING: replacing module MAT
> WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype,
> HDF5.HD
> F5Dataset}, Type{Bool}) in module MAT_HDF5 at
> C:\Users\XYZ\.julia\v0.4\MAT\src\MA
> T_HDF5.jl:565 overwritten in module MAT_HDF5 at
> C:\Users\XYZ\.julia\v0.4\MAT\src\
> MAT_HDF5.jl:565.
> WARNING: Method definition readWARNING: replacing module MAT
> (Union{HDF5.HDF5Group, HDF5WARNING: Method definition
> read.(HDF5DatatypeUnion, {
> HDF5HDF5..HDF5DatasetHDF5Group}, , HDF5Type.{HDF5DatatypeArray, {HDF5Bool.,
> HDF5
> DatasetN<:}Any, }Type}{)Bool in module MAT_HDF5} at
> C:\Users\XYZ\.julia\v0.4\MAT\
> src\MAT_HDF5.jl:569) overwritten in module MAT_HDF5 in module MAT_HDF5 at
> C:\Use
> rs\XYZ\.julia\v0.4\MAT\src\MAT_HDF5.jl:569 at
> C:\Users\XYZ\.julia\v0.4\MAT\src\MAT
> _HDF5.jl:565.
>  overwritten in module MAT_HDF5 at
> C:\Users\XYZ\.julia\v0.4\MAT\src\MAT_HDF5.jl:5
> 65.
> WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype,
> HDF5.HD
> F5Dataset}, Type{Array{Bool, N<:Any}}) in module MAT_HDF5 at
> C:\Users\XYZ\.julia\
> v0.4\MAT\src\MAT_HDF5.jl:569 overwritten in module MAT_HDF5 at
> C:\Users\XYZ\.juli
> a\v0.4\MAT\src\MAT_HDF5.jl:569.
> 
> 
> What am I doing wrong?
> 
> Thanks.

[julia-users] How to load data from a *.mat file on all workers in Julia 0.4.5 without require()?

2016-04-12 Thread 'Jhan Jar' via julia-users


Hi,

In Julia 0.3.5, the following loaded data on all workers:

addprocs(3)
require("data_loading_script.jl")

Contents of my data_loading_script.jl were akin to:

using MAT
source_file = matopen(data_filename)

var1 = read(source_file, "var1");
var2 = read(source_file, "var2")
.
.
varN = read(source_file, "varN")

close(source_file)

Now, to make it work without require() in Julia 0.4.5 I changed 
data_loading_script.jl 
to:
  @everywhere begin
using MAT
source_file = matopen(data_filename)

var1 = read(source_file, "var1");
var2 = read(source_file, "var2")
.
.
varN = read(source_file, "varN")

close(source_file)
  end

And when I do a include("data_loading_script.jl"), the data/vars get loaded 
on all workers, but the REPL displays:

WARNING: replacing module MAT
WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype, 
HDF5.HD
F5Dataset}, Type{Bool}) in module MAT_HDF5 at 
C:\Users\XYZ\.julia\v0.4\MAT\src\MA
T_HDF5.jl:565 overwritten in module MAT_HDF5 at 
C:\Users\XYZ\.julia\v0.4\MAT\src\
MAT_HDF5.jl:565.
WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype, 
HDF5.HD
F5Dataset}, Type{Array{Bool, N<:Any}}) in module MAT_HDF5 at 
C:\Users\XYZ\.julia\
v0.4\MAT\src\MAT_HDF5.jl:569 overwritten in module MAT_HDF5 at 
C:\Users\XYZ\.juli
a\v0.4\MAT\src\MAT_HDF5.jl:569.
WARNING: replacing module MAT
WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype, 
HDF5.HD
F5Dataset}, Type{Bool}) in module MAT_HDF5 at 
C:\Users\XYZ\.julia\v0.4\MAT\src\MA
T_HDF5.jl:565 overwritten in module MAT_HDF5 at 
C:\Users\XYZ\.julia\v0.4\MAT\src\
MAT_HDF5.jl:565.
WARNING: Method definition readWARNING: replacing module MAT
(Union{HDF5.HDF5Group, HDF5WARNING: Method definition 
read.(HDF5DatatypeUnion, {
HDF5HDF5..HDF5DatasetHDF5Group}, , HDF5Type.{HDF5DatatypeArray, {HDF5Bool., 
HDF5
DatasetN<:}Any, }Type}{)Bool in module MAT_HDF5} at 
C:\Users\XYZ\.julia\v0.4\MAT\
src\MAT_HDF5.jl:569) overwritten in module MAT_HDF5 in module MAT_HDF5 at 
C:\Use
rs\XYZ\.julia\v0.4\MAT\src\MAT_HDF5.jl:569 at 
C:\Users\XYZ\.julia\v0.4\MAT\src\MAT
_HDF5.jl:565.
 overwritten in module MAT_HDF5 at 
C:\Users\XYZ\.julia\v0.4\MAT\src\MAT_HDF5.jl:5
65.
WARNING: Method definition read(Union{HDF5.HDF5Group, HDF5.HDF5Datatype, 
HDF5.HD
F5Dataset}, Type{Array{Bool, N<:Any}}) in module MAT_HDF5 at 
C:\Users\XYZ\.julia\
v0.4\MAT\src\MAT_HDF5.jl:569 overwritten in module MAT_HDF5 at 
C:\Users\XYZ\.juli
a\v0.4\MAT\src\MAT_HDF5.jl:569.


What am I doing wrong?

Thanks.

Re: [julia-users] How to load data from a *.mat file on all workers in Julia 0.4.5 without require()?

Re: [julia-users] How to load data from a *.mat file on all workers in Julia 0.4.5 without require()?

[julia-users] How to load data from a *.mat file on all workers in Julia 0.4.5 without require()?

3 matches

Site Navigation

Mail list logo

Footer information