Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Raghavendra G]

On Mon, Jul 18, 2016 at 4:35 PM, Raghavendra Talur 
wrote:

>
>
> On Mon, Jul 18, 2016 at 4:10 PM, Prasanna Kalever 
> wrote:
>
>> Hey Team,
>>
>>
>> My understanding is that @transport argumet in
>> glfs_set_volfile_server() is meant for specifying transport used in
>> fetching volfile server,
>>
>
> Yes, @transport arg here is transport to use for fetching volfile.
>
>
>> IIRC which currently supports tcp and unix only...
>>
> Yes, this is correct too.
>
>
>>
>> The doc here
>> https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
>> +166 shows the rdma as well, which is something I cannot digest.
>>
> This is doc written with assumption that rdma would work too.
>
>
>>
>>
>> Can someone correct me ?
>>
>> Have we ever supported volfile fetch over rdma ?
>>
>
> I think no. To test, you would have to set rdma as only transport option
> in glusterd.vol and see what happens in volfile fetch.
>
>
> IMO, fetching volfile over rdma is an overkill and would not be required.
> RDMA should be kept only for IO operations.
>

+1. Actually there is no point in having infiniband to fetch volfile as
* RDMA/infiniband is useful for large data transfer
* Even when using RDMA/infiniband, we use a tcp/ip socket for initial
handshake (specifically an IPoIB stack) - RDMA connection manager
(librdmacm). So, a tcp/ip based address or pathway is necessary even while
using RDMA.

So, its a overkill to use RDMA for fetching volfiles.


>
> We should just remove it from the docs.
>
> Thanks,
> Raghavendra Talur
>
>
>>
>> Thanks,
>> --
>> Prasanna
>>
>
>
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
>



-- 
Raghavendra G
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Raghavendra Talur]

On Mon, Jul 18, 2016 at 4:35 PM, Raghavendra Talur 
wrote:

>
>
> On Mon, Jul 18, 2016 at 4:10 PM, Prasanna Kalever 
> wrote:
>
>> Hey Team,
>>
>>
>> My understanding is that @transport argumet in
>> glfs_set_volfile_server() is meant for specifying transport used in
>> fetching volfile server,
>>
>
> Yes, @transport arg here is transport to use for fetching volfile.
>
>
>> IIRC which currently supports tcp and unix only...
>>
> Yes, this is correct too.
>
>
>>
>> The doc here
>> https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
>> +166 shows the rdma as well, which is something I cannot digest.
>>
> This is doc written with assumption that rdma would work too.
>
>
>>
>>
>> Can someone correct me ?
>>
>> Have we ever supported volfile fetch over rdma ?
>>
>
> I think no. To test, you would have to set rdma as only transport option
> in glusterd.vol and see what happens in volfile fetch.
>

Rafi, Prasanna and I looked at the code and verified that volfile is
fetched over tcp in the above case.

Here is the complete scenario
1. option: unix, volfile is fetched over unix.
2. option:tcp, volfile is fetched over socket.
3. option:rdma, volfile is fetched over socket with no warning about no
support for rdma.

This gives an illusion to user that volfile is also fetched over rdma,
whereas we used tcp connection for it. I would recommend deprecating the
volfile-server-transport option's overloaded usecase of deciding IO
transport in 3.9 version of Gluster and having a different option name for
it.

Thanks,
Raghavendra Talur


>
>
> IMO, fetching volfile over rdma is an overkill and would not be required.
> RDMA should be kept only for IO operations.
>
> We should just remove it from the docs.
>
> Thanks,
> Raghavendra Talur
>
>
>>
>> Thanks,
>> --
>> Prasanna
>>
>
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Prasanna Kalever]

On Mon, Jul 18, 2016 at 4:31 PM, Raghavendra Gowdappa
<rgowd...@redhat.com> wrote:
>
>
> - Original Message -
>> From: "Prasanna Kalever" <pkale...@redhat.com>
>> To: "gluster-devel" <gluster-devel@gluster.org>
>> Cc: "Kaushal Madappa" <kmada...@redhat.com>
>> Sent: Monday, July 18, 2016 4:10:24 PM
>> Subject: [Gluster-devel] What tranpsort type in glfs_set_volfile_server()
>>  exactly mean ?
>>
>> Hey Team,
>>
>>
>> My understanding is that @transport argumet in
>> glfs_set_volfile_server() is meant for specifying transport used in
>> fetching volfile server,
>> IIRC which currently supports tcp and unix only...
>
> Yes, its hard-coded to use only "socket" transport. See [1]. However if 
> required its not difficult to add rdma option. However, infiniband need not 
> be present on all nodes.
>
> [1] 
> https://github.com/gluster/glusterfs/blob/master/glusterfsd/src/glusterfsd-mgmt.c#L2132
>

Thanks for the info Raghavendra,

According to me, even addition of rdma transport for fetching a
volfile server is zero and perhaps not needed at all. :)

--
Prasanna

>>
>> The doc here https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
>> +166 shows the rdma as well, which is something I cannot digest.
>>
>>
>> Can someone correct me ?
>>
>> Have we ever supported volfile fetch over rdma ?
>>
>>
>> Thanks,
>> --
>> Prasanna
>> ___
>> Gluster-devel mailing list
>> Gluster-devel@gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-devel
>>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Raghavendra Talur]

On Mon, Jul 18, 2016 at 4:10 PM, Prasanna Kalever 
wrote:

> Hey Team,
>
>
> My understanding is that @transport argumet in
> glfs_set_volfile_server() is meant for specifying transport used in
> fetching volfile server,
>

Yes, @transport arg here is transport to use for fetching volfile.


> IIRC which currently supports tcp and unix only...
>
Yes, this is correct too.


>
> The doc here
> https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
> +166 shows the rdma as well, which is something I cannot digest.
>
This is doc written with assumption that rdma would work too.


>
>
> Can someone correct me ?
>
> Have we ever supported volfile fetch over rdma ?
>

I think no. To test, you would have to set rdma as only transport option in
glusterd.vol and see what happens in volfile fetch.


IMO, fetching volfile over rdma is an overkill and would not be required.
RDMA should be kept only for IO operations.

We should just remove it from the docs.

Thanks,
Raghavendra Talur


>
> Thanks,
> --
> Prasanna
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Raghavendra Gowdappa]

- Original Message -
> From: "Prasanna Kalever" <pkale...@redhat.com>
> To: "gluster-devel" <gluster-devel@gluster.org>
> Cc: "Kaushal Madappa" <kmada...@redhat.com>
> Sent: Monday, July 18, 2016 4:10:24 PM
> Subject: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() 
> exactly mean ?
> 
> Hey Team,
> 
> 
> My understanding is that @transport argumet in
> glfs_set_volfile_server() is meant for specifying transport used in
> fetching volfile server,
> IIRC which currently supports tcp and unix only...

Yes, its hard-coded to use only "socket" transport. See [1]. However if 
required its not difficult to add rdma option. However, infiniband need not be 
present on all nodes.

[1] 
https://github.com/gluster/glusterfs/blob/master/glusterfsd/src/glusterfsd-mgmt.c#L2132

> 
> The doc here https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
> +166 shows the rdma as well, which is something I cannot digest.
> 
> 
> Can someone correct me ?
> 
> Have we ever supported volfile fetch over rdma ?
> 
> 
> Thanks,
> --
> Prasanna
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
> 
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Kaushal M]

On Mon, Jul 18, 2016 at 4:10 PM, Prasanna Kalever  wrote:
> Hey Team,
>
>
> My understanding is that @transport argumet in
> glfs_set_volfile_server() is meant for specifying transport used in
> fetching volfile server,
> IIRC which currently supports tcp and unix only...
>
> The doc here https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
> +166 shows the rdma as well, which is something I cannot digest.
>
>
> Can someone correct me ?
>
> Have we ever supported volfile fetch over rdma ?

That used to be the case. But there were  rdma related fixes done last
year that changed this behaviour.
Rafi and Raghavendra should be able to give you more information.

>
>
> Thanks,
> --
> Prasanna
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

[Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Prasanna Kalever]

Hey Team,


My understanding is that @transport argumet in
glfs_set_volfile_server() is meant for specifying transport used in
fetching volfile server,
IIRC which currently supports tcp and unix only...

The doc here https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
+166 shows the rdma as well, which is something I cannot digest.


Can someone correct me ?

Have we ever supported volfile fetch over rdma ?


Thanks,
--
Prasanna
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel