Re: [Gluster-devel] Adding one variable to inode structure

2017-06-04 Thread Pranith Kumar Karampuri
Oh you want applications to do getfattr to find that it is there?

I think I understood what you are looking for now. So basically
applications will keep doing creation of some files/directories, whenever a
video file is created you want the bricks to set an extended attribute on
the directory, so that the application can use it. I don't think this
doesn't look like the job of index xlator either.

Why do you not want to set the extended attribute from client and want the
fs to do it on-behalf of the application? Setting it from client has
benefits like even when one brick is down it will automatically heal this
extended attribute etc.

On Mon, Jun 5, 2017 at 12:10 PM, Tahereh Fattahi 
wrote:

> I want in in mount directory in client side
>
> On Mon, Jun 5, 2017 at 11:07 AM, Pranith Kumar Karampuri <
> pkara...@redhat.com> wrote:
>
>>
>>
>> On Mon, Jun 5, 2017 at 11:24 AM, Tahereh Fattahi 
>> wrote:
>>
>>> Thank you
>>> I see that this xlator is loaded in server side.
>>> How can I access to variable in index xlator in client side?
>>> is it correct? getfattr trusted.index.myvar
>>>
>>
>> To which xlator do you want this information? Or do you want this on
>> mount?
>>
>>
>>>
>>> On Mon, Jun 5, 2017 at 10:00 AM, Pranith Kumar Karampuri <
>>> pkara...@redhat.com> wrote:
>>>


 On Mon, Jun 5, 2017 at 9:55 AM, Tahereh Fattahi 
 wrote:

> Assume that one client wants to search it's directories for video
> files.
>  I want use something that helps this client to search just
> directories that have this kind of file.
> like a extended attribute, but I want this attribute be set by server
> not by client.
> I dont know which xlator is suitable for this work.
>

 The xlator that comes close to it is:  index xlator
 xlators/features/index/src

 You may have to track extra operations like
 create/mknod/link/rename/unlink to make sure you get the functionality
 you want. Basically this xlator helps you in indexing a behavior. We use
 this for indexing directories/files that need heal etc.


>
> On Mon, Jun 5, 2017 at 7:13 AM, Pranith Kumar Karampuri <
> pkara...@redhat.com> wrote:
>
>> This sounds hacky. In general anything that is specific about an
>> inode, we try to store it in inode-ctx. Who uses this information about
>> presence of video-file and how? May be with that knowledge there could 
>> be a
>> possibility we can improve the solution. Do let us know the complete
>> problem you are trying to solve.
>>
>> On Mon, Jun 5, 2017 at 4:53 AM, Tahereh Fattahi <
>> t28.fatt...@gmail.com> wrote:
>>
>>> Hi
>>> I want to add one boolean field to inode structure for a directory.
>>>  when it is 1 it means that directory has one or more video file.
>>> when it is 0 it means that there is no video file in that directory.
>>> I can add this variable to inode structure and update it in server
>>> side, in posix_create function (when there is a create request for a 
>>> video
>>> file).
>>> question is about client knowledge about this variable. is it
>>> possible that client can see the amount of this variable of different
>>> servers (bricks) and OR them to one variable in cient's inode of the
>>> directory? in which xlator I should try in client side?
>>>
>>> ___
>>> Gluster-devel mailing list
>>> Gluster-devel@gluster.org
>>> http://lists.gluster.org/mailman/listinfo/gluster-devel
>>>
>>
>>
>>
>> --
>> Pranith
>>
>
>


 --
 Pranith

>>>
>>>
>>
>>
>> --
>> Pranith
>>
>
>


-- 
Pranith
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Adding one variable to inode structure

2017-06-04 Thread Tahereh Fattahi
I want in in mount directory in client side

On Mon, Jun 5, 2017 at 11:07 AM, Pranith Kumar Karampuri <
pkara...@redhat.com> wrote:

>
>
> On Mon, Jun 5, 2017 at 11:24 AM, Tahereh Fattahi 
> wrote:
>
>> Thank you
>> I see that this xlator is loaded in server side.
>> How can I access to variable in index xlator in client side?
>> is it correct? getfattr trusted.index.myvar
>>
>
> To which xlator do you want this information? Or do you want this on mount?
>
>
>>
>> On Mon, Jun 5, 2017 at 10:00 AM, Pranith Kumar Karampuri <
>> pkara...@redhat.com> wrote:
>>
>>>
>>>
>>> On Mon, Jun 5, 2017 at 9:55 AM, Tahereh Fattahi 
>>> wrote:
>>>
 Assume that one client wants to search it's directories for video files.
  I want use something that helps this client to search just directories
 that have this kind of file.
 like a extended attribute, but I want this attribute be set by server
 not by client.
 I dont know which xlator is suitable for this work.

>>>
>>> The xlator that comes close to it is:  index xlator
>>> xlators/features/index/src
>>>
>>> You may have to track extra operations like
>>> create/mknod/link/rename/unlink to make sure you get the functionality
>>> you want. Basically this xlator helps you in indexing a behavior. We use
>>> this for indexing directories/files that need heal etc.
>>>
>>>

 On Mon, Jun 5, 2017 at 7:13 AM, Pranith Kumar Karampuri <
 pkara...@redhat.com> wrote:

> This sounds hacky. In general anything that is specific about an
> inode, we try to store it in inode-ctx. Who uses this information about
> presence of video-file and how? May be with that knowledge there could be 
> a
> possibility we can improve the solution. Do let us know the complete
> problem you are trying to solve.
>
> On Mon, Jun 5, 2017 at 4:53 AM, Tahereh Fattahi  > wrote:
>
>> Hi
>> I want to add one boolean field to inode structure for a directory.
>>  when it is 1 it means that directory has one or more video file.
>> when it is 0 it means that there is no video file in that directory.
>> I can add this variable to inode structure and update it in server
>> side, in posix_create function (when there is a create request for a 
>> video
>> file).
>> question is about client knowledge about this variable. is it
>> possible that client can see the amount of this variable of different
>> servers (bricks) and OR them to one variable in cient's inode of the
>> directory? in which xlator I should try in client side?
>>
>> ___
>> Gluster-devel mailing list
>> Gluster-devel@gluster.org
>> http://lists.gluster.org/mailman/listinfo/gluster-devel
>>
>
>
>
> --
> Pranith
>


>>>
>>>
>>> --
>>> Pranith
>>>
>>
>>
>
>
> --
> Pranith
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Adding one variable to inode structure

2017-06-04 Thread Pranith Kumar Karampuri
On Mon, Jun 5, 2017 at 11:24 AM, Tahereh Fattahi 
wrote:

> Thank you
> I see that this xlator is loaded in server side.
> How can I access to variable in index xlator in client side?
> is it correct? getfattr trusted.index.myvar
>

To which xlator do you want this information? Or do you want this on mount?


>
> On Mon, Jun 5, 2017 at 10:00 AM, Pranith Kumar Karampuri <
> pkara...@redhat.com> wrote:
>
>>
>>
>> On Mon, Jun 5, 2017 at 9:55 AM, Tahereh Fattahi 
>> wrote:
>>
>>> Assume that one client wants to search it's directories for video files.
>>>  I want use something that helps this client to search just directories
>>> that have this kind of file.
>>> like a extended attribute, but I want this attribute be set by server
>>> not by client.
>>> I dont know which xlator is suitable for this work.
>>>
>>
>> The xlator that comes close to it is:  index xlator
>> xlators/features/index/src
>>
>> You may have to track extra operations like create/mknod/link/rename/unlink
>> to make sure you get the functionality you want. Basically this xlator
>> helps you in indexing a behavior. We use this for indexing
>> directories/files that need heal etc.
>>
>>
>>>
>>> On Mon, Jun 5, 2017 at 7:13 AM, Pranith Kumar Karampuri <
>>> pkara...@redhat.com> wrote:
>>>
 This sounds hacky. In general anything that is specific about an inode,
 we try to store it in inode-ctx. Who uses this information about presence
 of video-file and how? May be with that knowledge there could be a
 possibility we can improve the solution. Do let us know the complete
 problem you are trying to solve.

 On Mon, Jun 5, 2017 at 4:53 AM, Tahereh Fattahi 
 wrote:

> Hi
> I want to add one boolean field to inode structure for a directory.
>  when it is 1 it means that directory has one or more video file. when
> it is 0 it means that there is no video file in that directory.
> I can add this variable to inode structure and update it in server
> side, in posix_create function (when there is a create request for a video
> file).
> question is about client knowledge about this variable. is it possible
> that client can see the amount of this variable of different servers
> (bricks) and OR them to one variable in cient's inode of the directory? in
> which xlator I should try in client side?
>
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-devel
>



 --
 Pranith

>>>
>>>
>>
>>
>> --
>> Pranith
>>
>
>


-- 
Pranith
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

2017-06-04 Thread Pranith Kumar Karampuri
What is your usecase if I may ask?

On Mon, Jun 5, 2017 at 11:08 AM, Xie Changlong 
wrote:

> 在 6/5/2017 1:22 PM, Pranith Kumar Karampuri 写道:
>
>> On Mon, Jun 5, 2017 at 8:29 AM, Xie Changlong 
>> wrote:
>>
>> 在 6/5/2017 10:50 AM, Pranith Kumar Karampuri 写道:
>>>
>>> I think there have been improvements here to use special instructions to


>>> if "special instructions" means profile command or more? Also can you
>>> point which commit?
>>>
>>>
>> I meant Intel CPU extentions
>> You should look at
>> http://review.gluster.org/12209
>> http://review.gluster.org/12210
>> https://review.gluster.org/16963
>> https://review.gluster.org/17009
>>
>
> Useful enough for me, thanks for your patience.
>
>
>>
>> do the increments instead of taking spin-locks and doing increments. So
>>>
 may be it doesn't affect performance as much anymore. I think if you
 don't
 see a difference, then the enhancements are doing a good job :-).

 Which version of gluster are you using?


>>> Our version is gluster 3.8.4
>>>
>>> --
>>> Thanks
>>>  -Xie
>>>
>>>
>>
>>
>>
> --
> Thanks
> -Xie
>



-- 
Pranith
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Adding one variable to inode structure

2017-06-04 Thread Tahereh Fattahi
Thank you
I see that this xlator is loaded in server side.
How can I access to variable in index xlator in client side?
is it correct? getfattr trusted.index.myvar

On Mon, Jun 5, 2017 at 10:00 AM, Pranith Kumar Karampuri <
pkara...@redhat.com> wrote:

>
>
> On Mon, Jun 5, 2017 at 9:55 AM, Tahereh Fattahi 
> wrote:
>
>> Assume that one client wants to search it's directories for video files.
>>  I want use something that helps this client to search just directories
>> that have this kind of file.
>> like a extended attribute, but I want this attribute be set by server not
>> by client.
>> I dont know which xlator is suitable for this work.
>>
>
> The xlator that comes close to it is:  index xlator
> xlators/features/index/src
>
> You may have to track extra operations like create/mknod/link/rename/unlink
> to make sure you get the functionality you want. Basically this xlator
> helps you in indexing a behavior. We use this for indexing
> directories/files that need heal etc.
>
>
>>
>> On Mon, Jun 5, 2017 at 7:13 AM, Pranith Kumar Karampuri <
>> pkara...@redhat.com> wrote:
>>
>>> This sounds hacky. In general anything that is specific about an inode,
>>> we try to store it in inode-ctx. Who uses this information about presence
>>> of video-file and how? May be with that knowledge there could be a
>>> possibility we can improve the solution. Do let us know the complete
>>> problem you are trying to solve.
>>>
>>> On Mon, Jun 5, 2017 at 4:53 AM, Tahereh Fattahi 
>>> wrote:
>>>
 Hi
 I want to add one boolean field to inode structure for a directory.
  when it is 1 it means that directory has one or more video file. when
 it is 0 it means that there is no video file in that directory.
 I can add this variable to inode structure and update it in server
 side, in posix_create function (when there is a create request for a video
 file).
 question is about client knowledge about this variable. is it possible
 that client can see the amount of this variable of different servers
 (bricks) and OR them to one variable in cient's inode of the directory? in
 which xlator I should try in client side?

 ___
 Gluster-devel mailing list
 Gluster-devel@gluster.org
 http://lists.gluster.org/mailman/listinfo/gluster-devel

>>>
>>>
>>>
>>> --
>>> Pranith
>>>
>>
>>
>
>
> --
> Pranith
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

2017-06-04 Thread Xie Changlong

在 6/5/2017 1:22 PM, Pranith Kumar Karampuri 写道:

On Mon, Jun 5, 2017 at 8:29 AM, Xie Changlong 
wrote:


在 6/5/2017 10:50 AM, Pranith Kumar Karampuri 写道:


I think there have been improvements here to use special instructions to



if "special instructions" means profile command or more? Also can you
point which commit?



I meant Intel CPU extentions
You should look at
http://review.gluster.org/12209
http://review.gluster.org/12210
https://review.gluster.org/16963
https://review.gluster.org/17009


Useful enough for me, thanks for your patience.





do the increments instead of taking spin-locks and doing increments. So

may be it doesn't affect performance as much anymore. I think if you don't
see a difference, then the enhancements are doing a good job :-).

Which version of gluster are you using?



Our version is gluster 3.8.4

--
Thanks
 -Xie







--
Thanks
-Xie
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Adding one variable to inode structure

2017-06-04 Thread Pranith Kumar Karampuri
On Mon, Jun 5, 2017 at 9:55 AM, Tahereh Fattahi 
wrote:

> Assume that one client wants to search it's directories for video files.
>  I want use something that helps this client to search just directories
> that have this kind of file.
> like a extended attribute, but I want this attribute be set by server not
> by client.
> I dont know which xlator is suitable for this work.
>

The xlator that comes close to it is:  index xlator
xlators/features/index/src

You may have to track extra operations like create/mknod/link/rename/unlink
to make sure you get the functionality you want. Basically this xlator
helps you in indexing a behavior. We use this for indexing
directories/files that need heal etc.


>
> On Mon, Jun 5, 2017 at 7:13 AM, Pranith Kumar Karampuri <
> pkara...@redhat.com> wrote:
>
>> This sounds hacky. In general anything that is specific about an inode,
>> we try to store it in inode-ctx. Who uses this information about presence
>> of video-file and how? May be with that knowledge there could be a
>> possibility we can improve the solution. Do let us know the complete
>> problem you are trying to solve.
>>
>> On Mon, Jun 5, 2017 at 4:53 AM, Tahereh Fattahi 
>> wrote:
>>
>>> Hi
>>> I want to add one boolean field to inode structure for a directory.
>>>  when it is 1 it means that directory has one or more video file. when
>>> it is 0 it means that there is no video file in that directory.
>>> I can add this variable to inode structure and update it in server side,
>>> in posix_create function (when there is a create request for a video file).
>>> question is about client knowledge about this variable. is it possible
>>> that client can see the amount of this variable of different servers
>>> (bricks) and OR them to one variable in cient's inode of the directory? in
>>> which xlator I should try in client side?
>>>
>>> ___
>>> Gluster-devel mailing list
>>> Gluster-devel@gluster.org
>>> http://lists.gluster.org/mailman/listinfo/gluster-devel
>>>
>>
>>
>>
>> --
>> Pranith
>>
>
>


-- 
Pranith
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

2017-06-04 Thread Pranith Kumar Karampuri
On Mon, Jun 5, 2017 at 8:29 AM, Xie Changlong 
wrote:

> 在 6/5/2017 10:50 AM, Pranith Kumar Karampuri 写道:
>
>> I think there have been improvements here to use special instructions to
>>
>
> if "special instructions" means profile command or more? Also can you
> point which commit?
>

I meant Intel CPU extentions
You should look at
http://review.gluster.org/12209
http://review.gluster.org/12210
https://review.gluster.org/16963
https://review.gluster.org/17009


> do the increments instead of taking spin-locks and doing increments. So
>> may be it doesn't affect performance as much anymore. I think if you don't
>> see a difference, then the enhancements are doing a good job :-).
>>
>> Which version of gluster are you using?
>>
>
> Our version is gluster 3.8.4
>
> --
> Thanks
> -Xie
>



-- 
Pranith
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Adding one variable to inode structure

2017-06-04 Thread Tahereh Fattahi
Assume that one client wants to search it's directories for video files.
 I want use something that helps this client to search just directories
that have this kind of file.
like a extended attribute, but I want this attribute be set by server not
by client.
I dont know which xlator is suitable for this work.

On Mon, Jun 5, 2017 at 7:13 AM, Pranith Kumar Karampuri  wrote:

> This sounds hacky. In general anything that is specific about an inode, we
> try to store it in inode-ctx. Who uses this information about presence of
> video-file and how? May be with that knowledge there could be a possibility
> we can improve the solution. Do let us know the complete problem you are
> trying to solve.
>
> On Mon, Jun 5, 2017 at 4:53 AM, Tahereh Fattahi 
> wrote:
>
>> Hi
>> I want to add one boolean field to inode structure for a directory.
>>  when it is 1 it means that directory has one or more video file. when it
>> is 0 it means that there is no video file in that directory.
>> I can add this variable to inode structure and update it in server side,
>> in posix_create function (when there is a create request for a video file).
>> question is about client knowledge about this variable. is it possible
>> that client can see the amount of this variable of different servers
>> (bricks) and OR them to one variable in cient's inode of the directory? in
>> which xlator I should try in client side?
>>
>> ___
>> Gluster-devel mailing list
>> Gluster-devel@gluster.org
>> http://lists.gluster.org/mailman/listinfo/gluster-devel
>>
>
>
>
> --
> Pranith
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

2017-06-04 Thread Xie Changlong

在 6/5/2017 10:50 AM, Pranith Kumar Karampuri 写道:
I think there have been improvements here to use special instructions to 


if "special instructions" means profile command or more? Also can you 
point which commit?


do the increments instead of taking spin-locks and doing increments. So 
may be it doesn't affect performance as much anymore. I think if you 
don't see a difference, then the enhancements are doing a good job :-).


Which version of gluster are you using?


Our version is gluster 3.8.4

--
Thanks
-Xie
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?

2017-06-04 Thread Pranith Kumar Karampuri
I think there have been improvements here to use special instructions to do
the increments instead of taking spin-locks and doing increments. So may be
it doesn't affect performance as much anymore. I think if you don't see a
difference, then the enhancements are doing a good job :-).

Which version of gluster are you using?

On Mon, Jun 5, 2017 at 8:09 AM, Xie Changlong 
wrote:

> Hi all
>
> It's said[1] that profile based on io-stats, if you enable this feature,
> it can affect system performance while the profile information is being
> collected.
>
> I do some tests on my two linux+vmware virtual machine with replica(lack
> of resources ). And the results shows no diffrence to me, following is the
> test case
> #dd if=/dev/zero  of=test bs=4k count=524288
> #fio --filename=test -iodepth=64 -ioengine=libaio --direct=1 --rw=read
> --bs=1m --size=2g --numjobs=4 --runtime=10 --group_reporting
> --name=test-read
> #fio -filename=test -iodepth=64 -ioengine=libaio -direct=1 -rw=write
> -bs=1m -size=2g -numjobs=4 -runtime=20 -group_reporting -name=test-write
> #fio -filename=test -iodepth=64 -ioengine=libaio -direct=1 -rw=randread
> -bs=4k -size=2G -numjobs=64 -runtime=20 -group_reporting
> -name=test-rand-read
> #fio -filename=test -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite
> -bs=4k -size=2G -numjobs=64 -runtime=20 -group_reporting
> -name=test-rand-write
> It's said that fio is only for lagre files, also i suspect that the test
> infrastructure is too small. The question is that, if you guys have
> detailed data for how profile affect performance?
>
> More, we wanna gain the detail r/w iops/bandwidth data for each brick. It
> seems that only profile can provide relatived data to be calculated?if i'm
> wrong pls corrent me.
>
> If profile really affect peformance so much, would you mind a new command
> such as "gluster volume io [nfs]" to acquire brick r/w fops/data? Or just
> help us review it?
>
> [1] https://access.redhat.com/documentation/en-us/red_hat_gluste
> r_storage/3.2/html/administration_guide/chap-monitoring_red_
> hat_storage_workload#sect-Running_the_Volume_Profile_Command
> --
> Thanks
> -Xie
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-devel
>



-- 
Pranith
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Adding one variable to inode structure

2017-06-04 Thread Pranith Kumar Karampuri
This sounds hacky. In general anything that is specific about an inode, we
try to store it in inode-ctx. Who uses this information about presence of
video-file and how? May be with that knowledge there could be a possibility
we can improve the solution. Do let us know the complete problem you are
trying to solve.

On Mon, Jun 5, 2017 at 4:53 AM, Tahereh Fattahi 
wrote:

> Hi
> I want to add one boolean field to inode structure for a directory.
>  when it is 1 it means that directory has one or more video file. when it
> is 0 it means that there is no video file in that directory.
> I can add this variable to inode structure and update it in server side,
> in posix_create function (when there is a create request for a video file).
> question is about client knowledge about this variable. is it possible
> that client can see the amount of this variable of different servers
> (bricks) and OR them to one variable in cient's inode of the directory? in
> which xlator I should try in client side?
>
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-devel
>



-- 
Pranith
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

[Gluster-devel] [Qusetions] How profile affect glusterfs performance?

2017-06-04 Thread Xie Changlong

Hi all

It's said[1] that profile based on io-stats, if you enable this feature, 
it can affect system performance while the profile information is being 
collected.


I do some tests on my two linux+vmware virtual machine with replica(lack 
of resources ). And the results shows no diffrence to me, following is 
the test case

#dd if=/dev/zero  of=test bs=4k count=524288
#fio --filename=test -iodepth=64 -ioengine=libaio --direct=1 --rw=read 
--bs=1m --size=2g --numjobs=4 --runtime=10 --group_reporting 
--name=test-read
#fio -filename=test -iodepth=64 -ioengine=libaio -direct=1 -rw=write 
-bs=1m -size=2g -numjobs=4 -runtime=20 -group_reporting -name=test-write
#fio -filename=test -iodepth=64 -ioengine=libaio -direct=1 -rw=randread 
-bs=4k -size=2G -numjobs=64 -runtime=20 -group_reporting 
-name=test-rand-read
#fio -filename=test -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite 
-bs=4k -size=2G -numjobs=64 -runtime=20 -group_reporting 
-name=test-rand-write
It's said that fio is only for lagre files, also i suspect that the test 
infrastructure is too small. The question is that, if you guys have 
detailed data for how profile affect performance?


More, we wanna gain the detail r/w iops/bandwidth data for each brick. 
It seems that only profile can provide relatived data to be 
calculated?if i'm wrong pls corrent me.


If profile really affect peformance so much, would you mind a new 
command such as "gluster volume io [nfs]" to acquire brick r/w 
fops/data? Or just help us review it?


[1] 
https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.2/html/administration_guide/chap-monitoring_red_hat_storage_workload#sect-Running_the_Volume_Profile_Command

--
Thanks
-Xie
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] [Qusetions] How profile influnce glusterfs performance?

2017-06-04 Thread Xie Changlong

Hi all

It's said[1] that profile based on io-stats, if you enable this feature, 
it can affect system performance while the profile information is being 
collected.
I do some tests on my two linux+vmware virtual machine with replica(lack 
of resources :( ). And the results shows no diffrence to me, following 
is the test case

#dd if=/dev/zero  of=test bs=4k count=524288
#fio --filename=test -iodepth=64 -ioengine=libaio --direct=1 --rw=read 
--bs=1m --size=2g --numjobs=4 --runtime=10 --group_reporting 
--name=test-read
#fio -filename=test -iodepth=64 -ioengine=libaio -direct=1 -rw=write 
-bs=1m -size=2g -numjobs=4 -runtime=20 -group_reporting -name=test-write
#fio -filename=test -iodepth=64 -ioengine=libaio -direct=1 -rw=randread 
-bs=4k -size=2G -numjobs=64 -runtime=20 -group_reporting 
-name=test-rand-read
#fio -filename=test -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite 
-bs=4k -size=2G -numjobs=64 -runtime=20 -group_reporting 
-name=test-rand-write
It's said that fio is only for lagre files, also i suspect that the test 
infrastructure is too small. The question is that, if you guys have 
detailed data for how profile affect performance?
More, we wanna gain the detail r/w iops/bandwidth data for each brick. 
It seems that only profile can provide relatived data to be calculated?

if i'm wrong pls corrent me.
If profile really affect peformance so much, would you mind a new 
command such as "gluster volume io [nfs]" to acquire brick r/w 
fops/data? Or just help us review it?


	[1] 
https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.2/html/administration_guide/chap-monitoring_red_hat_storage_workload#sect-Running_the_Volume_Profile_Command


--
Thanks
-Xie
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel


[Gluster-devel] Weekly Untriaged Bugs

2017-06-04 Thread jenkins
[...truncated 6 lines...]
https://bugzilla.redhat.com/1458582 / cli: add all as volume option in gluster 
volume get usage
https://bugzilla.redhat.com/1457724 / common-ha: IPv6 in ganesha-ha.conf 
doesn't work
https://bugzilla.redhat.com/1455912 / core: [Brick Multiplexing] heal info 
shows the status of the bricks as  "Transport endpoint is not connected" though 
bricks are up
https://bugzilla.redhat.com/1450567 / core: brick process cannot be started at 
the first time
https://bugzilla.redhat.com/1449416 / core: errno used incorrectly or 
misleadingly in error messages
https://bugzilla.redhat.com/1457558 / core: GlusterFS 3.10.4 tracker
https://bugzilla.redhat.com/1452766 / core: VM crashing but there's no apparent 
reason
https://bugzilla.redhat.com/1454701 / distribute: DHT: Pass errno as an 
argument to gf_msg
https://bugzilla.redhat.com/1457339 / distribute: DHT: slow readdirp performance
https://bugzilla.redhat.com/1457340 / distribute: DHT: slow readdirp performance
https://bugzilla.redhat.com/1457341 / distribute: DHT: slow readdirp performance
https://bugzilla.redhat.com/1450685 / doc: Document options to configure 
geo-replication for lower latency
https://bugzilla.redhat.com/1452865 / fuse: fuse mount dies.
https://bugzilla.redhat.com/1450684 / geo-replication: Geo-replication delay 
cannot be configured to less than 3 seconds
https://bugzilla.redhat.com/1457976 / geo-replication: Georeplication status 
goes faulty after reboot 1 source node
https://bugzilla.redhat.com/1457272 / geo-replication: Old content on last node 
when using Cascade Geo Replication in a particular case
https://bugzilla.redhat.com/1451937 / glusterd: Cannot probe nodes on ubuntu 
16.04 and not on centos 7.3
https://bugzilla.redhat.com/1455831 / glusterd: libglusterfs: updates old 
comment for 'arena_size'
https://bugzilla.redhat.com/1458539 / gluster-smb: [Negative Lookup]: negative 
lookup features doesn't seem to work on restart of volume
https://bugzilla.redhat.com/1457058 / io-cache: glusterfs client crash on 
io-cache.so(__ioc_page_wakeup+0x44)
https://bugzilla.redhat.com/1452961 / posix: [PATCH] incorrect xattr list 
handling on FreeBSD
https://bugzilla.redhat.com/1457827 / project-infrastructure: Changes to the 
voting system on glusterfs 'master' branch
https://bugzilla.redhat.com/1457824 / project-infrastructure: New branch for 
'glusterfs' project called 'experimental'
https://bugzilla.redhat.com/1449313 / read-ahead: 
[whql][virtio-block+glusterfs]"Disk Stress" and "Disk Verification" job always 
failed on win7-32/win2012/win2k8R2 guest
https://bugzilla.redhat.com/1457732 / replicate: "split-brain observed 
[Input/output error]" error messages in samba logs during parallel rm -rf
https://bugzilla.redhat.com/1457289 / tiering: tierd listens to a port.
[...truncated 2 lines...]

build.log
Description: Binary data
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

[Gluster-devel] Adding one variable to inode structure

2017-06-04 Thread Tahereh Fattahi
Hi
I want to add one boolean field to inode structure for a directory.
 when it is 1 it means that directory has one or more video file. when it
is 0 it means that there is no video file in that directory.
I can add this variable to inode structure and update it in server side, in
posix_create function (when there is a create request for a video file).
question is about client knowledge about this variable. is it possible that
client can see the amount of this variable of different servers (bricks)
and OR them to one variable in cient's inode of the directory? in which
xlator I should try in client side?
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Regression with brick multiplex turned on failing or aborted

2017-06-04 Thread Atin Mukherjee
On Sat, May 27, 2017 at 2:57 PM, Atin Mukherjee  wrote:

>
> On Sat, 27 May 2017 at 09:55, Nigel Babu  wrote:
>
>> FYI: There are now emails to gluster-maintainers@ about this. If you'd
>> like to help diagnose/fix the problems, please see the job and logs here:
>> https://build.gluster.org/job/regression-test-with-multiplex/
>>
>
> Thank you Nigel for taking this up. It definitely helps to track if any of
> the recent changes has caused regression in brick mux feature. I've been
> following the reports (and so as Jeff I believe). Currently there are two
> failures which every run will report.
>
> ./tests/bugs/glusterd/bug-1406411-fail-add-brick-on-replica-count-change.t
>
> ./tests/features/trash.t
>
>
> Both the failures are RCAed and expect these failures to be fixed in few days 
> time. Nigel did brought to my notice about one of the run where it was 
> waiting on some LVM setup too long and then the run was aborted, but I'm 
> notsure if brick mux has anything to do with it. Any other aborted runs Nigel?
>
>

Though the above two test failures are now been addressed, the result of
the overall runs do not look promising. Too many failures and aborted runs
@ https://build.gluster.org/job/regression-test-with-multiplex/ . I'll be
checking the failures in detail and get back with further updates.


>
>
>> --
>> nigelb
>> ___
>> Gluster-devel mailing list
>> Gluster-devel@gluster.org
>> http://lists.gluster.org/mailman/listinfo/gluster-devel
>
> --
> - Atin (atinm)
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel