should
be easy to port functrace to support infernalis , right?
Regards,
James
-Original Message-
From: Blinick, Stephen L [mailto:stephen.l.blin...@intel.com]
Sent: Wednesday, December 16, 2015 4:01 PM
To: James (Fei) Liu-SSI
Subject: RE: Configuration of your benchmark for the p
Hi Haomai,
Code was reviewed and fixes was verified in my bench. Thanks for your quick
turnaround.
Regards,
James
-Original Message-
From: Haomai Wang [mailto:haomaiw...@gmail.com]
Sent: Wednesday, December 02, 2015 9:49 PM
To: James (Fei) Liu-SSI
Cc: ceph-devel
Subject: Re
Hi Somnath,
Great findings. As you mentioned, unique_ptr and smart_ptr always have a well
known problem about the performance comparing to conventional pointer , Got a
chance to run your interesting code and close to what you find.
But I did not find any place in filestore/newstore (keyvaluesto
Hi Haomai,
I happened to run ceph_objectstore_bench against key value store on master
branch. It always crashed at finisher_thread_entry : assert(!ls_rval.empty());
It looks like the completion not only has null entry in the finisher queue ,
but also has none entry in the finisher_queue_r
Hi Mark,
Have been busy this morning and missed the meeting today. Would be possible
to upload the recording video to the site at your most convenient time?
Thanks,
James
-Original Message-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf
Hi Sage and other fellow cephers,
I truly share the pains with you all about filesystem while I am working on
objectstore to improve the performance. As mentioned , there is nothing wrong
with filesystem. Just the Ceph as one of use case need more supports but not
provided in near future by
approach .
Regards,
James
-Original Message-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of James (Fei) Liu-SSI
Sent: Tuesday, October 20, 2015 1:33 PM
To: Sage Weil
Cc: Somnath Roy; ceph-devel@vger.kernel.org
Subject: RE: newstore
-Vault2015.pdf
Regards,
James
-Original Message-
From: Sage Weil [mailto:sw...@redhat.com]
Sent: Tuesday, October 20, 2015 5:34 AM
To: James (Fei) Liu-SSI
Cc: Somnath Roy; ceph-devel@vger.kernel.org
Subject: RE: newstore direction
On Mon, 19 Oct 2015, James (Fei) Liu-SSI wrote
Hi Sage and Somnath,
In my humble opinion, There is another more aggressive solution than raw
block device base keyvalue store as backend for objectstore. The new key value
SSD device with transaction support would be ideal to solve the issues. First
of all, it is raw SSD device. Secondly ,
Hi John,
Thanks for your explanations.
Actually, clients can. Clients can request fairly complex operations like
"read an xattr, stop if it's not there, now write the following discontinuous
regions of the file...". RADOS executes these transactions atomically.
[James] Could you m
Hi David,
Generally speaking, it is going to be super difficult to maximize the
bandwidth of NVMe with current Ceph latest release. In my humble opinion, I
don't think Ceph is aiming at high performance storage.
Here is link for your reference for some good work done by Samsung and SanDisk
re
the bottleneck. Anything else in
your mind will be the bottleneck?
Regards,
James
-Original Message-
From: Casey Bodley [mailto:cbod...@redhat.com]
Sent: Wednesday, September 30, 2015 6:57 AM
To: Xiaoxi Chen
Cc: James (Fei) Liu-SSI; ceph-devel@vger.kernel.org
Subject: Re: Backend
Hi Casey,
Great job.
Regards,
James
-Original Message-
From: Casey Bodley [mailto:cbod...@redhat.com]
Sent: Tuesday, September 29, 2015 1:06 PM
To: James (Fei) Liu-SSI
Cc: ceph-devel@vger.kernel.org
Subject: Re: Backend ObjectStore engine performance bench with FIO
Hi James
Hi Varada,
Let me know when you complete the rebase. Then I can help you over here to
reproduce and fix the issue.
Regards,
James
-Original Message-
From: Varada Kari [mailto:varada.k...@sandisk.com]
Sent: Tuesday, September 29, 2015 10:38 AM
To: James (Fei) Liu-SSI; Sage Weil
r in your repo.
thanks,
James
-Original Message-
From: Varada Kari [mailto:varada.k...@sandisk.com]
Sent: Tuesday, September 29, 2015 10:14 AM
To: James (Fei) Liu-SSI; Sage Weil; Matt W. Benjamin; Loic Dachary
Cc: ceph-devel
Subject: RE: loadable objectstore
Hi James,
Symbol is present in
Hi Varada,
Can you use command nm to see whether " tracepoint_dlopen" is defined in
"./.libs/libceph_filestore.so"?
Regards,
James
-Original Message-
From: Varada Kari [mailto:varada.k...@sandisk.com]
Sent: Monday, September 28, 2015 6:21 PM
To: James (Fei
Hi Varada,
Have you rebased the pull request to master already?
Thanks,
James
-Original Message-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Varada Kari
Sent: Friday, September 11, 2015 3:28 AM
To: Sage Weil; Matt W. Benjamin; Lo
. thanks
Regards,
James
-Original Message-
From: James (Fei) Liu-SSI
Sent: Friday, September 18, 2015 2:55 PM
To: 'Chen, Xiaoxi'
Cc: 'ceph-devel@vger.kernel.org'
Subject: RE: Newstore create failed with fio_objectstore
Hi Xiaoxi and Cephers,
Thanks for your feedback
rocksdb,
but it would be very helpful if you would like to help us playing on LevelDB.
By the way, great job on fio_objectstore, which is really good for backend
bottleneck analysis.
--Xiaoxi
From: James (Fei) Liu-SSI [mailto:james@ssi.samsung.com]
Sent: Friday, September 18, 2015 1:47 AM
To
Hi Quentin,
Samsung has so different type of SSD for different type of workload with
different SSD media like SLC,MLC,TLC ,3D NAND etc. They were designed for
different workloads for different purposes. Thanks for your understanding and
support.
Regards,
James
From: ceph-users [mailto:ceph-use
wrote:
>> Hi James,
>>
>> I just looked back at the results you posted, and saw that you were using
>> iodepth=1. Setting this higher should help keep the FileStore busy.
>>
>> Casey
>>
>> - Original Message -
>>> From: "James (Fei)
/ELF_Format.pdf
[2]https://gcc.gnu.org/ml/gcc/2004-06/msg01956.html
Regards,
James
-Original Message-
From: Allen Samuels [mailto:allen.samu...@sandisk.com]
Sent: Saturday, September 12, 2015 1:35 PM
To: Varada Kari; James (Fei) Liu-SSI; Sage Weil; Matt W. Benjamin; Loic Dachary
Cc: ceph-devel
Hi Varada,
Got a chance to go through the code. Great job. It is much cleaner . Several
questions:
1. What you think about the performance impact with the new implementation?
Such as dynamic library vs static link?
2. Could any vendor just provide a objectstore interfaces complied dynamic
objectstore_aio_open,
.close_file = fio_objectstore_aio_close,
};
Let me know what you think.
Regards,
James
-Original Message-
From: Casey Bodley [mailto:cbod...@redhat.com]
Sent: Friday, September 11, 2015 7:28 AM
To: James (Fei) Liu-SSI
Cc: Haomai Wang; ceph-d
September 04, 2015 8:43 PM
To: James (Fei) Liu-SSI
Cc: Casey Bodley; ceph-devel@vger.kernel.org
Subject: Re: About Fio backend with ObjectStore API
On Sat, Sep 5, 2015 at 4:29 AM, James (Fei) Liu-SSI
wrote:
> Hi Casey,
>Thanks. I even got a compiling error with fio-objectstore branch.
objectstore=filestore
directory=/mnt/fio_ceph_filestore
filestore_journal=/var/lib/ceph/osd/journal-ram/fio_ceph_filestore1
-Original Message-
From: Haomai Wang [mailto:haomaiw...@gmail.com]
Sent: Tuesday, September 08, 2015 7:28 PM
To: James (Fei) Liu-SSI
Cc: Casey Bodley
Subject: Re: About
Error 1
jamesliu@jamesliu-OptiPlex-7010:~/WorkSpace/ceph_fio$ git branch
* fio-objectstore
master
Regards,
James
-Original Message-
From: Casey Bodley [mailto:cbod...@redhat.com]
Sent: Thursday, September 03, 2015 10:44 AM
To: James (Fei) Liu-SSI
Cc: ceph-devel@vger.kernel.org
Subje
Hi Anrija,
Your feedback is greatly appreciated.
Regards,
James
From: Andrija Panic [mailto:andrija.pa...@gmail.com]
Sent: Friday, September 04, 2015 12:39 PM
To: James (Fei) Liu-SSI
Cc: Quentin Hartman; ceph-users
Subject: Re: [ceph-users] which SSD / experiences with Samsung 843T vs. Intel
little bit strange over here.
Regards,
James
From: Andrija Panic [mailto:andrija.pa...@gmail.com]
Sent: Friday, September 04, 2015 12:21 PM
To: Quentin Hartman
Cc: James (Fei) Liu-SSI; ceph-users
Subject: Re: [ceph-users] which SSD / experiences with Samsung 843T vs. Intel
s3700
Quentin,
try
]
Sent: Friday, September 04, 2015 11:53 AM
To: James (Fei) Liu-SSI
Cc: Quentin Hartman; ceph-users
Subject: Re: [ceph-users] which SSD / experiences with Samsung 843T vs. Intel
s3700
Hi James,
I had 3 CEPH nodes as folowing: 12 OSDs(HDD) and 2 SSDs (2x 6 Journals
partitions on each SSD) - SSDs
Hi Quentin and Andrija,
Thanks so much for reporting the problems with Samsung.
Would be possible to get to know your configuration of your system? What kind
of workload are you running? Do you use Samsung SSD as separate journaling
disk, right?
Thanks so much.
James
From: ceph-users [mailt
Hi Haomai and Case,
Do you have any fixes for that segfault?
Thanks,
James
-Original Message-
From: Haomai Wang [mailto:haomaiw...@gmail.com]
Sent: Wednesday, July 22, 2015 6:07 PM
To: Casey Bodley
Cc: Casey Bodley; Matt W. Benjamin; James (Fei) Liu-SSI;
ceph-devel
reflect that the whole
objectstore will be supported by fio_ceph_objectstore.cc. what you think?
Let me know if you need any help from my side.
Regards,
James
-Original Message-
From: Casey Bodley [mailto:cbod...@gmail.com]
Sent: Thursday, July 09, 2015 12:32 PM
To: James (Fei) Liu-SSI
t; << std::endl;
240 goto failed;
241 }
242
243 ft.create_collection(coll_t());
244 fs->apply_transaction(ft);
245
246
247 return 0;
248
249 failed:
250 return 1;
251
252 }
-Original Message-
From: Casey Bodley [mailto:cbod...@gmail.
] On Behalf Of James (Fei) Liu-SSI
Sent: Tuesday, June 30, 2015 2:19 PM
To: Casey Bodley
Cc: Haomai Wang; ceph-devel@vger.kernel.org
Subject: RE: About Fio backend with ObjectStore API
Hi Casey,
Thanks a lot.
Regards,
James
-Original Message-
From: Casey Bodley [mailto:cbod
to get this upstream? How do we
>> make this happen?
>>
>>
>> On 06/30/2015 04:38 PM, Mark Nelson wrote:
>>>
>>> It would be fantastic if folks decided to work on this and got it
>>> pushed upstream into fio proper. :D
>>>
>>> Mark
&
nt: Tuesday, June 30, 2015 8:50 AM
To: Allen Samuels; James (Fei) Liu-SSI; Haomai Wang
Cc: ceph-devel
Subject: RE: Inline dedup/compression
- Reference count has to be maintained as an attribute of the object
- As mentioned in the write workflow, duplicate segment writes increment the
referen
Hi Casey,
Thanks a lot.
Regards,
James
-Original Message-
From: Casey Bodley [mailto:cbod...@gmail.com]
Sent: Tuesday, June 30, 2015 2:16 PM
To: James (Fei) Liu-SSI
Cc: Haomai Wang; ceph-devel@vger.kernel.org
Subject: Re: About Fio backend with ObjectStore API
Hi,
When Danny Al
Hi Haomai,
What are you trying to ask is to benchmark local objectstore(like
kvstore/filestore/newstore) locally with FIO(ObjectStore engine)? You want to
purely compare the performance locally for these objectstores, right?
Regards,
James
-Original Message-
From: ceph-devel-ow...
details more for each solution.
I really like your idea for dedupe in OSD side by the way. Let me think
more about it.
Regards,
James
-Original Message-
From: Haomai Wang [mailto:haomaiw...@gmail.com]
Sent: Friday, June 26, 2015 8:55 PM
To: James (Fei) Liu-SSI
Cc: ceph-devel
Subject: Re
world. But everybody want to save
space/cost as data grows.
Regards,
James
-Original Message-
From: Gregory Farnum [mailto:g...@gregs42.com]
Sent: Monday, June 29, 2015 4:01 AM
To: James (Fei) Liu-SSI
Cc: Haomai Wang; ceph-devel
Subject: Re: Inline dedup/compression
We discuss this periodical
apple to apple
comparison. But it is good reference. The datacenters need cost effective
solution.
Regards,
James
-Original Message-
From: Haomai Wang [mailto:haomaiw...@gmail.com]
Sent: Thursday, June 25, 2015 8:08 PM
To: James (Fei) Liu-SSI
Cc: ceph-devel
Subject: Re: Inline dedup
Hi Cephers,
It is not easy to ask when Ceph is going to support inline
dedup/compression across OSDs in RADOS because it is not easy task and
answered. Ceph is providing replication and EC for performance and failure
recovery. But we also lose the efficiency of storage store and cost associ
: James (Fei) Liu-SSI; dev at dpdk.org
Cc: Liang, Cunming
Subject: RE: [dpdk-dev] Issues of MSIx interrupt enable with user space driver
The V6 "Interrupt PMD" patch has been sent out to DPDK.org 2 months ago, and V7
is under development with changes to include more generic APIs
28, 2015 4:43 PM
To: James (Fei) Liu-SSI
Cc: dev at dpdk.org
Subject: Re: [dpdk-dev] Issues of MSIx interrupt enable with user space driver
On Tue, 28 Apr 2015 21:57:31 +
"James (Fei) Liu-SSI" mailto:james.liu at
ssi.samsung.com>> wrote:
> Hi All,
> We are porting d
-bounces at dpdk.org] on behalf of James (Fei) Liu-SSI
[james@ssi.samsung.com]
Sent: Tuesday, April 28, 2015 2:57 PM
To: dev at dpdk.org
Subject: [dpdk-dev] Issues of MSIx interrupt enable with user space driver
Hi All,
We are porting driver from kernel into user space driver with DPDK for one
Hi All,
We are porting driver from kernel into user space driver with DPDK for one
of our devices. Polling thread works fine without any issue. However, we want
to switch from polling to interrupt based handler. While we enable interrupt
with VFIO MSIx, we always get below errors after issui
47 matches
Mail list logo
