Re: [ceph-users] Application HA & Scalability Via ceph
Hi Alek, The Lua branch is definitely ready for testing now. I'm putting together a blog post about it and ill shoot a note to mailing list when that's complete. On Oct 19, 2013 11:45 AM, "Alek Paunov" wrote: > On 18.10.2013 22:23, Noah Watkins wrote: > >> >> As far as constructing scriptable object interfaces (Java, LISP, >> etc...) this is certainly possible, and pretty cool :) Currently we >> have a development version of Lua support (github.com/ceph/ceph.git >> cls-lua), and an LLVM JIT implementation about ready to make public. >> > > Noah, Please drop a note to the LuaJIT ML with the idea and current > features, when it is an appropriate moment for testing of this branch. > > Thanks, > Alek > > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Application HA & Scalability Via ceph
On 18.10.2013 22:23, Noah Watkins wrote: As far as constructing scriptable object interfaces (Java, LISP, etc...) this is certainly possible, and pretty cool :) Currently we have a development version of Lua support (github.com/ceph/ceph.git cls-lua), and an LLVM JIT implementation about ready to make public. Noah, Please drop a note to the LuaJIT ML with the idea and current features, when it is an appropriate moment for testing of this branch. Thanks, Alek ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Application HA & Scalability Via ceph
On Fri, Oct 18, 2013 at 12:23 PM, Noah Watkins wrote: > On Fri, Oct 18, 2013 at 12:04 PM, wrote: >> Hi all, >> >> Is this possible? >> Does it make sense? > > As far as constructing scriptable object interfaces (Java, LISP, > etc...) this is certainly possible, and pretty cool :) Currently we > have a development version of Lua support (github.com/ceph/ceph.git > cls-lua), and an LLVM JIT implementation about ready to make public. This definitely makes sense, but I think the rest of it might be stretching the abstraction and capabilities a bit farther than they're prepared for. Object class methods right now are synchronous calls — the client sends in an op on object foo, the op is executed on object foo (including the call into the object class), and then it returns to the client. While it's processing that op, other accesses to object foo are blocked. While we are starting to equip the OSDs with the tooling necessary to spin off operations to other objects on other OSDs as part of our promote work, it's still fairly primitive and there's no direct exposure to it via the object classes — and again, these sorts of subops within a class would block anybody else wanting to access that object. What I suspect you could do feasibly is embed object classes which do each stage of a pipeline in the smallest granularity that's feasible, and then have intelligent clients sending off the op requests and marshaling responses as appropriate. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Application HA & Scalability Via ceph
On Fri, Oct 18, 2013 at 12:04 PM, wrote: > Hi all, > > Is this possible? > Does it make sense? As far as constructing scriptable object interfaces (Java, LISP, etc...) this is certainly possible, and pretty cool :) Currently we have a development version of Lua support (github.com/ceph/ceph.git cls-lua), and an LLVM JIT implementation about ready to make public. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Application HA & Scalability Via ceph
Hi all, Given ceph's class/method capability, and it's HA and scalability characteristics, I'm wondering if it is possible to implement an HA/Scalable application completely in ceph (e.g., ceph is both the HA/scalable storage cluster and the HA/scalable application cluster)? I'm envisioning a set of objects, each with their methods executing on their respective replica OSDs, wherein they work together as an application. Imagine a set of Java classes and instances, or a LISP interpreter, mapped directly into ceph librados objects. Is this possible? Does it make sense? What does it mean to have a long running instance of a librados object with replication? What happens when an object is moved/copied to another OSD? Could one build an HA/Scalable mapper/reducer with this? Could one build an HA/Scalable complex-event-processor with this? Could one build an HA/Scalable fully programmable executable object store? Comments? Paul Whittington Chief Architect McAfee 2325 West Broadway Street Suite B Idaho Falls, ID 83402 Direct: 208.552.8702 Web: www.mcafee.com The information contained in this email message may be privileged, confidential and protected from disclosure. If you are not the intended recipient, any review, dissemination, distribution or copying is strictly prohibited. If you have received this email message in error, please notify the sender by reply email and delete the message and any attachments. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
