Hi,
I'm new here and with Riak. If I do something wrong, please, let me know.
I've made a Riak cluster with two identical machines: Intel core i3 2.3GHz
4GB RAM 1TB HD. They are connected by a gigabit ethernet network.
Everything is working fine. I'm using a Bitcask backend.
I've made a PHP scri
Will check on that.
Can you think of anything that would explain the 5x increase in disk writes
we are seeing with the same workload?
On Thu, Nov 1, 2012 at 6:03 PM, Matthew Von-Maszewski wrote:
> Look for any activity in the LOG. Level-0 "creations" are fast and not
> typically relevant. You
Look for any activity in the LOG. Level-0 "creations" are fast and not
typically relevant. You would be most interested in LOG lines containing
"Compacting" (start) and "Compacted" (end). The time in between will throttle.
The idea is that these compaction events can pile up, one after anoth
Thanks. The amortized stalls may very well describe what we are seeing. If
I combine leveldb logs from all partitions on one of the upgraded nodes
what should I look for in terms of compaction activity to verify this?
On Thu, Nov 1, 2012 at 5:48 PM, Matthew Von-Maszewski wrote:
> Dietrich,
>
> I
Dietrich,
I can see your concern with the write IOS statistic. Let me comment on the
easy question first: block_size.
The block_size parameter in 1.1 was not getting passed to leveldb from the
erlang layer. You were using a 4096 byte block parameter no matter what you
typed in the app.confi
We've just gone through the process of upgrading two riak clusters from 1.1
to 1.2.1. Both are on the leveldb backend backed by RAID0'd SSDs. The
process has gone smoothly and we see that latencies as measured at the
gen_fsm level are largely unaffected.
However, we are seeing some troubling disk
Oh, you know what, SqlBulkCopy is import only, so you can ignore what I
just wrote. It's part of ADO.NET
You really just want to stream rows into Riak as fast as you can - I'd run
with CorrugatedIron and use either RiakClient.Put or RiakAsyncClient.Put
depending on how synchronous you want to be w
Thank you. I rebuilt Erlang from source (as per the documentation) and no I
don't get any errors.
This is for an evaluation/demo not for production so although it took some
time building everything from source turned out best for me.
From: Jared Morrow [mailto:ja...@basho.com]
Sent: Thur
Kevin,
It comes down to what you want to do with it. If you want to run Riak,
store data in it and use it in some production sense, you don't want the
'make devrel' functionality anyway. You want one Riak node running on each
machine. Use the Riak package we ship (you don't need to uninstall Erl
The other thing to consider, for SQL Server exports, is that you should be
using the SqlBulkCopy class (or bcp.exe) to pull data out of your SQL
Server without doing terrible terrible things to your SQL Server
performance. You'll be better served by pushing data in stages rather than
attempting to
Jeremy,
I was looking at the merge index code and I think the issue is that the
method by which segments are chosen for compaction may be very slow to get
to the larger segments.
1. Merge Index only schedules merging when a buffer is rolled-over to a
segment. This means there will _always_ be at
What you are going to want to do is to get the code from the T4 link. You
will use that to generate your POCO classes. Optionally you can create the
classes by hand since there are only a few of them. Create a .NET
application, C# in this case. Include the POCO classes into your main app
along wit
I went through hard time a few months back trying to install Riak from source
on Ubuntu Natty. The Riak Docs were not descriptive enough with what needed to
be done.
Do you have access to a clean Linux Server e.g. Rackspace Cloud Servers or
Linux on a VM? If so, the following script should do
So I almost forgot, you can use CorrugatedIron and do it all from .NET
code. It is a .NET driver to Riak http://corrugatediron.org
Not sure why I did not think of it.
Thanks,
Jeff
On Thu, Nov 1, 2012 at 3:41 PM, Dmitri Zagidulin wrote:
> Ah, ok.
> Then I highly recommend following Jayson Barle
Ah, ok.
Then I highly recommend following Jayson Barley's approach, in the previous
email. Query SQL server, compose a POCO type object, serialize it to JSON,
and store it in Riak either via the C++/C# client, or just use an HTTP
client and PUT/POST it over http.
On Thu, Nov 1, 2012 at 3:37 PM, Ke
OK.
My preferred programming language is C++ or more recently C#. I have done
some Java programming but that was a while back. When I have played with
JavaScript it was always in the context of Microsoft's version of
JavaScript.
I would like to migrate about 5 tables. Our database is very
Seeing the following segfault periodically on RedHat 6.2/64bit running the
Basho provided rpm of riak 1.2.1:
kernel: beam.smp[30850]: segfault at 18 ip 7f63ec325259 sp
7f63fd29b188 error 4 in erlang_js_drv.so[7f63ec2d1000+e8000]
--
View this message in context:
http://riak-users.197444
I have done this for CouchDB but haven't had a need to for Riak, yet.
A couple of links that will help you create a tool to do just this in .NET.
T4 from Microsoft - This will allow you to create your classes from a DB.
It isn't difficult to learn. Here is a post with code that you can use as
you
Possibly. Let's step back for a second, however. Node.js might not be a
good fit for your migration script needs.
A couple of questions:
1) What's your preferred programming language? Java, python, javascript,
etc?
2) What kind of data are you trying to migrate? (one table or many? what
kind of
In this case the "server" is the Microsoft SQL Server. Right? So I need to
have IIS running on the same machine as the SQL Server?
From: riak-users [mailto:riak-users-boun...@lists.basho.com] On Behalf Of
Dmitri Zagidulin
Sent: Thursday, November 01, 2012 2:07 PM
To: riak-users
Subject: Re: Imp
Node.js http://nodejs.org/ http://en.wikipedia.org/wiki/Nodejs is a
server-side Javascript web application framework.
It is completely unrelated to Java, and will have to be installed
separately. (It uses its own, javascript-specific package management app
called 'npm' (it's similar to ruby gems a
Excellent question.
Unfortunately, you're not going to find any universal/pushbutton tool to
migrate data from an SQL db to Riak.
Fortunately, writing that migration tool that is specific to your
application is fairly straightforward. All of the variations out there boil
down to:
1) Export your d
Sorry for the newbie question but is node.js part of the Java distribution
for a Ubuntu Linux Server or do I need to get it as a package? How is it
installed? I am assuming that once node.js is installed then the code will
be just like any other Java app. Right?
From: Jeff Kirkell [mailto:jeff.
Since I already have erlang installed do I have to uninstall it and do this
apt-get then reinstall it? If so how do I do that? I am just following the
directions in the documentation
(http://docs.basho.com/riak/latest/tutorials/installation/Installing-on-Debian-and-Ubuntu/).
Like the documentat
If you're building from source you'll want to have some dependencies installed
first by running the following command i.e. before installing Erlang:
apt-get -y install build-essential libncurses5-dev openssl libssl-dev m4
libssh-dev unixodbc-dev libwxgtk2.8-dev libglu-dev fop xsltproc default-jd
I got erlang from a package. How do I build from source? Once it is built
how do I install it so that the instructions in the documentation work. The
'wget' and 'dpkg' lines that you call out are a direct quote from the
documentation and that is what I followed. I installed the Riak package
withou
fatal: not a git repository (or any of the parent directories): .git
Can be safely ignored, it has to do with us trying to figure out what tag
is being used for a given directory.
-J
On Thu, Nov 1, 2012 at 12:24 PM, Kevin Burton wrote:
> Interesting. make works without error. ‘make rel’ is wher
Interesting. make works without error. make rel is where the error occurs.
The last lines of make are:
ð rel (compile)
ð riak-1.2.1 (compile)
The last lines of make rel
ð rel (compile)
ð riak-1.2.1 (compile)
ð rel (generate)
ERROR: Unable to generate spec: read file info
This Microsoft blog post gives a sample how to query the SQL Server
http://blogs.msdn.com/b/sqlphp/archive/2012/06/08/introducing-the-microsoft-driver-for-node-js-for-sql-server.aspx
In the record loop, you use a Riak Node driver like riak-js.
I can't share the scripts I wrote due to work but I c
Okay, so reltool isn't working, did you build erlang from source or did you
use some package?
If you used a package, you can try building from source, configure it to
install somewhere outside of /usr/lib (by doing a
--prefix=/usr/local/erlang-r15b01 or something in the ./configure step).
Then ma
Would you mind sharing that app? If you have time since I am not familiar
with Node.js would you mind showing me how you ran it as well as the source.
Thank you.
From: Jeff Kirkell [mailto:jeff.kirk...@gmail.com]
Sent: Thursday, November 01, 2012 1:07 PM
To: Kevin Burton
Cc: riak-users
Subject
By the way the build seems to work fine (make rel). Just a few warnings. But
there is no indication of an error until the erlang generate error detailed
below.
From: Jared Morrow [mailto:ja...@basho.com]
Sent: Thursday, November 01, 2012 12:58 PM
To: Kevin Burton
Cc: riak-users@lists.basho.com
There is nothing that I have come across. What I did in the past was run a
quick Node.js app that pulled data out of SQL Server using one of the
available drivers and serialize and write to Riak. It is not perfect, and
may be slow depending on the amount of data but it does work.
Jeff
On Thu, No
I am having trouble sharing files with the machine that I am sending email
on. The Linux machine is a VM and I am using Outlook to send this email
(Micrsoft Windows 7). There are theoretically a way to share a clipboard or
file between the machines (the VM and the host) but right now that is
anoth
Devrel will depend on a working build first, so sticking with just 'make'
to see if that works will be a good first step.
If you can run 'make' and put the output in a gist or pastebin for me I can
try and take a look at it.
Are you building from an untarred source tarball of Riak 1.2.1, or cloni
I get
Erlang R15B01 (erts-5.9.1) [source] [64bit] [async-threads:0]
[kernel-poll:false]
EShell V5.9.1 (abort with ^G)
In the case of make devrel it is definitely skipping something as the dev
directory is completely empty.
From: Jared Morrow [mailto:ja...@basho.com]
Sent: Thursday
I would like some scripts or programming tools that I could use to transfer
existing data held in Microsoft SQL Server databases into Riak. Do such
tools exist?
___
riak-users mailing list
riak-users@lists.basho.com
http://lists.basho.com/mailman/listinf
Riak Users,
I'm happy to announce the first alpha release of Yokozuna. Yokozuna is a
new take on providing search support for Riak. It tightly integrates Solr
4.0.0 and the Riak master branch.
I'm very excited about Yokozuna. It brings the power of Solr search to
Riak. This means language sup
If building 1.2.1 from source, make sure you have erlang r15B01 installed
and in your path.
That particular error I have never seen. If you type 'erl' in the command
line, what do you see?
-Jared
On Thu, Nov 1, 2012 at 11:33 AM, Kevin Burton wrote:
> Better yet I decided to build from source.
Same thing happens when I 'make devrel'.
From: Kevin Burton [mailto:rkevinbur...@charter.net]
Sent: Thursday, November 01, 2012 12:33 PM
To: 'Jared Morrow'
Cc: 'riak-users@lists.basho.com'
Subject: RE: Riak installation on Ubuntu Server
Better yet I decided to build from source. But I ran
Better yet I decided to build from source. But I ran into the following
error:
ERROR: Unable to generate spec: read file info
/usr/lib/erlang/man/man1/qemu-i386.1 failed
>From the content this error seems to related to erlang more than riak but I
am wondering if this makes other portions of
Kevin,
So you are on 12.10, which is one minor release past Precise (12.04) which
is the current LTS (Long Term Support) release. I haven't confirmed that
the Precise Riak package will work on Quantal, but I suspect it will be
fine. In version mismatches most issues you'll find will be on instal
I can do a lsb_release -a and I get:
Distributor ID: Ubuntu
Description: Ubuntu 12.10
Release: 12.10
Codename: quantal
From: Jared Morrow [mailto:ja...@basho.com]
Sent: Thursday, November 01, 2012 11:42 AM
To: Kevin Burton
Cc: riak-users@lists.basho.com
Subject: Re: Riak installation on
Kevin
As far as I know, the lsb_release tool is installed by default on all
Ubuntu installs. You can use it to get the codename of the release like:
For Ubuntu 10.04
$ lsb_release -c
Codename:lucid
or Ubuntu 12.04
$ lsb_release -c
Codename:precise
You can also get the information from
DeadZen,
Thanks for the email.
I think a stand-alone list for riak_core makes a lot of sense. core is
a very powerful piece of software, and more people are starting to use
it distinct of Riak. A separate list for Core might help to make it
more useful on the whole, and we do need to ensure that
I was looking at the options of installing Riak and there are several
options under Ubuntu: Lucid, Natty, and Precise. This is a Linux Ubuntu
Server. I am not sure how to tell which variant it is.
Thank you.
Kevin
___
riak-users mailing list
riak
I reindexed a bunch of items that are still in the search index but no
disk space was reclaimed. Is there any Riak console Erlang voodoo I
can do to convince Riak Search that now would be a good time to
compact the merge_index?
--
Jeremy
On Tue, Oct 30, 2012 at 4:26 PM, Jeremy Raymond wrote:
>
Firstly, I would like to start off by emphasizing my appreciation for and
belief that separating riak_core was a very good thing.
I just wished there was a dedicated place to discuss riak_core. I saw that
there is essentially no mailing list to discuss
riak_core issues; which I feel are wider in s
ElasticSearch's clustering is much better than Solr as well. If you're looking
for two products that both work well in a clustered, shared nothing
environment, elasticsearch + riak makes more sense than solr + riak to me.
- Alex
- Original Message -
From: "Guido Medina"
To: "riak-users
You will realize that one specific solution doesn't solve everything, so
you will probably have to use a piece from each base on their strengths,
Riak = *Key-Value*, HA proxy (not related) is a good *TCP balancer*, we
use it and it works like a charm, here is a sample configuration
https://gist
Morning, Afternoon, Evening to All -
For today's Recap: meetups, talks, code, and more.
Enjoy.
Mark
twitter.com/pharkmillups
October 29 - October 31
==
1) There inaugural Riak DC Meetup is happening in Alexandra, VA on November 14.
* Details here ---> http://www.meetu
51 matches
Mail list logo
