Issue in queying file present in swift compliant object storage

2017-09-13 Thread Chetan Kothari
I have registered plug-in to connect to container of Oracle Storage Cloud Service using Swift library. I am able to query files present in top level in container of Oracle Storage Cloud Service. For example - oscs.`select * from test_tsv` ( test_tsv is file present as objet in container I

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Takeo Ogawara
Yes, that’s right. [drill@node21 ~]$ ps -ef | grep Drillbit drill 955 1 0 Sep13 ?00:02:26 /usr/lib/jvm/jre-1.7.0-openjdk.x86_64/bin/java -Xms4G -Xmx4G -XX:MaxDirectMemorySize=8G -XX:ReservedCodeCacheSize=1G -Ddrill.exec.enable-epoll=false -XX:MaxPermSize=512M -XX:+CMSClassUnl

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Robert Hou
You wrote: I meant I started Drill from Linux user “drill”. Do you mean that you logged in as user "drill" and started the drillbit? Can you run: ps -ef | grep Drillbit Thanks. --Robert From: Takeo Ogawara Sent: Wednesday, September 13, 2017 10:

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Takeo Ogawara
I don’t specify the user name in sqlline command. I meant I started Drill from Linux user “drill”. [drill@node21 ~]$ ./apache-drill-1.11.0/bin/sqlline -u jdbc:drill:zk=node21:5181,node22:5181,node23:5181/drill/cluster3-drillbits apache drill 1.11.0 "the only truly happy people are children, the cr

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Robert Hou
This might work: "pcap": { "type": "pcap" } Thanks. --Robert From: Arjun kr Sent: Wednesday, September 13, 2017 10:22 PM To: user@drill.apache.org Subject: Re: Query Error on PCAP over MapR FS I have not used pcap storage format before. Doesn't it re

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Robert Hou
You wrote: I’m running drill as user “drill”. How are you invoking sqllline? Are you specifying a user "drill"? You should be able to query the file with two steps: 1) use mfs; this invokes the plugin 2) select * from `x.pcap`; Since x.pcap is in the root directory, you don't need

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Arjun kr
I have not used pcap storage format before. Doesn't it require specific format defined in storage plugin ( as psv format given below)? "formats": { "psv": { "type": "text", "extensions": [ "psv" ], "delimiter": "|" }, Thanks, Arjun _

Re: How to query values in list

2017-09-13 Thread Robert Hou
Good to know! Thanks. --Robert From: gus Sent: Wednesday, September 13, 2017 7:28 PM To: user@drill.apache.org Subject: Re: How to query values in list Dear Robert, it worked! I also needed to change this: store.mongo.all_text_mode = true thanks!, gus

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Takeo Ogawara
I used storage plugin named “mfs” with “maprfs:///“. I modified plugin name from “mfs” to “dfs” and tested a query, but the result was the same (No such file). "Hadoop fs -ls / " can find x.pcap [drill@node21 log]$ hadoop fs -ls / | grep x.pcap -rw-r--r-- 3 root root 6083 2017-09-13 16:

Re: How to query values in list

2017-09-13 Thread gus
Dear Robert, it worked! I also needed to change this: store.mongo.all_text_mode = true thanks!, gus Em Thu, Sep 14, 2017 at 12:47:31AM +, Robert Hou escreveu: > Try: > > >select t.v11._ from dfs.`` t where t.v11._ = '0070'; > > > This works for json. Try it with MongoDB. > >

Re: How to query values in list

2017-09-13 Thread Robert Hou
Try: select t.v11._ from dfs.`` t where t.v11._ = '0070'; This works for json. Try it with MongoDB. Thanks. --Robert From: gus Sent: Wednesday, September 13, 2017 11:26 AM To: user@drill.apache.org Subject: How to query values in list Hi, in this exa

How to query values in list

2017-09-13 Thread gus
Hi, in this example[1], what's the syntax in apache drill to query "v11._" with the value of "0070"? I'm using MongoDB. thanks!, gus [1] example: https://share.riseup.net/#PgfEnTO7jEXPbpA5QOgcRg

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Andries Engelbrecht
Drill is not seeing the file in the location you pointed it. What did you name the storage plugin? The default is normally dfs for the distributed filesystem. Also did you place the file in the root directory of the dfs? What do you get back if you run Hadoop fs –ls / For your testing you can j

Re: Workaround for drill queries during node failure

2017-09-13 Thread John Omernik
As long as the nodes are "up" during the planning phase they will be included in the planning. If they go "down" after planning, (i.e. during execution) and fragments are requested, they will not report, and will fail the query. So if you start off with 5 nodes, but node 4 is down for patches, and

Re: Query Error on PCAP over MapR FS

2017-09-13 Thread Takeo Ogawara
Hi, I modified storage config like this. "type": "file", "enabled": true, "connection": "maprfs:///", "config": null, "workspaces": { "root": { "location": "/", "writable": false, "defaultInputFormat": null } } But query like “select * from mfs.`x.pcap`” failed. Is the