Re: Phoenix Connection Lost on Map Reduce Job Intermittently

That's not enough context for us to diagnose why your job is failing, but this stack trace exists only in Hadoop code. Given that, I would have to assume it's a bug in Hadoop 3.0.0. There are many newer versions of Hadoop and I would suggest you use one of the latest releases of Hadoop 3,

Re: Tech Talk on Thursday : Phoenix High Availability

Sorry I missed this one! I'll have to catch the recording :) On 6/29/21 1:30 PM, Kadir Ozdemir wrote: Hi All, I am hoping that you will be able to join the tech talk meeting on Thursday. Mingliang Liu, Daniel Wong, and Abhishek Singh Chouhan will introduce a new feature, Phoenix High

Re: Phoenix Error - ERROR 504 (4203)

Assuming you mean 5.1.2 (as there is no such release 5.2.1) and without any other data that would be necessary to properly diagnose what happened... I would assume that the upgrade code inside of Phoenix to automatically upgrade the Phoenix system tables is not effective across such a large

Re: [DISCUSS] Unbundling Sqlline and slf4j backend from phoenix-client and phoenix-client embedded

I think the idea is that we would include a sqlline jar with the Phoenix distribution. Context: we had some grief where a sqlline upgrade caused user pain because they were relying on specific output from sqlline. If we have the sqlline jar _not_ packaged inside phoenix-client, then users can

Re: Advice wanted on supporting a tag feature for searching an HBase Table via Phoenix

I had a similar sort of issues (granted, less data scale), and I went with option 2. If you put the rowkey of your "data" table plus the tag itself into the rowkey for your other table/index, you should be able to grow without running into HBase scalability (though, pulling 10GB of tags for

Re: [ANNOUNCE] New Phoenix committer Richárd Antal

Congrats, Richard! On 1/4/21 3:31 PM, Ankit Singhal wrote: On behalf of the Apache Phoenix PMC, I'm pleased to announce that Richárd Antal has accepted the PMC's invitation to become a committer on Apache Phoenix. We appreciate all of the great contributions Richárd has made to the community

Re: Phoenix connection issue

between hbase and presto. Please help me or suggestions on this issue. I can able to query hbase table from phoenix but issue comes only from connecting presto phoenix only. On Fri, 23 Oct, 2020, 7:27 pm Josh Elser, <mailto:els...@apache.org>> wrote: (-to: dev@phoenix, +bcc: de

Re: Phoenix connection issue

(-to: dev@phoenix, +bcc: dev@phoenix, +to: user@phoenix) I've taken the liberty of moving this over to the user list. Typically, such an exception is related to Kerberos authentication, when the HBase service denies in an incoming, non-authenticated client. However, since you're running

Re: Unable to use some functions on DECIMAL columns

providing any assistance I can.  What further info would be helpful? Cheers S ---- *From:* Josh Elser *Sent:* 01 August 2020 2:26 AM *To:* user@phoenix.apache.org *Subject:* Re: Unable to use some functions on DECIMAL col

Re: Unable to use some functions on DECIMAL columns

Simon, If you have clear bug report, please open up a Jira issue for it. Keep in mind that as much information as you can provide to indicate the problem you see, the better. Assume that whoever might read your Jira issue is coming from zero-context. Right now, you haven't shared any error,

Re: Add pseudo columns to an existing view

Yes. Please see the docs which illustrate how to create views. On 7/28/20 2:12 AM, Arun J wrote: Team, Can we create or alter a view to add a column which is pseudo columns such as # FULLNAME from other columns such as FIRSTNAME + LASTNAME # NUMVALUE from other columns TO_NUMBER(STRVALUE)

Re: how to connect phoenix cluster enabled with Kerberos using Java JDBC

You're missing a colon between the port and root znode in your JDBC URL. From http://phoenix.apache.org/ ``` jdbc:phoenix [ : [ : [ : [ : [ : ] ] ] ] ] ``` On 7/23/20 4:24 AM, Istvan Toth wrote: The code looks OK. Check that you can resolve the name of, and have IP connectivity to *each

Re: Too many connections from / - max is 60

:1125)/ Thanks! On Tue, Jun 2, 2020 at 6:57 AM Josh Elser <mailto:els...@apache.org>> wrote: HBase (daemons) try to use a single connection for themselves. A RS also does not need to mutate state in ZK to handle things like gets and puts. Phoenix is probably the

Re: Error Parameter value unbound. Parameter at index 1 is unbound on Subquery

Gentle reminder to always do a general search for similar issues https://issues.apache.org/jira/browse/PHOENIX-5192 There have been some issues which have been similarly reported in the past, but no one has been able to provide a reproduction. Perhaps you can be the one to do that. As of now,

Re: How to bulk load a csv file into a phoenix table created in lowercase

Quoting can be really annoying. Remember that when you are executing commands, you have to deal with what your shell will do to quoting. You say that escaping the slashes doesn't work? e.g. `pqsl -t MICHTEST.\"StagingNotificationPreferencesRT\" ...` What else did you try? Have you checked

Re: Latest supported HBase version

<https://www.cloudera.com/documentation/enterprise/5/latest/topics/phoenix_installation.html>available to CDH 5.16.2 customers and Phoenix 5.0 parcel available to CDH 6.2+ customers. On Mon, Apr 20, 2020 at 8:49 PM Josh Elser <mailto:els...@apache.org>> wrote: You sh

Re: Latest supported HBase version

You should contact Cloudera for information on how to use Phoenix on CDH. There is no upstream build of Apache Phoenix 5.x which was built and tested against any release of CDH. There is only the downstream work which Cloudera packages and provides themselves. On 4/20/20 11:09 AM, Arun J

[ANNOUNCE] New VP Apache Phoenix

I'm pleased to announce that the ASF board has just approved the transition of VP Phoenix from myself to Ankit. As with all things, this comes with the approval of the Phoenix PMC. The ASF defines the responsibilities of the VP to be largely oversight and secretarial. That is, a VP should be

Re: Reverse engineer a phoneix table definition

of which I filed and the other one Josh did. :-) I agree with Josh, I'd love to see an implementation of this if someone has bandwidth. Geoffrey Jacoby On Tue, Apr 14, 2020 at 8:01 AM Josh Elser mailto:els...@apache.org>> wrote: Yeah, I don't have

Re: Reverse engineer a phoneix table definition

Yeah, I don't have anything handy. I'll happily review and commit such a utility if you happen to write one (even if flawed). On 4/12/20 1:31 AM, Simon Mottram wrote: Best I can offer is  "SELECT * FROM SYSTEM.CATALOG where table_name = '" + tableName + "' and table_schem = '" 

Re: Select * gets 0 rows from index table

Hey Reid! Can you clarify a couple of things? * What version of Phoenix? * Did you `select * from index_table` verbatim? Most of the time, when you have an index table, you'd be interacting with the data table which (behind the scenes) goes to the index table. * * Caveat about covered

Re: Phoenix dependency jar for PhoenixDataSource

We received your email the first time. Please remember that this is a community of volunteers. Do not send multiple emails asking the same question. In the future, you can validate that the list received your message via the interface at https://list.apache.org Thank you. On 2/27/20 8:38

Re: Query on phoenix upgrade to 5.1.0

client for session: 0x16fece700a300fb 2020-01-30 13:20:57,623 DEBUG org.apache.phoenix.jdbc.PhoenixDriver: Expiring hbase-data-upgrade001-stg.foo.bar,hbase-data-upgrade002-stg.foo.bar,hbase-master-upgrade001-stg.foo.bar:2181:/hbase because of EXPLICIT 2020-01-30 13:20:57,623 INFO org.apache.phoenix

Re: Query on phoenix upgrade to 5.1.0

re is no issues to run DML operations.   >     org.apache.hadoop.hbase.TableNotFoundException: SYSTEM.CHILD_LINK Please let me know if any steps/documents for phoenix upgrade from 4.14 to 5.0. Thanks, Prathap On Tue, Jan 14, 2020 at 11:34 PM Josh Elser mailto

Re: Index table empty

Hi Tim, It sounds like you're doing the right steps to build an index with the async approach. Not having records after IndexTool runs successfully is definitely unexpected :) If you aren't getting any records in the index table after running the IndexTool, my guess is that something is

Re: Query on phoenix upgrade to 5.1.0

(with VP-Phoenix hat on) This is not an official Apache Phoenix release, nor does it follow the ASF trademarks/branding rules. I'll be following up with the author to address the trademark violations. Please direct your questions to the author of this project. Again, it is *not* Apache

Re: [ANNOUNCE] Apache Phoenix 4.15.0 released

Responding with my VP Phoenix hat, as this worries me with blurred-lines of what is "Vendor" and "Apache". First, Cloudera/Hortonworks and any other company who redistributes some version of Apache Phoenix (henceforth, called a "vendor") do not do so as official Apache Phoenix releases.

Re: FAQ page is blank now

Indeed it is. Looks like a dev had a bad commit to the website. Fixing. Thanks for letting us know. On 1/9/20 10:42 AM, Alexander Batyrshin wrote:  Looks like FAQ page at http://phoenix.apache.org/faq.html  is blank now

Re: Apache Phoenix website search seems to be broken

I'm not sure who actually runs search-hadoop. I don't believe it's anyone affiliated with Apache Phoenix. Thanks for letting us know it's broken, Anil! I'll drop it from the website for now. Maybe we can find something akin to a `site:phoenix.apache.org ` Google search that we can embed? On

Re: Issue using ANY ARRAY feature

Hi Simon, Thanks for replying back with your fix. We appreciate when folks do this so that others can also see the solution. http://phoenix.apache.org/download.html only publishes the "latest" release for a line that we're maintaining. That's why you'll see 4.14.3 listed on the website, not

New committer: Istvan Toth

Everyone, On behalf of the PMC, I'm pleased to announce Apache Phoenix's newest committer: Istvan Toth. Please join me in extending a warm welcome to Istvan -- congratulations on this recognition. Thank you for your contributions and we all look forward to more involvement in the future!

Re: Phoenix spark java integration example

some insights . On Mon, 25 Nov 2019 at 8:47 AM, Josh Elser <mailto:josh.el...@gmail.com>> wrote: Hi Karthigeyan, I'm moving your message over to the users list in the hopes that a more broad audience might see your ask. The dev list is focused around the day-to-day de

Re: Phoenix spark java integration example

Hi Karthigeyan, I'm moving your message over to the users list in the hopes that a more broad audience might see your ask. The dev list is focused around the day-to-day development of Apache Phoenix. I don't believe I've seen any examples of the phoenix-spark module in Java. If you happen

Re: When Phoenix 5.x for HBase-2.x will be updated?

ASF policy states that we have to talk about unreleased code on the dev list, not the user list. Moving this over to the dev list as such :) On 11/4/19 8:41 AM, Alexander Batyrshin wrote: As I see there are many bug fixes and updates (consistent indexes) for 4.x Phoenix branch. So im curios

Re: Need help with PHONEIX 5

Venkat, First, it is poor etiquette to specifically send project members emails. Please refrain from doing this in the future for any project at the ASF unless you have explicit approval from that person. Second, there is no official release of Phoenix that advertises support against any HBase

Re: Index on SYSTEM.LOG failed

url=http://localhost:876> On Thu, Oct 24, 2019 at 8:18 PM Josh Elser <mailto:els...@apache.org>> wrote: Do you have a mismatch of Phoenix thinclient jars and Phoenix QueryServer versions? You're getting a classpath-type error, not some Phoenix internal error. On 10

Re: Index on SYSTEM.LOG failed

Do you have a mismatch of Phoenix thinclient jars and Phoenix QueryServer versions? You're getting a classpath-type error, not some Phoenix internal error. On 10/24/19 10:01 AM, Aleksandr Saraseka wrote: Hello. We're logging queries in Phoenix. Main criteria can be a start_time (to

Re: Sequence number

Are you saying that you didn't restart the Phoenix QueryServer after you restored the Phoenix system tables? And then, after running into issues, you restarted PQS and then it worked as expected? I can respect that we probably don't say this anywhere, but you should definitely be restarting

Re: Materialized views in Hbase/Phoenix

Bulk loading would help a little bit in the "all-or-nothing" problem, but still not be fool proof. You could have a set of files which are destined to different tables and have very clear data that needs to be loaded, but, if a file(s) failed to be loaded, you would have to take some steps to

Re: Performance degradation on query analysis

l Message- From: Josh Elser [mailto:els...@apache.org <mailto:els...@apache.org>] Sent: Tuesday, September 17, 2019 5:16 PM To: user@phoenix.apache.org <mailto:user@phoenix.apache.org> Subject: Re: Performance degradation on query analysis Can you share th

Re: What is the phoenix-queryserver-client-4.14.2-HBase-1.4.jar?

endpoint to PQS for Phoenix read/write functions, should I depend on A) phoenix-4.14.2-HBase-1.4-thin-client.jar B) phoenix-queryserver-client-4.14.2-HBase-1.4.jar C) both On Thu, Sep 19, 2019, 4:12 AM Josh Elser mailto:els...@apache.org>> wrote:

Re: What is the phoenix-queryserver-client-4.14.2-HBase-1.4.jar?

ryserver-client-4.14.2-HBase-1.4.jar C) both On Thu, Sep 19, 2019, 4:12 AM Josh Elser mailto:els...@apache.org>> wrote: "phoenix-queryserver-client" is the name of the Maven module which holds the required code for the "JDBC thin cli

Re: What is the phoenix-queryserver-client-4.14.2-HBase-1.4.jar?

"phoenix-queryserver-client" is the name of the Maven module which holds the required code for the "JDBC thin client", aka PQS client, aka "queryserver client". Maven convention is that a jar with the name of the Maven module is created. However, the majority of the code for the thin client

Re: Performance degradation on query analysis

Can you share the output you see from the EXPLAIN? Does it differ between times it's "fast" and times it's "slow"? Sharing the table(s) DDL statements would also help, along with the shape and version of your cluster (e.g. Apache Phoenix 4.14.2 with 8 RegionServers). Spit-balling ideas:

Re: Need help on steps to copy Phoenix table from HDP 2.6 to HDP 3.1

I reached out to Sam in private since he's dealing non-Apache releases. His solution was to bulk load files from the old version of Phoenix to the new (HDP 2.6 to 3.1, respectively), but when he ran a query in the new system, he did not see the records despite them being there in HBase. The

Re: PSQ processlist

Sep 9, 2019 at 5:09 PM Josh Elser <mailto:els...@apache.org>> wrote: Not unique to PQS, see: https://issues.apache.org/jira/browse/PHOENIX-2715 On 9/9/19 9:02 AM, Aleksandr Saraseka wrote: > Hello. > Does Phoenix Query Server have any possibility to track run

Re: PSQ processlist

Not unique to PQS, see: https://issues.apache.org/jira/browse/PHOENIX-2715 On 9/9/19 9:02 AM, Aleksandr Saraseka wrote: Hello. Does Phoenix Query Server have any possibility to track running queries ? Like user connects with thin client and run some long running query, can I understand who

Re: Multi-Tenancy and shared records

Hi Simon, Phoenix does not provide any authorization/security layers on top of what HBase does (the thread on user@hbase has a suggestion on cell ACLs which is good). I think the question you're ultimately asking is: no, the TenantID is not an authorization layer. In a nut-shell, the

Re: Any reason for so small phoenix.mutate.batchSize by default?

Hey Alexander, Was just poking at the code for this: it looks like this is really just determining the number of mutations that get "processed together" (as opposed to a hard limit). Since you have done some work, I'm curious if you could generate some data to help back up your suggestion:

Re: Is there a way to specify split num or reducer num when creating phoenix table ?

Configuring salt buckets is not the same thing as pre-splitting a table. You should not be setting a crazy large number of buckets like you are. If you want more parallelism in the MapReduce job, pre-split along date-boundaries, with the salt bucket taken into consideration (e.g. \x00_date,

Re: On duplicate key update

Out of the box, Phoenix will provide the same semantics that HBase does for concurrent updates to a (data) table. https://hbase.apache.org/acid-semantics.html If you're also asking about how index tables remain in sync, the answer is a bit more complicated (and has changed in recent

Re: Is there any way to using appropriate index automatically?

are not contained in the index. This is done by default for local indexes because we know that the table and index data co-reside on the same region server thus ensuring the lookup is local.” I ‘m totally confused. On Aug 20, 2019, at 12:32 AM, Josh Elser <mailto:els...@apache.org>> wrot

Re: Is there any way to using appropriate index automatically?

http://phoenix.apache.org/faq.html#Why_isnt_my_secondary_index_being_used On 8/19/19 6:06 AM, you Zhuang wrote: Phoenix-version: 4.14.3-HBase-1.4-SNAPSHOT hbase-version: 1.4.6 Table: CREATE TABLE test_phoenix.app ( dt integer not null, a bigint not null , b bigint not null , c bigint not null ,

Re: java.io.IOException: Added a key not lexically larger than previous

Are you using a local index? Can you share the basics please (HBase and Phoenix versions). I'm not seeing if you've shared this previously on this or another thread. Sorry if you have. Short-answer, it's possible that something around secondary indexing in Phoenix causes this but not

Re: Phoenix with multiple HBase masters

PQS addresses from ZK, and performs load balancing. Thus ELB won't be needed. On Wed, Aug 7, 2019, 9:01 AM Josh Elser mailto:els...@apache.org>> wrote: Great answer, Aleksandr! Also worth mentioning there is only ever one active HBase Master a

Re: Phoenix with multiple HBase masters

Great answer, Aleksandr! Also worth mentioning there is only ever one active HBase Master at a time. If you have multiple started, one will be active as the master and the rest will be waiting as a standby in case the current active master dies for some reason (expectedly or unexpectedly).

Re: Phoenix client threads

Please take a look at the documentation: https://phoenix.apache.org/tuning.html On 7/29/19 4:24 AM, Sumanta Gh wrote: Hi, When we use Phoenix client, there are by default 10 new PHOENIX-SCANNER-RENEW-LEASE-threads created. There are also new threads spawned for hconnection-shared-thread-pool.

Re: Phoenix Upgrade 4.7 to 4.14 - Cannot use Phoenix

Looks like this is a bug in the system table upgrade code path which doesn't handle the jump from 4.7 to 4.14 correctly. This big of a version jump is not tested/supported in Apache. Does CLABS give you a guarantee that this will work? It would likely be good to contact Cloudera support if

Re: Secondary Indexes - Missing Data in Phoenix

Local indexes are stored in the same table as the data. They are "local" to the data. I would not be surprised if you are running into issues because you are using such an old version of Phoenix. On 7/24/19 10:35 PM, Alexander Lytchier wrote: Hi, We are currently using Cloudera as a

Re: Alter Table throws java.lang.NullPointerException

Please start by sharing the version of Phoenix that you're using. Did you search Jira to see if there was someone else who also reported this issue? On 7/23/19 4:24 PM, Alexander Batyrshin wrote: Hello all, Got this: alter table TEST_TABLE SET APPEND_ONLY_SCHEMA=true;

Re: Spark sql query the hive external table mapped from phoenix always throw out Class org.apache.phoenix.hive.PhoenixSerDe not found exception

(Moving this over to the user list as that's the appropriate list for this question) Do you get an error? We can't help you with only a "it didn't work" :) I'd suggest that you try to narrow down the scope of the problem: is it unique to Hive external tables? Can you use a different Hive

Re: Questions about ZK Load Balancer

Yeah, that's correct. I think I requested some documentation to be added by the original author to clarify that it's not end-to-end usable, but I don't think it ever happened. The "load balancer" isn't anything more than service advertisement, IIRC. IMO, the write-up I made here[1] is going

Re: Curl kerberized QueryServer using protobuf type

Hey Reid, Protobuf is a binary format -- this is error'ing out because you're sending it plain-text. You're going to have quite a hard time constructing messages in bash alone. There are lots of language bindings[1]. You should be able to pick any of these to help encode/decode messages (if

Re: A strange question about Phoenix

Make sure you have updated statistics for your table. Depending on the last time you created the stats, you may have to manually delete the stats from SYSTEM.STATS (as there are safeguards to prevent re-creating statistics too frequently). There have been some bugs in the past that results

Re: Phoenix 4 to 5 Upgrade Path

data compatibility at least two versions back? Does this intention apply across major version boundaries? More specifically, does it imply that data produced by 4.14.1 is intended to be compatible with 4.14.2 and 5.0.0? Thank you. vova On Wed, Jun 12, 2019 at 1:18 PM Josh Elser <mailto:

Re: Phoenix 4 to 5 Upgrade Path

What version of Phoenix 4 are you coming from? Of note, if you're lagging far behind, you'll get bit by the column encoding turning on by default in 4.10 [1] In general, before we update the system catalog table, we take a snapshot of it, so you can roll back (although this would be manual).

Re: Problem with ROW_TIMESTAMP

When you want to use Phoenix to query your data, you're going to have a much better time if you also use Phoenix to load the data. Unless you specifically know what you're doing (and how to properly serialize the data into HBase so that Phoenix can read it), you should use Phoenix to both

Re: Fwd: DELIVERY FAILURE: Error transferring to QCMBSJ601.HERMES.SI.SOCGEN; Maximum hop count exceeded. Message probably in a routing loop.

:38 PM William Shen <mailto:wills...@marinsoftware.com>> wrote: Thanks Josh for looking into this! On Fri, Apr 5, 2019 at 12:52 PM Josh Elser mailto:els...@apache.org>> wrote: I can't do this right now, but I've asked Infra to give me the karma I

Re: PQS + Kerberos problems

Make sure you have authorization set up correctly between PQS and HBase. Specifically, you must have the appropriate Hadoop proxyuser rules set up in core-site.xml so that HBase will allow PQS to impersonate the PQS end-user. On 5/14/19 11:04 AM, Aleksandr Saraseka wrote: Hello, I have

NoSQL Day on May 21st in Washington D.C.

For those of you in/around the Washington D.C. area, NoSQL day is fast approaching. If you've not already signed up, please check out the agenda and consider joining us for a fun and technical day with lots of talks from Apache committers and big names in industry:

Re: Phoenix Mapreduce

No, you will not "lose" data. You will just have mappers that read from more than one Region (and thus, more than one RegionServer). The hope in this approach is that we can launch Mappers on the same node of the RegionServer hosting your Region and avoid any reading any data over the network.

Re: Large differences in query execution time for similar queries

Further, I'd try to implement James' suggestions _not_ using the Phoenix Query Server. Remember that the thin-client uses PQS, adding a level of indirection and re-serialization. By using the "thick" driver, you can avoid this overhead which will help you get repeatable test results with less

Re: Fwd: DELIVERY FAILURE: Error transferring to QCMBSJ601.HERMES.SI.SOCGEN; Maximum hop count exceeded. Message probably in a routing loop.

:47 PM, Josh Elser wrote: Not just you. I have an email filter set up for folks like this :) A moderator should be able to force a removal. Trying it now to see if I'm a moderator (I don't think I am, but might be able to add myself as one). On 4/4/19 7:15 PM, William Shen wrote: I kept

Re: Fwd: DELIVERY FAILURE: Error transferring to QCMBSJ601.HERMES.SI.SOCGEN; Maximum hop count exceeded. Message probably in a routing loop.

Not just you. I have an email filter set up for folks like this :) A moderator should be able to force a removal. Trying it now to see if I'm a moderator (I don't think I am, but might be able to add myself as one). On 4/4/19 7:15 PM, William Shen wrote: I kept getting this every time I send

2 weeks remaining for NoSQL Day abstract submission

There are just *two weeks* remaining to submit abstracts for NoSQL Day 2019, in Washington D.C. on May 21st. Abstracts are due April 19th. https://dataworkssummit.com/nosql-day-2019/ Abstracts don't need to be more than a paragraph or two. Please the time sooner than later to submit your

Re: split count for mapreduce jobs with PhoenixInputFormat

, 2019 at 7:31 AM Josh Elser mailto:els...@apache.org>> wrote: You can extend/customize the PhoenixInputFormat with your own code to increase the number of InputSplits and Mappers. On 1/30/19 6:43 AM, Edwin Litterst wrote: > Hi,

Re: split count for mapreduce jobs with PhoenixInputFormat

You can extend/customize the PhoenixInputFormat with your own code to increase the number of InputSplits and Mappers. On 1/30/19 6:43 AM, Edwin Litterst wrote: Hi, I am using PhoenixInputFormat as input source for mapreduce jobs. The split count (which determines how many mappers are used for

Re: Is it possible to do a dynamic deploy of a newer version of Phoenix coprocessor to specific tables?

only be accessing tables with the same Phoenix version. But it maybe that my take has a lot of erroneous assumptions in it, as I haven't looked at the internals of the JDBC driver code. On Mon, 21 Jan 2019 at 18:09, Josh Elser <mailto:els...@apache.org>> wrote: Owen, Th

Re: Is it possible to do a dynamic deploy of a newer version of Phoenix coprocessor to specific tables?

Owen, There would be significant "unwanted side-effects". You would be taking on a very large burden trying to come up with a corresponding client version of Phoenix which would still work against the newer coprocessors that you are trying to deploy. Phoenix doesn't provide any guarantee of

Re: Hbase vs Phienix column names

(from the peanut-gallery) That sounds to me like a useful utility to share with others if you're going to write it anyways, Anil :) On 1/8/19 12:54 AM, Thomas D'Silva wrote: There isn't an existing utility that does that. You would have to look up the COLUMN_QUALIFIER for the columns you are

Re: slf4j class files in phoenix-5.0.0-HBase-2.0-client.jar

Sent from my iPhone > > On Dec 22, 2018, at 9:25 AM, Josh Elser wrote: > > This is as expected. JDBC expects that a database driver provide all of its > dependencies in a single jar file. > > On Mon, Dec 17, 2018 at 4:39 PM Liang Zhao wrote: >> >> Hi, >&g

Re: slf4j class files in phoenix-5.0.0-HBase-2.0-client.jar

This is as expected. JDBC expects that a database driver provide all of its dependencies in a single jar file. On Mon, Dec 17, 2018 at 4:39 PM Liang Zhao wrote: > Hi, > > > > We found slf4j class files in your phoenix-5.0.0-HBase-2.0-client.jar, > which caused multiple binding of slf4j as the

Re: client does not have phoenix.schema.isNamespaceMappingEnabled

.0.1.0-187/hbase/lib/hbase-zookeeper-2.0.0.3.0.1.0-187.jar:/usr/hdp/3.0.1.0-187/hbase/lib/jackson-annotations-2.9.5.jar:/usr/hdp/3.0.1.0-187/hbase/lib/jackson-core-2.9.5.jar On Tue, Nov 27, 2018 at 4:26 PM Josh Elser <mailto:els...@apache.org>> wrote: To add a non-jar file t

Re: client does not have phoenix.schema.isNamespaceMappingEnabled

To add a non-jar file to the classpath of a Java application, you must add the directory containing that file to the classpath. Thus, the following is wrong: HADOOP_CLASSPATH=/usr/hdp/3.0.1.0-187/hbase/lib/hbase-protocol.jar:/etc/hbase/3.0.1.0-187/0/hbase-site.xml And should be:

Re: JDBC Connection URL to Phoenix on Azure HDInsight

Are you trying to use the thick driver (direct HBase connection) or the thin driver (via Phoenix Query Server)? You're providing examples of both. If the thick driver: by default, I believe that HDI configures a root znode of "/hbase" not "/hbase-unsecure" which would be a problem. You need

Re: Heap Size Recommendation

HBASE_HEAPSIZE is just an environment variable which sets the JVM heap size. Your question doesn't make any sense to me. On 11/16/18 8:44 AM, Azharuddin Shaikh wrote: Hi All, We want to improve the read performance of phoenix query for which we are trying to upgrade the HBASE_HEAPSIZE.

Re: Python phoenixdb adapter and JSON serialization on PQS

viously very much interested in understanding how the protobuf path can be made faster. Thanks again for the help! Manoj On Tue, Nov 6, 2018 at 9:51 AM Josh Elser <mailto:els...@apache.org>> wrote: On 11/5/18 10:10 PM, Manoj Ganesan wrote: > Thanks for the pointers

Re: Python phoenixdb adapter and JSON serialization on PQS

e server to run the JDBC oeprations. So, yes: an Avatica client is always using HTTP, given whatever serialization you instruct it to use. I'll work on getting some test cases here soon to illustrate this as well as the performance problem. Thanks again! Manoj On Mon, Nov 5, 2018 at 10:

Re: Python phoenixdb adapter and JSON serialization on PQS

python adapter and not when using sqlline-thin, do they follow different code paths (especially around serialization)? Thanks again, Manoj On Fri, Nov 2, 2018 at 4:05 PM Josh Elser <mailto:els...@apache.org>> wrote: I would strongly suggest you do not use the JSON serialization. T

Re: ABORTING region server and following HBase cluster "crash"

al indexes, not specific to phoenix. I apologize if my response came off as dismissing phoenix altogether. FWIW, I'm a big advocate of phoenix at my org internally, albeit for the newer version. On Fri, Nov 2, 2018, 4:09 PM Josh Elser <mailto:els...@apache.org>> wrote: I woul

Re: ABORTING region server and following HBase cluster "crash"

<mailto:0x62...@gmail.com>> wrote: > > After update web interface at Master show that every region server now 1.4.7 and no RITS. > > Cluster recovered only when we restart all regions servers 4 times... > >> On 11 Sep 2018, at 04:08, Josh Else

Re: Python phoenixdb adapter and JSON serialization on PQS

I would strongly suggest you do not use the JSON serialization. The JSON support is implemented via Jackson which has no means to make backwards compatibility "easy". On the contrast, protobuf makes this extremely easy and we have multiple examples over the past years where we've been able to

Re: Phoenix Performances & Uses Cases

Specifically to your last two points about windowing, transforming, grouping, etc: my current opinion is that Hive does certain analytical style operations much better than Phoenix. Personally, I don't think it makes sense for Phoenix to try to "catch up". It would take years for us to build

Re: Phoenix metrics error on thin client

y, please let me know On Thu, Oct 18, 2018 at 7:00 PM Monil Gandhi mailto:mgand...@gmail.com>> wrote: Okay. Will take a look. Thanks On Wed, Oct 17, 2018 at 8:28 AM Josh Elser mailto:els...@apache.org>> wrote: The methods that you are invoking as

Re: Connection Pooling?

Batyrshin, you asked about statement caching which is different than connection pooling. @JMS, yes, the FAQ is accurate (as is the majority of the rest of the documentation ;)) On 10/18/18 1:14 PM, Batyrshin Alexander wrote: I've already asked the same question in this thread -

Re: Phoenix metrics error on thin client

The methods that you are invoking assume that the Phoenix JDBC driver (the java class org.apache.phoenix.jdbc.PhoenixDriver) is in use. It's not, so you get this error. The Phoenix "thick" JDBC driver is what's running inside of the Phoenix Query Server, just not in your local JVM. As such,

Re: ON DUPLICATE KEY with Global Index

Can you elaborate on what is unclear about the documentation? This exception and the related documentation read as being in support of each other to me. On 10/9/18 5:39 AM, Batyrshin Alexander wrote: Hello all, Documentations (http://phoenix.apache.org/atomic_upsert.html) say: "Although

Re: Specifying HBase cell visibility labels or running as a particular user

Hey Mike, You can definitely authenticate yourself as with the Kerberos credentials of your choice. There are generally two ways in you can do this: 1. Login using UserGroupInformation APIs and then make JDBC calls with the Phoenix JDBC driver (thick or thin) 2. Use the principal+keytab JDBC

Re: Table dead lock: ERROR 1120 (XCL20): Writes to table blocked until index can be updated

HBase will invalidate the location of a Region on seeing certain exceptions (including NotServingRegionException). After it sees the exception you have copied below, it should re-fetch the location of the Region. If HBase keeps trying to access a Region on a RS that isn't hosting it, either

Re: org.apache.phoenix.shaded.org.apache.thrift.TException: Unable to discover transaction service. -> TException: Unable to discover transaction service.

If you're using HBase with Hadoop3, HBase should have Hadoop3 jars. Re-build HBase using the -Dhadoop.profile=3.0 (I think it is) CLI option. On 9/26/18 7:21 AM, Francis Chuang wrote: Upon further investigation, it appears that this is because

  1   2   3   4   >