[
https://issues.apache.org/jira/browse/PHOENIX-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819114#comment-15819114
]
Nico Pappagianis commented on PHOENIX-3588:
---
[~jmahonin] Any objection
Nico Pappagianis created PHOENIX-3588:
-
Summary: Update Phoenix-Spark integration tests to use Spark 2.0
features instead of 1.x deprecated methods
Key: PHOENIX-3588
URL: https://issues.apache.org/jira/browse
[
https://issues.apache.org/jira/browse/PHOENIX-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752860#comment-15752860
]
Nico Pappagianis commented on PHOENIX-3532:
---
The test
[
https://issues.apache.org/jira/browse/PHOENIX-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752640#comment-15752640
]
Nico Pappagianis commented on PHOENIX-3532:
---
I also ran mvn verify on pho
[
https://issues.apache.org/jira/browse/PHOENIX-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752394#comment-15752394
]
Nico Pappagianis edited comment on PHOENIX-3532 at 12/15/16 8:1
[
https://issues.apache.org/jira/browse/PHOENIX-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752394#comment-15752394
]
Nico Pappagianis edited comment on PHOENIX-3532 at 12/15/16 8:1
[
https://issues.apache.org/jira/browse/PHOENIX-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15752394#comment-15752394
]
Nico Pappagianis commented on PHOENIX-3532:
---
I'm getting the same
[
https://issues.apache.org/jira/browse/PHOENIX-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749464#comment-15749464
]
Nico Pappagianis commented on PHOENIX-3532:
---
Thanks [~jmahonin]
Github user nico-pappagianis commented on a diff in the pull request:
https://github.com/apache/phoenix/pull/226#discussion_r92485510
--- Diff:
phoenix-spark/src/main/scala/org/apache/phoenix/spark/SparkSqlContextFunctions.scala
---
@@ -29,11 +29,13 @@ class
Github user nico-pappagianis commented on a diff in the pull request:
https://github.com/apache/phoenix/pull/226#discussion_r92485493
--- Diff:
phoenix-spark/src/main/scala/org/apache/phoenix/spark/SparkContextFunctions.scala
---
@@ -32,10 +32,10 @@ class SparkContextFunctions
Github user nico-pappagianis commented on a diff in the pull request:
https://github.com/apache/phoenix/pull/226#discussion_r92484983
--- Diff:
phoenix-spark/src/it/scala/org/apache/phoenix/spark/PhoenixSparkITTenantSpecific.scala
---
@@ -19,18 +19,35 @@ import
Github user nico-pappagianis commented on a diff in the pull request:
https://github.com/apache/phoenix/pull/226#discussion_r92484889
--- Diff:
phoenix-spark/src/it/scala/org/apache/phoenix/spark/PhoenixSparkITTenantSpecific.scala
---
@@ -39,62 +56,78 @@ class
Github user nico-pappagianis commented on a diff in the pull request:
https://github.com/apache/phoenix/pull/226#discussion_r92484804
--- Diff:
phoenix-spark/src/it/scala/org/apache/phoenix/spark/AbstractPhoenixSparkIT.scala
---
@@ -46,11 +46,6 @@ class AbstractPhoenixSparkIT
Github user nico-pappagianis commented on a diff in the pull request:
https://github.com/apache/phoenix/pull/226#discussion_r92484705
--- Diff: phoenix-spark/src/it/resources/tenantSetup.sql ---
@@ -15,3 +15,4 @@
-- limitations under the License.
CREATE VIEW IF NOT
GitHub user nico-pappagianis opened a pull request:
https://github.com/apache/phoenix/pull/226
Pass tenantId parameter to PhoenixRDD when reading tables
- Added corresponding tests
- Cleaned up some test code
You can merge this pull request into a Git repository by running
[
https://issues.apache.org/jira/browse/PHOENIX-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15747295#comment-15747295
]
Nico Pappagianis commented on PHOENIX-3532:
---
Hey [~jmahonin],
I realized
Nico Pappagianis created PHOENIX-3532:
-
Summary: Enable DataFrames and RDDs to read from a tenant-specific
table
Key: PHOENIX-3532
URL: https://issues.apache.org/jira/browse/PHOENIX-3532
Project
Github user nico-pappagianis commented on the issue:
https://github.com/apache/phoenix/pull/221
Looks like everything's there.
Oh sorry about the white space - I must have hit IntelliJ auto format
shortcut.
Thanks again for all the help!
On Thursday, Nov
Github user nico-pappagianis commented on the issue:
https://github.com/apache/phoenix/pull/221
Thanks James. I did the following:
from my local branch:
git pull --rebase origin master
git push origin multiTenantSaveToPhoenixRDDFix
On
Github user nico-pappagianis commented on a diff in the pull request:
https://github.com/apache/phoenix/pull/221#discussion_r87472913
--- Diff:
phoenix-spark/src/main/scala/org/apache/phoenix/spark/ProductRDDFunctions.scala
---
@@ -16,19 +16,20 @@ package org.apache.phoenix.spark
Github user nico-pappagianis commented on a diff in the pull request:
https://github.com/apache/phoenix/pull/221#discussion_r87470431
--- Diff:
phoenix-spark/src/main/scala/org/apache/phoenix/spark/ProductRDDFunctions.scala
---
@@ -16,19 +16,20 @@ package org.apache.phoenix.spark
Github user nico-pappagianis commented on a diff in the pull request:
https://github.com/apache/phoenix/pull/221#discussion_r87291460
--- Diff:
phoenix-spark/src/main/scala/org/apache/phoenix/spark/ProductRDDFunctions.scala
---
@@ -16,19 +16,20 @@ package org.apache.phoenix.spark
Github user nico-pappagianis commented on the issue:
https://github.com/apache/phoenix/pull/221
@jmahonin I've added a couple tests for DataFrames and refactored the test
code a bit. Thanks for looking at this again.
---
If your project is set up for it, you can reply to this
[
https://issues.apache.org/jira/browse/PHOENIX-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15648637#comment-15648637
]
Nico Pappagianis commented on PHOENIX-3427:
---
Thanks Josh. I implemented
GitHub user nico-pappagianis opened a pull request:
https://github.com/apache/phoenix/pull/221
PHOENIX-3427 fix saveToRdd for tenant-specific connections
@JamesRTaylor @jmahonin
Here is the fix for writing to tenant-specific objects via RDDs.
I added an optional
[
https://issues.apache.org/jira/browse/PHOENIX-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637383#comment-15637383
]
Nico Pappagianis commented on PHOENIX-3427:
---
[~jmahonin] Congratulat
[
https://issues.apache.org/jira/browse/PHOENIX-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15627257#comment-15627257
]
Nico Pappagianis commented on PHOENIX-3427:
---
Here is the stack trace.
[
https://issues.apache.org/jira/browse/PHOENIX-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nico Pappagianis updated PHOENIX-3427:
--
Comment: was deleted
(was: The problem appears to be with the call to
[
https://issues.apache.org/jira/browse/PHOENIX-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622798#comment-15622798
]
Nico Pappagianis commented on PHOENIX-3427:
---
The problem appears to be
Nico Pappagianis created PHOENIX-3427:
-
Summary: rdd.saveToPhoenix gives table undefined error when
attempting to write to a tenant-specific view (TenantId defined in
configuration object and passed to saveToPhoenix)
Key
Hello all,
I've been doing some experimenting trying to get Phoenix-Spark to
read/write from a tenant specific view but have had no success. Judging by
the docs and from the source code I've looked at I haven't found any
options for connecting as the tenant, which is required when interacting
with
pears then
that there is no way to connect as a tenant with phoenix-spark integration,
and therefore we cannot view a tenant-specific table.
Is this correct?
On Fri, Oct 7, 2016 at 1:28 PM, Nico Pappagianis <
nico.pappagia...@salesforce.com> wrote:
> Thanks Josh,
> The above works for mu
nd then you can use something like:
>
> df.write
> .format("org.apache.phoenix.spark")
> .mode("overwrite")
> .option("table", "...")
> .option("zkUrl", "...")
> .save()
>
> Or for RDDs:
&
Hi Josh just saw your post. Let me take a look at that stack overflow post
you linked. Could you elaborate on how you pass TenantID manually?
Thanks
On Fri, Oct 7, 2016 at 11:27 AM, Nico Pappagianis <
nico.pappagia...@salesforce.com> wrote:
> Thanks James,
>
> I am able to read
the phoenix-spark integration propagates connection properties,
> but an alternate way of specifying the tenant ID is through that mechanism
> (which would workaround the URL building issue).
>
> On Fri, Oct 7, 2016 at 10:06 AM, Nico Pappagianis <
> nico.pappagia...@salesforc
on property is being propagated down to the Phoenix connection
> opened for the Spark integration?
> Thanks,
> James
>
> On Thu, Oct 6, 2016 at 8:36 PM, Nico Pappagianis <
> nico.pappagia...@salesforce.com> wrote:
>
> > Does phoenix-spark integration support multitenancy? I'm having a hard
> time
> > getting it working on my tenant-specific view.
> >
> > Thanks
> >
>
Does phoenix-spark integration support multitenancy? I'm having a hard time
getting it working on my tenant-specific view.
Thanks
Solved:
Looks like I just needed a quote preceding the quotes I wanted in the
string, i.e. """ENTITY.""z02"""""
Strange, because when using the sqlContext the string only needed to be of
the form """ENTITY."z02&q
Hello all,
I have a scala script that references a phoenix table called
ENTITY."tableName" including the quotation marks.
When I try to read from the table and load into an RDD via:
val table = """ENTITY."z02
val nameCol = "colName"
val rdd: RDD[Map[String, AnyRef]] = sc.phoenixTableAsRDD(
39 matches
Mail list logo
