[
https://issues.apache.org/jira/browse/PHOENIX-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872491#comment-15872491
]
James Taylor commented on PHOENIX-2648:
---------------------------------------
[~suman_d123] - [~randerzander]'s idea above is a good one. You can create a
view, defining the dynamic columns during view creation as described here:
http://phoenix.apache.org/views.html. If you want to get rid of columns (i.e.
you don't want a SELECT * ), then you can do an {{ALTER VIEW my_view DROP
COLUMN my_col1, my_col2}} as described here:
http://phoenix.apache.org/language/index.html#alter. Using views is a more sane
way to do this as then Phoenix will track the dynamic columns for you in it's
metadata tables.
Please let us know how that works out, [~xjodoin] & [~xiaopeng-liao].
> Phoenix Spark Integration does not allow Dynamic Columns to be mapped
> ---------------------------------------------------------------------
>
> Key: PHOENIX-2648
> URL: https://issues.apache.org/jira/browse/PHOENIX-2648
> Project: Phoenix
> Issue Type: Bug
> Affects Versions: 4.6.0
> Environment: phoenix-spark-4.6.0-HBase-0.98 ,
> spark-1.5.0-bin-hadoop2.4
> Reporter: Suman Datta
> Assignee: Xiaopeng Liao
> Labels: patch, phoenixTableAsRDD, spark
> Fix For: 4.6.0
>
>
> I am using spark-1.5.0-bin-hadoop2.4 and phoenix-spark-4.6.0-HBase-0.98 to
> load phoenix tables on hbase to Spark RDD. Using the steps in
> https://phoenix.apache.org/phoenix_spark.html, I can successfully map
> standard columns in a table to Phoenix RDD.
> But my table has some important dynamic columns
> (https://phoenix.apache.org/dynamic_columns.html) which are not getting
> mapped to Spark RDD in this process.(using sc.phoenixTableAsRDD)
> This is proving a showstopper for me for using phoenix with spark.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
