[ https://issues.apache.org/jira/browse/PIG-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091225#comment-16091225 ]
Jeff Zhang commented on PIG-5080: --------------------------------- [~kellyzly] I linked ZEPPELIN-2232 with this ticket. The purpose and benefit is to allow user combine the advantage of both pig-latin and sql. Pig-latin is suitable for data processing while sql is suitable for ad-hoc query. E.g. user may write a long pig script to convert a raw data to clean data, and then store it in spark table. After that he can use sql to query the data and then visualize the result. > Support store alias as spark table > ---------------------------------- > > Key: PIG-5080 > URL: https://issues.apache.org/jira/browse/PIG-5080 > Project: Pig > Issue Type: New Feature > Components: spark > Affects Versions: 0.16.0 > Reporter: Jeff Zhang > Assignee: Jeff Zhang > Fix For: 0.17.1 > > Attachments: PIG-5080-1.patch, PIG-5080-2.patch > > > The purpose is that I'd like to take advantage of both pig and hive. > Pig-latin has powerful data flow expression ability which is useful for ETL > while hive is good at query. > The scenario is that I'd like to store pig alias as spark temporary table > (cache can be optional). And I have an another spark engine which share the > same SparkContext (in the same JVM) to query the table. > Please close this ticket if it is already supported. I didn't go through all > the features of pig-spark. -- This message was sent by Atlassian JIRA (v6.4.14#64029)