[jira] [Commented] (SPARK-40657) Add support for compiled classes (Java classes)

2022-11-16 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-40657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635082#comment-17635082
 ] 

Apache Spark commented on SPARK-40657:
--

User 'rangadi' has created a pull request for this issue:
https://github.com/apache/spark/pull/38680

> Add support for compiled classes (Java classes)
> ---
>
> Key: SPARK-40657
> URL: https://issues.apache.org/jira/browse/SPARK-40657
> Project: Spark
>  Issue Type: Improvement
>  Components: Protobuf, Structured Streaming
>Affects Versions: 3.3.0
>Reporter: Raghu Angadi
>Assignee: Raghu Angadi
>Priority: Major
> Fix For: 3.4.0
>
>
> For some users, it is more convenient to provide compiled classes rather than 
> a descriptor file. 
> We can support java compiled classes. Python could also use the same since 
> all the processing happens in Scala.
> Supporting python compiled classes is out-of-scope for this. It is not clear 
> how well we can support that, short of using python UDF. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-40657) Add support for compiled classes (Java classes)

2022-10-24 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-40657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17623577#comment-17623577
 ] 

Apache Spark commented on SPARK-40657:
--

User 'rangadi' has created a pull request for this issue:
https://github.com/apache/spark/pull/38384

> Add support for compiled classes (Java classes)
> ---
>
> Key: SPARK-40657
> URL: https://issues.apache.org/jira/browse/SPARK-40657
> Project: Spark
>  Issue Type: Improvement
>  Components: Protobuf, Structured Streaming
>Affects Versions: 3.3.0
>Reporter: Raghu Angadi
>Assignee: Raghu Angadi
>Priority: Major
> Fix For: 3.4.0
>
>
> For some users, it is more convenient to provide compiled classes rather than 
> a descriptor file. 
> We can support java compiled classes. Python could also use the same since 
> all the processing happens in Scala.
> Supporting python compiled classes is out-of-scope for this. It is not clear 
> how well we can support that, short of using python UDF. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-40657) Add support for compiled classes (Java classes)

2022-10-24 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-40657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17623576#comment-17623576
 ] 

Apache Spark commented on SPARK-40657:
--

User 'rangadi' has created a pull request for this issue:
https://github.com/apache/spark/pull/38384

> Add support for compiled classes (Java classes)
> ---
>
> Key: SPARK-40657
> URL: https://issues.apache.org/jira/browse/SPARK-40657
> Project: Spark
>  Issue Type: Improvement
>  Components: Protobuf, Structured Streaming
>Affects Versions: 3.3.0
>Reporter: Raghu Angadi
>Assignee: Raghu Angadi
>Priority: Major
> Fix For: 3.4.0
>
>
> For some users, it is more convenient to provide compiled classes rather than 
> a descriptor file. 
> We can support java compiled classes. Python could also use the same since 
> all the processing happens in Scala.
> Supporting python compiled classes is out-of-scope for this. It is not clear 
> how well we can support that, short of using python UDF. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-40657) Add support for compiled classes (Java classes)

2022-10-17 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-40657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17619012#comment-17619012
 ] 

Apache Spark commented on SPARK-40657:
--

User 'rangadi' has created a pull request for this issue:
https://github.com/apache/spark/pull/38286

> Add support for compiled classes (Java classes)
> ---
>
> Key: SPARK-40657
> URL: https://issues.apache.org/jira/browse/SPARK-40657
> Project: Spark
>  Issue Type: Improvement
>  Components: Protobuf, Structured Streaming
>Affects Versions: 3.3.0
>Reporter: Raghu Angadi
>Priority: Major
>
> For some users, it is more convenient to provide compiled classes rather than 
> a descriptor file. 
> We can support java compiled classes. Python could also use the same since 
> all the processing happens in Scala.
> Supporting python compiled classes is out-of-scope for this. It is not clear 
> how well we can support that, short of using python UDF. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-40657) Add support for compiled classes (Java classes)

2022-10-17 Thread Apache Spark (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-40657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17619013#comment-17619013
 ] 

Apache Spark commented on SPARK-40657:
--

User 'rangadi' has created a pull request for this issue:
https://github.com/apache/spark/pull/38286

> Add support for compiled classes (Java classes)
> ---
>
> Key: SPARK-40657
> URL: https://issues.apache.org/jira/browse/SPARK-40657
> Project: Spark
>  Issue Type: Improvement
>  Components: Protobuf, Structured Streaming
>Affects Versions: 3.3.0
>Reporter: Raghu Angadi
>Priority: Major
>
> For some users, it is more convenient to provide compiled classes rather than 
> a descriptor file. 
> We can support java compiled classes. Python could also use the same since 
> all the processing happens in Scala.
> Supporting python compiled classes is out-of-scope for this. It is not clear 
> how well we can support that, short of using python UDF. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-40657) Add support for compiled classes (Java classes)

2022-10-12 Thread Raghu Angadi (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-40657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616711#comment-17616711
 ] 

Raghu Angadi commented on SPARK-40657:
--

I will add this. 

cc: [~sanysand...@gmail.com] [~mposdev21] 

> Add support for compiled classes (Java classes)
> ---
>
> Key: SPARK-40657
> URL: https://issues.apache.org/jira/browse/SPARK-40657
> Project: Spark
>  Issue Type: Improvement
>  Components: Structured Streaming
>Affects Versions: 3.3.0
>Reporter: Raghu Angadi
>Priority: Major
>
> For some users, it is more convenient to provide compiled classes rather than 
> a descriptor file. 
> We can support java compiled classes. Python could also use the same since 
> all the processing happens in Scala.
> Supporting python compiled classes is out-of-scope for this. It is not clear 
> how well we can support that, short of using python UDF. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org