Ryan Lovett created SPARK-26242:
---
Summary: Leading slash breaks proxying
Key: SPARK-26242
URL: https://issues.apache.org/jira/browse/SPARK-26242
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-26189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-26189.
--
Resolution: Fixed
Assignee: Huaxin Gao
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-26221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705626#comment-16705626
]
Apache Spark commented on SPARK-26221:
--
User 'rxin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-26221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705627#comment-16705627
]
Apache Spark commented on SPARK-26221:
--
User 'rxin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-26226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705629#comment-16705629
]
Apache Spark commented on SPARK-26226:
--
User 'rxin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-26221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26221:
Assignee: Apache Spark (was: Reynold Xin)
> Improve Spark SQL instrumentation and
[
https://issues.apache.org/jira/browse/SPARK-26221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26221:
Assignee: Reynold Xin (was: Apache Spark)
> Improve Spark SQL instrumentation and
[
https://issues.apache.org/jira/browse/SPARK-26226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-26226.
-
Resolution: Fixed
Fix Version/s: 3.0.0
> Update query tracker to report timeline for
Reynold Xin created SPARK-26241:
---
Summary: Add queryId to IncrementalExecution
Key: SPARK-26241
URL: https://issues.apache.org/jira/browse/SPARK-26241
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-26241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-26241:
Issue Type: Sub-task (was: Bug)
Parent: SPARK-26221
> Add queryId to
[
https://issues.apache.org/jira/browse/SPARK-26219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705620#comment-16705620
]
Apache Spark commented on SPARK-26219:
--
User 'shahidki31' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-23647:
-
Fix Version/s: 3.0.0
> extend hint syntax to support any expression for Python
>
[
https://issues.apache.org/jira/browse/SPARK-23647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-23647:
Assignee: Dylan Guedes
> extend hint syntax to support any expression for Python
>
[
https://issues.apache.org/jira/browse/SPARK-23647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-23647.
--
Resolution: Fixed
Issue resolved by pull request 20788
[
https://issues.apache.org/jira/browse/SPARK-21030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-21030.
--
Resolution: Done
> extend hint syntax to support any expression for Python and R
>
[
https://issues.apache.org/jira/browse/SPARK-25876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah resolved SPARK-25876.
Resolution: Fixed
Fix Version/s: 3.0.0
> Simplify configuration types in k8s backend
>
[
https://issues.apache.org/jira/browse/SPARK-26219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-26219.
Resolution: Fixed
Assignee: shahid
Fix Version/s: 3.0.0
> Executor
[
https://issues.apache.org/jira/browse/SPARK-26225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705373#comment-16705373
]
Thincrs commented on SPARK-26225:
-
A user of thincrs has selected this issue. Deadline: Fri, Dec 7, 2018
Ying Wang created SPARK-26240:
-
Summary: [pyspark] Updating illegal column names with
withColumnRenamed does not change schema changes, causing
pyspark.sql.utils.AnalysisException
Key: SPARK-26240
URL:
[
https://issues.apache.org/jira/browse/SPARK-26188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705307#comment-16705307
]
Damien Doucet-Girard commented on SPARK-26188:
--
[~ste...@apache.org] thanks for the tip, I
[
https://issues.apache.org/jira/browse/SPARK-23078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705282#comment-16705282
]
Marcelo Vanzin commented on SPARK-23078:
Is this actually needed now that k8s supports client
[
https://issues.apache.org/jira/browse/SPARK-26239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705277#comment-16705277
]
Marcelo Vanzin commented on SPARK-26239:
That can work but it doesn't address the 3rd bullet.
>
[
https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705269#comment-16705269
]
Dongjoon Hyun commented on SPARK-25145:
---
I used your configuration `zerocopy` like the followings
[
https://issues.apache.org/jira/browse/SPARK-26237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705275#comment-16705275
]
Qi Shao commented on SPARK-26237:
-
Figured out that if pyspark configs needs to be done before running
[
https://issues.apache.org/jira/browse/SPARK-26237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Qi Shao resolved SPARK-26237.
-
Resolution: Invalid
> [K8s] Unable to switch python version in executor when running pyspark client
>
[
https://issues.apache.org/jira/browse/SPARK-26239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705273#comment-16705273
]
Matt Cheah edited comment on SPARK-26239 at 11/30/18 8:59 PM:
--
Could we add
[
https://issues.apache.org/jira/browse/SPARK-26239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705273#comment-16705273
]
Matt Cheah commented on SPARK-26239:
Would a simple addition just to point to file paths for the
[
https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-25145.
---
Resolution: Cannot Reproduce
> Buffer size too small on spark.sql query with filterPushdown
[
https://issues.apache.org/jira/browse/SPARK-26239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705236#comment-16705236
]
Thincrs commented on SPARK-26239:
-
A user of thincrs has selected this issue. Deadline: Fri, Dec 7, 2018
[
https://issues.apache.org/jira/browse/SPARK-26200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler resolved SPARK-26200.
--
Resolution: Duplicate
> Column values are incorrectly transposed when a field in a PySpark
[
https://issues.apache.org/jira/browse/SPARK-26200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705224#comment-16705224
]
Bryan Cutler commented on SPARK-26200:
--
Thanks [~davidlyness], I'll mark this as a duplicate since
[
https://issues.apache.org/jira/browse/SPARK-21453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705222#comment-16705222
]
Julian commented on SPARK-21453:
I also get the following error around the same time (shortly after
[
https://issues.apache.org/jira/browse/SPARK-21453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705215#comment-16705215
]
Julian commented on SPARK-21453:
I see this issue is still open (although no one has posted here for a
Ilan Filonenko created SPARK-26238:
--
Summary: Set SPARK_CONF_DIR to be ${SPARK_HOME}/conf for K8S
Key: SPARK-26238
URL: https://issues.apache.org/jira/browse/SPARK-26238
Project: Spark
Marcelo Vanzin created SPARK-26239:
--
Summary: Add configurable auth secret source in k8s backend
Key: SPARK-26239
URL: https://issues.apache.org/jira/browse/SPARK-26239
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-26201.
---
Resolution: Fixed
Assignee: Sanket Chintapalli
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-26237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Qi Shao updated SPARK-26237:
Summary: [K8s] Unable to switch python version in executor when running
pyspark client (was: [K8s]
Qi Shao created SPARK-26237:
---
Summary: [K8s] Unable to switch python version in executor when
running pyspark shell.
Key: SPARK-26237
URL: https://issues.apache.org/jira/browse/SPARK-26237
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705045#comment-16705045
]
Marcelo Vanzin commented on SPARK-26043:
It would be better if you can show what you mean with
[
https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705005#comment-16705005
]
Dongjoon Hyun commented on SPARK-25145:
---
Thank you for the enriching the information. I'll try to
[
https://issues.apache.org/jira/browse/SPARK-26214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704978#comment-16704978
]
Thomas Decaux edited comment on SPARK-26214 at 11/30/18 4:24 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-26214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704978#comment-16704978
]
Thomas Decaux commented on SPARK-26214:
---
Well, not so different :
{code:java}
public void
[
https://issues.apache.org/jira/browse/SPARK-26214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704958#comment-16704958
]
Marco Gaido commented on SPARK-26214:
-
I don't think it is really the same. I don't think it is a
Gabor Somogyi created SPARK-26236:
-
Summary: Kafka delegation token support documentation
Key: SPARK-26236
URL: https://issues.apache.org/jira/browse/SPARK-26236
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704926#comment-16704926
]
Ian O Connell commented on SPARK-26043:
---
Dumping into a map though would leak it into the API of
[
https://issues.apache.org/jira/browse/SPARK-26236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704903#comment-16704903
]
Gabor Somogyi commented on SPARK-26236:
---
Started to work on this.
> Kafka delegation token
[
https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704877#comment-16704877
]
Sean Owen commented on SPARK-26043:
---
I see. Typically you'd just instantiate Configuration and it
[
https://issues.apache.org/jira/browse/SPARK-25857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704894#comment-16704894
]
Gabor Somogyi commented on SPARK-25857:
---
+1, it's not easy topic.
> Document delegation token
[
https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704869#comment-16704869
]
Ian O Connell commented on SPARK-26043:
---
I can't use the hadoopConfiguration from the spark
[
https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704864#comment-16704864
]
Ian O Connell commented on SPARK-26043:
---
[~srowen] i just edited the comment right this sec to add
[
https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704829#comment-16704829
]
Ian O Connell edited comment on SPARK-26043 at 11/30/18 3:02 PM:
-
With
[
https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704856#comment-16704856
]
Sean Owen commented on SPARK-26043:
---
What is the use case for that? I think this class was intended to
[
https://issues.apache.org/jira/browse/SPARK-26200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704839#comment-16704839
]
David Lyness commented on SPARK-26200:
--
Yep, I believe the root cause for this and SPARK-24915 are
[
https://issues.apache.org/jira/browse/SPARK-26234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joby Joje closed SPARK-26234.
-
A card SPARK-20845 is already in place to resolve this, hence closing the
ticket.
> Column list
[
https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704829#comment-16704829
]
Ian O Connell commented on SPARK-26043:
---
With this change it makes it difficult to get a fully
[
https://issues.apache.org/jira/browse/SPARK-26235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26235:
Assignee: Apache Spark
> Change log level for
[
https://issues.apache.org/jira/browse/SPARK-26235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704821#comment-16704821
]
Apache Spark commented on SPARK-26235:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-26235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26235:
Assignee: (was: Apache Spark)
> Change log level for
[
https://issues.apache.org/jira/browse/SPARK-26188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704804#comment-16704804
]
Steve Loughran commented on SPARK-26188:
bq. > My team uses spark to partition and output
Gengliang Wang created SPARK-26235:
--
Summary: Change log level for
ClassNotFoundException/NoClassDefFoundError in SparkSubmit to Error
Key: SPARK-26235
URL: https://issues.apache.org/jira/browse/SPARK-26235
[
https://issues.apache.org/jira/browse/SPARK-26234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-26234.
-
Resolution: Duplicate
> Column list specification in INSERT statement
>
[
https://issues.apache.org/jira/browse/SPARK-26198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-26198:
--
Priority: Minor (was: Major)
> Metadata serialize null values throw NPE
>
[
https://issues.apache.org/jira/browse/SPARK-26232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros resolved SPARK-26232.
Resolution: Won't Fix
One of the third party tool uses Netty3, so as a transitive
[
https://issues.apache.org/jira/browse/SPARK-26234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joby Joje updated SPARK-26234:
--
Description:
While trying to OVERWRITE the Hive table with specific columns from
Spark(Pyspark)
[
https://issues.apache.org/jira/browse/SPARK-26234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joby Joje updated SPARK-26234:
--
Description:
While trying to OVERWRITE the Hive table with specific columns from
Spark(Pyspark)
Joby Joje created SPARK-26234:
-
Summary: Column list specification in INSERT statement
Key: SPARK-26234
URL: https://issues.apache.org/jira/browse/SPARK-26234
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-26232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26232:
Assignee: Apache Spark
> Remove old Netty3 dependency from the build
>
Miquel created SPARK-26233:
--
Summary: Incorrect decimal value with java beans and
first/last/max... functions
Key: SPARK-26233
URL: https://issues.apache.org/jira/browse/SPARK-26233
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704700#comment-16704700
]
Apache Spark commented on SPARK-26232:
--
User 'attilapiros' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-26232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26232:
Assignee: (was: Apache Spark)
> Remove old Netty3 dependency from the build
>
[
https://issues.apache.org/jira/browse/SPARK-26232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704699#comment-16704699
]
Apache Spark commented on SPARK-26232:
--
User 'attilapiros' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-26232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-26232:
---
Summary: Remove old Netty3 dependency from the build (was: Remove old
Netty3
Attila Zsolt Piros created SPARK-26232:
--
Summary: Remove old Netty3 artifact from the build
Key: SPARK-26232
URL: https://issues.apache.org/jira/browse/SPARK-26232
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-24661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704668#comment-16704668
]
Oleg V Korchagin commented on SPARK-24661:
--
Why PySpark in components list?
> Window API -
[
https://issues.apache.org/jira/browse/SPARK-26211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704591#comment-16704591
]
Apache Spark commented on SPARK-26211:
--
User 'ueshin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-26211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704590#comment-16704590
]
Apache Spark commented on SPARK-26211:
--
User 'ueshin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bjørnar Jensen reopened SPARK-25145:
New information that I believe will make it reproducible:
The "zerocopy" option is what
Shrikant created SPARK-26231:
Summary: Dataframes inner join on double datatype columns
resulting in Cartesian product
Key: SPARK-26231
URL: https://issues.apache.org/jira/browse/SPARK-26231
Project:
[
https://issues.apache.org/jira/browse/SPARK-26214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704475#comment-16704475
]
Thomas Decaux edited comment on SPARK-26214 at 11/30/18 9:32 AM:
-
Sure,
[
https://issues.apache.org/jira/browse/SPARK-26214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704475#comment-16704475
]
Thomas Decaux commented on SPARK-26214:
---
Sure, it's already to do this (like I said).
The same
Gengliang Wang created SPARK-26230:
--
Summary: FileIndex: if case sensitive, validate partitions with
original column names
Key: SPARK-26230
URL: https://issues.apache.org/jira/browse/SPARK-26230
[
https://issues.apache.org/jira/browse/SPARK-26230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26230:
Assignee: (was: Apache Spark)
> FileIndex: if case sensitive, validate partitions
[
https://issues.apache.org/jira/browse/SPARK-26230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704470#comment-16704470
]
Apache Spark commented on SPARK-26230:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-26230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26230:
Assignee: Apache Spark
> FileIndex: if case sensitive, validate partitions with original
[
https://issues.apache.org/jira/browse/SPARK-26229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ranjith Pulluru updated SPARK-26229:
Component/s: (was: Spark Core)
> Expose SizeEstimator as a developer API in pyspark
>
[
https://issues.apache.org/jira/browse/SPARK-26229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ranjith Pulluru updated SPARK-26229:
Description:
SizeEstmator is not available in pyspark.
This api will be helpful for
Ranjith Pulluru created SPARK-26229:
---
Summary: Expose SizeEstimator as a developer API in pyspark
Key: SPARK-26229
URL: https://issues.apache.org/jira/browse/SPARK-26229
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-25528.
-
Resolution: Fixed
Fix Version/s: 3.0.0
> data source V2 API refactoring (batch read)
>
88 matches
Mail list logo
