[
https://issues.apache.org/jira/browse/SPARK-36283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen resolved SPARK-36283.
Resolution: Duplicate
> Bug when creating dataframe without schema and with Arrow disabled
>
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17387883#comment-17387883
]
Darcy Shen commented on SPARK-35211:
Updated
> Bug when creating dataframe without schema and with
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Summary: Bug when creating dataframe without schema and with Arrow disabled
(was: Support UDT for
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Description:
A reproducible small repo can be found here:
[
https://issues.apache.org/jira/browse/SPARK-36283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-36283:
---
External issue URL: (was:
https://issues.apache.org/jira/browse/SPARK-35211)
> Bug when creating
[
https://issues.apache.org/jira/browse/SPARK-36283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-36283:
---
External issue URL: https://issues.apache.org/jira/browse/SPARK-35211
> Bug when creating dataframe
[
https://issues.apache.org/jira/browse/SPARK-36283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-36283:
---
Description:
A reproducible small repo can be found here:
[
https://issues.apache.org/jira/browse/SPARK-36283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-36283:
---
Description:
h2. Case 1: Create PySpark Dataframe using Pandas DataFrame with Arrow
disabled and
[
https://issues.apache.org/jira/browse/SPARK-36283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-36283:
---
Description:
h2. Case 1
Create PySpark Dataframe using Pandas DataFrame with Arrow disabled and
[
https://issues.apache.org/jira/browse/SPARK-36283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-36283:
---
Description:
h2. Case 1
{code:python}
spark = SparkSession.builder.getOrCreate()
Darcy Shen created SPARK-36283:
--
Summary: Bug when creating dataframe without schema and with Arrow
disabled
Key: SPARK-36283
URL: https://issues.apache.org/jira/browse/SPARK-36283
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
External issue URL: (was: https://github.com/apache/spark/pull/32320)
> Support UDT for Pandas
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
External issue URL: https://github.com/apache/spark/pull/32320
> Support UDT for Pandas with Arrow
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Labels: correctness (was: )
> Support UDT for Pandas with Arrow Disabled
>
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331175#comment-17331175
]
Darcy Shen commented on SPARK-35211:
Provided with schema, strict type check will be performed:
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Description:
{code:java}
$ pip freeze
certifi==2020.12.5
coverage==5.5
flake8==3.9.0
mccabe==0.6.1
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331170#comment-17331170
]
Darcy Shen edited comment on SPARK-35211 at 4/24/21, 8:52 AM:
--
With schema
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331170#comment-17331170
]
Darcy Shen commented on SPARK-35211:
With schema provided, it works fine.
{code}
(spark) ➜ spark
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Description:
{code:java}
$ pip freeze
certifi==2020.12.5
coverage==5.5
flake8==3.9.0
mccabe==0.6.1
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Description:
{code:java}
$ pip freeze
certifi==2020.12.5
coverage==5.5
flake8==3.9.0
mccabe==0.6.1
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Description:
{code:java}
pip freeze
certifi==2020.12.5
coverage==5.5
flake8==3.9.0
mccabe==0.6.1
[
https://issues.apache.org/jira/browse/SPARK-35211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-35211:
---
Parent: SPARK-34600
Issue Type: Sub-task (was: Bug)
> Support UDT for Pandas with Arrow
Darcy Shen created SPARK-35211:
--
Summary: Support UDT for Pandas with Arrow Disabled
Key: SPARK-35211
URL: https://issues.apache.org/jira/browse/SPARK-35211
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-34799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34799:
---
Summary: Return UDT from Pandas UDF: @pandas_udf(UDT) (was: Return
User-defined types from Pandas
[
https://issues.apache.org/jira/browse/SPARK-34799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34799:
---
Description:
Focus on a simpler case first: `@pandas_udf(UDT)`.
Because Pandas UDF uses pyarrow
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Summary: Support UDT for Pandas/Spark convertion with Arrow support Enabled
(was: Support UDT for
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Summary: Support UDT for Pandas/Spark conversion with Arrow support Enabled
(was: Support UDT for
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Summary: Support UDT for Pandas/Spark convertion with Arrow Enabled (was:
Support UDT for
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Summary: Support UDT for Pandas/Spark convertion with Arrow Optimization
(was: Support UDT for
[
https://issues.apache.org/jira/browse/SPARK-34835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34835:
---
Description:
For user defined type with TimestampType, conversion from pandas to pyarrow and
from
[
https://issues.apache.org/jira/browse/SPARK-34835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34835:
---
Description:
For user defined type with TimestampType, conversion from pandas to pyarrow and
from
[
https://issues.apache.org/jira/browse/SPARK-34835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34835:
---
Description:
For user defined type with TimestampType, conversion from pandas to pyarrow and
from
[
https://issues.apache.org/jira/browse/SPARK-34835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34835:
---
Description:
For user defined type with TimestampType, conversion from pandas to pyarrow and
from
[
https://issues.apache.org/jira/browse/SPARK-34835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34835:
---
Description:
For user defined type with TimestampType, conversion from pandas to pyarrow and
from
[
https://issues.apache.org/jira/browse/SPARK-34835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34835:
---
Description:
For user defined type with TimestampType, conversion from pandas to pyarrow and
from
[
https://issues.apache.org/jira/browse/SPARK-34835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34835:
---
Description: For user defined type with TimestampType, conversion from
pandas to pyarrow and from
Darcy Shen created SPARK-34835:
--
Summary: Support TimestampType in UDT
Key: SPARK-34835
URL: https://issues.apache.org/jira/browse/SPARK-34835
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304606#comment-17304606
]
Darcy Shen edited comment on SPARK-34600 at 3/19/21, 3:14 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304606#comment-17304606
]
Darcy Shen commented on SPARK-34600:
[~hyukjin.kwon][~eddyxu]
Let me move the PR to the
[
https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34600:
---
Description: This is an umbrella ticket. (was: Because Pandas UDF uses
pyarrow to passing data, it
[
https://issues.apache.org/jira/browse/SPARK-34799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34799:
---
Description:
Because Pandas UDF uses pyarrow to passing data, it does not currently support
Darcy Shen created SPARK-34799:
--
Summary: Return User-defined types from Pandas UDF
Key: SPARK-34799
URL: https://issues.apache.org/jira/browse/SPARK-34799
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
{code:python}
spark.conf.set("spark.sql.execution.arrow.enabled", "true")
from
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
{code:python}
spark.conf.set("spark.sql.execution.arrow.enabled", "true")
from
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
{code:python}
spark.conf.set("spark.sql.execution.arrow.enabled", "true")
from
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
{code:python}
spark.conf.set("spark.sql.execution.arrow.enabled", "true")
from
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
{code:python}
$ bin/pyspark
Python 3.8.8 (default, Feb 24 2021, 13:46:16)
[Clang
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
{code:python}
$ bin/pyspark
Python 3.8.8 (default, Feb 24 2021, 13:46:16)
[Clang
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Summary: Support UDT for Pandas with Arrow Optimization (was: Support UDT
for Pandas)
> Support
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
{code:python}
$ bin/pyspark
Python 3.8.8 (default, Feb 24 2021, 13:46:16)
[Clang
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
(spark) ➜ spark git:(SPARK_34771) ✗ bin/pyspark
Python 3.8.8 (default, Feb 24 2021,
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
(spark) ➜ spark git:(SPARK_34771) ✗ bin/pyspark
Python 3.8.8 (default, Feb 24 2021,
[
https://issues.apache.org/jira/browse/SPARK-34771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-34771:
---
Description:
(spark) ➜ spark git:(SPARK_34771) ✗ bin/pyspark
Python 3.8.8 (default, Feb 24 2021,
Darcy Shen created SPARK-34771:
--
Summary: Support UDT for Pandas
Key: SPARK-34771
URL: https://issues.apache.org/jira/browse/SPARK-34771
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Description:
This may be the first failed build:
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Description:
This may be the first failed build:
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Description:
This may be the first failed build:
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Description:
This may be the first failed build:
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Description:
This may be the first failed build:
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Description:
This may be the first failed build:
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Description:
This may be the first failed build:
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Description:
This may be the first failed build:
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Description:
This may be the first failed build:
[
https://issues.apache.org/jira/browse/SPARK-33894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-33894:
---
Parent: SPARK-25075
Issue Type: Sub-task (was: Test)
> Word2VecSuite failed for Scala 2.13
Darcy Shen created SPARK-33894:
--
Summary: Word2VecSuite failed for Scala 2.13
Key: SPARK-33894
URL: https://issues.apache.org/jira/browse/SPARK-33894
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248259#comment-17248259
]
Darcy Shen commented on SPARK-32526:
ExpressionEncoderSuite still fails to work:
[
https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247693#comment-17247693
]
Darcy Shen commented on SPARK-33044:
[
https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247687#comment-17247687
]
Darcy Shen commented on SPARK-33044:
Awesome!
> Add a Jenkins build and test job for Scala 2.13
>
[
https://issues.apache.org/jira/browse/SPARK-33348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235462#comment-17235462
]
Darcy Shen commented on SPARK-33348:
Would better keep it until Apache Spark switches to Scala 2.13
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-21708:
---
Affects Version/s: 2.4.0
> use sbt 1.x
> ---
>
> Key: SPARK-21708
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Description:
DecimalType Literal should not be casted to Long.
eg. For `df.filter("x < 3.14")`,
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Priority: Blocker (was: Major)
> Incorrect Literal Casting of DecimalType in OrcFilters
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Target Version/s: (was: 2.4.1)
> Incorrect Literal Casting of DecimalType in OrcFilters
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Fix Version/s: 3.0.0
> Incorrect Literal Casting of DecimalType in OrcFilters
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Fix Version/s: 2.4.1
> Incorrect Literal Casting of DecimalType in OrcFilters
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Labels: correctness (was: )
> Incorrect Literal Casting of DecimalType in OrcFilters
>
[
https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-27160:
---
Target Version/s: 2.4.1
> Incorrect Literal Casting of DecimalType in OrcFilters
>
Darcy Shen created SPARK-27160:
--
Summary: Incorrect Literal Casting of DecimalType in OrcFilters
Key: SPARK-27160
URL: https://issues.apache.org/jira/browse/SPARK-27160
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-26885:
---
Summary: Remove /-[d]d format in DataTimeUtils for
stringToTimestamp and stringToDate
Darcy Shen created SPARK-26885:
--
Summary: Remove format in DataTimeUtils for stringToTimestamp
and stringToDate
Key: SPARK-26885
URL: https://issues.apache.org/jira/browse/SPARK-26885
Project:
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748705#comment-16748705
]
Darcy Shen commented on SPARK-21708:
I tried to use sbt 1.x, but failed on the sbt externalPom
[
https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16718981#comment-16718981
]
Darcy Shen commented on SPARK-26132:
[~srowen]
I'm adding subtasks for
[
https://issues.apache.org/jira/browse/SPARK-26338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-26338:
---
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-25075
> Use scala-xml explicitly
>
[
https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-25075:
---
Issue Type: Umbrella (was: Bug)
> Build and test Spark against Scala 2.13
>
[
https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-25075:
---
Issue Type: Bug (was: Sub-task)
Parent: (was: SPARK-26338)
> Build and test Spark
[
https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-25075:
---
Issue Type: Sub-task (was: Umbrella)
Parent: SPARK-26338
> Build and test Spark against
[
https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-25075:
---
Affects Version/s: (was: 2.1.0)
2.4.0
> Build and test Spark against
Darcy Shen created SPARK-26338:
--
Summary: Use scala-xml explicitly
Key: SPARK-26338
URL: https://issues.apache.org/jira/browse/SPARK-26338
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716302#comment-16716302
]
Darcy Shen commented on SPARK-25075:
I maintained a list of scala libraries which spark uses.
[
https://issues.apache.org/jira/browse/SPARK-26321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-26321:
---
Description:
First:
./build/mvn -Phive-thriftserver -DskipTests package
Then:
$ bin/spark-sql
[
https://issues.apache.org/jira/browse/SPARK-23974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714611#comment-16714611
]
Darcy Shen commented on SPARK-23974:
Well, we are upgrading from Spark 2.1.1 to Spark 2.4.0
This
Darcy Shen created SPARK-26321:
--
Summary: Split a SQL in a correct way
Key: SPARK-26321
URL: https://issues.apache.org/jira/browse/SPARK-26321
Project: Spark
Issue Type: Improvement
Darcy Shen created SPARK-26319:
--
Summary: Add appendReadColumns Unit Test for HiveShimSuite
Key: SPARK-26319
URL: https://issues.apache.org/jira/browse/SPARK-26319
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714101#comment-16714101
]
Darcy Shen commented on SPARK-21708:
Please make the Priority higher.
sbt 1.x is better than sbt
[
https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605457#comment-16605457
]
Darcy Shen commented on SPARK-14220:
Congrats!
First green one:
[
https://issues.apache.org/jira/browse/SPARK-25298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599651#comment-16599651
]
Darcy Shen commented on SPARK-25298:
sbt -Dscala-2.12 -Dscala.version=2.12.6
This is the
Darcy Shen created SPARK-25304:
--
Summary: enable HiveSparkSubmitSuite SPARK-8489 test for Scala 2.12
Key: SPARK-25304
URL: https://issues.apache.org/jira/browse/SPARK-25304
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599580#comment-16599580
]
Darcy Shen commented on SPARK-25297:
This issue has been fixed by
Darcy Shen created SPARK-25298:
--
Summary: spark-tools build failure for Scala 2.12
Key: SPARK-25298
URL: https://issues.apache.org/jira/browse/SPARK-25298
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-25297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darcy Shen updated SPARK-25297:
---
Description:
*+see
1 - 100 of 104 matches
Mail list logo
