[
https://issues.apache.org/jira/browse/SPARK-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-12807:
---
Target Version/s: 1.6.1
> Spark External Shuffle not working in Hadoop clusters with Jackson
[
https://issues.apache.org/jira/browse/SPARK-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130421#comment-15130421
]
Steve Loughran commented on SPARK-8688:
---
Has anyone filed a bug against HDFS for this?
> Hadoop
[
https://issues.apache.org/jira/browse/SPARK-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131015#comment-15131015
]
Steve Loughran commented on SPARK-12807:
the PR I've got shades jackson; leveldb must stay in
[
https://issues.apache.org/jira/browse/SPARK-13471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163038#comment-15163038
]
Steve Loughran commented on SPARK-13471:
*
Steve Loughran created SPARK-13471:
--
Summary: Upgrade spark-project hive 1.2.1 jar to one with a groovy
2.4.4 dependency
Key: SPARK-13471
URL: https://issues.apache.org/jira/browse/SPARK-13471
[
https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171744#comment-15171744
]
Steve Loughran commented on SPARK-10063:
The fault is having speculation turned on, rather than
[
https://issues.apache.org/jira/browse/SPARK-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171916#comment-15171916
]
Steve Loughran commented on SPARK-13413:
this just broke some of my code. Specifically a plugin
[
https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172654#comment-15172654
]
Steve Loughran commented on SPARK-10063:
sorry! HADOOP-9565
> Remove
Steve Loughran created SPARK-13513:
--
Summary: add some tests for leap year handling in catalyst
Key: SPARK-13513
URL: https://issues.apache.org/jira/browse/SPARK-13513
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117288#comment-15117288
]
Steve Loughran commented on SPARK-7889:
---
I'm going to note something something problematic about
[
https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154052#comment-15154052
]
Steve Loughran commented on SPARK-13241:
The REST API compatibility is described in
[
https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196048#comment-15196048
]
Steve Loughran commented on SPARK-8819:
---
lets see ...
nope.
setting {{ false}} in
the errant
[
https://issues.apache.org/jira/browse/SPARK-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195087#comment-15195087
]
Steve Loughran commented on SPARK-799:
--
If you want to go into the JVM. then there's a .JS script
Steve Loughran created SPARK-13829:
--
Summary: Spark submit with keytab can't submit to a non-HDFS yarn
cluster
Key: SPARK-13829
URL: https://issues.apache.org/jira/browse/SPARK-13829
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191315#comment-15191315
]
Steve Loughran commented on SPARK-13829:
{code}
16/03/11 17:34:51 ERROR SparkContext: Error
Steve Loughran created SPARK-13933:
--
Summary: hadoop-2.7 profile's curator version should be 2.7.1
Key: SPARK-13933
URL: https://issues.apache.org/jira/browse/SPARK-13933
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195915#comment-15195915
]
Steve Loughran commented on SPARK-8819:
---
FWIW, the problem still exists in v 2.4.1 of the plugin, at
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197165#comment-15197165
]
Steve Loughran commented on SPARK-7481:
---
...thinking some more about this
How about
# adding a
[
https://issues.apache.org/jira/browse/SPARK-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191372#comment-15191372
]
Steve Loughran commented on SPARK-13829:
its a bit subtle here, as it's not clear you need a
[
https://issues.apache.org/jira/browse/SPARK-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214760#comment-15214760
]
Steve Loughran commented on SPARK-13829:
This was someone trying to use the {{ --keytab option}}
[
https://issues.apache.org/jira/browse/SPARK-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-13829:
---
Priority: Minor (was: Major)
> Spark submit with keytab can't submit to a non-HDFS yarn
[
https://issues.apache.org/jira/browse/SPARK-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214760#comment-15214760
]
Steve Loughran edited comment on SPARK-13829 at 3/28/16 7:47 PM:
-
This
[
https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229880#comment-15229880
]
Steve Loughran commented on SPARK-10063:
The problem with returning to the classic committer is
[
https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239042#comment-15239042
]
Steve Loughran commented on SPARK-11157:
file a spark bug and if it needs escalation to YARN, one
[
https://issues.apache.org/jira/browse/SPARK-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233474#comment-15233474
]
Steve Loughran commented on SPARK-10793:
I've not gone near it for a while; what's left is
[
https://issues.apache.org/jira/browse/SPARK-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197206#comment-15197206
]
Steve Loughran commented on SPARK-13933:
No custom guava built. Hadoop dealt with the problem by
[
https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209153#comment-15209153
]
Steve Loughran edited comment on SPARK-14106 at 3/23/16 8:56 PM:
-
This
Steve Loughran created SPARK-14106:
--
Summary: history server application cache doesn't detect that apps
are completed
Key: SPARK-14106
URL: https://issues.apache.org/jira/browse/SPARK-14106
Project:
[
https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209153#comment-15209153
]
Steve Loughran commented on SPARK-14106:
This surfaced in logs of my yarn timeline integration
[
https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209168#comment-15209168
]
Steve Loughran commented on SPARK-14106:
Is this serious? Not if the probes returned by the
[
https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209175#comment-15209175
]
Steve Loughran commented on SPARK-14106:
The solution I propose is for {{LoadedAppUI}} to return
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15177623#comment-15177623
]
Steve Loughran commented on SPARK-7481:
---
Hadoop 2.6 added S3a, which we put into a new
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15177918#comment-15177918
]
Steve Loughran commented on SPARK-7481:
---
Longer term, having spark_home /lib/*.jar is the best,
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15177922#comment-15177922
]
Steve Loughran commented on SPARK-7481:
---
For comparison, the full AWS SDK is 13MB; the s3 SDK 570K,
[
https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15178347#comment-15178347
]
Steve Loughran commented on SPARK-11157:
FWIW Hadoop lets you swap out 11.x and go to any later
Steve Loughran created SPARK-13599:
--
Summary: Groovy-all ends up in spark-assembly if hive profile set
Key: SPARK-13599
URL: https://issues.apache.org/jira/browse/SPARK-13599
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-13471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174144#comment-15174144
]
Steve Loughran commented on SPARK-13471:
SPARK-13599 should obsolete this
> Upgrade
[
https://issues.apache.org/jira/browse/SPARK-13471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved SPARK-13471.
Resolution: Won't Fix
> Upgrade spark-project hive 1.2.1 jar to one with a groovy 2.4.4
[
https://issues.apache.org/jira/browse/SPARK-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173791#comment-15173791
]
Steve Loughran commented on SPARK-13413:
(no need, I can get it off {{SC.env...}}
> Remove
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175664#comment-15175664
]
Steve Loughran commented on SPARK-7481:
---
One issue here that hadoop 2.6's hadoop-aws pulls in the
[
https://issues.apache.org/jira/browse/SPARK-14222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15226036#comment-15226036
]
Steve Loughran commented on SPARK-14222:
you'd be taking on maintenance and support costs forever
[
https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215797#comment-15215797
]
Steve Loughran commented on SPARK-11416:
There'a also the issue of syncing with Hive; for
[
https://issues.apache.org/jira/browse/SPARK-14222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215804#comment-15215804
]
Steve Loughran commented on SPARK-14222:
FWIW, you can use jackson annotations to cover mapping
[
https://issues.apache.org/jira/browse/SPARK-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215996#comment-15215996
]
Steve Loughran commented on SPARK-6270:
---
There's actually some security implications too: the shared
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214576#comment-15214576
]
Steve Loughran commented on SPARK-7481:
---
I've created a pull request on this, which has
# a new
[
https://issues.apache.org/jira/browse/SPARK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259963#comment-15259963
]
Steve Loughran commented on SPARK-6527:
---
I've not seen a JIRA surface;
# if anyone does, link it
[
https://issues.apache.org/jira/browse/SPARK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259966#comment-15259966
]
Steve Loughran commented on SPARK-6527:
---
Actually, looking at {{SparkContext.binaryFiles()}}, this
[
https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286954#comment-15286954
]
Steve Loughran commented on SPARK-15343:
thanks for this, I'll look at it. FWIW it should work
Steve Loughran created SPARK-15090:
--
Summary: Spark Hive thriftserver can get 413 errors in Kerberos+AD
deployments
Key: SPARK-15090
URL: https://issues.apache.org/jira/browse/SPARK-15090
Project:
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274218#comment-15274218
]
Steve Loughran commented on SPARK-7481:
---
For people watching this, know that it works best if you
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-7481:
--
Summary: Add spark-cloud module to pull in aws+azure object store FS
accessors; test
[
https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved SPARK-14106.
Resolution: Not A Bug
Understanding this more, its coming from the history provider's view
[
https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239927#comment-15239927
]
Steve Loughran commented on SPARK-11157:
thanks. Although it's not directly a YARN bug, where
[
https://issues.apache.org/jira/browse/SPARK-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299793#comment-15299793
]
Steve Loughran commented on SPARK-13599:
Sorry to hear about this: I know precisely how
[
https://issues.apache.org/jira/browse/SPARK-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299800#comment-15299800
]
Steve Loughran commented on SPARK-13599:
correction: if you have groovy 2.4.6 you should be clear
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389707#comment-15389707
]
Steve Loughran commented on SPARK-7481:
---
Sad but true.
* The PR I've put up adds the hadoop-aws and
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389730#comment-15389730
]
Steve Loughran commented on SPARK-7481:
---
ps, latest s3a state
# [Object stores in
Steve Loughran created SPARK-16736:
--
Summary: remove redundant FileSystem.exists() calls from Spark
codebase
Key: SPARK-16736
URL: https://issues.apache.org/jira/browse/SPARK-16736
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-16736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393770#comment-15393770
]
Steve Loughran commented on SPARK-16736:
See also HIVE-14323
> remove redundant FileSystem
Steve Loughran created SPARK-16737:
--
Summary: ListingFileCatalog comments about RPC calls in object
store isn't correct
Key: SPARK-16737
URL: https://issues.apache.org/jira/browse/SPARK-16737
[
https://issues.apache.org/jira/browse/SPARK-16737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-16737:
---
Description:
The comment text which came in with SPARK-16121 says
{code}
- Although
[
https://issues.apache.org/jira/browse/SPARK-16736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-16736:
---
Summary: remove redundant FileSystem status checks calls from Spark
codebase (was: remove
Steve Loughran created SPARK-17058:
--
Summary: Add maven snapshots-and-staging profile to build/test
against staging artifacts
Key: SPARK-17058
URL: https://issues.apache.org/jira/browse/SPARK-17058
[
https://issues.apache.org/jira/browse/SPARK-14387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-14387:
---
Affects Version/s: 2.0.0
Target Version/s: 2.0.1
Component/s: SQL
> Enable
[
https://issues.apache.org/jira/browse/SPARK-13514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372728#comment-15372728
]
Steve Loughran commented on SPARK-13514:
does the same file:// config setting exist in your
[
https://issues.apache.org/jira/browse/SPARK-15923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370547#comment-15370547
]
Steve Loughran commented on SPARK-15923:
I do think the docs could be clarified a bit here; when
[
https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410870#comment-15410870
]
Steve Loughran commented on SPARK-10063:
The solution for this is going to be s3guard,
[
https://issues.apache.org/jira/browse/SPARK-19111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848403#comment-15848403
]
Steve Loughran commented on SPARK-19111:
Charles, you might also want to keep an eye on:
[
https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851290#comment-15851290
]
Steve Loughran commented on SPARK-19407:
Yes, looks like {{StreamMetadata.read()}} is getting it
[
https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851290#comment-15851290
]
Steve Loughran edited comment on SPARK-19407 at 2/3/17 10:17 AM:
-
Yes,
[
https://issues.apache.org/jira/browse/SPARK-19715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884230#comment-15884230
]
Steve Loughran commented on SPARK-19715:
OK. I'd recommend going twith Path.getURI.getPath() to
[
https://issues.apache.org/jira/browse/SPARK-19715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882995#comment-15882995
]
Steve Loughran commented on SPARK-19715:
This is a silly question, but has the situation " a
[
https://issues.apache.org/jira/browse/SPARK-19715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884230#comment-15884230
]
Steve Loughran edited comment on SPARK-19715 at 2/25/17 1:24 PM:
-
OK. I'd
[
https://issues.apache.org/jira/browse/SPARK-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-14561:
---
Component/s: Spark Core
> History Server does not see new logs in S3
>
Steve Loughran created SPARK-19739:
--
Summary: SparkHadoopUtil.appendS3AndSparkHadoopConfigurations to
propagate full set of AWS env vars
Key: SPARK-19739
URL: https://issues.apache.org/jira/browse/SPARK-19739
Steve Loughran created SPARK-17159:
--
Summary: Improve FileInputDStream.findNewFiles list performance
Key: SPARK-17159
URL: https://issues.apache.org/jira/browse/SPARK-17159
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-17179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-17179:
---
Affects Version/s: 2.0.0
Priority: Major (was: Critical)
Description:
[
https://issues.apache.org/jira/browse/SPARK-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428677#comment-15428677
]
Steve Loughran commented on SPARK-17159:
# the most minimal change is to get rid of that
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-7481:
--
Description:
To keep the s3n classpath right, to add s3a, swift & azure, the dependencies of
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-7481:
--
Affects Version/s: (was: 1.3.1)
2.1.0
> Add spark-cloud module to
[
https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated SPARK-7481:
--
Summary: Add spark-hadoop-cloud module to pull in object store support
(was: Add spark-cloud
[
https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890040#comment-15890040
]
Steve Loughran commented on SPARK-6951:
---
Having been downstream of YARN timeline server and its
[
https://issues.apache.org/jira/browse/SPARK-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458485#comment-15458485
]
Steve Loughran commented on SPARK-17307:
I don't think it should. I think maybe some
[
https://issues.apache.org/jira/browse/SPARK-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467247#comment-15467247
]
Steve Loughran commented on SPARK-17307:
It's not yet in there. If you got the SPARK-7481 JIRA
[
https://issues.apache.org/jira/browse/SPARK-17418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470518#comment-15470518
]
Steve Loughran edited comment on SPARK-17418 at 9/7/16 12:43 PM:
-
Which
[
https://issues.apache.org/jira/browse/SPARK-17418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470518#comment-15470518
]
Steve Loughran commented on SPARK-17418:
Which dependency is being discussed here? The full AWS
[
https://issues.apache.org/jira/browse/SPARK-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449830#comment-15449830
]
Steve Loughran commented on SPARK-17307:
I think this a subset of SPARK-7481, where I am doing
[
https://issues.apache.org/jira/browse/SPARK-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448732#comment-15448732
]
Steve Loughran commented on SPARK-17243:
One thing to consider here whether there are any ways to
[
https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490023#comment-15490023
]
Steve Loughran commented on SPARK-10063:
Amazon EMR's s3 is its own codebase; afraid you'll have
[
https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535594#comment-15535594
]
Steve Loughran commented on SPARK-15343:
Jo, this is an eternal problem with the Hadoop stack:
[
https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15548557#comment-15548557
]
Steve Loughran commented on SPARK-10063:
Looking at the git logs to see which code changed,
[
https://issues.apache.org/jira/browse/SPARK-17593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503663#comment-15503663
]
Steve Loughran commented on SPARK-17593:
Looking at the dir tree, anything you could do to
[
https://issues.apache.org/jira/browse/SPARK-17259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved SPARK-17259.
Resolution: Duplicate
> Hadoop 2.7 profile to depend on Hadoop 2.7.3
>
[
https://issues.apache.org/jira/browse/SPARK-17593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503583#comment-15503583
]
Steve Loughran commented on SPARK-17593:
Sean is right: this is primarily S3, or more
Steve Loughran created SPARK-17259:
--
Summary: Hadoop 2.7 profile to depend on Hadoop 2.7.3
Key: SPARK-17259
URL: https://issues.apache.org/jira/browse/SPARK-17259
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439352#comment-15439352
]
Steve Loughran commented on SPARK-17243:
The REST API actually lets you set a time range for
[
https://issues.apache.org/jira/browse/SPARK-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432462#comment-15432462
]
Steve Loughran commented on SPARK-9004:
---
If you know the filesystem, you can get summary stats from
[
https://issues.apache.org/jira/browse/SPARK-15965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432432#comment-15432432
]
Steve Loughran commented on SPARK-15965:
This is being fixed with tests in my work in SPARK-7481;
[
https://issues.apache.org/jira/browse/SPARK-16363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432421#comment-15432421
]
Steve Loughran commented on SPARK-16363:
S3A uses
[
https://issues.apache.org/jira/browse/SPARK-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432435#comment-15432435
]
Steve Loughran commented on SPARK-10297:
FWIW, S3 and the S3a doesn't have a size limit any more
201 - 300 of 830 matches
Mail list logo
