[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-11-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703363#comment-16703363 ] Hudson commented on HDFS-13713: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15525 (See

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-11-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703312#comment-16703312 ] Steve Loughran commented on HDFS-13713: --- +1 tests failures are unrelated: I'm not getting them

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702596#comment-16702596 ] Hadoop QA commented on HDFS-13713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701947#comment-16701947 ] Hadoop QA commented on HDFS-13713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-11-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701704#comment-16701704 ] Steve Loughran commented on HDFS-13713: --- OK, you apply to trunk @ retest on your infra, I'll apply@

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-11-28 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701666#comment-16701666 ] Ewan Higgs commented on HDFS-13713: --- {quote}Apart from some ambiguity about concurrency, is this ready

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-11-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701639#comment-16701639 ] Steve Loughran commented on HDFS-13713: --- Where are we with this? Apart from some ambiguity about

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-10-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662511#comment-16662511 ] Steve Loughran commented on HDFS-13713: --- bq. "If you complete multiple objects to the same

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-10-24 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662334#comment-16662334 ] Ewan Higgs commented on HDFS-13713: --- {quote} I'd expect it to be visible, yes?{quote} Yes.

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652272#comment-16652272 ] Steve Loughran commented on HDFS-13713: --- Interesting. Are you seeing that ordering against AWS S3

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-10-16 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651665#comment-16651665 ] Ewan Higgs commented on HDFS-13713: --- HDFS-13713.008.patch (using HDFS prefix, not HADOOP prefix even

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-10-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644954#comment-16644954 ] Steve Loughran commented on HDFS-13713: --- {quote}My thoughts are that the file commit should

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-10-10 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644855#comment-16644855 ] Ewan Higgs commented on HDFS-13713: --- I'll make some time to look at this. My thoughts are that the

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-10-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643613#comment-16643613 ] Steve Loughran commented on HDFS-13713: --- Now that the 0-byte HDFS write is in, the oustanding issue

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-10-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16635398#comment-16635398 ] Steve Loughran commented on HDFS-13713: --- w.r.t concurrent uploads, HDFS and other filesystems

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-10-02 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16635374#comment-16635374 ] Ewan Higgs commented on HDFS-13713: --- {quote}Either the MPU rejects a second attempt to write to the

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626136#comment-16626136 ] Hadoop QA commented on HDFS-13713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625438#comment-16625438 ] Sunil Govindan commented on HDFS-13713: --- Thanks [~ste...@apache.org] and [~ehiggs] for helping here

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625083#comment-16625083 ] Steve Loughran commented on HDFS-13713: --- {checkstyle}

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624858#comment-16624858 ] Hadoop QA commented on HDFS-13713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624848#comment-16624848 ] Hadoop QA commented on HDFS-13713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624835#comment-16624835 ] Steve Loughran commented on HDFS-13713: --- BTW, test run is taking 100s for me: too long {code}

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624373#comment-16624373 ] Hadoop QA commented on HDFS-13713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624225#comment-16624225 ] Steve Loughran commented on HDFS-13713: --- patch 004. Review, with a fair amount of revision of the

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623854#comment-16623854 ] Steve Loughran commented on HDFS-13713: --- just seen there's an update on this...will review ASAP >

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-17 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617263#comment-16617263 ] Ewan Higgs commented on HDFS-13713: --- [~ste...@apache.org], any feedback for patch 003? Thanks > Add

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-17 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617232#comment-16617232 ] Sunil Govindan commented on HDFS-13713: --- Hi [~elgoiri]  and [~ehiggs]. This patch is closer to

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604368#comment-16604368 ] Hadoop QA commented on HDFS-13713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-05 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604207#comment-16604207 ] Ewan Higgs commented on HDFS-13713: --- 003 * Update specifications based on [~ste...@apache.org]'s

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-04 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603655#comment-16603655 ] Íñigo Goiri commented on HDFS-13713: bq. Maybe, but would pointing to the S3 implementation preempt

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603599#comment-16603599 ] Steve Loughran commented on HDFS-13713: --- OK. h3. * parent.isDirectory() * Caller gets to do any

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-04 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603504#comment-16603504 ] Ewan Higgs commented on HDFS-13713: --- {quote}duplicate entries: should the s3a one do a check & fail

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-04 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603489#comment-16603489 ] Ewan Higgs commented on HDFS-13713: --- [~goiri], yes there is a HDFS implementation. See

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-04 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603299#comment-16603299 ] Íñigo Goiri commented on HDFS-13713: Does it make sense to add a pointer to the S3 implementation as

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603111#comment-16603111 ] Steve Loughran commented on HDFS-13713: --- * unused parts: call out need to clean up * duplicate

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-04 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602927#comment-16602927 ] Ewan Higgs commented on HDFS-13713: --- {quote}something about how all listed handles must be in

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602322#comment-16602322 ] Steve Loughran commented on HDFS-13713: --- Ewan, here's my revision of the .md file; forgotten too

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-09-03 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602095#comment-16602095 ] Ewan Higgs commented on HDFS-13713: --- 002 * Explanation of how the API should work. * Use some backticks

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-08-29 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596919#comment-16596919 ] Ewan Higgs commented on HDFS-13713: --- 001 - Basic documentation file in

[jira] [Commented] (HDFS-13713) Add specification of Multipart Upload API to FS specification, with contract tests

2018-08-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595901#comment-16595901 ] Sunil Govindan commented on HDFS-13713: --- Hi [~ehiggs]. As this jira is marked for 3.2 as a