jon-wei commented on a change in pull request #9171: Doc update for the new
input source and the new input format
URL: https://github.com/apache/druid/pull/9171#discussion_r367702186
##########
File path: docs/ingestion/hadoop.md
##########
@@ -145,7 +145,51 @@ A type of inputSpec where a static path to the data files
is provided.
For example, using the static input paths:
```
-"paths" :
"s3n://billy-bucket/the/data/is/here/data.gz,s3n://billy-bucket/the/data/is/here/moredata.gz,s3n://billy-bucket/the/data/is/here/evenmoredata.gz"
+"paths" :
"hdfs://path/to/data/is/here/data.gz,hdfs://path/to/data/is/here/moredata.gz,hdfs://path/to/data/is/here/evenmoredata.gz"
+```
+
+You can also read from cloud storage such as AWS S3 or Google Cloud Storage.
+To do so, you need to install the necessary library under
`${DRUID_HOME}/hadoop-dependencies` in _all MiddleManager or Indexer processes_.
Review comment:
Noting here that `${DRUID_HOME}/hadoop-dependencies` doesn't work for this
since the HDFS extension needs these libraries on the peon startup
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org
For additional commands, e-mail: commits-h...@druid.apache.org
