Marko A. Rodriguez created TINKERPOP-1017:
---------------------------------------------
Summary: Get InputRDDFormat to work with Multiple Splits
Key: TINKERPOP-1017
URL: https://issues.apache.org/jira/browse/TINKERPOP-1017
Project: TinkerPop
Issue Type: Improvement
Components: hadoop
Affects Versions: 3.1.1-incubating
Reporter: Marko A. Rodriguez
{{InputFormatRDD}} was recently added to enable {{HadoopGraph}} to OLTP stream
in {{InputRDD}} data. It is currently single threaded. I tried to make it
parallel, but ran into some {{Exceptions}} I didn't understand. For OLTP it
doesn't matter, however, it would be good to make it work with multiple Hadoop
{{InputSplits}} and then, Hadoop could read from Spark in OLAP too :). I don't
know why that would ever be used... ? But if its easy enough to do, just do it.
[~rspitzer] --- When https://issues.apache.org/jira/browse/TINKERPOP-1011 you
will see {{InputFormatRDD}}. You might have an idea on how to do this. If you
care -- no worries though.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
