Chul Kang created S2GRAPH-205:
---------------------------------
Summary: too many initialize S2Graph when writeBatchMutate on
S2GraphSink
Key: S2GRAPH-205
URL: https://issues.apache.org/jira/browse/S2GRAPH-205
Project: S2Graph
Issue Type: Sub-task
Components: s2jobs
Reporter: Chul Kang
When call the function S2GraphHelper.initS2Graph() , S2Graph is initialized
every time.
It causes initialize the Model class, so many connections can be created to DB.
In especially, when you call writeBatchWithMutate on the S2graphSink class, the
following code initializes S2Graph on each task.
```
df.foreachPartition { iters =>
val config = ConfigFactory.parseString(serializedConfig)
val s2Graph = S2GraphHelper.initS2Graph(config)
...
}
```
I think it would be better, if we can re-use S2Graph instance on the same
executor.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
