This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
from 63a0d9d Add statistics struct and Support manually inject statistics
(#6420)
add b13e512 [Feature] Support spark connector sink data to Doris (#6256)
No new revisions were added by this update.
Summary of changes:
.../org/apache/doris/spark}/DorisStreamLoad.java | 41 +++----
.../spark}/exception/StreamLoadException.java | 6 +-
.../org/apache/doris/spark/rest/RestService.java | 75 +++++++++++--
.../apache/doris/spark}/rest/models/Backend.java | 4 +-
.../doris/spark}/rest/models/BackendRow.java | 7 +-
.../doris/spark}/rest/models/RespContent.java | 2 +-
.../doris/spark/sql/DorisSourceProvider.scala | 119 ++++++++++++++++++++-
.../apache/doris/spark/sql/DorisWriterOption.scala | 41 +++++++
.../doris/spark/sql/DorisWriterOptionKeys.scala | 18 ++--
.../doris/spark/sql/DataframeSinkDoris.scala} | 32 ++++--
10 files changed, 275 insertions(+), 70 deletions(-)
copy
extension/{flink-doris-connector/src/main/java/org/apache/doris/flink/table =>
spark-doris-connector/src/main/java/org/apache/doris/spark}/DorisStreamLoad.java
(83%)
copy extension/{flink-doris-connector/src/main/java/org/apache/doris/flink =>
spark-doris-connector/src/main/java/org/apache/doris/spark}/exception/StreamLoadException.java
(96%)
copy extension/{flink-doris-connector/src/main/java/org/apache/doris/flink =>
spark-doris-connector/src/main/java/org/apache/doris/spark}/rest/models/Backend.java
(96%)
copy extension/{flink-doris-connector/src/main/java/org/apache/doris/flink =>
spark-doris-connector/src/main/java/org/apache/doris/spark}/rest/models/BackendRow.java
(97%)
copy extension/{flink-doris-connector/src/main/java/org/apache/doris/flink =>
spark-doris-connector/src/main/java/org/apache/doris/spark}/rest/models/RespContent.java
(98%)
create mode 100644
extension/spark-doris-connector/src/main/scala/org/apache/doris/spark/sql/DorisWriterOption.scala
copy be/src/olap/memory/row_block.cpp =>
extension/spark-doris-connector/src/main/scala/org/apache/doris/spark/sql/DorisWriterOptionKeys.scala
(76%)
copy
extension/spark-doris-connector/src/{main/scala/org/apache/doris/spark/sql/DorisSourceProvider.scala
=> test/scala/org/apache/doris/spark/sql/DataframeSinkDoris.scala} (55%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
