we've been back for about an hour. :)
On Fri, Oct 22, 2021 at 1:52 PM shane knapp ☠ wrote:
> system load on the primary is getting suspiciously high, and free ram has
> mysteriously disappeared and we are rapidly approaching swap. whatever
> could it be?
>
> java.
>
> i'm going to take this
system load on the primary is getting suspiciously high, and free ram has
mysteriously disappeared and we are rapidly approaching swap. whatever
could it be?
java.
i'm going to take this opportunity to reboot everything and start from a
clean-ish state. we'll be down for ~45m or so.
shane
--
Hi,
Ryan and I drafted a design doc to support a new type of join: storage
partitioned join which covers bucket join support for DataSourceV2 but is
more general. The goal is to let Spark leverage distribution properties
reported by data sources and eliminate shuffle whenever possible.
Design
