Re: [build system] quick jenkins reboot
we've been back for about an hour. :) On Fri, Oct 22, 2021 at 1:52 PM shane knapp ☠ wrote: > system load on the primary is getting suspiciously high, and free ram has > mysteriously disappeared and we are rapidly approaching swap. whatever > could it be? > > java. > > i'm going to take this opportunity to reboot everything and start from a > clean-ish state. we'll be down for ~45m or so. > > shane > -- > Shane Knapp > Computer Guy / Voice of Reason > UC Berkeley EECS Research / RISELab Staff Technical Lead > https://rise.cs.berkeley.edu > -- Shane Knapp Computer Guy / Voice of Reason UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu
[build system] quick jenkins reboot
system load on the primary is getting suspiciously high, and free ram has mysteriously disappeared and we are rapidly approaching swap. whatever could it be? java. i'm going to take this opportunity to reboot everything and start from a clean-ish state. we'll be down for ~45m or so. shane -- Shane Knapp Computer Guy / Voice of Reason UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu
[DISCUSS] SPIP: Storage Partitioned Join for Data Source V2
Hi, Ryan and I drafted a design doc to support a new type of join: storage partitioned join which covers bucket join support for DataSourceV2 but is more general. The goal is to let Spark leverage distribution properties reported by data sources and eliminate shuffle whenever possible. Design doc: https://docs.google.com/document/d/1foTkDSM91VxKgkEcBMsuAvEjNybjja-uHk-r3vtXWFE (includes a POC link at the end) We'd like to start a discussion on the doc and any feedback is welcome! Thanks, Chao
