Hi all, We've just released Scio 0.8.0-beta2 (Scala API for Apache Beam for those on the Beam mailing list). This will likely be the last beta before 0.8.0 stable release.
Cheers, Neville https://github.com/spotify/scio/releases/tag/v0.8.0-beta2 Features - Bump Beam to 2.16.0 (#2292 <https://github.com/spotify/scio/pull/2292>) - Bump featran to 0.4.0 - Add DelegatingSideInput and TypedSparkeySideInput. (#2287 <https://github.com/spotify/scio/pull/2287>) - Add initial BigQuery methods with Beam schema (#2197 <https://github.com/spotify/scio/pull/2197>) - Allow user to pass in Bigtable GcRule (#2256 <https://github.com/spotify/scio/pull/2256>) - Support accessing all counters within JobTest (fix #2007 <https://github.com/spotify/scio/issues/2007>) (#2247 <https://github.com/spotify/scio/pull/2247>) - Add BigQuery Source type (#2214 <https://github.com/spotify/scio/pull/2214>) - Add Storage API read from query (#2204 <https://github.com/spotify/scio/pull/2204>) Bug Fixes & Improvements - Segregate and deprecate avro reflective records support (#2300 <https://github.com/spotify/scio/pull/2300>) - Fix lambda ser/de in SCollectionMatchers, #2294 <https://github.com/spotify/scio/issues/2294> (#2296 <https://github.com/spotify/scio/pull/2296>) - Use PubsubIO.readMessagesWithCoderAndParseFn from Beam 2.16 (#2295 <https://github.com/spotify/scio/pull/2295>) - Wrap PubsubWithAttributes write in composite PTransform (fix #2286 <https://github.com/spotify/scio/issues/2286>) (#2288 <https://github.com/spotify/scio/pull/2288>) - AvroType macro shouldn't generate duplicate record classes fix #2264 <https://github.com/spotify/scio/issues/2264>) (#2267 <https://github.com/spotify/scio/pull/2267>) - Add Paradise dependency back to scio-repl classpath (fix #2265 <https://github.com/spotify/scio/issues/2265>) (#2266 <https://github.com/spotify/scio/pull/2266>) - Use JavaSerializer for encoding Throwable (fix #2249 <https://github.com/spotify/scio/issues/2249>) (#2261 <https://github.com/spotify/scio/pull/2261>) - Check name uniqueness without running on Dataflow (#2252 <https://github.com/spotify/scio/pull/2252>) - Added fix for BinaryIO output. (#2251 <https://github.com/spotify/scio/pull/2251>) - Truncate app args if long (#2244 <https://github.com/spotify/scio/pull/2244>) - Fix: run repl with jdk11 (#2246 <https://github.com/spotify/scio/pull/2246>) - Reduce guava usage #2223 <https://github.com/spotify/scio/pull/2223> #2242 <https://github.com/spotify/scio/pull/2242> - Use upstream magnolia for scala >= 2.12, fix #2192 <https://github.com/spotify/scio/issues/2192> (#2241 <https://github.com/spotify/scio/pull/2241>) - Fix #2096 <https://github.com/spotify/scio/issues/2096>: restore sbt < 1.3.0 behaviour by not closing classloader (#2224 <https://github.com/spotify/scio/pull/2224>) - Update version check message (#2227 <https://github.com/spotify/scio/pull/2227>) - Don't wrap exceptions in WrappedBCoder (#2266 <https://github.com/spotify/scio/pull/2266>) - Bypass nullable coder for ObjectFileIO, fix #2187 <https://github.com/spotify/scio/issues/2187> (#2188 <https://github.com/spotify/scio/pull/2188>) Breaking Changes - Decouple SQL extension from scio-core (#2201 <https://github.com/spotify/scio/pull/2201>)