+1 (non-binding)
- verified signature and checksum
- built from source and run tests
- Validated Spark3: Used Ryan's example command, played with Spark3, looks
very good.
- Validated vectorized reads: open vectorization-enabled, works well.
Best,
Jingsong
On Mon, Jul 13, 2020 at 2:37 PM Gautam
I ran the following steps:
- downloaded and verified signature and checksum.
- ran ./gradlew build, it took 8m23s on an 8core16g cloud virtual
machine.
- rebuilt our app with iceberg-spark-runtime-0.9.0.jar and verified on a
spark cluster. It works well.
+1 (non-binding)
On Mon, Jul 13,
+1
- verified signatures and checksum
- Ran RAT checks
- Build src and ran all tests
- Ran a simple spark job.
-Best,
R.
On Mon, Jul 13, 2020 at 8:36 AM Junjie Chen
wrote:
> I ran the following steps:
>- downloaded and verified signature and checksum.
>- ran ./gradlew build, it took
+1 (binding)
- Verified signatures
- Verified checksum
- Built src from tarball and ran tests.
- Looked at JMH dependency to make sure it wasn't leaking into the
published artifacts.
.. Owen
On Mon, Jul 13, 2020 at 11:00 AM RD wrote:
> +1
> - verified signatures and checksum
> -
+1 (non-binding)
Environment
OSX
openjdk 1.8.0_252
Build from source with tests
Build time ~7mins
Except for some warnings looks good
> On Jul 10, 2020, at 9:20 AM, Ryan Murray wrote:
>
> 1. Verify the signature: OK
> 2. Verify the checksum: OK
> 3. Untar the archive tarball: OK
> 4. Run RAT c
Dongjoon,
Thanks for raising this issue. I did some digging and the problem is that
in Spark 3.0, the logical plans saves a Table instance with the current
state when it was loaded -- when the `createOrReplaceTempView` call
happened. That never gets refreshed, which is why you get stale data. In
2
One more thing: a work-around is to redefine the view. That discards the
original logical plan and table and returns the expected result in Spark 3.
On Mon, Jul 13, 2020 at 11:53 AM Ryan Blue wrote:
> Dongjoon,
>
> Thanks for raising this issue. I did some digging and the problem is that
> in Sp
+1 (non-binding)
- Verified signatures
- Verified checksum
- Build from src tarball and ran tests
- Ran internal test suite, they pass
On Mon, Jul 13, 2020 at 11:46 AM Pavan Lanka
wrote:
> +1 (non-binding)
>
>
>- Environment
> - OSX
> - openjdk 1.8.0_252
>- Build from source
+1 (binding)
I think the issue that was brought up by Dongjoon is valid and we should
document the current caching behavior.
The problem is also more generic and does not apply only to views as operations
that are happening through the source directly may not propagated to the
catalog.
I thin
On Mon, Jul 13, 2020 at 4:28 PM Anton Okolnychyi
wrote:
> I think the issue that was brought up by Dongjoon is valid and we should
> document the current caching behavior.
> The problem is also more generic and does not apply only to views as
> operations that are happening through the source dir
I agree that we should follow up and address this. I'll open a PR with an
update for docs and we can explore other options as well.
I think that the main issue here is how tables are loaded when not using a
catalog. When using a catalog, tables are cached so that writes update the
in-memory refere
With 12 +1 votes, 1 -0 vote, and no -1 votes, this candidate passes.
I'll open a PR to document and explain the behavior that Dongjoon noted.
Thank you for voting everyone!
On Thu, Jul 9, 2020 at 6:45 PM Ryan Blue wrote:
> Hi everyone,
>
> I propose the following RC to be released as the offic
12 matches
Mail list logo
