Thank you, Jacek.
BTW, I added `@private` since we need PMC's help to make an Apache Spark
release.
Can I get more feedbacks from the other PMC members?
Please me know if you have any concerns (e.g. Release date or Release
manager?)
As one of the community members, I assumed the followings (if
Hello,
I have 2 parquet tables:
stored - table of 10 M records
data - table of 100K records
*This is fast:*
val dataW = data.where("registration_ts in (20190516204l,
20190515143l,20190510125l, 20190503151l)")
dataW.count
res44: Long = 42
//takes 3 seconds
stored.join(broadcast(dataW),
No sorry I'm not at liberty to share other people's code.
On Fri, Jul 12, 2019 at 9:33 AM, Gourav Sengupta < gourav.sengu...@gmail.com >
wrote:
>
> Hi Reynold,
>
>
> I am genuinely curious about queries which are more than 1 MB and am
> stunned by tens of MB's. Any samples to share :)
>
>
Hi Reynold,
I am genuinely curious about queries which are more than 1 MB and am
stunned by tens of MB's. Any samples to share :)
Regards,
Gourav
On Thu, Jul 11, 2019 at 5:03 PM Reynold Xin wrote:
> There is no explicit limit but a JVM string cannot be bigger than 2G. It
> will also at some
Good to know. Will look into the Raspberry Pi 4 (w/4GB RAM).
In general, are there any tuning or configuration tips/tricks for very
memory-constrained deployments (e.g., 1-4GB RAM)?
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
unsubscribe
--
*Conor Begley* | *QUERY*CLICK
*Software Developer Intern*
e: conor.beg...@queryclick.com <%23#--email--%23...@queryclick.com>
dd: +44 (0)131 516 5251
ed: +44 (0)131 556 7078 // lon: +44 (0)207 183 0344
[image: QueryClick is a Healthy Working Lives Bronze Award Winner.]
