Hi Eric,
We are also running into the same issue. Are you able to find some
suitable solution to this problem
Best Regards
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Is-there-a-way-to-limit-the-sql-query-result-size-tp18316p23272.html
Sent from
Hi spark-users,
When I use spark-sql or beeline to query a large dataset, sometimes the
query result may cause driver OOM.
So I wonder is there a config property in spark sql to limit the max return
result size (without LIMIT clause in sql query)?
For example, before the select query, I run