If the query is returning empty result , without your shuffle service and aqe turned on, then the issue could be 1) Bug in AQE or 2) Wrong stats, resulting in empty relation optimization kicking in. so check the stats.. run analyze table command before querying,
If it happens only with your custom Shuffle service, then bug is likely in your code.. On Wed, Sep 17, 2025 at 10:21 PM Jason Jun <[email protected]> wrote: > Hi there, > > I'm building external shuffle server to make serverless spark for our > kubernetes deployment. > If i turned off AQE, --conf spark.sql.adaptive.enabled=false, query is > working, but if i turn it on then running query returns nothing. > > I couldn't find good documentation for this. > it would be really appreciated if I can any advice from anyone on this? > > Thanks > Jason > >
