Re: [Spark Core] unhashable type: 'dict' during shuffle step

2017-07-18 Thread Josh Holbrook
Hi all, Just an update: I ran a variation of the job with the new latest_time code and it failed again, but I think I was misreading the history dash. This time, it shows 2 attempts, the second of which failed during the max call as before, but the *first* of which appears to be failing during

[Spark Core] unhashable type: 'dict' during shuffle step

2017-07-18 Thread Josh Holbrook
Hello! I'm running into a very strange issue with pretty much no hits on the internet, and I'm hoping someone here can give me some protips! At this point, I'm at a loss. This is a little long-winded, but hopefully you'll indulge me. Background: I'm currently trying to port some existing spark