I'm fairly certain that Rakudo's current behavior (returning a Failure for indexes other than zero) is correct here. Switching "fail" to "die" is definitely not correct.
I'm declaring this ticket "fixed" and can be resolved when we have spectests verifying that the non-zero indexes return a Failure. Pm