Unfortunately looks like you're hitting correctness issue SPARK-26154 which patch is available but review is dragged a bit.

Given the patch is a bit huge, you might not want to try out porting back the patch to your version manually. Then I think your best bet is asking committers to review the patch sooner, as well as asking for porting back to the version line what you use.

Related Query

More Query from same tag