錯誤：Caused by:org.apache.spark.SparkException: Kryo serialization failed: Buffer overflow.Available: 0, required: 21. To avoid this,

這個是寫入Redis時用的序列化器，然后錯誤提示是超過了大小限制，把配置調大即可。

.set("spark.kryoserializer.buffer.max","128");

如果沒有配置，那么找一下看下有沒有硬編碼寫了大小的范圍導致的。

 

參考：

http://blog.csdn.net/keyuquan/article/details/73379955

https://www.jianshu.com/p/758f147c63b4

https://www.2cto.com/net/201701/589554.html

https://stackoverflow.com/questions/27403732/kryoexception-buffer-overflow-with-very-small-input