1. 程式人生 > >Exception in Spark

Exception in Spark

stream style .get clas map read blog initial creat

1: Exception in thread "main" org.apache.spark.SparkException: org.apache.spark.streaming.dstream.MappedDStream@5a69b104 has not been initialized

原因: StreamingContext.checkpoint(...)指定的checkpoint目錄下有另一個application生成的checkpoint文件, 導致StreamContext.getOrCreate時加載checkpoint失敗, StreamingContext初始化失敗
解決方案: 刪除該checkpoint目錄或換一個目錄進行checkpoint。 對於重新編譯的Application, checkpoint目錄下必須沒有其他application生成的checkpoint文件


Exception in Spark