spark的dataframe存储中都会调用write的mode方法:
data.write.mode(“append”).saveAsTable(s" u s e r i d . {userid}. userid.{datasetid}")
data.write.mode(SaveMode.Overwrite).parquet(hdfspath)
但不同时候的参数是不同的
先看一下源码:
spark-v2.3.0:
def mode(saveMode: SaveMode): DataFrameWriter[T] = {
this.mode = saveMode
this
}
/**
* Specifies the behavior when data or table already exists


5310

被折叠的 条评论
为什么被折叠?



