1. 程式人生 > >epoch和iteration的區別

epoch和iteration的區別

one epoch: 指所有training samples的一次forward pass和一次backward pass.

batch size: 指一次forward/backward pass中training samples的數量.batch size越大,所需的記憶體空間越多.

iterations: number of passes, each pass using [batch size] number of examples.

one pass = one forward pass + one backward pass
例:對於1000個訓練樣本,batch size是500,那麼每個epoch需要迭代兩次.