Memory embedded non-intrusive reduced order modeling of non-ergodic flows