Late 15th century; earliest use found in Rule Minoresses. From refector- + -er, after either post-classical Latin refectorarius or (in early use) Middle French refecturier, refectourier, etc.