Late 18th century; earliest use found in Philosophical Transactions of the Royal Society of London. From the names of RowleyRegis, a town near Birmingham, England and RowleyHill, the hill on which the town is located, and from which the stone was quarried + rag.