The earliest description of this utility prop so far found is in Guyot's Nouvelles récréations mathématiques, Vol. 1, 1769, p. 34 (1st ed.). The earliest discovered description of the change bag in English occurs in a book on mathematical amusements. Surrounded by genuine mathematical demonstrations, the Change Bag is described as a method to force a number in the anonymous Philosophical Amusements, 1797, p. 7.
Henry Hardin, in his column in Mahatma, Vol. 3 No. 2, Aug. 1899, p. 275, writes about “The Plush Bag”, a Change Bag with a handle, the form in which it has predominated to the present day. Hardin's article seems to imply that the prop was available, presumably from magic dealers, and he comments that it was “but little known” at the time of his writing. Also worth noting, perhaps, is “The Wonderful Velvet Bag” in W. H. J. Shaw's New Ideas in Magic, 1902, p. 30. This does not add any additional information, but unlike the Hardin write-up, it does include an illustration.
A later source, Gustav Oeder credits the invention of the handled Change Bag to Clementine de Vere, who, under the stage name of Ionia, had a short-lived but respected career as an illusionist. Clementine was a daughter of Charles de Vere, a prominent professional magician and magic dealer. See Oeder's article on women magicians in Magie, Vol. 18 No. 5, May 1935, p. 86. If correct, Miss de Vere—born Dec. 20, 1988—was a precocious inventor, as she would have been ten years old when Hardin's description of the prop was published. Oeder provides no source for his information, and no earlier corroboration is known to date.