Thanks for reaching out Ally, I am so glad you found us!
The maker is probably Edmund Johnson who was a Birmingham maker, active in the late 1800s to early 1900s. He used an E.J in a circle punch. He’s known for small gold dress ornaments, stick pins, and miniature busts.
This sounds like a "miniature bust pin" or hat pin top. They were often sold as sweetheart tokens or dress ornaments. Naked busts with hair up were very popular in the Art Nouveau / Edwardian period.
Ally can you check for other tiny marks on the back or base. A crown, anchor, lion = Birmingham silver/gold hallmarks. That would date it exactly.