Duplicates of galaxies and bright point sources are seen quite often in gravitational lensing. My favorite is probably this image of the galaxy cluster MACS J0138:
Credit: S. Rodney (U. of S. Carolina), G. Brammer (Cosmic Dawn Center), J. DePasquale (STScI), P. Laursen (Cosmic Dawn Center)).
The image on the left is from 2016, and the image on the right is from 2019. The big, reddish arcs that encircle the cluster are multiple images of the same background galaxy (MRG-M0138): one on the right side of the cluster, and two that are smeared out over each other below the cluster. A fourth image is seen as a radial arc closer to the center at ~22:30 o'clock.
The reason I like this example is that a supernova ("SN Requiem") exploded in the background galaxy, and appeared in three different locations in 2016. They were discovered a bit by chance by my colleague (who has good eyes), when he noticed that the three dots had disappeared in 2019.
Because the light takes different paths around the cluster, there is typically a time delay of the order of months in such cases. By modeling the mass distribution of the lensing cluster, it is possible to learn pretty accurately how much the light is delayed, magnified, and distorted. Doing this, it was actually possible to predict that a fourth image of SN Requiem should appear in 2037 (± a few years) in the location marked by a yellow circle in the right image (Rodney et al. 2021).
The reason the time delay for that image is so much longer is that it's closer to the center of the cluster, meaning that the light traverses a deeper gravitational potential, meaning that time goes slower. Pretty cool, right?
Another cool example is the lensing and magnification of what we believe to be a single star, dubbed "Earendel" at a distance of 28 billion lightyears. The star itself is only seen once, but the star cluster that it's a part of is seen three times:
Credit: NASA/ESA/Brian Welch (JHU)/Dan Coe (STScI)/Peter Laursen (DAWN).
The above image is a close-up of the tiny region where Earendel happened to fall right on top of the narrow line where the magnification increases by (tens of) thousands of times (a so-called "caustic line"; in the image I called it "magnification line" because it was used for a press release). A cluster of many stars is seen slightly offset from the line, resulting in a much smaller magnification but instead being mirrored by gravity.
Do we see many?
In order for a galaxy cluster to produce multiple images of a background source, it must be rather massive, and also quite concentrated in mass. Small clusters rarely act as strong lenses, but once you get above a certain mass, say $M\gtrsim10^{15}\,M_\odot$, a large fraction of them show those giant arcs, and also multiple images of the same background object. Other famous clusters include e.g. Abell 1689 showing ~30 multiply imaged background galaxies (Limousin et al. 2007), and Abell 2744, with no fewer than 61 multiply imaged galaxies (Jauzac et al. 2015).
So yes, we see many!
Mirrors and multiple orbits of light
The illustration in the post you link to was actually made by me for a press release for a related, but physically quite different situation, discovered by Sneppen (2021). This is an analytical solution to an idealized situation where light in principle can circle arbitrarily many times around a black hole. So yes, in principle you can see arbitrarily many copies of both background objects, and in fact objects on any side of the lensing black hole, including yourself.
In order for a light ray to be deflected even just once (i.e. to make a mirror image), the trajectory of the light must be very, very close to the lens. This means that only black holes work, because all other objects are not compact enough (for extended lenses, as you approach the center you also have less and less lensing mass). That's why for galaxy clusters you always only see deflection angles of the order of arcminutes, not degrees, and definitely nothing close to 180°.
So the words "in principle" carry a heavy weight here. As you look closer to the black hole, the trajectory deflects exponentially fast. That means that an extended object will in practice be smeared out over 360° around the black hole forming a ring, ruining the (mirror) image. So no, a group of rays from a distant galaxy would in general not look like a galaxy.
There is one scenario that could perhaps work: It turns out that for rotating black holes, you do not need to look so much closer to the black hole to see the next image. For a maximally rotating black hole you only need to look at half the distance between one image and the black hole, in order to see the next image (compared to $e^{2\pi}\sim500$ for a non-rotating black hole).
So in the ideal situation that you have a fast-spinning, nearby black hole you could in principle (!) (!) see your distorted mirror image. Sort of like this illustration that I also made for the same press release (and which importantly is qualitative, not quantitative):
