It's somewhat difficult to explain this particular perspective,
I do not find this difficult at all. You're in good company as far as I can tell, with a great many philosophers in the past having thought along those lines, and many laymen today as well.
certain experiences the complexity and depth of which I fear I could not live without,
I believe this feeling stems from ignorance about how deep your circumstances can fall until you cannot "live with them" any longer. In other words, if someone says something like this, I assume they mean they value those hard experiences they made in their life, or that those tough phases shaped them in a way they appreciate now.
For example, those others who can wake up every morning at five am so that they can go to construction site and dig holes for eight or nine hours a day - what is their life like?
Just as you say it is. They wake up at 5am and are either happy about that if that timing coincides with their natural rhythm or they managed to consciously adapt to the time; or they are grumpy and eternally unhappy every morning. If they are disposed to working on their own brain, it is possible to make this kind of thing normal and unproblematic (source: am a night owl; am getting up at 5-6am most mornings out of my free decision for reasons not imposed from outside, and am very happy each time. So a sample size of "1" but it is possible). Then they do their physical labour and are either happy or unhappy, but they just do it.
A lot of people are not particularly happy, but still manage to do what needs to be done. Check out stories about big wars (WW1, WW2, ...). People were, in fact, exceedingly unhappy for large bouts in those times, and endured horrible things far outstripping anything any normal person could even fathom without having read or heard about it after the fact. The human (and animal) brain is extremely good at surviving even the worst of the worst conditions.
How can they come back home each night just to have a meal and watch a movie?
They just do. Note that this is not only relevant for physical labourers. Brain workers (e.g. IT, etc.) have exactly the same issue. Even if they just hit keyboards the whole day, their work can be exceedingly horrible if their surroundings are bad enough. They still just do it (until they break, same as the construction workers).
How can these people really exist? And what is their existence like?
Happy or unhappy, but they simply exist. The one is not related to the other. This is not a question of philosophy but of biology. If you assume the general tenets of evolution are true, then it is clear that not dieing is the by far most evolutionary beneficial feature of an organism at all. All the higher level brain functions (emotions, pain reception etc.) are subordinated to surviving (of course, targeted towards it). As far as I know, animals are generally assumed to be incapable of conscious suicide. Even in humans, suicide is the exception, not the rule, albeit it would be very easy for us to do (ignoring our own resistance to it). Everybody is surrounded by plenty of ways to end it all, every day, every second, and still only very few chose this.
I am trying to avoid sounding arrogant or privileged, although in the sense of the latter, I have certainly had my fair share of trouble, it is true.
No worries. Since you are able to communicate via the internet, you and me are for sure part of a small minority of extremely privileged people, when compared to the majority of humanity.
life is a completely and fundamentally personal experience
Yes, you are absolutely right. There is no way to truly experience someone else's life. We can't even solve the problem of "qualia" (i.e., does the red apple look as red to you as it does to me).
my own family members are so to speak posited as entities for my own enterprise, my own friends placed there such as to grace my own existence with a sense of companionship, or for some other reason.
Now you're straying into the world where there is some universal "intent", be it God or Karma or whatever it may be. You are free to think that, there is nothing inherently bad about it (unless it leads you to bad actions like killing your family members because you believe they're just bots placed around you for your entertainment - even if they really were; the other bots (policemen, judges) would afterwards make your life miserable).
I do believe in others' existence. [...] you yourself also possess a specifically and ultimately personal experience
Sure, that's the idea. As valid as the other idea. It does not matter. It would, today, be trivial to replace the whole of Philosophy.SE with a bunch of GPT-5 bots and if you squeeze your eyes and don't look too closely you maybe wouldn't even notice. The ultimate version of "Plato's Cave" analogy.
In short, is living a specifically and ultimately personal enterprise?
In short: yes.