I experience the same issue, though not so big area. I assume it’s just the beginning (will spread) and it happened after or during the last summer.
Once I repaired such an issue on my old Skoda Fabia but it was the carpet on the roof from the inside (ceiling). I just guess there is a glue which after few years of service says goodbye and the any glued fabric or leather goes away like you showed (if not sewed but glued only).
There might be online shops to buy a meter of fabric or leather and definitely there are spray-glues for that to attach the fabric onto the plastic/metal surfaces (I did it once as i mentioned).
What is tricky, is how to make it nice on bumpy surfaces like that door handle and the area around. Of course, firstly that handle needs to be disassembled and cleaned. Pretty dirty job if there was some glue before, but the area is small, so maybe some 2hrs job I guess. But if you can find another spare part, might be a better option.