You are not alone!
I've read a couple Eric Newby, and have loved them both, and the others are sat on my shelf waiting patiently to be read at some point in the future.
William Dalrymple is also one of my favourites - I've got a thing about India, and can't go too long without reading a travel book or novel about the country, despite having no inclination to actually visit myself!
I like the entire spectrum from the serious to the comic, and some of my other favourites have been:
Tony Hawks - great fun
The River at the Centre of the World by Simon Winchester - although it took me ages to read it, it was a bit dry, but very interesting
Duende by Jason Webster - I loved this because of the flamenco aspect more than the travel, but it is found in the travel section of bookshops and I thought it was very well written, so I've also bought Andalus, which is now on my TBR list.
Honey and Dust by Piers Moore Ede - a good mix of history, nature, travel and apiculture in the book, as well as the personal emotional journey of recovery.
I tried to read Behind The Wall by Colin Thubron, but I didn't like his writing style and gave up after about 80 pages. I had the same problem that there were few people and rambling descriptions. He also was writing about China, but kept throwing French words and phrases into the text, which just seemed out of place and jarring.