there is a great implemantation using concurrent hashMap and a queue for maintining the least used. here is the link: http://stackoverflow.com/questions/221525/how-would-you-implement-an-lru-cache-in-java-6