Is it possible for you to take a still image at a higher magnification? Based on the metric ruler, I estimate the animal to be around 2mm, which leads me think it may be the larva of a dermestid beetle, but I would need a better look to be sure...
The images are good enough to get a better idea of what your critters are. The "beetle" is actually some species of 'booklice' - in the Order Psocodea. They are best known as scavengers on the starch in book binding glues, hence their common name.
The larva looks a lot like some species of Dermestidae. These feed on a wide variety of natural animal and plant materials and are especially notorious pests in insect collections. They can also be damaging to carpets or other textile products made of natural fibers.
If you search "Dermestidae" and "booklice" on the web, you should be able to find a wealth of info that could guide you to finding the source and ways of ridding yourself of them. In most cases, identifying the food source and removing it is the key to ridding one's home of pests.