Make your own manger for baby Jesus!
If you look at the above photo, I found this Styrofoam cooler at Dollar tree, it is smaller than the standard size you usually see. It was basically what I was looking for without spending a lot or asking my husband to build one for me. They do make the color of paint that you see in the real one below, but you have to be careful what kind of paint you use on Styrofoam because certain paints will mess up the foam.
Here's the website.
Here is the raffia skirt.
see the swaddling cloth here.