Cut a block of open-cell foam to the desired size of your fully-inflated pillow.
Measure the dimensions of your block of foam. Cut a piece the width and length of the foam block plus half its height from the nozzle end of an inflatable water raft.
Insert the foam block into the space between the top and bottom layers of the raft. Glue the perimeter of the two pieces of rubber together, sealing it tight around the foam to prevent any leaks.
Wait 24 hours for the glue to fully dry. Open the nozzle and roll the inflatable pillow up to deflate it, closing the nozzle again before releasing. Open and pinch the nozzle to allow the pillow to re-inflate itself.