Can caterpillars switch between milkweed varieties?

Caterpillars can easily switch between milkweed varieties. We often switch between common, swamp, purple, and tropical milkweed. The only one it can be difficult to get them to switch to is Asclepias tuberosa (butterfly weed)