I know a couple people that have tried this and it didn’t work out very good for them… little tomato plants etc. The straw dried out too quickly and required a lot of water. I do like to use straw as a mulch though, I think it adds a lot of beneficial fungi to the soil wherever it’s used.
Probably works best if you let those bales sit outside for a year or two decomposing before planting in them.