I think your plan sounds decent in that case, I would be careful of using too much compost as it can cause problems with excess potassium and phosphorus, most compost that is available in large quantities will be quickly digested And disappear.

Great crops can be grown in low OM soil as long as the biology has enough labile carbon for energy, the soil is not too unbalanced and you correctly feed the crop.