Im running direct manifold vac on all my cars. Most people I know are doing it that way. There are some people here that feel strongly that that is bad but I will let them explain that.
It can vary carb to carb and year to year but in general higher up ports on the carbs are 'ported', 'controlled', or 'timed'. That means they are not just straight manifold. There can also be manifold ports on a carb. Manifold vac is what ever vacuum the engine is creating. When the throttle is closed vacuum is high because the engine is trying to suck more air than the throttle is letting in. WHen you open the throttle vacuum drops because all the sudden the engine can get all the air it needs. If the engine is not loaded the engine easily then speeds up with that extra air (and fuel) and gets back to that point where the throttle is holding it back so vacuum goes high again. If the engine is loaded the vacuum stays low because basically you keep the throttle more open to try and get more air (and fuel) in to try and increase the speed which increases the air (and fuel) demand. The ported, timed, or controlled vacuum ports on the carbs do something to alter that signal. On some the ports are actually covered by the throttle blades so they only come on at certain throttle positions. Some are just simply above the throttle plate so they are not exposed to vacuum unless the throttle blades are open. The later you get the more of those type of ports there are for various emissions gadgets. In your case it sounds like you have a ported source with is not on at idle which is typical. This means you dont get any advance at idle which is good for emissions. As soon as you open the throttle the vacuum port opens so the dizzy is exposed to vacuum which pulls in the advance. If you had a load on the engine the vacuum would not have been very strong so the advance would likely have not moved much until the load reduced then it would pull in some advance. It helps if you think of it as a vacuum retard. The engine can take lots of advance under light or no load where it cant handle it is under heavy load. Now if you think about how the vacuum reacts. No or light load means vacuum is high (because the throttle is basically holding it back) so we get advance which is good. High load vacuum is low and also when the engine cant handle the advance so it get retarded. Kinda neat huh? And they dont need a complicated computer to figure it out with a million sensors like we have now.