Limewash holds by soaking into a porous mineral surface. Latex, acrylic and bare drywall paper give it nothing to soak into. We use the primer system your product specifies. New drywall usually gets a drywall primer, then a mineral or bonding primer. Sound paint often needs just the bonding coat. Some primers can be tinted near the final color, so thin spots do not flash white.
Before any primer, we wash off grease and dust, fill and sand holes, and test that the old paint is stuck tight. Shiny enamel may need a scuff-sand. Paint that peels or rubs off chalky has to be stabilized or taken off, because limewash is only as good as what is under it. Some limewash lines are for bare masonry only and never go on drywall.