Are you actually loosing boost? Does your boost gauge stay consistent, do you have one etc?
Lag can also be contributed to manifold leaks (manifold and gaskets). Exhaust gases spin the turbine blades hot side so if the gases are slowed at any point from a leak you will get lag, same goes for bent fins compressor and turbine side. Also same with leaks in the downpipe and exhaust as it slows the rate in which the gases are expelled again causing lag.
As the lads said also could be a boost leak unless boost is consistent, also restrictions in inlet track slowing the rate in which the turbo can "pull" the air through.
What management are you running? Ignition retardation will also cause lag, same goes if stock ECU puts you in limp home mode, any diagnostic faults or engine lights being illuminated?
T