^^^as it has been said above, if actuator is removed, you'll have to make sure something keeps the wastegate door closed then. otherwize it won't boost much. if by "removed" you mean you have removed boost lines goind to it, then you would still need to make sure your wastegate door is fully closed. if that wastegate is not closed properly, you'll get uge lag an low boost
are you sure you have no boost leak in IC piping ? how have you checked this ?
I had that problem ones, it ended to be the trottle body which wasn't tighten properly. make sure you check your entire boost route to the engine