By default Windows will try to download a minidriver for a new smart card when inserted using Windows Plug and Play (PnP). This may take a great deal of time, and also prevent CSSI from working if the wrong Minidriver is installed.
To disable this process, set the following Group Policy:
gpedit.msc -> Local Computer Policy -> Computer Configuration -> Administrative Templates -> Windows Components -> Smart Card : "Turn on Smart Card Plug and Play service" = "Disabled"
If you are still having trouble with Plug and Play , see Microsoft Knowledge Base article 976832.