Try a mixer like M-Audio M-Track that comes with its own ASIO driver. I have no noticeable latency. Other similar products, like Presonus and Focusrite may have their own drivers or will recommend ASIO4All (free driver available on the internet). I use ASIO4All when recording from my keyboard.

More information on what your setup would be like would help understand your requirements.