Outlook Shutdown Addin from daveswebsite.com may be useful for getting rid of outlook as it often stays around. Personally though I'd try and work out why it stays in memory.