Firefox does a good job of cleaning up after itself.
You should know that if you're intending to use this to hide your activities from your employer or for use in a school, its very likely they're using another means to monitor what you do. It's impossible to circumvent if they do it right.