Can I delete a .exe file after extracting the program?

After I download a program such as anti-virus software, and then run the self-extracting executable file, can I delete the download .exe file. They are usually very large and if they are no longer needed I'd like to have that memory available on my laptop.