Hey Boris. Given the same seed, IOTA always generates the same private keys (and consequently same addresses).
The wallet acts as a convenience, caching transactions locally so that you don't have to download them every time you launch the wallet. However, it does not need to store any private keys; it is a relatively trivial operation to regenerate them (as long as you enter in the correct seed).
To directly answer your question, you are correct; you can delete your light wallet (or even a full node) and access your entire balance in the future on any device, as long as you have the seed.
This also means that anyone else who obtains your seed can access your balance, so protect it well!