On Jul 18, 2018, at 10:21 AM, Paul Berger via cctalk <cctalk at classiccmp.org>
wrote:
I would think that any interpreted BASIC would do this
or for that matter any interpreted language except maybe for APL
You'd think so but many BASIC dialects don't fully tokenize. Many leave in all the
extra spaces the user types in, such as the Microsoft BASIC on various Commodores. Some
BASICs even require the spaces in order to properly parse during tokenization.
There's a page here which includes a field for machines which do full tokenization:
https://en.wikipedia.org/wiki/List_of_computers_with_on-board_BASIC
--
Follow me on twitter: @FozzTexx
Check out my blog:
http://insentricity.com