oga/xml at d5569ead0b1fd84e9d6525f1003c078712268df1 - oga

History

Yorick Peterse 629dcd3fe6 Support for IO inputs in the lexer. Using IO/StringIO objects one can parse large XML files without first having to read the entire file into memory. This can potentially save a lot of memory at the cost of a slightly slower runtime. For IO like instances the lexer will consume the input line by line. If a String is given it's consumed as a whole instead. A small side effect of reading the input line by line is that text such as "foo\nbar" will be lexed as two tokens instead of one. Fixes #19.	2014-05-26 00:30:39 +02:00
..
Lexer.rl	Support for IO inputs in the lexer.	2014-05-26 00:30:39 +02:00

Yorick Peterse 629dcd3fe6 Support for IO inputs in the lexer.

Using IO/StringIO objects one can parse large XML files without first having to
read the entire file into memory. This can potentially save a lot of memory at
the cost of a slightly slower runtime.

For IO like instances the lexer will consume the input line by line. If a
String is given it's consumed as a whole instead. A small side effect of
reading the input line by line is that text such as "foo\nbar" will be lexed as
two tokens instead of one.

Fixes #19.

2014-05-26 00:30:39 +02:00

Lexer.rl

Support for IO inputs in the lexer.

2014-05-26 00:30:39 +02:00