core
/
oga
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
oga/lib/oga.rb

57 lines
1.5 KiB
Ruby
Raw Normal View History

Basic XPath parser setup.
2014-06-01 21:02:28 +00:00
require 'ast'
Use a Set for storing void element names.
2014-04-10 10:28:47 +00:00
require 'set'
Added require() for StringIO. This is needed since the lexer checks if the input is a StringIO instance.
2014-07-01 07:37:52 +00:00
require 'stringio'
Lazy decoding of XML/HTML entities. Instead of decoding entities in the lexer we'll do this whenever XML::Text#text is called. This removes the overhead from the parsing phase and ensures the process is only triggered when actually needed. Note that calling #to_xml and/or the #inspect methods on a Text (or parent) instance will also trigger the entity conversion process. The new entity decoding API supports both regular entities (e.g. &) as well as codepoint based entities (both regular and hexadecimal codepoints). To allow safe read-only access to Text instances from multiple threads a mutex is used. This mutex ensures that only 1 thread can trigger the conversion process. Fixes #68
2015-03-05 22:00:43 +00:00
require 'thread'
Imported a half-assed lexer.
2014-02-26 18:54:11 +00:00
Convenience methods for parsing XML/HTML.
2014-09-03 07:30:56 +00:00
require_relative 'oga/version'
require_relative 'oga/oga'
Added thread-safe LRU class This class will be used for storing parser XPath/CSS ASTs. See #71 for more information.
2015-03-22 23:21:52 +00:00
require_relative 'oga/lru'
Added Oga::EntityDecoder This module removes some of the code duplication needed to determine what entity decoder to use.
2015-04-07 19:17:46 +00:00
require_relative 'oga/entity_decoder'
Added NodeNameSet class This class can be used to more easily create a Set containing both lowercase and uppercase element names.
2015-04-21 22:54:29 +00:00
require_relative 'oga/node_name_set'
Convenience methods for parsing XML/HTML.
2014-09-03 07:30:56 +00:00
Slap JRuby so that it can load the .jar file.
2014-05-06 18:45:26 +00:00
# Load these first so that the native extensions don't have to define the
# Oga::XML namespace.
Namespaced the lexer/parser under Oga::XML. With the upcoming XPath and CSS selector lexers/parsers it will be confusing to keep these in the root namespace.
2014-03-25 08:34:38 +00:00
require_relative 'oga/xml/lexer'
require_relative 'oga/xml/parser'
Basic pull parsing setup. This parser extends the regular DOM parser but instead delegates certain nodes to a block instead of building a DOM tree. The API is a bit raw in its current form but I'll extend it and make it a bit more user friendly in the following commits. In particular I want to make it easier to figure out if a certain node is nested inside another node.
2014-04-28 15:22:17 +00:00
Manually bootstrap JRuby after all. After discussing this with @headius I've decided to do this the manual way anyway. Apparently the basic load service stuff is deprecated and not very reliable.
2014-05-07 20:32:34 +00:00
require_relative 'liboga'
Setup Ragel for JRuby and load things the hard way
2014-05-06 17:06:04 +00:00
Disable code coverage for JRuby specific code.
2014-06-23 07:42:14 +00:00
#:nocov:
Manually bootstrap JRuby after all. After discussing this with @headius I've decided to do this the manual way anyway. Apparently the basic load service stuff is deprecated and not very reliable.
2014-05-07 20:32:34 +00:00
if RUBY_PLATFORM == 'java'
org.liboga.Liboga.load(JRuby.runtime)
end
Disable code coverage for JRuby specific code.
2014-06-23 07:42:14 +00:00
#:nocov:
Slap JRuby so that it can load the .jar file.
2014-05-06 18:45:26 +00:00
self-close certain XML/HTML elements. When an XML element has no child nodes a self-closing tag is used. When parsing documents/elements in HTML mode this is only done if the element is a so called "void element" (e.g. <link> tags). This fixes #46.
2014-09-15 22:44:38 +00:00
require_relative 'oga/xml/html_void_elements'
Encode/decode XML entities. When lexing XML entities such as &amp; and &lt; these sequences are now converted into their "actual" forms. In turn, Oga::XML::Text#to_xml ensures they are encoded when the method is called. Performance wise this puts some strain on the lexer, for every T_TEXT/T_STRING node now potentially has to have its content modified. In the benchmark xml/lexer/string_average_bench.rb the average processing time is now about the same as before the improvements made in 8db77c0a09bf6c996dd2856a6dbe1ad076b1d30a. I was hoping that the lexer would still be a bit faster, but alas this is not the case. Doing this in native code would be a nightmare as C doesn't have a proper string replacement function. I'm not old/sadistic enough to write on myself just yet. This fixes #49
2014-09-28 19:35:00 +00:00
require_relative 'oga/xml/entities'
XML module for more easily querying using XPath.
2014-09-02 18:16:52 +00:00
require_relative 'oga/xml/querying'
Moved Document#each_node into a separate module. This allows it to be re-used by XML::Node.
2014-09-05 17:42:38 +00:00
require_relative 'oga/xml/traversal'
Initial rough sketches for the DOM API.
2014-03-26 17:12:00 +00:00
require_relative 'oga/xml/node'
Rough DOM building setup.
2014-03-28 07:59:48 +00:00
require_relative 'oga/xml/document'
Use a new base class for XML text nodes. The classes Text, Cdata and Comment now extend CharacterData instead of Text.
2014-08-15 08:43:16 +00:00
require_relative 'oga/xml/character_node'
Dedicated DOM builder class for CDATA tags.
2014-03-28 08:27:53 +00:00
require_relative 'oga/xml/text'
require_relative 'oga/xml/comment'
require_relative 'oga/xml/cdata'
Dedicated handling of XML declaration nodes.
2014-04-02 20:30:45 +00:00
require_relative 'oga/xml/xml_declaration'
Support for parsing XML processing instructions.
2014-08-15 20:23:26 +00:00
require_relative 'oga/xml/processing_instruction'
Tree building of doctypes.
2014-04-03 20:44:00 +00:00
require_relative 'oga/xml/doctype'
Tests for the Namespace class.
2014-08-07 18:01:14 +00:00
require_relative 'oga/xml/namespace'
Moved default namespace into Oga::XML The default namespace is now located at Oga::XML::DEFAULT_NAMESPACE instead of Oga::XML::Attribute::DEFAULT_NAMESPACE.
2015-03-25 23:35:28 +00:00
require_relative 'oga/xml/default_namespace'
Default attribute namespaces. When an attribute is prefixed with "xml" the default namespace should be used automatically. This namespace is not registered on element level by default as this namespace isn't registered manually, instead it's a "magic" namespace. This also ensures we match the behaviour of libxml more closely, hopefully reducing confusion.
2014-08-27 18:24:40 +00:00
require_relative 'oga/xml/attribute'
Extra type validation for XML::Element options.
2014-08-07 19:10:01 +00:00
require_relative 'oga/xml/element'
Specs for the NodeSet class.
2014-06-26 17:52:03 +00:00
require_relative 'oga/xml/node_set'
Added a convenience class for parsing HTML. This removes the need for users having to set the `:html` option themselves.
2014-03-25 08:40:24 +00:00
Implemented a basic SAX API. This API is a little bit dodgy (similar to Nokogiri's API) due to the use of separate parser and handler classes. This is done to ensure that the return values of callback methods (e.g. on_element) aren't used by Racc for building AST trees. This also ensures that whatever variables are set by the handler don't conflict with any variables of the parser. This fixes #42.
2014-09-16 12:30:46 +00:00
require_relative 'oga/xml/sax_parser'
Removed the node_type method crap. The logic this was used for now only resides in the pull parser, instead of being exposed to the public. This fixes #30.
2014-09-13 13:09:52 +00:00
require_relative 'oga/xml/pull_parser'
Implemented a basic SAX API. This API is a little bit dodgy (similar to Nokogiri's API) due to the use of separate parser and handler classes. This is done to ensure that the return values of callback methods (e.g. on_element) aren't used by Racc for building AST trees. This also ensures that whatever variables are set by the handler don't conflict with any variables of the parser. This fixes #42.
2014-09-16 12:30:46 +00:00
Added a convenience class for parsing HTML. This removes the need for users having to set the `:html` option themselves.
2014-03-25 08:40:24 +00:00
require_relative 'oga/html/parser'
Implemented a basic SAX API. This API is a little bit dodgy (similar to Nokogiri's API) due to the use of separate parser and handler classes. This is done to ensure that the return values of callback methods (e.g. on_element) aren't used by Racc for building AST trees. This also ensures that whatever variables are set by the handler don't conflict with any variables of the parser. This fixes #42.
2014-09-16 12:30:46 +00:00
require_relative 'oga/html/sax_parser'
Lazy decoding of XML/HTML entities. Instead of decoding entities in the lexer we'll do this whenever XML::Text#text is called. This removes the overhead from the parsing phase and ensures the process is only triggered when actually needed. Note that calling #to_xml and/or the #inspect methods on a Text (or parent) instance will also trigger the entity conversion process. The new entity decoding API supports both regular entities (e.g. &amp;) as well as codepoint based entities (both regular and hexadecimal codepoints). To allow safe read-only access to Text instances from multiple threads a mutex is used. This mutex ensures that only 1 thread can trigger the conversion process. Fixes #68
2015-03-05 22:00:43 +00:00
require_relative 'oga/html/entities'
Boilerplate for the XPath lexer.
2014-05-14 06:48:49 +00:00
require_relative 'oga/xpath/lexer'
Basic XPath parser setup.
2014-06-01 21:02:28 +00:00
require_relative 'oga/xpath/parser'
Initial, half-assed attempt at an XPath evaluator.
2014-07-07 17:41:09 +00:00
require_relative 'oga/xpath/evaluator'
Basic boilerplate for lexing CSS selectors.
2014-09-16 14:32:57 +00:00
require_relative 'oga/css/lexer'
Basic CSS parser boilerplate. This currently only parses single node tests (e.g. just "foo").
2014-10-02 21:31:58 +00:00
require_relative 'oga/css/parser'