core
/
oga
3
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
oga/lib/oga.rb

66 lines
1.4 KiB
Ruby
Raw Normal View History

Basic XPath parser setup.
2014-06-01 21:02:28 +00:00
require 'ast'
Use a Set for storing void element names.
2014-04-10 10:28:47 +00:00
require 'set'
Added require() for StringIO. This is needed since the lexer checks if the input is a StringIO instance.
2014-07-01 07:37:52 +00:00
require 'stringio'
Lazy decoding of XML/HTML entities. Instead of decoding entities in the lexer we'll do this whenever XML::Text#text is called. This removes the overhead from the parsing phase and ensures the process is only triggered when actually needed. Note that calling #to_xml and/or the #inspect methods on a Text (or parent) instance will also trigger the entity conversion process. The new entity decoding API supports both regular entities (e.g. &) as well as codepoint based entities (both regular and hexadecimal codepoints). To allow safe read-only access to Text instances from multiple threads a mutex is used. This mutex ensures that only 1 thread can trigger the conversion process. Fixes #68
2015-03-05 22:00:43 +00:00
require 'thread'
Imported a half-assed lexer.
2014-02-26 18:54:11 +00:00
Use require vs require_relative See ruby-ll commit b27fe7cc109a39184ac984405a1e452868f3fac9 for a more in-depth explanation of this.
2015-06-03 04:42:30 +00:00
require 'oga/version'
require 'oga/oga'
require 'oga/lru'
require 'oga/entity_decoder'
require 'oga/blacklist'
require 'oga/whitelist'
Convenience methods for parsing XML/HTML.
2014-09-03 07:30:56 +00:00
Slap JRuby so that it can load the .jar file.
2014-05-06 18:45:26 +00:00
# Load these first so that the native extensions don't have to define the
# Oga::XML namespace.
Use require vs require_relative See ruby-ll commit b27fe7cc109a39184ac984405a1e452868f3fac9 for a more in-depth explanation of this.
2015-06-03 04:42:30 +00:00
require 'oga/xml/lexer'
require 'oga/xml/parser'
Basic pull parsing setup. This parser extends the regular DOM parser but instead delegates certain nodes to a block instead of building a DOM tree. The API is a bit raw in its current form but I'll extend it and make it a bit more user friendly in the following commits. In particular I want to make it easier to figure out if a certain node is nested inside another node.
2014-04-28 15:22:17 +00:00
Use require vs require_relative See ruby-ll commit b27fe7cc109a39184ac984405a1e452868f3fac9 for a more in-depth explanation of this.
2015-06-03 04:42:30 +00:00
require 'liboga'
Setup Ragel for JRuby and load things the hard way
2014-05-06 17:06:04 +00:00
Disable code coverage for JRuby specific code.
2014-06-23 07:42:14 +00:00
#:nocov:
Manually bootstrap JRuby after all. After discussing this with @headius I've decided to do this the manual way anyway. Apparently the basic load service stuff is deprecated and not very reliable.
2014-05-07 20:32:34 +00:00
if RUBY_PLATFORM == 'java'
org.liboga.Liboga.load(JRuby.runtime)
end
Disable code coverage for JRuby specific code.
2014-06-23 07:42:14 +00:00
#:nocov:
Slap JRuby so that it can load the .jar file.
2014-05-06 18:45:26 +00:00
Generate XML without relying on recursion While using recursion is an easy way of generating XML it can lead to the call stack overflowing when serialising documents with lots of nested nodes. Generally there are two ways of working around this: 1. Use an explicit stack (e.g. an array or a queue of sorts) instead of relying on the call stack. 2. Use an algorithm that doesn't use a stack at all (e.g. Morris traversal). This commit introduces the XML::Generator class which can serialize documents back to XML without using a stack at all. This class takes advantage of XML nodes having access to not only their child nodes, but also their siblings and their parents. All XML serialisation logic now resides in the XML::Generator class. In turn the various "to_xml" methods just use this class and serialize everything starting at "self".
2016-09-03 19:24:19 +00:00
require 'oga/xml/to_xml'
Use require vs require_relative See ruby-ll commit b27fe7cc109a39184ac984405a1e452868f3fac9 for a more in-depth explanation of this.
2015-06-03 04:42:30 +00:00
require 'oga/xml/html_void_elements'
require 'oga/xml/entities'
require 'oga/xml/querying'
require 'oga/xml/traversal'
Added expanded_name for Element and Attribute
2015-08-18 12:07:09 +00:00
require 'oga/xml/expanded_name'
Use require vs require_relative See ruby-ll commit b27fe7cc109a39184ac984405a1e452868f3fac9 for a more in-depth explanation of this.
2015-06-03 04:42:30 +00:00
require 'oga/xml/node'
require 'oga/xml/document'
require 'oga/xml/character_node'
require 'oga/xml/text'
require 'oga/xml/comment'
require 'oga/xml/cdata'
require 'oga/xml/processing_instruction'
Make XmlDeclaration a ProcessingInstruction This allows Oga to parse documents that contain an XML declaration at a place other than at the document root. Oga still only assigns the XML declaration to the document whenever it is at the top-level. This matches libxml/XML specification behaviour as far as I can tell.
2016-09-17 12:39:07 +00:00
require 'oga/xml/xml_declaration'
Use require vs require_relative See ruby-ll commit b27fe7cc109a39184ac984405a1e452868f3fac9 for a more in-depth explanation of this.
2015-06-03 04:42:30 +00:00
require 'oga/xml/doctype'
require 'oga/xml/namespace'
require 'oga/xml/default_namespace'
require 'oga/xml/attribute'
require 'oga/xml/element'
require 'oga/xml/node_set'
Generate XML without relying on recursion While using recursion is an easy way of generating XML it can lead to the call stack overflowing when serialising documents with lots of nested nodes. Generally there are two ways of working around this: 1. Use an explicit stack (e.g. an array or a queue of sorts) instead of relying on the call stack. 2. Use an algorithm that doesn't use a stack at all (e.g. Morris traversal). This commit introduces the XML::Generator class which can serialize documents back to XML without using a stack at all. This class takes advantage of XML nodes having access to not only their child nodes, but also their siblings and their parents. All XML serialisation logic now resides in the XML::Generator class. In turn the various "to_xml" methods just use this class and serialize everything starting at "self".
2016-09-03 19:24:19 +00:00
require 'oga/xml/generator'
Use require vs require_relative See ruby-ll commit b27fe7cc109a39184ac984405a1e452868f3fac9 for a more in-depth explanation of this.
2015-06-03 04:42:30 +00:00
require 'oga/xml/sax_parser'
require 'oga/xml/pull_parser'
require 'oga/html/parser'
require 'oga/html/sax_parser'
require 'oga/html/entities'
Added Oga::Ruby::Node This class will be used for building Ruby ASTs that will be generated based on XPath expressions.
2015-07-02 20:52:07 +00:00
require 'oga/ruby/node'
Added Ruby::Generator class This class will be used to serialize a Ruby AST back to valid Ruby source code (as a String).
2015-07-02 21:15:10 +00:00
require 'oga/ruby/generator'
Added Oga::Ruby::Node This class will be used for building Ruby ASTs that will be generated based on XPath expressions.
2015-07-02 20:52:07 +00:00
Use require vs require_relative See ruby-ll commit b27fe7cc109a39184ac984405a1e452868f3fac9 for a more in-depth explanation of this.
2015-06-03 04:42:30 +00:00
require 'oga/xpath/lexer'
require 'oga/xpath/parser'
Evaluate compiled blocks in an isolated Binding Re-using the Binding of the XPath::Compiler#compile method would lead to race conditions, and possibly a memory leak due to the Binding sticking around for compiled Proc's lifetime. By using a dedicated class (and its corresponding Binding) we can work around this. Access to this class is not synchronized as compiled Procs don't mutate their enclosing environment. The race condition can be demonstrated using code such as the following: xml = <<-EOF <people> <person> <name>Alice</name> </person> <person> <name>Bob</name> </person> <person> <name>Eve</name> </person> </people> EOF 4.times.map do Thread.new do 10_000.times do document = Oga.parse_xml(xml) document.at_xpath('people/person/name').text end end end.each(&:join) Running this code would result in NoMethodErrors due to "at_xpath" returning a NilClass opposed to an Oga::XML::Element.
2015-09-07 12:02:31 +00:00
require 'oga/xpath/context'
Super basic boilerplate for the XPath compiler
2015-06-22 21:49:09 +00:00
require 'oga/xpath/compiler'
XPath compiler support for the "=" operator
2015-07-26 23:00:14 +00:00
require 'oga/xpath/conversion'
Use require vs require_relative See ruby-ll commit b27fe7cc109a39184ac984405a1e452868f3fac9 for a more in-depth explanation of this.
2015-06-03 04:42:30 +00:00
require 'oga/css/lexer'
require 'oga/css/parser'