Critics have remarked that those four worthies were truly peerless throughout the ages; yet the present falls short of the pastβthe ancients favored unadorned simplicity, whereas the moderns prefer refined elegance. Styles of substance and ornament rise and fall in succession, shifting with the changing mores of the times; such evolution is simply the natural order of things. The ideal lies in honoring antiquity without clashing with the present, and embracing modernity without succumbing to its flawsβembodying that perfect balance of substance and refinement that defines the true gentleman. There is surely no need to abandon a carved palace in favor of a cave dwelling, or to trade a jade carriage for a primitive cart with solid wooden wheels.
<?php
/*
* This file is part of the Symfony package.
*
* (c) Fabien Potencier <fabien@symfony.com>
*
* For the full copyright and license information, please view the LICENSE
* file that was distributed with this source code.
*/
namespace Symfony\Component\DomCrawler;
use Masterminds\HTML5;
use Symfony\Component\CssSelector\CssSelectorConverter;
/**
* Crawler eases navigation of a list of \DOMNode objects.
*
* @author Fabien Potencier <fabien@symfony.com>
*
* @implements \IteratorAggregate<int, \DOMNode>
*/
class Crawler implements \Countable, \IteratorAggregate
{
/**
* @var string|null
*/
protected $uri;
/**
* The default namespace prefix to be used with XPath and CSS expressions.
*/
private string $defaultNamespacePrefix = 'default';
/**
* A map of manually registered namespaces.
*
* @var array<string, string>
*/
private array $namespaces = [];
/**
* A map of cached namespaces.
*/
private \ArrayObject $cachedNamespaces;
private ?string $baseHref;
private ?\DOMDocument $document = null;
/**
* @var list<\DOMNode>
*/
private array $nodes = [];
/**
* Whether the Crawler contains HTML or XML content (used when converting CSS to XPath).
*/
private bool $isHtml = true;
private ?HTML5 $html5Parser = null;
/**
* @param \DOMNodeList|\DOMNode|\DOMNode[]|string|null $node A Node to use as the base for the crawling
*/
public function __construct(\DOMNodeList|\DOMNode|array|string $node = null, string $uri = null, string $baseHref = null, bool $useHtml5Parser = true)
{
$this->uri = $uri;
$this->baseHref = $baseHref ?: $uri;
$this->html5Parser = $useHtml5Parser ? new HTML5(['disable_html_ns' => true]) : null;
$this->cachedNamespaces = new \ArrayObject();
$this->add($node);
}
/**
* Returns the current URI.
*/
public function getUri(): ?string
{
return $this->uri;
}
/**
* Returns base href.
*/
public function getBaseHref(): ?string
{
return $this->baseHref;
}
/**
* Removes all the nodes.
*
* @return void
*/
public function clear()
{
$this->nodes = [];
$this->document = null;
$this->cachedNamespaces = new \ArrayObject();
}
/**
* Adds a node to the current list of nodes.
*
* This method uses the appropriate specialized add*() method based
* on the type of the argument.
*
* @param \DOMNodeList|\DOMNode|\DOMNode[]|string|null $node A node
*
* @return void
*
* @throws \InvalidArgumentException when node is not the expected type
*/
public function add(\DOMNodeList|\DOMNode|array|string|null $node)
{
if ($node instanceof \DOMNodeList) {
$this->addNodeList($node);
} elseif ($node instanceof \DOMNode) {
$this->addNode($node);
} elseif (\is_array($node)) {
$this->addNodes($node);
} elseif (\is_string($node)) {
$this->addContent($node);
} elseif (null !== $node) {
throw new \InvalidArgumentException(sprintf('Expecting a DOMNodeList or DOMNode instance, an array, a string, or null, but got "%s".', get_debug_type($node)));
}
}
/**
* Adds HTML/XML content.
*
* If the charset is not set via the content type, it is assumed to be UTF-8,
* or ISO-8859-1 as a fallback, which is the default charset defined by the
* HTTP 1.1 specification.
*
* @return void
*/
public function addContent(string $content, string $type = null)
{
if (empty($type)) {
$type = str_starts_with($content, '<?xml') ? 'application/xml' : 'text/html';
}
// DOM only for HTML/XML content
if (!preg_match('/(x|ht)ml/i', $type, $xmlMatches)) {
return;
}
$charset = preg_match('//u', $content) ? 'UTF-8' : 'ISO-8859-1';
// http://www.w3.org/TR/encoding/#encodings
// http://www.w3.org/TR/REC-xml/#NT-EncName
$content = preg_replace_callback('/(charset *= *["\']?)([a-zA-Z\-0-9_:.]+)/i', function ($m) use (&$charset) {
if ('charset=' === $this->convertToHtmlEntities('charset=', $m[2])) {
$charset = $m[2];
}
return $m[1].$charset;
}, $content, 1);
if ('x' === $xmlMatches[1]) {
$this->addXmlContent($content, $charset);
} else {
$this->addHtmlContent($content, $charset);
}
}
/**
* Adds an HTML content to the list of nodes.
*
* The libxml errors are disabled when the content is parsed.
*
* If you want to get parsing errors, be sure to enable
* internal errors via libxml_use_internal_errors(true)
* and then, get the errors via libxml_get_errors(). Be
* sure to clear errors with libxml_clear_errors() afterward.
*
* @return void
*/
public function addHtmlContent(string $content, string $charset = 'UTF-8')
{
$dom = $this->parseHtmlString($content, $charset);
$this->addDocument($dom);
$base = $this->filterRelativeXPath('descendant-or-self::base')->extract(['href']);
$baseHref = current($base);
if (\count($base) && !empty($baseHref)) {
if ($this->baseHref) {
$linkNode = $dom->createElement('a');
$linkNode->setAttribute('href', $baseHref);
$link = new Link($linkNode, $this->baseHref);
$this->baseHref = $link->getUri();
} else {
$this->baseHref = $baseHref;
}
}
}
/**
* Adds an XML content to the list of nodes.
*
* The libxml errors are disabled when the content is parsed.
*
* If you want to get parsing errors, be sure to enable
* internal errors via libxml_use_internal_errors(true)
* and then, get the errors via libxml_get_errors(). Be
* sure to clear errors with libxml_clear_errors() afterward.
*
* @param int $options Bitwise OR of the libxml option constants
* LIBXML_PARSEHUGE is dangerous, see
* http://symfony.com/blog/security-release-symfony-2-0-17-released
*
* @return void
*/
public function addXmlContent(string $content, string $charset = 'UTF-8', int $options = \LIBXML_NONET)
{
// remove the default namespace if it's the only namespace to make XPath expressions simpler
if (!str_contains($content, 'xmlns:')) {
$content = str_replace('xmlns', 'ns', $content);
}
$internalErrors = libxml_use_internal_errors(true);
$dom = new \DOMDocument('1.0', $charset);
$dom->validateOnParse = true;
if ('' !== trim($content)) {
@$dom->loadXML($content, $options);
}
libxml_use_internal_errors($internalErrors);
$this->addDocument($dom);
$this->isHtml = false;
}
/**
* Adds a \DOMDocument to the list of nodes.
*
* @param \DOMDocument $dom A \DOMDocument instance
*
* @return void
*/
public function addDocument(\DOMDocument $dom)
{
if ($dom->documentElement) {
$this->addNode($dom->documentElement);
}
}
/**
* Adds a \DOMNodeList to the list of nodes.
*
* @param \DOMNodeList $nodes A \DOMNodeList instance
*
* @return void
*/
public function addNodeList(\DOMNodeList $nodes)
{
foreach ($nodes as $node) {
if ($node instanceof \DOMNode) {
$this->addNode($node);
}
}
}
/**
* Adds an array of \DOMNode instances to the list of nodes.
*
* @param \DOMNode[] $nodes An array of \DOMNode instances
*
* @return void
*/
public function addNodes(array $nodes)
{
foreach ($nodes as $node) {
$this->add($node);
}
}
/**
* Adds a \DOMNode instance to the list of nodes.
*
* @param \DOMNode $node A \DOMNode instance
*
* @return void
*/
public function addNode(\DOMNode $node)
{
if ($node instanceof \DOMDocument) {
$node = $node->documentElement;
}
if (null !== $this->document && $this->document !== $node->ownerDocument) {
throw new \InvalidArgumentException('Attaching DOM nodes from multiple documents in the same crawler is forbidden.');
}
$this->document ??= $node->ownerDocument;
// Don't add duplicate nodes in the Crawler
if (\in_array($node, $this->nodes, true)) {
return;
}
$this->nodes[] = $node;
}
/**
* Returns a node given its position in the node list.
*/
public function eq(int $position): static
{
if (isset($this->nodes[$position])) {
return $this->createSubCrawler($this->nodes[$position]);
}
return $this->createSubCrawler(null);
}
/**
* Calls an anonymous function on each node of the list.
*
* The anonymous function receives the position and the node wrapped
* in a Crawler instance as arguments.
*
* Example:
*
* $crawler->filter('h1')->each(function ($node, $i) {
* return $node->text();
* });
*
* @param \Closure $closure An anonymous function
*
* @return array An array of values returned by the anonymous function
*/
public function each(\Closure $closure): array
{
$data = [];
foreach ($this->nodes as $i => $node) {
$data[] = $closure($this->createSubCrawler($node), $i);
}
return $data;
}
/**
* Slices the list of nodes by $offset and $length.
*/
public function slice(int $offset = 0, int $length = null): static
{
return $this->createSubCrawler(\array_slice($this->nodes, $offset, $length));
}
/**
* Reduces the list of nodes by calling an anonymous function.
*
* To remove a node from the list, the anonymous function must return false.
*
* @param \Closure $closure An anonymous function
*/
public function reduce(\Closure $closure): static
{
$nodes = [];
foreach ($this->nodes as $i => $node) {
if (false !== $closure($this->createSubCrawler($node), $i)) {
$nodes[] = $node;
}
}
return $this->createSubCrawler($nodes);
}
/**
* Returns the first node of the current selection.
*/
public function first(): static
{
return $this->eq(0);
}
/**
* Returns the last node of the current selection.
*/
public function last(): static
{
return $this->eq(\count($this->nodes) - 1);
}
/**
* Returns the siblings nodes of the current selection.
*
* @throws \InvalidArgumentException When current node is empty
*/
public function siblings(): static
{
if (!$this->nodes) {
throw new \InvalidArgumentException('The current node list is empty.');
}
return $this->createSubCrawler($this->sibling($this->getNode(0)->parentNode->firstChild));
}
public function matches(string $selector): bool
{
if (!$this->nodes) {
return false;
}
$converter = $this->createCssSelectorConverter();
$xpath = $converter->toXPath($selector, 'self::');
return 0 !== $this->filterRelativeXPath($xpath)->count();
}
/**
* Return first parents (heading toward the document root) of the Element that matches the provided selector.
*
* @see https://developer.mozilla.org/en-US/docs/Web/API/Element/closest#Polyfill
*
* @throws \InvalidArgumentException When current node is empty
*/
public function closest(string $selector): ?self
{
if (!$this->nodes) {
throw new \InvalidArgumentException('The current node list is empty.');
}
$domNode = $this->getNode(0);
while (\XML_ELEMENT_NODE === $domNode->nodeType) {
$node = $this->createSubCrawler($domNode);
if ($node->matches($selector)) {
return $node;
}
$domNode = $node->getNode(0)->parentNode;
}
return null;
}
/**
* Returns the next siblings nodes of the current selection.
*
* @throws \InvalidArgumentException When current node is empty
*/
public function nextAll(): static
{
if (!$this->nodes) {
throw new \InvalidArgumentException('The current node list is empty.');
}
return $this->createSubCrawler($this->sibling($this->getNode(0)));
}
/**
* Returns the previous sibling nodes of the current selection.
*
* @throws \InvalidArgumentException
*/
public function previousAll(): static
{
if (!$this->nodes) {
throw new \InvalidArgumentException('The current node list is empty.');
}
return $this->createSubCrawler($this->sibling($this->getNode(0), 'previousSibling'));
}
/**
* Returns the ancestors of the current selection.
*
* @throws \InvalidArgumentException When the current node is empty
*/
public function ancestors(): static
{
if (!$this->nodes) {
throw new \InvalidArgumentException('The current node list is empty.');
}
$node = $this->getNode(0);
$nodes = [];
while ($node = $node->parentNode) {
if (\XML_ELEMENT_NODE === $node->nodeType) {
$nodes[] = $node;
}
}
return $this->createSubCrawler($nodes);
}
/**
* Returns the children nodes of the current selection.
*
* @throws \InvalidArgumentException When current node is empty
* @throws \RuntimeException If the CssSelector Component is not available and $selector is provided
*/
public function children(string $selector = null): static
{
if (!$this->nodes) {
throw new \InvalidArgumentException('The current node list is empty.');
}
if (null !== $selector) {
$converter = $this->createCssSelectorConverter();
$xpath = $converter->toXPath($selector, 'child::');
return $this->filterRelativeXPath($xpath);
}
$node = $this->getNode(0)->firstChild;
return $this->createSubCrawler($node ? $this->sibling($node) : []);
}
/**
* Returns the attribute value of the first node of the list.
*
* @param string|null $default When not null: the value to return when the node or attribute is empty
*
* @throws \InvalidArgumentException When current node is empty
*/
public function attr(string $attribute/* , string $default = null */): ?string
{
$default = \func_num_args() > 1 ? func_get_arg(1) : null;
if (!$this->nodes) {
if (null !== $default) {
return $default;
}
throw new \InvalidArgumentException('The current node list is empty.');
}
$node = $this->getNode(0);
return $node->hasAttribute($attribute) ? $node->getAttribute($attribute) : $default;
}
/**
* Returns the node name of the first node of the list.
*
* @throws \InvalidArgumentException When current node is empty
*/
public function nodeName(): string
{
if (!$this->nodes) {
throw new \InvalidArgumentException('The current node list is empty.');
}
return $this->getNode(0)->nodeName;
}
/**
* Returns the text of the first node of the list.
*
* Pass true as the second argument to normalize whitespaces.
*
* @param string|null $default When not null: the value to return when the current node is empty
* @param bool $normalizeWhitespace Whether whitespaces should be trimmed and normalized to single spaces
*
* @throws \InvalidArgumentException When current node is empty
*/
public function text(string $default = null, bool $normalizeWhitespace = true): string
{
if (!$this->nodes) {
if (null !== $default) {
return $default;
}
throw new \InvalidArgumentException('The current node list is empty.');
}
$text = $this->getNode(0)->nodeValue;
if ($normalizeWhitespace) {
return $this->normalizeWhitespace($text);
}
return $text;
}
/**
* Returns only the inner text that is the direct descendent of the current node, excluding any child nodes.
*
* @param bool $normalizeWhitespace Whether whitespaces should be trimmed and normalized to single spaces
*/
public function innerText(/* bool $normalizeWhitespace = true */): string
{
$normalizeWhitespace = 1 <= \func_num_args() ? func_get_arg(0) : true;
foreach ($this->getNode(0)->childNodes as $childNode) {
if (\XML_TEXT_NODE !== $childNode->nodeType && \XML_CDATA_SECTION_NODE !== $childNode->nodeType) {
continue;
}
if (!$normalizeWhitespace) {
return $childNode->nodeValue;
}
if ('' !== trim($childNode->nodeValue)) {
return $this->normalizeWhitespace($childNode->nodeValue);
}
}
return '';
}
/**
* Returns the first node of the list as HTML.
*
* @param string|null $default When not null: the value to return when the current node is empty
*
* @throws \InvalidArgumentException When current node is empty
*/
public function html(string $default = null): string
{
if (!$this->nodes) {
if (null !== $default) {
return $default;
}
throw new \InvalidArgumentException('The current node list is empty.');
}
$node = $this->getNode(0);
$owner = $node->ownerDocument;
if ($this->html5Parser && '<!DOCTYPE html>' === $owner->saveXML($owner->childNodes[0])) {
$owner = $this->html5Parser;
}
$html = '';
foreach ($node->childNodes as $child) {
$html .= $owner->saveHTML($child);
}
return $html;
}
public function outerHtml(): string
{
if (!\count($this)) {
throw new \InvalidArgumentException('The current node list is empty.');
}
$node = $this->getNode(0);
$owner = $node->ownerDocument;
if ($this->html5Parser && '<!DOCTYPE html>' === $owner->saveXML($owner->childNodes[0])) {
$owner = $this->html5Parser;
}
return $owner->saveHTML($node);
}
/**
* Evaluates an XPath expression.
*
* Since an XPath expression might evaluate to either a simple type or a \DOMNodeList,
* this method will return either an array of simple types or a new Crawler instance.
*/
public function evaluate(string $xpath): array|self
{
if (null === $this->document) {
throw new \LogicException('Cannot evaluate the expression on an uninitialized crawler.');
}
$data = [];
$domxpath = $this->createDOMXPath($this->document, $this->findNamespacePrefixes($xpath));
foreach ($this->nodes as $node) {
$data[] = $domxpath->evaluate($xpath, $node);
}
if (isset($data[0]) && $data[0] instanceof \DOMNodeList) {
return $this->createSubCrawler($data);
}
return $data;
}
/**
* Extracts information from the list of nodes.
*
* You can extract attributes or/and the node value (_text).
*
* Example:
*
* $crawler->filter('h1 a')->extract(['_text', 'href']);
*/
public function extract(array $attributes): array
{
$count = \count($attributes);
$data = [];
foreach ($this->nodes as $node) {
$elements = [];
foreach ($attributes as $attribute) {
if ('_text' === $attribute) {
$elements[] = $node->nodeValue;
} elseif ('_name' === $attribute) {
$elements[] = $node->nodeName;
} else {
$elements[] = $node->getAttribute($attribute);
}
}
$data[] = 1 === $count ? $elements[0] : $elements;
}
return $data;
}
/**
* Filters the list of nodes with an XPath expression.
*
* The XPath expression is evaluated in the context of the crawler, which
* is considered as a fake parent of the elements inside it.
* This means that a child selector "div" or "./div" will match only
* the div elements of the current crawler, not their children.
*/
public function filterXPath(string $xpath): static
{
$xpath = $this->relativize($xpath);
// If we dropped all expressions in the XPath while preparing it, there would be no match
if ('' === $xpath) {
return $this->createSubCrawler(null);
}
return $this->filterRelativeXPath($xpath);
}
/**
* Filters the list of nodes with a CSS selector.
*
* This method only works if you have installed the CssSelector Symfony Component.
*
* @throws \LogicException if the CssSelector Component is not available
*/
public function filter(string $selector): static
{
$converter = $this->createCssSelectorConverter();
// The CssSelector already prefixes the selector with descendant-or-self::
return $this->filterRelativeXPath($converter->toXPath($selector));
}
/**
* Selects links by name or alt value for clickable images.
*/
public function selectLink(string $value): static
{
return $this->filterRelativeXPath(
sprintf('descendant-or-self::a[contains(concat(\' \', normalize-space(string(.)), \' \'), %1$s) or ./img[contains(concat(\' \', normalize-space(string(@alt)), \' \'), %1$s)]]', static::xpathLiteral(' '.$value.' '))
);
}
/**
* Selects images by alt value.
*/
public function selectImage(string $value): static
{
$xpath = sprintf('descendant-or-self::img[contains(normalize-space(string(@alt)), %s)]', static::xpathLiteral($value));
return $this->filterRelativeXPath($xpath);
}
/**
* Selects a button by name or alt value for images.
*/
public function selectButton(string $value): static
{
return $this->filterRelativeXPath(
sprintf('descendant-or-self::input[((contains(%1$s, "submit") or contains(%1$s, "button")) and contains(concat(\' \', normalize-space(string(@value)), \' \'), %2$s)) or (contains(%1$s, "image") and contains(concat(\' \', normalize-space(string(@alt)), \' \'), %2$s)) or @id=%3$s or @name=%3$s] | descendant-or-self::button[contains(concat(\' \', normalize-space(string(.)), \' \'), %2$s) or @id=%3$s or @name=%3$s]', 'translate(@type, "ABCDEFGHIJKLMNOPQRSTUVWXYZ", "abcdefghijklmnopqrstuvwxyz")', static::xpathLiteral(' '.$value.' '), static::xpathLiteral($value))
);
}
/**
* Returns a Link object for the first node in the list.
*
* @throws \InvalidArgumentException If the current node list is empty or the selected node is not instance of DOMElement
*/
public function link(string $method = 'get'): Link
{
if (!$this->nodes) {
throw new \InvalidArgumentException('The current node list is empty.');
}
$node = $this->getNode(0);
if (!$node instanceof \DOMElement) {
throw new \InvalidArgumentException(sprintf('The selected node should be instance of DOMElement, got "%s".', get_debug_type($node)));
}
return new Link($node, $this->baseHref, $method);
}
/**
* Returns an array of Link objects for the nodes in the list.
*
* @return Link[]
*
* @throws \InvalidArgumentException If the current node list contains non-DOMElement instances
*/
public function links(): array
{
$links = [];
foreach ($this->nodes as $node) {
if (!$node instanceof \DOMElement) {
throw new \InvalidArgumentException(sprintf('The current node list should contain only DOMElement instances, "%s" found.', get_debug_type($node)));
}
$links[] = new Link($node, $this->baseHref, 'get');
}
return $links;
}
/**
* Returns an Image object for the first node in the list.
*
* @throws \InvalidArgumentException If the current node list is empty
*/
public function image(): Image
{
if (!\count($this)) {
throw new \InvalidArgumentException('The current node list is empty.');
}
$node = $this->getNode(0);
if (!$node instanceof \DOMElement) {
throw new \InvalidArgumentException(sprintf('The selected node should be instance of DOMElement, got "%s".', get_debug_type($node)));
}
return new Image($node, $this->baseHref);
}
/**
* Returns an array of Image objects for the nodes in the list.
*
* @return Image[]
*/
public function images(): array
{
$images = [];
foreach ($this as $node) {
if (!$node instanceof \DOMElement) {
throw new \InvalidArgumentException(sprintf('The current node list should contain only DOMElement instances, "%s" found.', get_debug_type($node)));
}
$images[] = new Image($node, $this->baseHref);
}
return $images;
}
/**
* Returns a Form object for the first node in the list.
*
* @throws \InvalidArgumentException If the current node list is empty or the selected node is not instance of DOMElement
*/
public function form(array $values = null, string $method = null): Form
{
if (!$this->nodes) {
throw new \InvalidArgumentException('The current node list is empty.');
}
$node = $this->getNode(0);
if (!$node instanceof \DOMElement) {
throw new \InvalidArgumentException(sprintf('The selected node should be instance of DOMElement, got "%s".', get_debug_type($node)));
}
$form = new Form($node, $this->uri, $method, $this->baseHref);
if (null !== $values) {
$form->setValues($values);
}
return $form;
}
/**
* Overloads a default namespace prefix to be used with XPath and CSS expressions.
*
* @return void
*/
public function setDefaultNamespacePrefix(string $prefix)
{
$this->defaultNamespacePrefix = $prefix;
}
/**
* @return void
*/
public function registerNamespace(string $prefix, string $namespace)
{
$this->namespaces[$prefix] = $namespace;
}
/**
* Converts string for XPath expressions.
*
* Escaped characters are: quotes (") and apostrophe (').
*
* Examples:
*
* echo Crawler::xpathLiteral('foo " bar');
* //prints 'foo " bar'
*
* echo Crawler::xpathLiteral("foo ' bar");
* //prints "foo ' bar"
*
* echo Crawler::xpathLiteral('a\'b"c');
* //prints concat('a', "'", 'b"c')
*/
public static function xpathLiteral(string $s): string
{
if (!str_contains($s, "'")) {
return sprintf("'%s'", $s);
}
if (!str_contains($s, '"')) {
return sprintf('"%s"', $s);
}
$string = $s;
$parts = [];
while (true) {
if (false !== $pos = strpos($string, "'")) {
$parts[] = sprintf("'%s'", substr($string, 0, $pos));
$parts[] = "\"'\"";
$string = substr($string, $pos + 1);
} else {
$parts[] = "'$string'";
break;
}
}
return sprintf('concat(%s)', implode(', ', $parts));
}
/**
* Filters the list of nodes with an XPath expression.
*
* The XPath expression should already be processed to apply it in the context of each node.
*/
private function filterRelativeXPath(string $xpath): static
{
$crawler = $this->createSubCrawler(null);
if (null === $this->document) {
return $crawler;
}
$domxpath = $this->createDOMXPath($this->document, $this->findNamespacePrefixes($xpath));
foreach ($this->nodes as $node) {
$crawler->add($domxpath->query($xpath, $node));
}
return $crawler;
}
/**
* Make the XPath relative to the current context.
*
* The returned XPath will match elements matching the XPath inside the current crawler
* when running in the context of a node of the crawler.
*/
private function relativize(string $xpath): string
{
$expressions = [];
// An expression which will never match to replace expressions which cannot match in the crawler
// We cannot drop
$nonMatchingExpression = 'a[name() = "b"]';
$xpathLen = \strlen($xpath);
$openedBrackets = 0;
$startPosition = strspn($xpath, " \t\n\r\0\x0B");
for ($i = $startPosition; $i <= $xpathLen; ++$i) {
$i += strcspn($xpath, '"\'[]|', $i);
if ($i < $xpathLen) {
switch ($xpath[$i]) {
case '"':
case "'":
if (false === $i = strpos($xpath, $xpath[$i], $i + 1)) {
return $xpath; // The XPath expression is invalid
}
continue 2;
case '[':
++$openedBrackets;
continue 2;
case ']':
--$openedBrackets;
continue 2;
}
}
if ($openedBrackets) {
continue;
}
if ($startPosition < $xpathLen && '(' === $xpath[$startPosition]) {
// If the union is inside some braces, we need to preserve the opening braces and apply
// the change only inside it.
$j = 1 + strspn($xpath, "( \t\n\r\0\x0B", $startPosition + 1);
$parenthesis = substr($xpath, $startPosition, $j);
$startPosition += $j;
} else {
$parenthesis = '';
}
$expression = rtrim(substr($xpath, $startPosition, $i - $startPosition));
if (str_starts_with($expression, 'self::*/')) {
$expression = './'.substr($expression, 8);
}
// add prefix before absolute element selector
if ('' === $expression) {
$expression = $nonMatchingExpression;
} elseif (str_starts_with($expression, '//')) {
$expression = 'descendant-or-self::'.substr($expression, 2);
} elseif (str_starts_with($expression, './/')) {
$expression = 'descendant-or-self::'.substr($expression, 3);
} elseif (str_starts_with($expression, './')) {
$expression = 'self::'.substr($expression, 2);
} elseif (str_starts_with($expression, 'child::')) {
$expression = 'self::'.substr($expression, 7);
} elseif ('/' === $expression[0] || '.' === $expression[0] || str_starts_with($expression, 'self::')) {
$expression = $nonMatchingExpression;
} elseif (str_starts_with($expression, 'descendant::')) {
$expression = 'descendant-or-self::'.substr($expression, 12);
} elseif (preg_match('/^(ancestor|ancestor-or-self|attribute|following|following-sibling|namespace|parent|preceding|preceding-sibling)::/', $expression)) {
// the fake root has no parent, preceding or following nodes and also no attributes (even no namespace attributes)
$expression = $nonMatchingExpression;
} elseif (!str_starts_with($expression, 'descendant-or-self::')) {
$expression = 'self::'.$expression;
}
$expressions[] = $parenthesis.$expression;
if ($i === $xpathLen) {
return implode(' | ', $expressions);
}
$i += strspn($xpath, " \t\n\r\0\x0B", $i + 1);
$startPosition = $i + 1;
}
return $xpath; // The XPath expression is invalid
}
public function getNode(int $position): ?\DOMNode
{
return $this->nodes[$position] ?? null;
}
public function count(): int
{
return \count($this->nodes);
}
/**
* @return \ArrayIterator<int, \DOMNode>
*/
public function getIterator(): \ArrayIterator
{
return new \ArrayIterator($this->nodes);
}
protected function sibling(\DOMNode $node, string $siblingDir = 'nextSibling'): array
{
$nodes = [];
$currentNode = $this->getNode(0);
do {
if ($node !== $currentNode && \XML_ELEMENT_NODE === $node->nodeType) {
$nodes[] = $node;
}
} while ($node = $node->$siblingDir);
return $nodes;
}
private function parseHtml5(string $htmlContent, string $charset = 'UTF-8'): \DOMDocument
{
return $this->html5Parser->parse($this->convertToHtmlEntities($htmlContent, $charset));
}
private function parseXhtml(string $htmlContent, string $charset = 'UTF-8'): \DOMDocument
{
$htmlContent = $this->convertToHtmlEntities($htmlContent, $charset);
$internalErrors = libxml_use_internal_errors(true);
$dom = new \DOMDocument('1.0', $charset);
$dom->validateOnParse = true;
if ('' !== trim($htmlContent)) {
@$dom->loadHTML($htmlContent);
}
libxml_use_internal_errors($internalErrors);
return $dom;
}
/**
* Converts charset to HTML-entities to ensure valid parsing.
*/
private function convertToHtmlEntities(string $htmlContent, string $charset = 'UTF-8'): string
{
set_error_handler(static fn () => throw new \Exception());
try {
return mb_encode_numericentity($htmlContent, [0x80, 0x10FFFF, 0, 0x1FFFFF], $charset);
} catch (\Exception|\ValueError) {
try {
$htmlContent = iconv($charset, 'UTF-8', $htmlContent);
$htmlContent = mb_encode_numericentity($htmlContent, [0x80, 0x10FFFF, 0, 0x1FFFFF], 'UTF-8');
} catch (\Exception|\ValueError) {
}
return $htmlContent;
} finally {
restore_error_handler();
}
}
/**
* @throws \InvalidArgumentException
*/
private function createDOMXPath(\DOMDocument $document, array $prefixes = []): \DOMXPath
{
$domxpath = new \DOMXPath($document);
foreach ($prefixes as $prefix) {
$namespace = $this->discoverNamespace($domxpath, $prefix);
if (null !== $namespace) {
$domxpath->registerNamespace($prefix, $namespace);
}
}
return $domxpath;
}
/**
* @throws \InvalidArgumentException
*/
private function discoverNamespace(\DOMXPath $domxpath, string $prefix): ?string
{
if (\array_key_exists($prefix, $this->namespaces)) {
return $this->namespaces[$prefix];
}
if ($this->cachedNamespaces->offsetExists($prefix)) {
return $this->cachedNamespaces[$prefix];
}
// ask for one namespace, otherwise we'd get a collection with an item for each node
$namespaces = $domxpath->query(sprintf('(//namespace::*[name()="%s"])[last()]', $this->defaultNamespacePrefix === $prefix ? '' : $prefix));
return $this->cachedNamespaces[$prefix] = ($node = $namespaces->item(0)) ? $node->nodeValue : null;
}
private function findNamespacePrefixes(string $xpath): array
{
if (preg_match_all('/(?P<prefix>[a-z_][a-z_0-9\-\.]*+):[^"\/:]/i', $xpath, $matches)) {
return array_unique($matches['prefix']);
}
return [];
}
/**
* Creates a crawler for some subnodes.
*
* @param \DOMNodeList|\DOMNode|\DOMNode[]|string|null $nodes
*/
private function createSubCrawler(\DOMNodeList|\DOMNode|array|string|null $nodes): static
{
$crawler = new static($nodes, $this->uri, $this->baseHref);
$crawler->isHtml = $this->isHtml;
$crawler->document = $this->document;
$crawler->namespaces = $this->namespaces;
$crawler->cachedNamespaces = $this->cachedNamespaces;
$crawler->html5Parser = $this->html5Parser;
return $crawler;
}
/**
* @throws \LogicException If the CssSelector Component is not available
*/
private function createCssSelectorConverter(): CssSelectorConverter
{
if (!class_exists(CssSelectorConverter::class)) {
throw new \LogicException('To filter with a CSS selector, install the CssSelector component ("composer require symfony/css-selector"). Or use filterXpath instead.');
}
return new CssSelectorConverter($this->isHtml);
}
/**
* Parse string into DOMDocument object using HTML5 parser if the content is HTML5 and the library is available.
* Use libxml parser otherwise.
*/
private function parseHtmlString(string $content, string $charset): \DOMDocument
{
if ($this->canParseHtml5String($content)) {
return $this->parseHtml5($content, $charset);
}
return $this->parseXhtml($content, $charset);
}
private function canParseHtml5String(string $content): bool
{
if (!$this->html5Parser) {
return false;
}
if (false === ($pos = stripos($content, '<!doctype html>'))) {
return false;
}
$header = substr($content, 0, $pos);
return '' === $header || $this->isValidHtml5Heading($header);
}
private function isValidHtml5Heading(string $heading): bool
{
return 1 === preg_match('/^\x{FEFF}?\s*(<!--[^>]*?-->\s*)*$/u', $heading);
}
private function normalizeWhitespace(string $string): string
{
return trim(preg_replace("/(?:[ \n\r\t\x0C]{2,}+|[\n\r\t\x0C])/", ' ', $string), " \n\r\t\x0C");
}
}
We have trained our AI Chat Bots with the knowledge of industry experts and conversion experts so you can be sure it knows how to do its job and answer all your questions instantly and provide requested information
AI Content Generation
Create amazing content 10X faster
Wordfairy can help you with a variety of writing tasks, from writing blog post, creating better resumes and job descriptions to composing emails and social media content, and many more. With 70+ templates, we can save you time and improve your writing skills.
AI Image Creation
Use AI to create any art or image
Are you looking for a tool to help you create unique beautiful artwork and images quickly and easily? Look no further! Our AI-powered software makes it simple to generate high-quality art and images with just a few clicks. With our intuitive interface and powerful technology, you can create stunning visuals in minutes instead of hours.
AI Voiceover Synthesize
Make studio-quality voiceovers in minutes
Truly human emotions in every voice over generated, breathing life into your voice overs. Our AI voices have elements that make a voice sound NATURAL and have all the expressions and tone inflections that are needed to make people more engaged in your content
AI Speech to Text Transcribe
Transcribe accurately your audio
Accurately transcribe audio content in various formats. Enable transcription of your audio files in multiple languages, as well as translation from those languages into English.
AI Code Generation
Write code like a Pro
Generate complex algorithms simply by using natural language to explain what you are after, we will take care rest for you. Write code like Pro in Python, Flutter, PHP, JavaScript, Ruby and other programming languages.
Think Big, Task Easy
Customers Using Incus Have Experienced:
90%
Time Reduced In Task
4x
Increase In Visibility
60%
Increase In Revenue
Select a Task
Choose from a variety of writing skills trained on industry best-practices
Ads
Create ads much faster and be more creative
Clickbait Titles
Create a creative clickbait titles for your products
Pro
Ad Headlines
Write an attention grabbing ad headlines
Blog Posts
Content for the generating articles, blog post
Blog Titles
Nobody wants to read boring blog titles, generate catchy blog titles with this tool
Blog Section
Write a full blog section (few paragraphs) about a subheading of your article
Blog Ideas
The perfect tool to start writing great articles. Generate creative ideas for your next post
Blog Intros
Write an intro that will entice your visitors to read more about your article
Blog Conclusion
End your blog articles with an engaging conclusion paragraph
Contents
Tools for writing creatives for different moods and tasks
Article Generator
Turn a title and outline text into a fully complete high quality article within seconds
Content Rewriter
Take a piece of content and rewrite it to make it more interesting, creative, and engaging
Paragraph Generator
Generate paragraphs about any topic including a keyword and in a specific tone of voice
Talking Points
Write short, simple and informative points for the subheadings of your article
Pros & Cons
Write the pros and cons of a product, service or website for your blog article
Summarize Text
Summarize any text in a short and easy to understand concise way
Product Description
Write the description about your product and why it worth it
Startup Name Generator
Generate cool, creative, and catchy names for your startup in seconds
Product Name Generator
Create creative product names from examples words
Academic Essay
Create creative academic essays for various subjects just in a second
Creative Stories
Allow AI to generate creative stories for you based on input text
Grammar Checker
Make sure that there are no errors in your content
Summarize for 2nd Grader
Summarize any complex content for a 2nd grader child
Text Extender
Extend your sentences with more description and additional information
Rewrite with Keywords
Rewrite your existing content with including specific keywords
Business Ideas
Generate business ideas based on your keywords and description
Tone Changer
Change the tone of your writing to match your audience
Dictionary
Use a dictionary to find all details of your word
Privacy Policy
Develop a privacy policy information for your organization
Terms and Conditions
Develop a terms and conditions information for your organization
Ecommerce
Powerful tools for e-commerce, listings of your products
Great AI tool to use for academic essay writing and summarising texts!
Josh P
UK
5
Absolutely blown away with the quality of the writing that the AI provides and all the different features, one of the best i've used by far.
Laura S
UK
5
Using this for university and its made my life so much easier!
Tom W
UK
5
Really impressed with everything thats offered by the price!
Sarah
UK
5
Used this when I had a writers block and wow! one of the best features is being able to change the writing tone and style of each text.
Peter Scott
UK
5
An absolute dream for an assignment that I had due. I was skeptical at first, but after seeing my grades go up I use wordfairy for all of my coursework.
John Cross
UK
5
Woohoo! Word Fairy AI just sprinkled some serious writing magic in my life! It's like having a personal writing assistant that never sleeps.
Tim
UK
5
I'm not exaggerating when I say Word Fairy AI is the Dumbledore of writing tools. It's like having a magical professor guiding me through the writing process. I was skeptical at firstβit's AI after all, right? But boy, was I proven wrong!
Kira Brown
UK
5
Finally met my writing soulmate! Word Fairy AI has become my brainstorm buddy, my grammar guru, and my secret weapon in the writing world. Its artificial intelligence beams with brilliance, offering word choices I'd never even think of!
Rob
UK
5
Writing just got a major upgrade, thanks to Word Fairy AI! It's like having a pocket-sized Shakespeare with impeccable grammar skills! This clever tool turns my writing foes into friends, fixing those sneaky typos and suggesting ways to improve clarity.
Bill
UK
5
Word Fairy AI is a total game-changer! It's like having a writing superhero by my side, guiding me through every paragraph. It spins my ideas into engaging content effortlessly.
Carol K
UK
5
Wow, Word Fairy AI has turned me into a wordsmith extraordinaire! I used to struggle with writer's block, but with this incredible writing tool, ideas flow like a river.
Rafique
UK
5
Prepare to be mind-blown by Word Fairy AI! This brilliant tool is my secret weapon in the battle against dull content. It sprinkles captivating phrases and catchy headlines all over my writing. Breath-taking AI-powered magic at its best.
Bella
UK
5
Wowza! Word Fairy AI is the writing genie I never knew I needed! With just a few clicks, it conjures up impeccable sentences and helps structure my thoughts flawlessly. Writing, editing, and proofreading have become a breeze.
Antonio
UK
5
This brilliant tool sprinkles dazzling vocabulary and grammar skills into your work, making it shine like a supernova. No more worrying about errors or boring content.
Jenny
UK
5
This baby corrects my clumsy wording, suggests better sentence structures, and even helps me find the perfect synonyms to spice things up. Seriously, if you've ever struggled with writing, let the Word Fairy AI work its magic for you!"
Iris
UK
5
t's like having a personal coach, pushing me towards better writing. Whether I'm composing a professional email or a creative masterpiece, this tool sprinkles linguistic fairy dust on every word. If you're tired of mediocre writing, make Word Fairy AI your new BFF!
Chen
UK
5
My productivity and creativity have hit the stratosphere thanks to this incredible AI. Prepare yourself for word wizardry!
Sumaya
UK
5
Seriously, where has this little AI genius been all my life? Writing projects have become a breeze, and my work is so much more polished now. Word Fairy AI, you've earned your wings in my heart!
Ellie
UK
5
Thanks to this genius AI, my writing has soared to new heights! I can't wait to see what magical stories we'll create together next!
Adam G
USA
5
Great AI tool to use for academic essay writing and summarising texts!
Josh P
UK
5
Absolutely blown away with the quality of the writing that the AI provides and all the different features, one of the best i've used by far.
Laura S
UK
5
Using this for university and its made my life so much easier!
Tom W
UK
5
Really impressed with everything thats offered by the price!
Sarah
UK
5
Used this when I had a writers block and wow! one of the best features is being able to change the writing tone and style of each text.
Peter Scott
UK
5
An absolute dream for an assignment that I had due. I was skeptical at first, but after seeing my grades go up I use wordfairy for all of my coursework.
John Cross
UK
5
Woohoo! Word Fairy AI just sprinkled some serious writing magic in my life! It's like having a personal writing assistant that never sleeps.
Tim
UK
5
I'm not exaggerating when I say Word Fairy AI is the Dumbledore of writing tools. It's like having a magical professor guiding me through the writing process. I was skeptical at firstβit's AI after all, right? But boy, was I proven wrong!
Kira Brown
UK
5
Finally met my writing soulmate! Word Fairy AI has become my brainstorm buddy, my grammar guru, and my secret weapon in the writing world. Its artificial intelligence beams with brilliance, offering word choices I'd never even think of!
Rob
UK
5
Writing just got a major upgrade, thanks to Word Fairy AI! It's like having a pocket-sized Shakespeare with impeccable grammar skills! This clever tool turns my writing foes into friends, fixing those sneaky typos and suggesting ways to improve clarity.
Bill
UK
5
Word Fairy AI is a total game-changer! It's like having a writing superhero by my side, guiding me through every paragraph. It spins my ideas into engaging content effortlessly.
Carol K
UK
5
Wow, Word Fairy AI has turned me into a wordsmith extraordinaire! I used to struggle with writer's block, but with this incredible writing tool, ideas flow like a river.
Rafique
UK
5
Prepare to be mind-blown by Word Fairy AI! This brilliant tool is my secret weapon in the battle against dull content. It sprinkles captivating phrases and catchy headlines all over my writing. Breath-taking AI-powered magic at its best.
Bella
UK
5
Wowza! Word Fairy AI is the writing genie I never knew I needed! With just a few clicks, it conjures up impeccable sentences and helps structure my thoughts flawlessly. Writing, editing, and proofreading have become a breeze.
Antonio
UK
5
This brilliant tool sprinkles dazzling vocabulary and grammar skills into your work, making it shine like a supernova. No more worrying about errors or boring content.
Jenny
UK
5
This baby corrects my clumsy wording, suggests better sentence structures, and even helps me find the perfect synonyms to spice things up. Seriously, if you've ever struggled with writing, let the Word Fairy AI work its magic for you!"
Iris
UK
5
t's like having a personal coach, pushing me towards better writing. Whether I'm composing a professional email or a creative masterpiece, this tool sprinkles linguistic fairy dust on every word. If you're tired of mediocre writing, make Word Fairy AI your new BFF!
Chen
UK
5
My productivity and creativity have hit the stratosphere thanks to this incredible AI. Prepare yourself for word wizardry!
Sumaya
UK
5
Seriously, where has this little AI genius been all my life? Writing projects have become a breeze, and my work is so much more polished now. Word Fairy AI, you've earned your wings in my heart!
Ellie
UK
5
Thanks to this genius AI, my writing has soared to new heights! I can't wait to see what magical stories we'll create together next!
Frequently Asked Questions
Got Questions? We have you covered
We are always here to provide full support and clear any doubts that you might have
What Is WordFairy AI?
Word Fairy AI is an advanced artificial intelligence writing tool designed to assist writers in creating high-quality and engaging content. Equipped with state-of-the-art algorithms, this innovative tool offers unparalleled writing guidance and support.
With Word Fairy AI, users can expect an intelligent and efficient writing partner that can generate ideas, provide grammar and spelling suggestions, and help structure essays, articles, or any written work. By leveraging the power of AI, this tool harnesses vast amounts of data and knowledge to deliver accurate and contextually relevant recommendations, saving writers valuable time and effort.
Gone are the days of struggling with writer's block or spending hours on end trying to perfect a sentence or paragraph. Word Fairy AI acts as a virtual mentor, offering creative inspiration and guiding users with well-crafted suggestions tailored to their specific writing needs. Whether you're an aspiring writer, a student, or a seasoned professional, this writing tool is your ultimate companion in the journey of crafting impeccable content.
Does Wordfairy AI Offer A Free Trial?
Absolutely! Word Fairy AI offers a free sign up and trail of 1000 words for you to see all of our different features and test out our custom AI software. We're certain that you will be blown away with how advanced and customised our software is.
What Is The Word Fairy AI Referral Scheme
Do you know anyone who can benefit from Word Fairy AI? Refer a friend and we will give you 50% of the value of the first month of their subscription in the form of a digital amazon voucher. Get in touch with us at admin@wordfairy.ai for more details!
How Does Word Fairy AI Work?
Equipped with cutting-edge algorithms, Word Fairy AI assists users in generating engaging and persuasive content across various genres and formats. From blog posts and marketing copy to academic papers and creative writing, this tool adapts to the specific writing style and requirements of each user, providing invaluable suggestions to enhance coherence, clarity, and overall impact.
What sets Word Fairy AI apart is its ability to learn and adapt to individual preferences and writing goals. As users interact with the tool, it gradually tailors its suggestions based on their writing patterns and preferences. This personalized approach ensures that each user receives the most relevant and helpful recommendations throughout their writing journey.
By leveraging the vast knowledge and deep understanding of language encoded within its algorithms, Word Fairy AI enables writers to express their ideas with precision and eloquence. From grammar and spelling corrections to insightful vocabulary suggestions, this tool acts as a virtual writing tutor, providing continuous feedback and support to help users reach their full potential.
How Are Texts Generated For The Same Answer Different?
What sets Word Fairy AI apart is its ability to analyze the context and purpose of the writing, generating tailored suggestions that resonate with the intended audience. By considering factors such as genre, tone, and target audience, this tool guides users toward crafting content that captivates and engages readers, making every written piece a masterpiece.
Furthermore, Word Fairy AI acts as a platform for continuous growth and improvement. By analyzing the writing patterns and preferences of each user, this tool learns and adapts, delivering increasingly accurate and contextually relevant suggestions as users interact with it more frequently. This personalized approach guarantees that each individual's unique style and voice shine through, fostering a sense of authenticity in every written work.
With its vast knowledge database and intricate understanding of language nuances, Word Fairy AI offers comprehensive writing support at users' fingertips. From instantaneous grammar checks to insightful vocabulary suggestions, this tool inspires users to push the boundaries of their writing abilities and enables them to create compelling and impactful content that resonates with their intended audience.
This means that even if the same question for the same topic is asked 100 times, there will be 100 unique and completely different answers with no similarities.
How Is Word Fairy AI Different From Chat GPT?
Word Fairy AI is distinct from Chat GPT in terms of its primary function and purpose. While Chat GPT is mainly designed to engage in conversational interactions and provide responses like a chatbot, Word Fairy AI focuses predominantly on enhancing the writing capabilities of its users. With a range of advanced language models and text generation algorithms, Word Fairy AI aims to assist individuals in crafting high-quality written content for various purposes, such as articles, reports, blog posts, or creative writing. By leveraging it's powerful AI technology, Word Fairy AI can provide users with intelligent suggestions, grammar corrections, and insightful recommendations to refine their writing skills and create compelling textual compositions.
Can I Use Word Fairy For My University Assignments?
Yes, you can definitely use Word Fairy for your university assignments. Word Fairy AI is an advanced artificial intelligence writing tool designed to assist users in creating well-written and professional documents. Its powerful features, such as grammar and spell-check, suggest improvements, and content enhancement, make it an ideal tool for academic writing.
Word Fairy AI ensures that your assignments are free from grammatical errors, typos, and awkward phrasing. This tool not only helps you proofread your work but also offers suggestions for improving sentence structure, vocabulary usage, and overall coherence. It acts as a virtual writing assistant, providing valuable feedback to enhance the quality of your assignments.
Moreover, Word Fairy AI saves you time and effort by automating tedious tasks such as citations and bibliography formatting. With its comprehensive database of citation styles, including APA, MLA, and Chicago, you can be confident that your references are accurately formatted. This allows you to focus more on the content of your assignments, ensuring it meets the high academic standards set by your university.
It is important to note that while Word Fairy AI assists and streamlines the writing process, it is still your responsibility as a student to ensure the integrity of your work. The tool's primary purpose is to enhance your writing skills and provide suggestions, but ultimately, you must ensure that the content and ideas presented in your assignments are original and properly cited.
In summary, Word Fairy AI is an invaluable tool for your university assignments. It provides a range of features designed to improve your writing, enhance the quality of your work, and save you time. By using Word Fairy AI, you can confidently submit well-written and professional assignments that meet the academic standards of your university.
I Still Have Questions
No Problem at all! Please feel free to get in touch with us at admin@wordfairy.ai and we would be more than happy to help
Facebook Ads
Write Facebook ads that engage your audience and deliver a high conversion rate
Instagram Captions
Grab attention with catchy captions for your Instagram posts
Instagram Hashtags Generator
Find the best hashtags to use for your Instagram posts
Social Media Post (Personal)
Write a social media post for yourself to be published on any platform
Social Media Post (Business)
Write a post for your business to be published on any social media platform
Facebook Headlines
Write catchy and convincing headlines to make your Facebook Ads stand out
Google Ads Headlines
Write catchy 30-character headlines to promote your product with Google Ads
Google Ads Description
Write a Google Ads description that makes your ad stand out and generates leads
LinkedIn Posts
Create an interesting linkedin post with the help of AI
Twitter Tweets
Generate an interesting twitter tweets with AI
LinkedIn Ad Headlines
Attention-grabbing, click-inducing and high-converting ad headlines for LinkedIn
LinkedIn Ad Descriptions
Professional and eye-catching ad descriptions that will make your product shine