Class: WebsiteConverterService

WebsiteConverterService()

The Website Converter module offers basic functionality for extracting meaningful text from websites. This can be a useful tool for processing website content with other modules. Note: Character volume is not charged for this module.

Constructor

new WebsiteConverterService()

Source:

Methods

call(user, url) → {Promise.<Object>}

Parameters:
Name Type Description
user string The ID of the user accessing the Soffos API. This string will be used for throttling and profanity tracking. Soffos assumes that the owner of the api is an application (app) and that app has users. Soffos API will accept any string."
url string The url to extract text from.
Source:
Returns:
text - Raw text extracted from the website. links - A dictionary containing a list of `internal` and a list of `external` links found on the website. `internal`: Links found on the page that are under the same domain as the provided url. `external`: Links found on the page that belong to different domains.
Type
Promise.<Object>
Example
Examples are available at "https://github.com/Soffos-Inc/soffosai-js/tree/master/samples"

setInputConfigs(name, url)

Parameters:
Name Type Description
name string Reference name of this Service. It will be used by the Pipeline to reference this Service.
url string | InputConfig The url to extract text from.
Source: