f3864691-3e77-4a95-9724-f1a7ade8e34b.jpg

3778c920-4d39-4157-b8b8-7f6362c5862b.nupkg

Text Analysis (or Text Mining) is the automated process of obtaining information from text. The goal is to create structured data out of free text content, as this can be easier interpreted by a computer.

It can be used for categorizing press articles, user reviews, incoming e-mails, tickets, monitoring comments or social media and many more.

The first release contains several basic, but powerful methods and techniques:

*   **Detect Language**: allows text to be classified according to its language. Supports 16 languages. It is helpful for setting the OCR engine or allowing you to route e-mails or document to specific people, depending on the detected language.
*   **Find Collocations**: identify words that commonly co-occur. Returns bigrams, most commonly two adjacent words i.e. invoice date for invoice documents.
*   **Prepare String to Analyze**: basic activity for text analyzing. Prepares provided string lowercasing it, removing special characters, numbers, single letters. The returned text contains only words separated by spaces.
*   **Remove Stopwords**: provides a more accurate automated analysis of the text. Supports 16 languages. It is important to remove from play all the words that are very frequent but provide little semantic information or no meaning at all. These words are also known as stopwords.
*   **Word Frequency Analyze**: finds the most frequently used words in a document. This is useful to identify document type by comparing results with a defined pattern.
*   **Word Position Analyze**: helps identify the type of a document by analyzing the position of specific words. Invoice keyword position at the top of the document, in the header, increases the possibility of this being an invoice, then if the keyword is mentioned somewhere on the 5th page of the document.

Create structured data out of free text content using Text Analysis

35b9607b-4633-429b-949e-c0ab9432dc53.PNG

8b868833-2ff7-48a2-9ad0-c0b03e4ccb5d.PNG

38a84f04-4301-4ba7-b218-3bec6335d338.PNG

MIT License Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the 'Software'), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED 'AS IS', WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Text Analysis Activities