We were founded in 2005 in a tiny apartment in Bucharest, Romania as DeskOver.

Fittingly, it was a customer who, in 2012, first saw the immense possibilities for us in the fledgling RPA market. Our desktop automation product launched in 2013. In 2015, we introduced our enterprise platform along with our new name.

Today, UiPath is the fastest-growing enterprise software company in history with scores of offices, thousands of employees, partnerships with the world’s best consulting and BPO firms, a 500,000-strong developer community, and 5MM+ robots at work in over 5,000 global enterprises.

Our mission is to deliver the leading Robotic Process Automation platform to our clients for an automation first mindset.

We build software robots that automate repetitive processes. Our software robots take on the tedious, mind-numbing work and free people to do the more stimulating, creative work worth doing.

But no matter how much we’ve grown, one thing hasn’t changed. We’re still building a company we love to work for

The Extract semi-structured data activity allows RPA developers to easily take advantage of UiPath's machine learning models for semi-structured documents processing. The models currently can analyze invoices and receipts, providing various information (total price, vendor address, list of items, etc.). By simply specifying the image to process and the address of the model to use, the activity returns the model's response already formatted for parsing or verification using UiPath's Validation Station.

A typical use case would be to retrieve the total and vendor name from a list of scanned receipts and input them in an expense managing software (e.g. Concur). An advanced version of this process could even check for confidence scores and trigger a different workflow which will present validation station to a human user.

There are currently two machine learning models that can be targeted by the activity:

You can find example scenarios in this repository: https://github.com/uipath-antoine/ExtractSemiStructuredDocumentExamples

A custom activity to query UiPath's machine learning models for semi-structured document data extraction

Product Manager

Sometime i'm getting "Newtonsoft.Json.JsonException" exception. is there any limitations ?

Hi @Antoine now i'm able to get response from server.

How to configure <a href="https://forum.uipath.com/t/receipt-and-invoice-ai-now-available-in-public-preview/125056" target="_blank">Invoice available field names</a> to Extract Semi Structured Document Activity ?<ul><li>“name”</li><li>“vendor-addr”</li><li>“billing-name”</li><li>“billing-addr”</li><li>etc..</li></ul>

Hello, Can you please help with below error? when i'm trying read extract PDF invoices (apx.10) i'm getting like: Extract semi-structured document: Could not parse the server response. Server response: with some HTML code and stuff. please do needful.I'm using version : 1.1.7171.26367 with all required dependencies and key from cloud.uipath.com.

Hi. I'm getting empty output for the invoice sample from the internet. What am I doing wrong? https://slicedinvoices.com/pdf/wordpress-pdf-invoice-plugin-sample.pdf. URL: "https://invoices.uipath.com"APIKey from cloud.uipath.com "Templateless Invoice Extraction" sectionDocument Type: "UiPath.MLModel.Invoice" (same result with the empty)Version: 1.1.7171.26367Empty output means AutomaticExtractionResult, DocumentObjectModel, RawText output variables are "Nothing".Best Regards, Valerii

This was working for me perfectly now im receiving the below everytime??Extract semi-structured document: Could not parse the server response. Server response:error code: 1015"

All working now, but some more questions if I may,The extracted text states that it is for "evaluation purposes only" I have potential work where I could seriously use this activity for a client.What are the restrictions around using this activity for production use?The API Key states that we are limited to 2 pages / 4mb per file, is there any way around this? As I have invoices from certain suppliers that would be over the 2 page limit.

I am trying to use this with the example provided (<a href="https://github.com/uipath-antoine/ExtractSemiStructuredDocumentExamples" target="_blank">https://github.com/uipath-antoine/ExtractSemiStructuredDocumentExamples</a>) and with my own API key but i am getting the error: "The request is larger than the server is willing or able to process.&nbsp;"I tried on 2 different pcs with the same result :(Any suggestions on what I can try or what is going wrong?

I need to know whether is it possible use this model in Production environment

we can use this to automate pdf documents

is there any trial version available for testing ? because i want to extract various types of unstructured pdf's. if this working fine then i will purchese this .

You can create a free account on https://platform.uipath.com/ and retrieve a free license for receipt/invoice extraction. You can find out more about licenses here: https://docs.uipath.com/cloudplatform/docs/about-licensing

TestMLModel: An unexpected condition was encountered on the server?

I'm getting above error while reading an image file

Hello, I am new to UiPath and download the example and want to try on our AP invoices to see the result. When I run it, I got below error. 

Extract semi-structured document:  The user does not have the necessary credentials.

I am using Studio Pro and have the Cloud trial license. Does anyone know the cause of this error and how to fix it?

Thanks for the quick response. I did exactly what you said but still have the same error. 

First I went to Other Services, use 'Copy API Key' button to copy the key. If I paste to Notepad, it looks like below. 

Q9M5ehAQuoxLXCGxE6PyEgmEjcryO1/8LT7WXaJxAmleo4PsJDOC7rlBVkSSEjfdi0wfj5ZRXCtbN9ffYfBQBA==

Second I pasted to "Extract semi-structured document" activity APIKey field as below (with ""):

"Q9M5ehAQuoxLXCGxE6PyEgmEjcryO1/8LT7WXaJxAmleo4PsJDOC7rlBVkSSEjfdi0wfj5ZRXCtbN9ffYfBQBA=="

After this, I run again, still the same error: Extract semi-structured document:  The user does not have the necessary credentials.

Then I changed the APIKey field value to "Q9M5ehAQuoxLXCGxE6PyEgmEjcryO1", still the same. 

I found below in the log, not sure this give some clue.

WRN: Assembly binding logging is turned OFF.

To enable assembly bind failure logging, set the registry value [HKLM\Software\Microsoft\Fusion!EnableLog] (DWORD) to 1.

Note: There is some performance penalty associated with assembly bind failure logging.

To turn this feature off, remove the registry value [HKLM\Software\Microsoft\Fusion!EnableLog].

20:23:44.4606 => [ERROR] [UiPath.Studio.Shared.Logging.OutputLogger] [45] Extract semi-structured document:  The user does not have the necessary credentials.

20:25:19.9227 => [ERROR] [UiPath.Studio.exe] [1] System.IO.IOException: Cannot locate resource 'themes/icons.xaml'.

   at MS.Internal.AppModel.ResourcePart.GetStreamCore(FileMode mode, FileAccess access)

   at System.IO.Packaging.PackagePart.GetStream(FileMode mode, FileAccess access)

   at System.IO.Packaging.PackWebResponse.CachedResponse.GetResponseStream()

   at System.IO.Packaging.PackWebResponse.GetResponseStream()

   at System.IO.Packaging.PackWebResponse.get_ContentType()

   at MS.Internal.WpfWebRequestHelper.GetContentType(WebResponse response)

   at MS.Internal.WpfWebRequestHelper.GetResponseStream(WebRequest request, ContentType& contentType)

   at System.Windows.ResourceDictionary.set_Source(Uri value)

   at UiPath.Studio.Plugin.Workflow.Services.ActivityIconFinder.TryGetThemedActivitiesIconDictionary(String assemblyName)

20:29:44.0041 => [ERROR] [UiPath.Studio.Shared.Logging.OutputLogger] [31] Extract semi-structured document:  The user does not have the necessary credentials.

Hello, I successfully run the example but I am totally new to this field. I have two questions: 

1. I noticed one of invoice quantity did not picked up correctly, how can I train the model? Any instruction would be greatly appreciated. 

2. Can I add additional fields such as Payment Term?

Thank you so much for all the help! With your help, I can run the example and I can see this will be very helpful to the AP Invoice Process. I will come up all the fields we need that are not already in the list and post to the location you mentioned. 

One other question, do you know when this will be released?

Do u have video for this Extract semi structured Document activity..If u provide how u create the sample project using this it would be helpful for me to understand it

Excellent use-case! Results output into Excel.

Use new model's API (no change on the user's side)

Extract Semi Structured Document Activity

Extract Semi Structured Document Activity

Help

How To