Which activities can be used to automate virtual machine environments in UiPath Studio

0 votes
In UiPath studio, which activities can be used for virtual machine environment's automation?
Mar 28, 2019 in RPA by Sobia
3,170 views

1 answer to this question.

0 votes

Hey @Sobia, in situations like virtual machine environments, certain applications are not compatible with the usage of normal scraping or UI automation technologies. So UiPath Studio uses OCR Activities which scan the entire screen of the machine, finding all the characters that are displayed. This enables the user to create automations based on what can be seen on the screen, simplifying automation in virtual machine environments. Citrix and other remote desktop utilities largely use OCR-based activities, as they only stream an image of the desktop to the user, which means normal UI selectors are impossible to find. Some of the OCR-based activities are:

1. Double Click OCR Text / Click OCR Text / Hover OCR Text: Uses OCR to scan the screen of the machine for text and perform actions relative to it. These are very useful activities in automating basic actions in virtual machine environments.

2.Get OCR Text: Extracts a string and its information from an indicated UI element using the OCR screen scraping method. By default, the Google OCR engine is used, but you can easily change it with Abbyy or Microsoft. This activity returns a string variable containing the text found in the UI element, and a TextInfo variable that contains the screen coordinates of all the found words.

3. Find OCR Text Position: Searches for a given string in an UI element, and returns a UIElement variable which contains the said string and the position where the text was found. This activity can be useful in locating UI elements relative to text on the screen.

4. OCR Text Exists: Checks if a text is found in a given UI element by using OCR technology and returns a boolean variable that is true if the text exists and false otherwise. This activity is useful in all types of text-based automation, as it enables you to make decisions based on whether or not a given string is displayed.

5. OCR Engines: OCR engines such as Google OCR, Google Cloud OCR, Microsoft OCR, Microsoft Cloud OCR and Abbyy Cloud OCR are available as separate activities. These activities extract a string and its position from a provided image by using different OCR engines. These activities can be used with other OCR activities and as output, the activities return an IEnumerable<KeyValuePair<Rectangle,String>> variable, which contains the extracted text and their on-screen coordinates, and a string variable which contains the extracted text.

answered Mar 28, 2019 by Anvi
• 14,150 points

Related Questions In RPA

0 votes
1 answer

What is Terminal Activities pack and how it can be used in UiPath studio?

Hello Lalit, the Terminal pack contains activities ...READ MORE

answered Apr 9, 2019 in RPA by Pratibha
• 3,690 points
2,549 views
0 votes
1 answer

What is Get Attribute activity and how it can be used in UiPath Studio?

Hey @vaani, Get Attribute activity in UiPath ...READ MORE

answered Mar 20, 2019 in RPA by Abha
• 28,140 points
7,925 views
0 votes
1 answer

How an agrument can be created and used in UiPath studio?

Hi @Piyush, to understand how an argument ...READ MORE

answered Mar 25, 2019 in RPA by Abha
• 28,140 points
3,637 views
0 votes
1 answer
0 votes
1 answer

What is Get Jobs activity used for in UiPath Studio?

Hey @Rakesh, Get Jobs Activity can be ...READ MORE

answered Mar 14, 2019 in RPA by Abha
• 28,140 points
2,942 views
0 votes
1 answer

How to format text in notepad using UiPath?

Hey @Rashmi, if you want to automate ...READ MORE

answered Mar 18, 2019 in RPA by Anvi
• 14,150 points
8,063 views
+2 votes
1 answer

How can I display current date in "dd-MMM-yy" format in UiPath Studio?

Hi Shilpa, if you want to display ...READ MORE

answered Mar 18, 2019 in RPA by Pratibha
• 3,690 points
17,055 views
0 votes
1 answer

How to check if a string exists in datatable using UiPath?

Hi @Ravi, to check whether a string ...READ MORE

answered Mar 19, 2019 in RPA by Anvi
• 14,150 points
17,686 views
0 votes
1 answer
0 votes
1 answer

Mention the activties from Database Activities Pack which you can use in uipath studio?

Hey Dhruv, following are the activities which ...READ MORE

answered Apr 9, 2019 in RPA by Anvi
• 14,150 points
3,478 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP