Which activities can be used to automate virtual machine environments in UiPath Studio?

0 votes
In UiPath studio, which activities can be used for virtual machine environment's automation?
Mar 28 in RPA by Sobia
82 views

1 answer to this question.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
0 votes

Hey @Sobia, in situations like virtual machine environments, certain applications are not compatible with the usage of normal scraping or UI automation technologies. So UiPath Studio uses OCR Activities which scan the entire screen of the machine, finding all the characters that are displayed. This enables the user to create automations based on what can be seen on the screen, simplifying automation in virtual machine environments. Citrix and other remote desktop utilities largely use OCR-based activities, as they only stream an image of the desktop to the user, which means normal UI selectors are impossible to find. Some of the OCR-based activities are:

1. Double Click OCR Text / Click OCR Text / Hover OCR Text: Uses OCR to scan the screen of the machine for text and perform actions relative to it. These are very useful activities in automating basic actions in virtual machine environments.

2.Get OCR Text: Extracts a string and its information from an indicated UI element using the OCR screen scraping method. By default, the Google OCR engine is used, but you can easily change it with Abbyy or Microsoft. This activity returns a string variable containing the text found in the UI element, and a TextInfo variable that contains the screen coordinates of all the found words.

3. Find OCR Text Position: Searches for a given string in an UI element, and returns a UIElement variable which contains the said string and the position where the text was found. This activity can be useful in locating UI elements relative to text on the screen.

4. OCR Text Exists: Checks if a text is found in a given UI element by using OCR technology and returns a boolean variable that is true if the text exists and false otherwise. This activity is useful in all types of text-based automation, as it enables you to make decisions based on whether or not a given string is displayed.

5. OCR Engines: OCR engines such as Google OCR, Google Cloud OCR, Microsoft OCR, Microsoft Cloud OCR and Abbyy Cloud OCR are available as separate activities. These activities extract a string and its position from a provided image by using different OCR engines. These activities can be used with other OCR activities and as output, the activities return an IEnumerable<KeyValuePair<Rectangle,String>> variable, which contains the extracted text and their on-screen coordinates, and a string variable which contains the extracted text.

answered Mar 28 by Anvi
• 5,880 points

Related Questions In RPA

0 votes
1 answer

What is Terminal Activities pack and how it can be used in UiPath studio?

Hello Lalit, the Terminal pack contains activities ...READ MORE

answered Apr 9 in RPA by Pratibha
• 2,520 points
36 views
0 votes
1 answer

What is Get Attribute activity and how it can be used in UiPath Studio?

Hey @vaani, Get Attribute activity in UiPath ...READ MORE

answered Mar 20 in RPA by Abha
• 5,840 points
78 views
0 votes
1 answer

How an agrument can be created and used in UiPath studio?

Hi @Piyush, to understand how an argument ...READ MORE

answered Mar 25 in RPA by Abha
• 5,840 points
58 views
0 votes
1 answer

What is Get Jobs activity used for in UiPath Studio?

Hey @Rakesh, Get Jobs Activity can be ...READ MORE

answered Mar 13 in RPA by Abha
• 5,840 points
59 views
0 votes
1 answer

How to format text in notepad using UiPath?

Hey @Rashmi, if you want to automate ...READ MORE

answered Mar 18 in RPA by Anvi
• 5,880 points
231 views
0 votes
1 answer

How can I display current date in "dd-MMM-yy" format in UiPath Studio?

Hi Shilpa, if you want to display ...READ MORE

answered Mar 18 in RPA by Pratibha
• 2,520 points
318 views
0 votes
1 answer

How to check if a string exists in datatable using UiPath?

Hi @Ravi, to check whether a string ...READ MORE

answered Mar 18 in RPA by Anvi
• 5,880 points
199 views
0 votes
1 answer

© 2018 Brain4ce Education Solutions Pvt. Ltd. All rights Reserved.
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.