I'm trying to scrape a website for the list of company names, code, industry, sector, market cap, etc in the table with Selenium. I'm new to it and I have tried writing the below code:
path_to_chromedriver = r'C:\Documents\chromedriver'
browser = webdriver.Chrome(executable_path=path_to_chromedriver)
url = r'http://sgx.com/wps/portal/sgxweb/home/company_disclosure/stockfacts'
output = browser.page_source
However, I'm able to get the below tags, but not the data in it.
<div class="table-wrapper results-display">
<div class="pager results-display"></div>
I have also tried BS4 to scrape it but failed at it. Any help on this is much appreciated.