Using Python 3.9 and Selenium to Web Scrape Market Indexes

It used to be very expensive in both time, money, and energy to get market, economic and financial data. People would get stock prices from CRSP tapes, read the paper version of the Wall Street Journal, buy the paper version of Value Line financial research. This all changed with the start of the internet in the 1990s. The internet removed the middlemen in delivering information and data to the user.

One big overarching theme of the internet is “FREE.” With web browsers and Python, we can quickly and often at no cost quickly get data to get a good general understanding of the current economic, financial, and market conditions. If we want a deeper understanding of economic and market conditions, we can pay for more valuable data for a reasonable fee.
In this book, we will use Python and Selenium to retrieve market index data.