Introduction to NetworkX in Python to analyze global relationships between oil-producing countries.
Social graphs are crucial for many reasons. These types of visualizations depict relationships between entities like people. In our case, we are going to create a social graph using NetworkX in Python to display the relationships between oil-producing countries. It is a very interesting topic from which we could learn a lot about the powerful world of oil.
In this example, we will use a high positive or negative correlation between the two country’s production output to define a relationship. …
Please don’t iterate over rows to web scrape tables using Python’s Scrapy application.
I’ve been refining my web scraping skills for a while now. I’ve used beautiful soup, requests, and Scrapy. Recently, I decided to take a second look at the Scrapy application. I wanted to see if it was more efficient to scrape the Yahoo Finance stock price history website with Scrapy versus requests using multithreading.
At first, I was annoyed by the response output when I tried to scrape a table. I researched online to see how other coders approached tables using the Scrapy application. …
Should you use multithreading or multiprocessing to scrape stock price history faster on Yahoo Finance?
Multithreading is faster than multiprocessing at Python web scraping stock price history from Yahoo Finance. To understand why, you must know the difference between multithreading and multiprocessing.
- Multithreading: One central processing unit or core in a multicore processor concurrently executes multiple threads of tasks together.
- Multiprocessing: Two or more central processing units allocate mutliple tasks across the units.
Think about how many cores are in your computer processor. It is likely that you might have four cores. This means that you can run four tasks at the same time across each core. …
The first step in any investor’s journey is to master the definitions of crucial company financial statistics and technical stock price measurements.
Access to stock market statistics is only as powerful as your knowledge of the data itself. Therefore, here are brief descriptions of common stock market statistics. These definitions should give you a better understanding of how you can use these stock measures to make sound investing choices. You can find each of these data points on the statistics tab on Yahoo Finance.
Stock market valuation measures
Value investors, in particular, prefer to use the following real measures of financial performance to determine whether a stock the market has reasonably priced an asset.
Intraday market capitalization
The intraday market capitalization is the share price of the stock multiplied…
How to web scrape the stock market statistics tab on the Yahoo Finance website using Python.
The Yahoo Finance website is one of the most popular data sources on the internet for Python programmers to gather stock market statistics. Particularly for value investors, statistics such as debt-to-equity and price-to-earnings are arguably the most essential weapons used in finance. Therefore, efficient data compilation for analysis using the Python coding language is as powerful as it is convenient.
It might sound onerous to create software that will speed up your financial data collection efforts. …
Web scrape a list of stocks with upcoming ex-dividend dates from the Nasdaq API using the Python pandas, requests, datetime, and calendar modules.
Install & import required Python packages
You will need the pandas, requests, datetime, and calendar modules to web scrape a list of stocks with upcoming ex-dividend dates from the Nasdaq API using the Python coding language.
import pandas, requests, datetime, calendar- Pandas: A data analysis library used to create and manipulate data within structures called dataframes. Learn more about the pandas module.
- Requests: An HTTP library for Python with a built-in JSON decoder. Learn more about the requests module.
- Datetime: Functions to create and format date and time objects in Python. Learn more about the datetime module.
- Calendar: Contains a method to retrieve the number of…
Easily scrape historical cryptocurrency exchange data from the Yahoo Finance website using the Python coding language.
Pip install packages
You need the following packages to scrape cryptocurrency exchange data from Yahoo Finance:
- Datetime: A module containing classes to manipulate date and time objects. Included in Python standard library. Install not necessary.
- Time: A set of functions to format time objects. Included in Python standard library. Install not necessary.
- Requests: A Python HTTP library to make requests to specified URLs and receive a response from the URL.
- Pandas: A data analysis library that reads HTML tables and converts them into a list of data frames.
- lxml: A website parser module that converts element trees to dictionary objects.
In the Anaconda…
U.S. foreign energy policy in Iran and Venezuela: A political activist from Honduras asks the U.S. Congress two crucial questions.
America’s dark history with Iran extends as far back as 30 years when a group of student activists took hostage hundreds of U.S. expatriates at a U.S. embassy in Tehran in 1979. Jimmy Carter, a well-respected humanitarian, was the President of the United States at the time. In response, President Carter sanctioned trade between the United States and Iran.
One day before Ronald Reagan’s inauguration, the U.S. lifted these sanctions in exchange for the release of all the hostages. During Ronald Reagan’s first term in office, Hezbollah, a Lebanese militant group connected to Iran, would take seven new U.S. hostages…
Step by step instructions to scrape up to 25 years of a stock’s dividend history from Yahoo Finance using the datetime, requests, lxml and pandas Python modules.
Install and import external python libraries
To scrape stock dividend histories from Yahoo Finance, you will need to install and import external packages into your program:
- Datetime: A module with functions designed to perform tasks on objects formatted as dates and times. Learn more about the datetime module.
- Time: A Python package with functions designed to convert time objects between different time zones. Learn more about the time module.
- Requests: An HTTP library for Python that allows you to make requests to specified URLs and receive a response from the URL. Learn more about HTTP requests.
- Pandas: A data analysis library for Python that can read…
Part 3: How to Scrape Data From Yahoo Finance with Python
This article is the third in a series going over how to scrape Yahoo Finance for stock price history data using the Python coding language. In this lesson, you will learn how to use the requests, lxml and pandas modules to build a function to scrape the price history table from Yahoo Finance. You can read the other articles in the series here.
In the first article, we defined three functions to create our request header and format the subdomain of the Yahoo Finance URL that we want to scrape. Open the file you created in this lesson. …
