Scraping User Information On GitHub Using PyGithub

An introduction to using GitHub REST API for data scientists.

Introduction

As data scientists we sometimes have to scrape data from different sources for analysis, since it’s an important aspect of our jobs to understand the whys of every data. Usually we scrape data off social media and e-commerce platforms like Twitter , Amazon, Walmart and so on. In this article, I would briefly be taking us over using PyGithub, a python library designed to ease the use of GitHub REST API, an API for GitHub users to interact conveniently with GitHub.

Github REST API

Github REST API are the APIs that are used to interact with GitHub. They can be used to perform all sort of activities a GitHub user is able to do on GitHub such as allowing you to create and manage repositories, create branches, open issues, pull requests, and so on. For fetching publicly available data such as public repositories, user profiles, and other user information, you can call the API.

Installing PyGithub

Fetching User Data

To call this API you are expected to provide an access token as mentioned before, this access token is a private token and should kept hidden. So a good practice is to create a .env file in your working directory and use os.getenv() to access your private data

You can now simply define the characteristics of the data you are trying to fetch. You can choose to search for users based on location, account name, full name, or public email. You can search for users with other feats like number of repositories a user own, when a user account was created or number of followers a user have.

Conclusion

Related posts:

They say drowning is a desperate thing But darling you’re the one I cling Being the painkiller of my past scars I’ll give you all the shooting stars The way your crooked smirk curves into a smile so…

A Poem that you love by Default. “DEFAULTED” is published by Prakhar Namdeo in Blue Insights.

Best Advice For Life. Erotic pictures, Erotic Stories, Porn Movies wash your mind completely and fill your mind with lust. Avoid it completely..