Skip to content

andrewbierbaum/InsightProject

Repository files navigation

InsightProject

The goal of this project is to track technology trends in various technical and social medial sources. This help gauge momentum behind a technology and identify the best posts for user discussion.

Pipeline

Screen Shot 2019-04-18 at 5 45 01 PM

Historical reddit data was batch processed using spark sql, processed in python, saved in sqlite, and visualized using dash. Near real-time updates were incorperated using a web API. The search tab was implemented using a reddit search API grabing 1000 records per call to generate the graph and comparison tables.

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors