GauravMisal / Project3 Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

This project is basically for collecting enormous data and analyzing it. It includes live streaming of data from FOREX trading API and Electric Vehicle stocks API. The data is fetched and processed using Kafka Streaming and Spark streaming.Throughout this project stocks of Forex data and Electric Vehicle parts making companies data were analyzed…

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
EV		EV
FOREX		FOREX
LAB SETUP		LAB SETUP
LICENSE		LICENSE
README.md		README.md

Repository files navigation

STOCK DATA STREAMING AND ANALYSIS

DESCRIPTION

This project includes live streaming of data from a stock analysis website tiingo.com,Alpha Vantage.
The data from Forex and EV trading API is streamed through Kafka.
After streaming, the data stored in topics is analysed.
The analysis of data is visualized in Jupyter notebook for various use cases.

STREAMING TOOLS

Websocket,
Requests library,
Pandas datareader library,
Netcat,
API : Tiingo API,Alpha Vantage API.
data visualization tool: matplotlib,Seaborn.

TECHNOLOGIES USED:

Spark
Kafka
Pyspark

ROLES AND RESPONSIBILITIES

DATA STREAMING AND SPARK submit job- Rajib’s team
Use cases- Eshwar’s team
Visualization- Karan’s team
EV stock use case-Kareem's team
Deployment-Trupti’s Team

About

This project is basically for collecting enormous data and analyzing it. It includes live streaming of data from FOREX trading API and Electric Vehicle stocks API. The data is fetched and processed using Kafka Streaming and Spark streaming.Throughout this project stocks of Forex data and Electric Vehicle parts making companies data were analyzed…

python kafka spark hadoop ubuntu jupyter-notebook pyspark requests spark-streaming java8 sparksql matplotlib seaboard alphavantage tiingo

Report repository

Releases

No releases published

Packages

Languages