Stock market data of various companies is analyzed with the help of shell scripts that run on Hadoop cluster which tells us about the company’s current position in the market and various other factors. The process of analyzing is made automated with the help of shell scripts in which analyzing queries are pre-written. This project aims at providing simple and easy analysis of various Stocks as per the user's requirement
#GUIDELINES TO RUN STOCK MARKET ANALYSIS SOFTWARE REQUIREMENTS-
- You need a linux based platform preferably Ubuntu to run Hadoop
- Install the Apache Hadoop into the system along with the packages –
- Java
- MySql
- Sqoop
- Hive
- R-base
- Setup the cluster and all the above listed packages.
- Check if all the packages are in running conditions or not.
#BACKGROUND INFORMATION-
- All the packages should be in running conditions.
- Setup the Username and Password in MySql as “root”.
- This is a Script-based Project.
- The Record of 15 companies is managed through MySql while other 15 companies record is managed through Hive.
- The Stock Market Analysis is broadly divided into two categories-
- Financial Analysis
- Technical Analysis
#STEP-BY-STEP STOCK MARKET ANALYSIS
-
Unzip all the files and folders.
-
Copy the records.csv file into the HDFS
-
Now in MySql, create a Database named “market”. ->Mysql –uroot -proot ->Create database market; ->Use market;
-
Now create a table named record ->Create table record(DATES varchar(10), NAME varchar(30), OPEN float, HIGH float, LOW float, CLOSE float, VOLUME float, ADJUSTED_CLOSE float);
-
With the help of sqoop commands, export the record file from HDFS to the table created. -> sqoop export
--connect jdbc://localhost:/mysql/ market
--username root
--password root
--m 1
--table record --export-dir \recordss.csv -
Similarly from the HDFS, export the record1.csv file to the hive table.
-
Now, copy all the scripts into your system.
-
Begin with the script name- project.sh Write as – ./project.sh
-
Now go through the options being displayed and choose the one you want to execute.
-
If you want to generate graphs, install the R-base package and in its terminal window, add the relation in which you want to generate graphs.