S&P 500 Versus Select Individual Stocks Dashboard Based On Big Data Infrastructure

https://drive.google.com/open?id=192wAleuz5nWhnSEbDfTTfwYVtQhCaW5U&usp=drive_fs

With worldwide financial literacy being very low, by S&P Global FinLit Survey it stands only at 33%, it can be seen that there is a need for the introductory material to show some straightforward explanations of some basic financial instruments. This paper explains the creation of a dashboard which is trying to show the differences between the S&P 500 ETF and some of its biggest individual stocks by weight. The dashboard mainly focuses on the problem of risk and diversification which were the least understood topics in the S&P Global FinLit Survey. This project was created using various data engineering tools like Docker, Airflow, Terraform, dbt, and Google Cloud Platform. Supporting tools like Docker and Terraform were chosen to best facilitate smooth integration into the Google Cloud Ecosystem. The cloud approach was chosen over an on-premise solution for the flexibility and simplicity of setting it up. This paper describes both the developed project and the insights obtained through the dashboard.