Portfolio Manager demo using Spark

You run scripts that create a portfolio of stocks.

The Portfolio Manager demo runs an application that is based on a financial use case. You run scripts that create a portfolio of stocks. On the online transaction processing (OLTP) side, each portfolio contains a list of stocks, the number of shares purchased, and the purchase price. The demo’s pricer utility simulates real-time stock data. Each portfolio gets updated based on its overall value and the percentage of gain or loss compared to the purchase price. The utility also generates 100 days of historical market data, which is the end-of-day price for each stock. On the DSE online analytical processing (OLAP) side, a Spark job calculates the greatest historical 10 day loss period for each portfolio, which is an indicator of the risk associated with a portfolio. This information is then fed back into the real-time application to allow customers to better gauge their potential losses.

DataStax demos do not work with either LDAP or internal authorization (username/password) enabled.

To run the demo, do the following:

Install DSE on a test node.

For package installations, install the demos packages in addition to DSE.

Default network interface localhost (127.0.0.1) is required for the demo.
Start DSE as a DSE Analytics node.
In a terminal, change to the /demos/portfolio_manager directory of your DSE installation.
The default location of the demos directory depends on the type of installation:
- Package installations: /usr/share/dse/demos
  
  You might need to install the demos packages, if you didn’t install them during your initial installation. For more information, see Install DataStax Enterprise (DSE) 5.1 on Debian-based systems with APT and Install DataStax Enterprise (DSE) 5.1 on RHEL-based systems with Yum.
- Tarball installations: INSTALL_DIRECTORY/demos
README.md files are provided with your DSE installation and in the demos directories with instructions on building and running the demo applications.
The Scala and Java source code for the demo are in the src directory.
Run the pricer utility to generate stock data for the application:
```
bin/pricer -o INSERT_PRICES
bin/pricer -o UPDATE_PORTFOLIOS
bin/pricer -o INSERT_HISTORICAL_PRICES -n 100
```
The utility takes several minutes to run.

For help, run bin/pricer --help.
Start the web service:
```
cd website
sudo ./start
```
Open a browser and go to http://localhost:8983/portfolio.

The real-time Portfolio Manager demo application is displayed.

Ana portfolio demo 1
Open another terminal.
Run the Spark SQL job in the 10-day-loss.q file.
```
dse spark-sql -f 10-day-loss.q
```
Run the equivalent Spark Scala job in the 10-day-loss.sh script.

The Spark application takes several minutes to run.
```
./10-day-loss.sh
```
Run the equivalent Spark Java job in the 10-day-loss-java.sh script.
```
./10-day-loss-java.sh
```
After the job completes, refresh the Portfolio Manager web page.

The results of the Largest Historical 10 day Loss for each portfolio are displayed.

Ana historical loss

Portfolio Manager demo using Spark

Was this helpful?

Give Feedback