Run the Wikipedia demo with SearchAnalytics

The following instructions describe how to use search queries in the Spark console on SearchAnalytics nodes using the Wikipedia demo.

Create a SearchAnalytics datacenter as described in Initialize a single datacenter per workload type, and start a node in SearchAnalytics mode.
Ensure that the cluster is running correctly by running dsetool ring. The node type should be SearchAnalytics.

Package installations: dsetool ring

Tarball installations: installation_location/bin/dsetool ring
In a terminal, change to the /demos/wikipedia directory in your DSE installation:
The default location of the demos directory depends on the type of installation:
- Package installations: /usr/share/dse/demos
  
  You might need to install the demos packages, if you didn’t install them during your initial installation. For more information, see Install DataStax Enterprise (DSE) 6.9 on Debian-based systems with APT and Install DataStax Enterprise (DSE) 6.9 on RHEL-based systems with Yum.
- Tarball installations: INSTALL_DIRECTORY/demos
README.md files are provided with your DSE installation and in the demos directories with instructions on building and running the demo applications.
Add the schema by running the 1-add-schema.sh script.
```
./1-add-schema.sh
```
Create the search indexes.
```
./2-index.sh
```
Start the Spark console:
```
dse spark
```

Create an RDD based on the wiki.solr table.

val table = sc.cassandraTable("wiki","solr")

table: com.datastax.spark.connector.rdd.CassandraTableScanRDD[com.datastax.spark.connector.CassandraRow] = CassandraTableScanRDD[0] at RDD at CassandraRDD.scala:15

Run a query using the title Solr index and collect the results.

val result = table.select("id","title").where("solr_query='title:Boroph*'").collect

Equivalent JSON query:

where("solr_query='{"q": "title:Boroph*"}'")

result:
    Array[com.datastax.spark.connector.CassandraRow] = Array(
        CassandraRow{id: 23729958, title: Borophagus parvus},
        CassandraRow{id: 23730195, title: Borophagus dudleyi},
        CassandraRow{id: 23730528, title: Borophagus hilli},
        CassandraRow{id: 23730810, title: Borophagus diversidens},
        CassandraRow{id: 23730974, title: Borophagus littoralis},
        CassandraRow{id: 23731282, title: Borophagus orc},
        CassandraRow{id: 23731616, title: Borophagus pugnator},
        CassandraRow{id: 23732450, title: Borophagus secundus})

For details on using search query syntax in CQL, see CQL queries.

Run the Wikipedia demo with SearchAnalytics

Was this helpful?

Give Feedback