Running the Wikipedia demo with SearchAnalytics

The following instructions describe how to use search queries in the Spark console on SearchAnalytics nodes using the Wikipedia demo.

Create a SearchAnalytics datacenter as described in Initializing a single datacenter per workload type, and start a node in SearchAnalytics mode.
Ensure that the cluster is running correctly by running dsetool ring.

The node type should be SearchAnalytics.
- Package and Installer-Services installations: dsetool ring
- Tarball and Installer-No Services installations: installation_location/bin/dsetool ring
In a terminal, change to the /demos/wikipedia directory in your DSE installation:
The default location of the demos directory depends on the type of installation:
- Package installations: /usr/share/dse/demos
  
  You might need to install the demos packages, if you didn’t install them during your initial installation. For more information, see Install DataStax Enterprise (DSE) 5.1 on Debian-based systems with APT and Install DataStax Enterprise (DSE) 5.1 on RHEL-based systems with Yum.
- Tarball installations: INSTALL_DIRECTORY/demos
README.md files are provided with your DSE installation and in the demos directories with instructions on building and running the demo applications.
Add the schema by running the 1-add-schema.sh script:
```
./1-add-schema.sh
```
Create the search indexes:
```
./2-index.sh
```
Start the Spark console:
```
dse spark
```

Create an RDD based on the wiki.solr table:

val table = sc.cassandraTable("wiki","solr")

table: com.datastax.spark.connector.rdd.CassandraTableScanRDD[com.datastax.spark.connector.CassandraRow] = CassandraTableScanRDD[0] at RDD at CassandraRDD.scala:15

Run a query using the title Solr index and collect the results:

val result = table.select("id","title").where("solr_query='title:Boroph*'").collect

Equivalent JSON query:

where("solr_query='{"q": "title:Boroph*"}'")

Array[com.datastax.spark.connector.CassandraRow] = Array(
    CassandraRow{id: 23729958, title: Borophagus parvus},
    CassandraRow{id: 23730195, title: Borophagus dudleyi},
    CassandraRow{id: 23730528, title: Borophagus hilli},
    CassandraRow{id: 23730810, title: Borophagus diversidens},
    CassandraRow{id: 23730974, title: Borophagus littoralis},
    CassandraRow{id: 23731282, title: Borophagus orc},
    CassandraRow{id: 23731616, title: Borophagus pugnator},
    CassandraRow{id: 23732450, title: Borophagus secundus})

For details on using search query syntax in CQL, see Search index syntax.

Running the Wikipedia demo with SearchAnalytics

Was this helpful?

Give Feedback