Checking imported data

You can use the Cassandra Query Language or Cassandra Command Interface to confirm the success of the Sqoop import.

DataStax Enterprise provides a SQL-like language called CQL that is similar to the DDL, DML, and SELECT syntax in SQL. CQL lessens the learning curve for those coming from RDBMS systems. You can use familiar syntax for all object creation and data access operations. You can use the Cassandra Query Language (CQL) utility to confirm the success of the Sqoop import. Alternatively, you can use the Cassandra Command Line Interface (CLI) to perform the same type of queries.

You can import data from any JDBC-compliant data source. For example:
  • DB2
  • MySQL
  • Oracle
  • SQL Server
  • Sybase

You need a JDBC driver for the RDBMS or other type of data source.

Using CQL to check imported data 

To check the data in the example pf importing data into a table, you can use CQL 2. For example, to check the number of rows imported into the table:

$ . /cqlsh -2 

USE newKS; 

SELECT count ( * ) FROM npa_nxx_cf limit 200000;

The number of records appears.

SELECT * FROM npa_nxx_cf where key IN ( 626794 , 212524 , 512538 );

Records appear for Pasadena, New York, and Austin.

KEY | city | lat | linetype | lon | npa | nxx | state 
-------+----------+-------+----------+--------+-----+-----+------- 
626794 | Pasadena | 34 . 17 | L | 118 . 13 | 626 | 794 | CA 
212524 | New York | 40 . 71 | L | 074 . 01 | 212 | 524 | NY 
512538 |   Austin | 30 . 27 | L | 097 . 74 | 512 | 538 | TX

Validating import results in a cluster 

Use this command to view the results in the Cassandra File System:

$ ./dse hadoop fs - ls /npa_nxx

Depending on the number of DataStax Enterprise analytics nodes and task tracker configuration, the output shows a number of files in the directory, part-m-0000n, where 'n' ranges from 0 to the number of tasks that were executed as part of the Hadoop job.

The contents of these files can be viewed using this command:

$ ./dse hadoop fs - cat /npa_nxx/part-m-00000

By varying the number of tasks (the 00000), the output looks something like this:

361991,361,991,27.73,097.40,L,TX,Corpus Christi
361992,361,992,27.73,097.40,L,TX,Corpus Christi
361993,361,993,27.73,097.40,L,TX,Corpus Christi
361994,361,994,27.73,097.40,L,TX,Corpus Christi
361998,361,998,27.79,097.90,L,TX,Agua Dulce
361999,361,999,27.80,097.40,W,TX,Padre Island National Seashore

As shown in the output, the CSV file format that Sqoop requires does not include optional spaces in the delimiter.