Contents
This sample demonstrates the use of the TIBCO StreamBase® Binary File Reader and Writer Adapters for Apache Hadoop Distributed File System (HDFS).
You must open the sample application, binaryrw.sbapp
and select the Parameters tab and edit the HDFS_FILE_PATH and HDFS_USER to
represent your current HDFS setup and where you would like to store the sample data.
-
In the Package Explorer view, double-click
myfile.csvto see the CSV records that will be converted to binary. -
Double-click to open the sample application,
binaryrw.sbapp. -
Click the
Run button. This opens the
Test/Debug perspective and starts the application.
-
In the Manual Input view, select the DoWrite input stream and press .
-
Look for tuples emitted on the BinaryDataWritten output stream and observe they contain the values from
myfile.csv. -
Select the DoRead input stream and press .
-
Look for tuples emitted on the BinaryDataRead output stream and observe they contain the values from
myfile.csv. -
Select the DoDelete input stream and press .
-
Look for tuples emitted on the DeleteStatus output stream to confirm the file has been deleted.
-
When done, press F9 or click the
Stop Running Application button.
This section describes how to run the sample in UNIX terminal windows or Windows command prompt windows. On Windows, be sure to use the StreamBase Command Prompt from the Start menu as described in the Test/Debug Guide, not the default command prompt.
-
Open three terminal windows on UNIX, or three StreamBase Command Prompt s on Windows. In each window, navigate to your workspace copy of the sample, as described above.
-
In window 1, type:
sbd binaryrw.sbapp -
In window 2, type:
sbc dequeue -vThis window will display the tuples dequeued from the adapter's output port.
-
In window 3, type the following command to cause the sample application to write the CSV file contents to a binary file:
echo null | sbc enqueue DoWrite -
Observe in window 2 that tuples are emitted from the
BinaryDataWrittenstream. -
In window 3, type the following command to cause the sample application to read the read and display the contents of the binary file:
echo null | sbc enqueue DoRead -
Observe in window 2 that tuples are emitted from the
BinaryDataReadstream. -
In window 3, type the following command to cause the sample application to delete the binary file:
echo null | sbc enqueue DoDelete -
Observe in window 2 that tuples are emitted from the
DeleteStatusstream. -
In window 3, type the following command to terminate the server and dequeuer:
sbadmin shutdown
In StreamBase Studio, import this sample with the following steps:
-
From the top menu, click → .
-
Select this sample from the Embedded Input Adapters list.
-
Click OK.
StreamBase Studio creates a project for this sample.
When you load the sample into StreamBase Studio, Studio copies the sample project's files to your Studio workspace, which is normally part of your home directory, with full access rights.
Important
Load this sample in StreamBase Studio, and thereafter use the Studio workspace copy of the sample to run and test it, even when running from the command prompt.
Using the workspace copy of the sample avoids the permission problems that can occur when trying to work with the initially installed location of the sample. The default workspace location for this sample is:
studio-workspace/sample_hdfsbinaryrw
See Default Installation
Directories for the location of studio-workspace on your system.
In the default TIBCO StreamBase installation, this sample's files are initially installed in:
streambase-install-dir/sample/hdfsbinaryrw
See Default Installation
Directories for the location of streambase-install-dir on your system. This location
may require administrator privileges for write access, depending on your platform.