home list archives users mailing list
 

Subject: 2 questions with DAI 3.

Date view Thread view Subject view Author view Attachment view

From: Isao Kojima (kojima@ni.aist.go.jp)
Date: Dec 05, 2007 13:49

Hi,

We will have a DAI3.0 hands-on tutorial session for japanese ogsadai
users on this friday and
we are now making some example programming scenarios. However, we
encounterd following 2 questions.

1) SQLBulkloadTuple activity?

One of our scenario includes to create temporal tables and insert the
data with Bulkload activity.
The workflow is just to connect SQLquery output to the input of
Bulkload activity as in the following code fragment.
-------
              URL serverURL = new
URL("http://localhost:8080/wsrf/services/dai/");
               ResourceID execResourceID = new
              ResourceID("DataRequestExecutionResource");
               ResourceID dataResourceID = new ResourceID("MySQLDataResource");
               Server server = new ServerProxy();
           server.setDefaultBaseServicesURL(serverURL);
           DataRequestExecutionResource execResource
=server.getDataRequestExecutionResource(execResourceID);
               SQLQuery query = new SQLQuery();
               query.setResourceID(dataResourceID);
               query.addExpression("SELECT * FROM sample;");
               SQLBulkLoadTuple loadTuples = new SQLBulkLoadTuple();
                       loadTuples.setResourceID(dataResourceID);
                       loadTuples.addTableName("result");
                       loadTuples.connectDataInput(query.getDataOutput());
               DeliverToRequestStatus deliver = new DeliverToRequestStatus();
                       deliver.connectInput(loadTuples.getDataOutput());
                       PipelineWorkflow workflow = new PipelineWorkflow();
                       workflow.add(query);
                       workflow.add(loadTuples);
                       workflow.add(deliver);
               RequestResource requestResource =
execResource.execute(workflow,RequestExecutionType.SYNCHRONOUS);
               System.out.println(requestResource.getRequestStatus().getExecutionStatus());
------
Output format of the SQLquery is tuples and the input format of the
Bulkload activity is also tuples so that I think it is OK
to connect them. However, it cannot work well and what is wrong for us?

2) Data Integration method between without using FTP/GridFTP?

Next our scenario is to make data integration between two resources.
In this scenario, we don't use FTP/GridFTP.

In OGSA-DAI 2.2 we had outputSteram/DeliverfromGDT.combination and
we want to do the same data processing in 3.0 framework.

Q) What kind of activity/programiing we can do for doing the same operation?

Regards,
Isao Kojima
AIST/GTRC
Japan.

Date view Thread view Subject view Author view Attachment view