list archives . users mailing list
 

Subject: Re: Use of databases on the Grid

Date view Thread view Subject view Author view Attachment view

From: Maria A. Nieto-Santisteban (nieto@skysrv.pha.jhu.edu)
Date: Nov 12, 2004 23:44

Hi,

On Fri, 12 Nov 2004, Beth A Plale wrote:

> Hello Maria,
>
> I am the chair of the OGSA-DAI User Group, and it is good to see your
> interest in database use on the Grid. In order to better guage your
> needs, can I inquire as to why this information is needed? Are you
> researching related work for a technical publication? Or surveying the
> field?

Both, I guess.

I have a paper where I compare the performance of a grid application,
MaxBCG, which finds galalxy clusters in the Sloan Digital Sky Survey.

This app. has been implementeed in two different ways: one uses files and
a combination of TCL scripts that call C routines, the other is pure SQL.
The file-based approach was run on the Grid (condor pools at FNL, Chicago
University and Wisconsin (maybe?) and the SQL on a private SQL cluster and
one of SDSS systems called CasJobs

http://casjobs.sdss.org/CasJobs/

CasJobs is a batch query system with SQL Server onthe back end that
provides the capabilities I described in the prior e-mail. So on one hand
I would like to find another places where I could do something similar and
compare performance, usability etc, and on the other hand I would like to
complete the paper with with references to applications using databases
systems on the grid.

In Astronomy, I know there is nothing similar to casjobs, so I wonder
whether is the same situation in other disciplines.

I want to know how extended are databases systems on the grid to do
science.

Thanks

Maria

> thanks
>
> beth plale
>
> Beth Plale
> Assistant Professor
> Department of Computer Science
> Indiana University
> Bloomington, Indiana
> plale@cs.indiana.edu
> +1 (812) 855 4373 (V)
> +1 (812) 855 4829 (F)
> +1 (812) 345-9852 (cell)
>
> On Fri, 12 Nov 2004, Maria A. Nieto-Santisteban wrote:
>
> > Dear all,
> >
> > I'm doing some (re)search about how database management systems are being
> > used on the Grid to do data analysis or data mining (whatever is your
> > preferred term).
> >
> > I would like to know HOW and WHAT specific applications and catalogs are
> > using the OGSA-DAI software (but not restricted). What DBMS are being
> > used: DB2, MySQL, SQL Server, Oracle, PostgreSQL, Xindice, eXist?
> >
> > Can anybody tell me about Grid nodes that support database management
> > systems? Are they tied to specific disciplines projects like Biology,
> > Astronomy, Chemistry, etc or are they available for general use (providing
> > the user has a proper certificate)? The only general one I'm aware of is
> > http://www.ngs.ac.uk/
> >
> >
> > I am mostly interested in a facility where I can create my own relational
> > database (MyDB), and I have full power to create tables, indexes,
> > functions, stored procedures, etc. In principle, MyDB can be used with any
> > data the user is willing to load which most of the times will come from a
> > very large database "nearby"
> >
> > That's the type of capabilities I am looking for on Grid nodes.
> >
> > As ogsa-dai users I'm sure you have many good applications there that I'm
> > willing to hear of. :)
> >
> > I really would appreciate any information you can provide me.
> >
> > Feel free to redirect this e-mail to anybody you might think can give an
> > answer :)
> >
> > Thanks,
> >
> > Maria
> >
> > ------------------------------------------------
> > Maria A. Nieto-Santisteban (nieto@pha.jhu.edu)
> > Johns Hopkins University
> > 3400 N. Charles St.
> > Physics & Astronomy Department
> > Baltimore, MD 21218 (USA)
> >
> > Tel: 1 410 516-7679 Fax: 1 410 516-5096
> >
> >
> >
> >
> 

-- 
------------------------------------------------
Maria A. Nieto-Santisteban (nieto@pha.jhu.edu)
Johns Hopkins University
3400 N. Charles St.
Physics & Astronomy Department
Baltimore, MD 21218 (USA)
Tel: 	1 410 516-7679  Fax: 	1 410 516-5096
Date view Thread view Subject view Author view Attachment view