[nzlug] Data processing.....

[Richard Dingwall]

If it's uniform CSV, you could "connect" to it directly as an ODBC data source.

Richard

On 5/28/07, Liz <liz at zeald.com> wrote:
> On Monday 28 May 2007 13:39:28 Andras Farago wrote:
> >   Hi guys,
> >   What software can you recommend to process a database/txt file/whatever
> > with approx 20 million rows, 25 fields in each row? I need to perform only
> > very simple queries like "SELECT a, Sum(b) FROM data GROUP BY a ORDER BY
> > Sum(b) DESC;". Another important option is the time, I can't wait all day
> > to get the result.
>
> Well that would depend on if its a database or a text file and what format its
> in.
> csv would be ideal - you could just import it into something else like SQL or
> open it in excell (openoffice or something) and then do the query.
> But without knowing the format its pretty impossible to say
>
> Liz
>
> >   Andrew
> >
> >
> >
> > ---------------------------------
> > How would you spend $50,000 to create a more sustainable environment in
> > Australia?  Go to Yahoo!7 Answers and share your idea.
> > _______________________________________________
> > NZLUG mailing list NZLUG at linux.net.nz
> > http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
>
>
>
> _______________________________________________
> NZLUG mailing list NZLUG at linux.net.nz
> http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug
>