[nzlug] Data processing.....

Liz liz at zeald.com
Mon May 28 13:43:41 NZST 2007


On Monday 28 May 2007 13:39:28 Andras Farago wrote:
>   Hi guys,
>   What software can you recommend to process a database/txt file/whatever
> with approx 20 million rows, 25 fields in each row? I need to perform only
> very simple queries like “SELECT a, Sum(b) FROM data GROUP BY a ORDER BY
> Sum(b) DESC;”. Another important option is the time, I can’t wait all day
> to get the result.

Well that would depend on if its a database or a text file and what format its 
in.
csv would be ideal - you could just import it into something else like SQL or 
open it in excell (openoffice or something) and then do the query.
But without knowing the format its pretty impossible to say

Liz

>   Andrew
>
>
>
> ---------------------------------
> How would you spend $50,000 to create a more sustainable environment in
> Australia?  Go to Yahoo!7 Answers and share your idea.
> _______________________________________________
> NZLUG mailing list NZLUG at linux.net.nz
> http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug





More information about the NZLUG mailing list