Re: DBI memory usage

[prev] [thread] [next] [Date index for 2005/01/18]

>> Is there a way to do large queries that return lots of data without
>> having my apache process grow by the equivalent size in ram of the
>> data returned?
>
> Yes.  Many databases support sending the results a few rows at a time
> instead of all at once.  For specific advice on this, you might check
> your DBD documentation or ask on the dbi-users list.  You can also have
> your program schedule the current apache process to exit after finishing
> the current request if you load a large amount of data into it.

Also ask yourself if you really need all of the data at
once. You may be able to filter it down in the query or
build some incremental data structures using row-by-row
iteration instead of fetchall_arrayref.


        -- 
        Steven Lembark                                       85-09 90th Street
Workhorse Computing                                Woodhaven, NY 11421
lembark@xxxxxxx.xxx                                     1 888 359 3508