Re: [dev] [sbase] sponge v2

From: Calvin Morrison <mutantturkey_AT_gmail.com>
Date: Wed, 3 Jul 2013 08:53:52 -0400

How?

On 3 July 2013 08:13, hiro <23hiro_AT_gmail.com> wrote:
> won't this increase cache misses for everything else?
>
> On 7/2/13, Calvin Morrison <mutantturkey_AT_gmail.com> wrote:
>> On 2 July 2013 15:50, Galos, David <galosd83_AT_students.rowan.edu> wrote:
>>>> I'm failing to see the problem with loading everything into memory.
>>>
>>> If the next step is "write that to a temp file" there is a big
>>> problem. There's nothing wrong with the present tempfile approach.
>>
>> Yes there is. It wastes read/writes on my hard drive, is slower than
>> in-memory reading, adds overhead of file operations, and also depends
>> on having a non-read only filesystem to write too.
>>
>>> It's reasonably fast
>> I want faster.
>>
>>>it's completely portable (so no crazy getrlimit or /proc reading). Strace
>>> shows that that's how 'sed -i' works.
>>
>> How would in memory storage incur any /proc reading?
>>
>>> If on any system other than linux, I would consider loading into ram,
>>> but because of memory overcommit, malloc never fails, the whole system
>>> crawls to a halt, and the oom killer takes 20 minutes to put
>>> everything back together. No thanks.
>>
>> Okay so you are discussing a problem with your version of unix and
>> malloc, not with the tool sponge.
>>
>> Calvin
>>
>>
>
Received on Wed Jul 03 2013 - 14:53:52 CEST