[Maxima-discuss] Maxima running out of memory

[André Fettouhi]

I'm using now maxima 5.37.2-sbcl with wxmaxima nightly from the 19th of
february. I am tryng to plot some data from a text file (roughly 36 MB)
that has about 360000 lines and 16 columns. I only need to plot two of
those columns but when reading the file with

IXAlogDataStrings[SensorNumber] : read_IXA_LOG_File(concat(workDir,
SSTDataFile[SensorNumber]))$

I get this after 15 minutes

Message from maxima's stderr stream: Heap exhausted during garbage
collection: 8 bytes available, 64 requested.
Gen StaPg UbSta LaSta LUbSt Boxed Unboxed LB LUB !move Alloc Waste
Trig WP GCs Mem-age
0: 0 0 0 0 0 0 0 0 0 0 0
5368709 0 0 0,0000
1: 0 0 0 0 0 0 0 0 0 0 0
5368709 0 0 0,0000
2: 0 0 0 0 0 0 0 0 0 0 0
5368709 0 0 0,0000
3: 0 0 0 0 0 0 0 0 0 0 0
5368709 0 0 0,0000
4: 0 0 0 0 0 0 0 0 0 0 0
5368709 0 0 0,0000
5: 39562 28626 0 0 18252 39964 94 0 34 237931264
906496 230668301 0 14 0,9469
6: 0 0 0 0 12980 2626 0 0 0 63922176 0
2000000 12717 0 0,0000
Total bytes allocated = 535066944
Dynamic-space-size bytes = 536870912
GC control variables:
*GC-INHIBIT* = true
*GC-PENDING* = true
*STOP-FOR-GC-PENDING* = false
fatal error encountered in SBCL pid 5208(tid 8729656):
Heap exhausted, game over.

Is there a way to avoid that? I have 16 GB in this laptop I use.

[Gunter Königsmann]

Robert has done great work on that => the next release will be much more
efficient on reading in data. Am already eagerly waiting for this one.

The maxima version from
http://wolfgang.dautermann.at/maxima/maxima-clisp-sbcl-current.exe

should include all the improvements - but still be limited: Apparently
it is hard to find a lisp that works in 64bit on windows and that
doesn't have some strange side effects. Did find and fix two bugs in
respect to the gnuplot interface that were triggered on win64, but there
might be more...

...alternatively Wolfgang's installer allows you to choose (by setting
the appropriate command-line parameter for maxima in wxMaxima's config
dialogue) to choose between clisp (very memory-efficient but slow) and
sbcl (fast - but sometimes tends to fragment the memory).

When using sbcl a --dynamic-space-size=999 can extend the available
memory to nearly 1GB - which is as much as one will get with the
combination sbcl+32 Bit (the rest of the memory is for the system+stack+...)

Kind regards,

Gunter.

Post by André Fettouhi
I'm using now maxima 5.37.2-sbcl with wxmaxima nightly from the 19th of
february. I am tryng to plot some data from a text file (roughly 36 MB)
that has about 360000 lines and 16 columns. I only need to plot two of
those columns but when reading the file with
IXAlogDataStrings[SensorNumber] : read_IXA_LOG_File(concat(workDir,
SSTDataFile[SensorNumber]))$
I get this after 15 minutes
Message from maxima's stderr stream: Heap exhausted during garbage
collection: 8 bytes available, 64 requested.
Gen StaPg UbSta LaSta LUbSt Boxed Unboxed LB LUB !move Alloc
Waste Trig WP GCs Mem-age
0: 0 0 0 0 0 0 0 0 0 0
0 5368709 0 0 0,0000
1: 0 0 0 0 0 0 0 0 0 0
0 5368709 0 0 0,0000
2: 0 0 0 0 0 0 0 0 0 0
0 5368709 0 0 0,0000
3: 0 0 0 0 0 0 0 0 0 0
0 5368709 0 0 0,0000
4: 0 0 0 0 0 0 0 0 0 0
0 5368709 0 0 0,0000
5: 39562 28626 0 0 18252 39964 94 0 34 237931264
906496 230668301 0 14 0,9469
6: 0 0 0 0 12980 2626 0 0 0 63922176
0 2000000 12717 0 0,0000
Total bytes allocated = 535066944
Dynamic-space-size bytes = 536870912
*GC-INHIBIT* = true
*GC-PENDING* = true
*STOP-FOR-GC-PENDING* = false
Heap exhausted, game over.
Is there a way to avoid that? I have 16 GB in this laptop I use.
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
_______________________________________________
Maxima-discuss mailing list
https://lists.sourceforge.net/lists/listinfo/maxima-discuss