Kal,
An update on this:
I ran samp03svr under gdb with no success. The output from a 'bt' showed an array of memory addresses with nothing attached to them, just question marks. I decided to compile all the plugins that I use (8 in total) with debug symbols (compiled with -g -O0 -rdynamic) and run the server under gdb.
These 8 plugins are:
G-Stylez MySQL R5
Incognito Plugins (Streamer v2.5, DNS v2.4, IRC v1.3.6 SSL, GVars v1.3)
****** Plugins (Sscanf 2.0, Whirlpool 64-bit version)
Kalcor's MapAndreas v1.0 beta
Additionally, I added logging to every function, every callback, and every command (in-game and irc, both Zcmd-driven command systems). When the server does the libc segfault, it is always on a different function. This would lead me to believe the issue stems from something outside the script.
My server's specs are:
Kimsufi/OVH dedicated server
Intel Q6600 Quad-core CPU
4GB DDR2 Ram
1TB SATA2 (non-RAID)
100MB up/down
OS: Ubuntu Linux v9.04 64-bit
This is the output I got from the 'bt' output. With all plugins under debug, this is what I got after 2 successful 'bt' captures under gdb:
http://pawn.pastebin.com/N675w5ss
I initially assumed it was the streamer plugin though under debug I would have expected more output from gdb so I ran the server again under gdb.
My understanding is that Blacklite from SACNR has this exact same issue with libc segfaults under completely random functions. We've both run similar tests with little useful output from gdb/bt.
UPDATE: I found output that I had from an strace during one of the crashes:
http://pawn.pastebin.com/w4UA7y1r. Here is one where it would commonly happen when a connection was made (prior to OnPlayerConnect firing), a known IP from a regular - not a malicious attacker:
http://pawn.pastebin.com/EE2wuTcF. You can see my function execution logging in there.