Huge memory consumption with CACHE-EX

[turbopower]

Unlikely, the changes are very small and all of them are fixes for possible crashes.

gf@gf:~/git/oscam$ git log --oneline f550a53f1f4e00c92b697d031369fbd36e34cf10 .. module-camd35.c
a7aafe2 fixed a emm-camd35 segfault
abdb1b4 camd35: fixed an aes segfault when using cacheex with camd35


f550a53f1f4e00c92b697d031369fbd36e34cf10 is svn 7179

Could you please tell us how to get version 7179 from svn to prepare the patches and recompile.
Personally i use easy build script to make fast compilation for a various platforms.
BR

[PlatoonRTV]

I think you mean 7180 ? :)

indeed, 7180 works ok

[CapNCooK]

The easiest way to detect memory leaks is to use valgrind. See this http://streamboard.de.vu/wbb2/thread.php?threadid=31968

Running oscam into valgrind as suggested on streamboard.

So far it logged:

--3378-- REDIR: 0x50d74d0 (strcpy) redirected to 0x4a25610 (_vgnU_ifunc_wrapper)--3378-- REDIR: 0x50e55f0 (__strcpy_sse2_unaligned) redirected to 0x4c2bfe0 (strcpy)
--3378-- REDIR: 0x50db1f0 (mempcpy) redirected to 0x4a25610 (_vgnU_ifunc_wrapper)
--3378-- REDIR: 0x5198260 (__mempcpy_ssse3_back) redirected to 0x4c2e4b0 (mempcpy)
--3378-- REDIR: 0x50d95d0 (strncpy) redirected to 0x4a25610 (_vgnU_ifunc_wrapper)
--3378-- REDIR: 0x50e5c20 (__strncpy_sse2_unaligned) redirected to 0x4c2c180 (strncpy)
--3378-- REDIR: 0x50eee40 (strstr) redirected to 0x4a25610 (_vgnU_ifunc_wrapper)
--3378-- REDIR: 0x5181540 (__strstr_sse42) redirected to 0x4c2e7a0 (strstr)
--3378-- REDIR: 0x50d7d00 (strncat) redirected to 0x4a25610 (_vgnU_ifunc_wrapper)
--3378-- REDIR: 0x50e8d00 (__strncat_sse2_unaligned) redirected to 0x4c2be60 (strncat)
--3378-- REDIR: 0x5155990 (__memcpy_chk) redirected to 0x4a25610 (_vgnU_ifunc_wrapper)
--3378-- REDIR: 0x5195780 (__memcpy_chk_ssse3_back) redirected to 0x4c2e690 (__memcpy_chk)

Memory is climbing up.. (uptime: 00:08:19 / Mem: 733 used of 2048 MB)

[CapNCooK]

Could you please tell us how to get version 7179 from svn to prepare the patches and recompile.
Personally i use easyoscam script to make fast compilation for a various platforms.
BR

The latest make.sh script is not compatible with 7179. Dunno exactly which version breaks the compatibility.
I did a manual ./config.sh and compiled. That worked, but several build options are missing, e.g. SHOW_MEM

[gfto]

Guys don't use this so called 'easy script'. Download the cross compilers you need from oscam's cross compiling page, and see oscam's readme and `make help` examples. There is nothing magical about using a cross compiler.

[CapNCooK]

Tonight, i started to narrow down the memory usage of oscam.

I disabled all my cache-ex users, and let the latest build (7228) run.
The mem usage stays steady onto 200MB with 55 readers (including cache-ex) connected, and 25 users (non-cache-ex) connected.

I started to enable users, and noticed that memory started climbing (- and kept climbing) enabling specific cache-ex users.
I wrote down these specific (3) users, which all appeared to be connected with CAMD35.
Also, these 3 are the only CAMD35 users i have configured in my server.

Now with these 3 disabled, my server is running fine!

--

Also, to underline, i still have some CAMD35 cache-ex readers connected in mode 3 causing no problems.
Memory starts climbing when adding CAMD35 users in mode 3 to the server.

I did not test any other mode with camd35 for now.

[turbopower]

What you think to migrate only in cccam? Please prepare long period test to be sure. So that mean i`m right camd35 is source of this mem leaks.

[CapNCooK]

What you think to migrate only in cccam please prepare long period test to be sure. So that mean i`m right camd35 is source of this mem leaks.

Hmm.. This morning oscam has crashed again on high mem.. After a significant longer uptime time that is.. But it still crashed.

I now removed camd35 support from the build and let that run... Will update later!

[mikie8]

the configs posted here , have very high client time out settings .

my server responds in 90 milliseconds , so if your timeout settings are 4000 , my server will respond 40 times before your server finds just one ecm .

how often do you see a correct a response from your server which takes 4 seconds ?

[CapNCooK]

the configs posted here , have very high client time out settings .

my server responds in 90 milliseconds , so if your timeout settings are 4000 , my server will respond 40 times before your server finds just one ecm .

how often do you see a correct a response from your server which takes 4 seconds ?

I agree on lowering the timeout value, although, its a "max responsetime" setting, so if his server finds a valid ECM any earlier, it will respond offcourse.

I have my own config like this:

# oscam.conf generated automatically by Streamboard OSCAM 1.20-unstable_by_EasyBuild_svn build #7228# Read more: http://streamboard.de.vu/svn/oscam/trunk/Distribution/doc/txt/oscam.conf.txt


[global]
usrfile                       = /var/log/oscam/user.log
logfile                       = /var/log/oscam/oscam.log
cwlogdir                      = /var/log/oscam/cw
emmlogdir                     = /var/log/oscam/emm
disableuserfile               = 0
loghistorysize                = 8192
clienttimeout                 = 1500
fallbacktimeout               = 1400
clientmaxidle                 = 900
failbantime                   = 2800
failbancount                  = 20
cachedelay                    = 25
unlockparental                = 1
nice                          = -15
serialreadertimeout           = 1000
maxlogsize                    = 4096
waitforcards                  = 0
waitforcards_extra_delay      = 5000
preferlocalcards              = 1
readerrestartseconds          = 15
dropdups                      = 1
block_same_ip                 = 1
block_same_name               = 1
lb_mode                       = 1
lb_save                       = 250
lb_reopen_seconds             = 300
lb_savepath                   = /tmp/oscam.lbstats
lb_reopen_mode                = 1
max_cache_time                = 4
max_cache_count               = 2500


[monitor]
port                          = 5678
serverip                      = <removed from post>
nocrypt                       = 127.0.0.1
aulow                         = 120
hideclient_to                 = 120
monlevel                      = 4


[newcamd]
port                          = <removed from post>
key                           = 0102030405060708091011121314


[cs357x]
port                          = 21000
serverip                      = <removed from post>


[cs378x]
port                          = 21001
serverip                      = <removed from post>


[cccam]
port                          = 20000
reshare                       = 1
ignorereshare                 = 1
version                       = 2.3.0
updateinterval                = 180
minimizecards                 = 1
nodeid                        = <removed from post>


[webif]
httpport                      = 80
httpuser                      = <removed from post>
httppwd                       = <removed from post>
httptpl                       = /usr/local/etc/picons/
httprefresh                   = 8
httpallowed                   = <removed from post>
httphideidleclients           = 1