| View previous topic :: View next topic |
| Author |
Message |
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
 Posted: Tue Oct 24, 2006 7:02 pm Post subject: Higher CPU usage.BT related?Is this normal? |
 |
|
I have noted an heavy increase in CPU usage after launching a BT donwload of mor of 3Gb.
I'm using the last 2.81CVS but I have noted this behaviour in 2.80 CVS too.
Usually my CPU load is something between 8 and 25%. Curently moves between 15 and 99% ... There is no hashing.Perhaps am I not used with BT? Is this a normal behaviour?
Thanks |
|
| Back to top |
|
 |
spiralvoice
Sage
Joined: 06 Jan 2003
Posts: 3982
Location: Germany
|
| Posted: Tue Oct 24, 2006 9:59 pm Post subject: |
|
|
Please shutdown all GUIs and do not use HTML and Telnet,
do you see the high CPU as well?
_________________
Link overview and precompiled cores here: http://mldonkey.sourceforge.net/DownloadLinks |
|
| Back to top |
|
|
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
| Posted: Wed Oct 25, 2006 11:37 am Post subject: |
|
|
I have killed mlnet cause he has occupied more than 300megs in 14Hours.
It seems there is a big memleak around.
For your propose test to be done being useful I need for my client to reach normal activity again.
Note, The problem has started being huge when we have started downloading the Zod image thru BT.
I have perception of the problem when the web-interface has started not respionding, (GUI has gived feedback for a while than he has stoped too)...
FC-6-i386-DVD.iso (3525195776 bytes) / ISO 9660 CD-ROM filesystem data 'FC/6 i386 DVD ' (bootable)
from tracker..
http://torrent.linux.duke.edu:6969/announce
try from:
http://torrent.fedoraproject.org/
ANother bug? ->
I have also noted a little detail while launching mlnet from commandline..here is a piece of the first output:
| Code: | | 2006/10/25 13:16:59 [cCO] max_opened_connections 250, total_files 95, max_concurrent_downloads 50, !!files 0 |
But I have set max_xoncurrent downloads to 100!! I dont' understand why it keeps the default of 50!! |
|
| Back to top |
|
|
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
| Posted: Wed Oct 25, 2006 11:41 am Post subject: |
|
|
I have about 1 mbyte/sec of meamleak at the moemnt... I have disabled BT and the leak has stopped imediately!!!!!!!(I have the killed mlnet cause the mlnet has about 133megs).
The issue is surely about the Bt plugin!!! |
|
| Back to top |
|
|
spiralvoice
Sage
Joined: 06 Jan 2003
Posts: 3982
Location: Germany
|
|
| Back to top |
|
|
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
| Posted: Wed Oct 25, 2006 1:26 pm Post subject: |
|
|
I have tried cacellig the Bt download, closing the plugin, relaunched the plugin..re started the download from the tracker.(I have changed BT-identity of client to "default" but I thing it is not important).
At start I have noted again a memory grow... it reached about 90megs in few seconds but then it has fallen down and memory seems stabilized around 66megs.
Now the activity seems stabilized and the CPU usage keep being around 98% continusly.
But the mlnet occupies only 66 megs and seems working better.
At the moment webinterface responds very slowly (usable but it's ridicusly slow cause I am in local network).
It's deterministic after BT donwld start working hard the webinterface stops responding and CPU usage became 99%.
| Code: | Buildinfo
Version: MLNet Multi-Network p2p client version 2.8.1.CVS
SCM version: 2006-10-24 20:28:56
Networks: Global Shares FileTP BitTorrent Donkey (SUI)
Ocaml version: 3.08.3 - C compiler version: 3.3.5 - C++ compiler version: 3.3.5
Build on: Linux i686 2.6.8-2-386 (little endian) with glibc 2.3.2
Configure args: '--disable-multinet' '--enable-donkey' '--enable-bittorrent' '--enable-filetp'
Features: multiuser threads zlib-1.2.2 bzip2-1.0.2 gd(jpg/png-1.2.8) iconv(active) magic(active) no-check-bounds
Buildinfo
Version: MLNet Multi-Network p2p client version 2.8.1.CVS
SCM version: 2006-10-24 20:28:56
Networks: Global Shares FileTP BitTorrent Donkey (SUI)
Ocaml version: 3.08.3 - C compiler version: 3.3.5 - C++ compiler version: 3.3.5
Build on: Linux i686 2.6.8-2-386 (little endian) with glibc 2.3.2
Configure args: '--disable-multinet' '--enable-donkey' '--enable-bittorrent' '--enable-filetp'
Features: multiuser threads zlib-1.2.2 bzip2-1.0.2 gd(jpg/png-1.2.8) iconv(active) magic(active) no-check-bounds
Runinfo
User: admin (Warning: empty Password) - uptime: 1h 36m 0s
Enabled nets: Donkey Kademlia BitTorrent FileTP
Server usage: enabled
Geoip: enabled, GeoLite data created by MaxMind, available from http://maxmind.com/
IP blocking: local: 0 ranges - web: 96007 ranges
DNS: DNS resolution not available, web_infos and BT does not work
Libmagic: file-type recognition database present
System info: Linux pigrigw.tana.net 2.6.8-2-386 #1 Tue Aug 16 12:46:35 UTC 2005 i686
language: EN - locale: ISO-8859-1 - UTC offset: +0200
max_string_length: 16777211 - word_size: 32 - max_array_length: 4194303
max file descriptors: 1024 - max useable file size: 2^63-1 bits (do the maths ;-p)
Network Port Type
BitTorrent 6687 client_port TCP
BitTorrent 6688 tracker_port TCP
Core 4080 http_port
Core 4000 telnet_port
Core 4001 gui_port
Donkey 6681 client_port TCP
Donkey 6685 client_port UDP
Donkey 6210 kademlia_port UDP |
OOPS I have noted that ocaml veersion is 3.08.3 .. have I to had use 3.09 ? Could it be the core of the problem? I'm sorry for this oversight. |
|
| Back to top |
|
|
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
| Posted: Wed Oct 25, 2006 1:30 pm Post subject: |
|
|
The upload is also jumping beetween 5 and 12Kbyte/sec.
Sometimes the memory exploades again from 66 to 90(and more) emgs, and immediately falls down again to 66.
I'm going to change the ocaml version just now. |
|
| Back to top |
|
|
spiralvoice
Sage
Joined: 06 Jan 2003
Posts: 3982
Location: Germany
|
| Posted: Wed Oct 25, 2006 3:52 pm Post subject: |
|
|
| fabtar wrote: | | FC-6-i386-DVD.iso (3525195776 bytes) / ISO 9660 CD-ROM filesystem data 'FC/6 i386 DVD ' (bootable) |
I setup a MLDonkey in a clean dir to test download of the same torrent.
2h uptime, 70 kb/s medium download, 50MB RAM usage.
| Quote: | Version: MLNet Multi-Network p2p client version 2.8.1.CVS
SCM version: 2006-10-25 13:36:15
Networks: Global Shares BitTorrent
Ocaml version: 3.09.3 - C compiler version: 4.1.1
Build on: Linux i686 2.6.18-gentoo-r1 (little endian) with glibc 2.5
Configure args: '--enable-minimum' '--enable-bittorrent' '--disable-donkey'
Features: multiuser threads zlib-1.2.3 no-bzip2 no-gd iconv(active) no-magic no-check-bounds
User: admin (Warning: empty Password) - uptime: 2h 18m 52s
Enabled nets: BitTorrent
Server usage: enabled
Geoip: enabled, GeoLite data created by MaxMind, available from http://maxmind.com/
IP blocking: local: 0 ranges - web: 110088 ranges
System info: Linux gentoo 2.6.18-gentoo-r1 #1 Wed Oct 18 22:48:25 CEST 2006 i686
language: DE - locale: UTF-8 - UTC offset: +0200
max_string_length: 16777211 - word_size: 32 - max_array_length: 4194303
max file descriptors: 1024 - max useable file size: 2^63-1 bits (do the maths ;-p) |
_________________
Link overview and precompiled cores here: http://mldonkey.sourceforge.net/DownloadLinks |
|
| Back to top |
|
|
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
| Posted: Wed Oct 25, 2006 4:36 pm Post subject: |
|
|
Ok, what about your CPU usage? I have changed (just now) to a core compiled on another debian box and I have a better CPU usage .. the average is about 50%, but stay low for some time (20%) and then rise to 99% for another piece of time, it's jumping continuosly from low to high... but I think it is normal as far as webinterface keep being responsive.
While the CPU load icrease the memory consumption grows to 70/80 megs and the falls down to 55 again.
But it seems
The webinterface is performing better ..it is more responsive.
My conclusion is that by compiling with 3.09.3 compiler has solved something.. but could this the original problem for real? Just for curiosity.
But I like to wait 1 hour first to jump to conclusion about the current core!.
Thanks for your support
My PC has a p3 700 with 320megs 120GigaHD |
|
| Back to top |
|
|
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
| Posted: Wed Oct 25, 2006 4:44 pm Post subject: |
|
|
Another detail:
At start I keep having:
2006/10/25 18:09:52 [dMain] Libmagic file-type recognition database present
2006/10/25 18:09:52 [cCO] checking max_opened_connections = 280 for validity
2006/10/25 18:09:52 [cCO] max_opened_connections 280, total_files 95, max_concurrent_downloads 50, !!files 0
2006/10/25 18:09:52 [cO] Logfile mlnet.log reset: bigger than 2 MB
2006/10/25 18:09:52 [cO] Logging in /home/mlnet/.mldonkey/mlnet.log
2006/10/25 18:10:00 [dMain] Core started
I have manually set max_concurretn_downloads to 100 |
|
| Back to top |
|
|
spiralvoice
Sage
Joined: 06 Jan 2003
Posts: 3982
Location: Germany
|
| Posted: Wed Oct 25, 2006 5:33 pm Post subject: |
|
|
| fabtar wrote: | | Ok, what about your CPU usage? |
Very low, nothing compared to your experience.
_________________
Link overview and precompiled cores here: http://mldonkey.sourceforge.net/DownloadLinks |
|
| Back to top |
|
|
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
| Posted: Wed Oct 25, 2006 5:59 pm Post subject: |
|
|
My core has started again peforming badly.
He has raised memory consumptio, webinterface was unusable, but I have tried sancho and I have sucesdully set a lower number of BT upload slots, this has improved the cpu usage and I have regained my webinterface  .
Tomorrow I'll try a fresh installation by pushing into the trash the old configs and starting from scratch.
Perhaps , I'll do a new fresh compilation with 3.09.3 compiled on the same box.
Cheers
About the connestion issue? |
|
| Back to top |
|
|
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
| Posted: Wed Oct 25, 2006 6:01 pm Post subject: |
|
|
Ah NO, the core is unusable again.
I'm going crazy!! 
let's try fresh configs immediatly !!!
cheers!! |
|
| Back to top |
|
|
spiralvoice
Sage
Joined: 06 Jan 2003
Posts: 3982
Location: Germany
|
| Posted: Wed Oct 25, 2006 6:08 pm Post subject: |
|
|
| fabtar wrote: | | set a lower number of BT upload slots, this has improved the cpu usage |
Please post content of following options:
- max_upload_slots
- BT-max_bt_uploaders
- BT-max_uploaders_per_torrent
_________________
Link overview and precompiled cores here: http://mldonkey.sourceforge.net/DownloadLinks |
|
| Back to top |
|
|
fabtar
Sage
Joined: 04 Feb 2004
Posts: 1575
Location: Italy
|
| Posted: Thu Oct 26, 2006 8:58 am Post subject: |
|
|
max upload slot=4
I have changed the BT settings a bunch of times lookin' for the problem I have tried for the
- BT-max_bt_uploaders 3
- BT-max_uploaders_per_torrent 3
- BT-max_bt_uploaders 2
- BT-max_uploaders_per_torrent 2
- BT-max_bt_uploaders 1
- BT-max_uploaders_per_torrent 1
Only one time I have set for mistake BT per torrent>max bt uploders ..but I hae immediatly corrected this. |
|
| Back to top |
|
|
|
FAQ
Search
Memberlist
Usergroups
Register
Profile
Log in to check your private messages
Log in
