[00:02] Hi Jack [00:13] mhepp (~mhepp@r72s22p13.home.nbox.cz) left irc: Remote host closed the connection [00:23] hi [00:24] I have vserver 0.26 with this. I will send it to you (bertl). Now I have a problem with linux-vserver.org. We need a clean download area... [00:25] correct, I would suggest to make a release and experimental dir ... [00:25] or development [00:25] and we should add the releases/devel on the wiki as planned ... [00:29] @jack there is no problem if you release your tools, as I do not maintain them ... [00:29] Bertl - you not have create one dir for stable(release) versions and second for development snapshots.. ? [00:29] @alex yes, this is the idea ... [00:29] we will do that ... [00:44] JonB (~jon@129.142.112.33) left irc: Quit: later [02:03] @jack, did you spend some thoughts on the network virtualization yet? [02:06] No sorry. [02:06] no problem, just wanted to know ;) [02:07] I have to leave. [02:07] okay, when to expect 0.26? [02:07] Just want you to known one thing about vserver and me [02:07] I can send it to you right now [02:08] Anyway about vserver and me [02:08] I was overload with tons of problems, work and what's not and finally start to see the light and this happened exactly the week you suggest to take over the project. [02:09] Since I have managed to stay somewhat on top. This may look like I am reacting to the change in the project and trying to grab it back [02:10] This is not the case. Pure coincidence that I have managed since 2 week to read and answer my email. I hope it will stay like this. [02:10] Just to clarify this. [02:10] hey jack, as I said I'm really glad that you are back, and I hope we will work together on vserver whenever possible .. [02:11] we just have to coordinate ... whatever part you want to take in the development process, it's yours ... [02:11] fine. Now I am leaving (I still have 4 kids, and this is another story) [02:11] have a nice evening ... [02:12] Oh btw, what happend to the mailing list. Last week, I moved all my mailing list to mailman. The noise went down and performance up. [02:12] nice evening, jack.. [02:12] have you seen the new mailing list martin has put up? [02:13] we have threaded archives and he is working on improving them further ... [02:14] Has this been announced ? [02:14] yes ... and we intent to switch at the end of this month ... [02:15] Ok. Just tell me and I will put an alias. [02:15] Go weekend [02:15] jack (~jack@206.162.172.138) left irc: Quit: using sirc version 2.211+KSIRC/1.2.4 [02:16] hi alex .. http://vserver.13thfloor.at/Stuff/syscall2.2.txt, is this okay? [02:16] hi all :) [02:16] I am getting line 19: [: =: unary operator expected [02:16] what programming language? ;) [02:16] when starting services in RH9 [02:17] probably bash [02:17] hmm, sounds like some shell variable is not set ... [02:17] i c [02:19] # Check that networking is up. [02:19] [ ${NETWORKING} = "no" ] && exit 0 [02:21] probably this isn't set in the /etc/sysconfig* [02:21] the variable NETWORKING should be set in /etc/sysconfig/network [02:22] yep. that was it. typo in NETWORKING [02:22] :) thanx [02:23] you're welcome ... [02:27] Bertl> okey. it`s not have new parts - only numbering cels.. [02:27] yes ... [02:32] how i understand - assign commands to cels ? or you want other ? [02:32] no, that's exactly my idea ... [02:33] just assign all present and future commands to those cells/numbers ... [02:35] at col 1 we must place all my "get" commands... it corrent ? [02:36] hmm, could you list them to help me remember? [02:36] correct.. [02:41] http://www.freevps.com/download/command_list [02:43] hmm, you don't mean _all_ your get commands, do you? [02:45] it`s primary commands - other can be added simular. [02:46] it`s primary commands - other can be added similar. [02:47] get max process capablity for example? [02:48] I would put it into the [12] [02:49] get ? [02:50] yes, maybe we should add INFO to that COLUMN? [02:51] for get statistic we reserverd 0,8,16,32,... or you have other thoughts about it colum ? [02:51] for get statistic we reserverd 0,8,16,32,... or you have other thoughts about it column ? [02:51] hmm you consider this statistics, okay, then [08] ... [02:52] I thought this was some setting you did with set before ... [02:53] yes. i consider all my "get" commands as statistics command. [02:54] hmm, but it's not statistical if you set it before ... so if this is a readback of a previous set value, we should consider putting it into the control column, and add INFO to make that clear ... [02:55] or if you prefer change the QUERY to INFO (more general) ... [02:56] "set" - is control. but if we get installed values or property - it`s statistic ? or not ? [02:57] okay, let us change the QUERY to INFO and you put it in the first column, yes? [02:58] http://vserver.13thfloor.at/Stuff/syscall2.2.txt [03:01] other way - transfor INFO/QUERY column to 3-dimensional. because many commands have reversed command for get statistic from it. it need 1 bit = one column. [03:03] hmm, well you can always have get/set command in the same cell, that is not a problem ... [03:04] the more I think about it, the better I like that ... [03:04] or do you mean something else? [03:07] but "get" is statitic ? [03:08] and me not change matrix - we rename (transform) one colomn.. [03:08] get is INFO, but it doesn't matter, since we changed the culumn label ... [03:08] which column would you like to rename? [03:10] STATS - but rename can be bad word.. transform to 3D. and 4D is commands. [03:11] hmm, so you want to use one bit from the COMMAND for get/set, right? [03:12] can be command - can be category. but yes. [03:12] we don't have it in category, so it would be command ... if you like that, why not ... 0-127 (set) 128-255 (get) okay? [03:13] okey :) [03:13] but personally I don't see any reason to do it .. because you can also use 17 (set), 18 get for example ... [03:14] for easy identification.. as matrix.. [03:15] as I said, no problem with that .. if you like to extend this to get/set/modify/other (2bits) it's okay for me too ... [03:17] i think more ease do modify in userland - in kernel have more atomic operations... [03:21] okey.. create\destroy context it for cel 01 ? [03:21] yep! [03:23] set schedeling police - it 14 ? [03:24] or [12] but [14] seems better ... [03:24] i agree 14. [03:25] set CPU usage - 12 ? [03:25] agreed! [03:26] first part finisned :) [03:27] sorry i make a tea and return :) [03:27] make it so ... [03:34] i`m back.. [03:34] is/was the tea good? [03:36] yes :) i like ahmand tea with jasmine.. [03:39] i hope you too ? [03:40] I like tee, but I drink it with cinnamon sticks ... [03:41] hm.. not drink with it :) [03:42] well, okay, I don't drink the sticks ;) [03:42] well, returned to fill cells :) [03:43] you have remarks for fill first row ? [03:43] migrate (context change) [03:43] 03 . [03:44] chsaferoot, chnamespace ... [03:44] 02/04 - unused ? [03:44] hm.. namespace is - vfs object... [03:45] okay, right ... [03:45] 04 host/system limits .. hmm ... [03:46] nothing yet ... but we'll see ... [03:46] it can be only extened capablites :-\ if it need. [03:46] ahh, good point, just forgot it ... [03:46] per context capabilities (sub/finer grained) [03:51] okey. [03:52] finish on row ? [03:52] for now, yes ... [03:53] @matt http://vserver.13thfloor.at/Experimental/patch-2.4.23-pre7-O1.2-c17h.diff http://vserver.13thfloor.at/Experimental/patch-2.4.23-pre7-O1.2.diff [03:56] ok.. [03:56] herbert - i want sleep :) [03:56] 3 am :-) [03:56] no problem ... we continue tomorrow? [03:57] of course :) [03:57] have a good night ... [03:58] thanx :) for you too [03:58] @MrBawb could you give the O(1) c17h a try? [03:59] shadow (~umka@212.86.233.226) left irc: Quit: go to bed [04:04] I can when I get home in an hour :) [04:04] perfect ... [04:05] what is the relationship between patch-2.4.23-pre7-O1.2-c17h.diff and patch-2.4.23-pre7-O1.2.diff? [04:05] are they both needed? [04:06] yes, as usual (for me) the patch-2.4.23-pre7-O1.2.diff is the scheduler and patch-2.4.23-pre7-O1.2-c17h.diff is the c17h stuff ontop of that ... [04:06] ah ok [04:07] since our schedules seem to be desynced, would you like me to email you the results? [04:08] if you don't find me here .. (Bertl_zZ) then, yes please ... [04:09] it would be great too if you could have it running for some time (lets say a day or so) under some load (e.g. frokbomb in one context) ... [04:10] what's your email? [04:10] herbert@13thfloor.at [04:10] ok [04:21] serving (~serving@213.186.190.62) left irc: Ping timeout: 485 seconds [04:25] serving (~serving@213.186.190.64) joined #vserver. [04:30] morning [04:30] night! [04:31] morning! [04:31] hehe [04:31] as I said, night! [04:31] how are you bertl? [04:31] fine, thanks, how are you? [04:31] good, life is peachy [04:32] how are the vserver plans going? any cool new developments? [04:32] yes, we have a c17h on O(1) scheduler ... wanna test? [04:33] sure, why not...does it have ml, or is that pushing my luck ;) [04:33] not yet, but I guess you can safely add that one ... [04:33] that on your experimental page? [04:33] ml is cool [04:33] http://vserver.13thfloor.at/Experimental/patch-2.4.23-pre7-O1.2.diff [04:33] http://vserver.13thfloor.at/Experimental/patch-2.4.23-pre7-O1.2-c17h.diff [04:33] i use it on my servers and it seems to work quite will [04:34] http://vserver.13thfloor.at/Experimental/patch-2.4.23-pre7-O1-c17g2-ml0.04.diff.bz2 [04:34] that one could work with it ... [04:35] but the O(1) scheduler stuff is very experimental, so be warned ... [04:35] aah [04:35] you might lose your best processes to it ;) [04:35] okay [04:35] hehe [04:35] hmm, what a dilemma [04:35] on the other hand, matt reported that it does miracles on his system ... [04:35] what i really need is a test box [04:36] heh :) that's a big call [04:36] he just had some troubles on his SMP system ... but that was another patch (one he adjusted himself) [04:36] just fyi, i'm running vserver on slackware and the tools all mostly work [04:37] okay [04:37] cool, I thought about putting up some wiki page where everybody can tell how and under what circumstances he/she uses vserver, what do you think about that? [04:38] i think it would be excellent [04:38] wikis are good [04:38] i saw some mention of the utilities being rewritten in C...are those going to replace the existing ones? [04:39] we decided that there will be two branches for userspace tools ... [04:39] ideally, the tools would be distribution aware [04:39] jack agreed to maintain his utilities (and this means adapting them to future stable versions) [04:39] oh [04:40] those are the C ones? [04:40] but the 'mainstream' if we have something like that, are enricos util-vserver ... [04:40] those are 95% C now and might become 100% C in the near future ... [04:41] so this: vserver-0.22.src.tar.gz [04:41] this doesn't include the bash scripts, which are basically the same on both userspace tools ... [04:41] is jacks stuff? [04:41] vserver-0.XX up to 0.24 is jack [04:41] util-vserver is enrico ... [04:41] okay [04:42] hmm, so if i wanted to add slackware support to the toolbase i should do it on util-vserver then... [04:42] I would suggest to do so ... but maybe a mix of both could be advantageous ... [04:43] for example, enrico doesn't include the newvserver stuff, because he isn't able to test it ... [04:43] righto [04:44] why not? [04:44] you have to ask him yourself ... [04:45] are aware of anybody having run vserver on non-x86, eg. sparc64? [04:45] s/are/are you/ [04:46] yes, we have someone on x86_64 and somebody who wanted to test on sparc/ultra sparc ... but got no feedback so far ... [04:46] hmmm [04:46] that is cool [04:46] it should run on sparc/sparc64 as I tried to add those platforms ... [04:46] i might test it at work [04:46] i am running debian on an ultra-10 [04:47] I have no such machines, and no access to them, but I'm willing to help if you encounter any issues with vservers on that kind of hardware ... [04:48] okay, i'll give it a go on monday and let you know how it turns out :) [04:48] perfect ... [04:48] I would suggest testing c17h, c17f in this order ... [04:49] okay [04:49] you will require latest tools (util-vserver) for c17h .. [04:49] but they will work for older kernel patches too ... [04:49] latest, as in cvs? or latest release? [04:50] he has his cvs on savannah, so pay a visit there, link is on linux-vserver.org ... [04:51] yep [04:52] so why has jack stepped back from maintaining vserver? real-life? [04:53] I guess it just wasn't fun anymore ... [04:53] :( [04:54] probably some (read a lot) troubles in real-life ... [04:54] but I'm glad, he still is working on this project ... [04:55] yeah [04:55] i'm glad the project is still going...it opens up a lot of possibilities [04:56] yeah?, tell me about them ... [04:56] i particularly like the idea of high-availability vservers [04:56] floating from host to host...very cool [04:56] i read in the archives that some guy had accomplished this on top of drbd and heartbeat [04:56] yes, I actually did some tests of this scenario ... with drbd ... [04:57] was it effective? [04:57] well, it worked reasonably good ... [04:57] blueshoe (~cocoons@phylogenomics.Berkeley.EDU) joined #vserver. [04:57] probably you can do without drbd, if you sync via rsync or something similar ... [04:58] hi blueshoe? [04:58] yeah, that was another possibility [04:58] gotta go, relatives have arrived [04:58] cu! [04:59] i just used debain's make-kpkg to compile a new kernel with the ctx patch, and it compiles fine, but when i boot and try chcontext 1 it complains [04:59] hmm, what exactly is in this kernel? [04:59] "can't set the new security context" ": Function not implemented" [04:59] 2.4.21 [05:00] vanilla, with what patches? [05:00] linux, debian, i386 [05:00] just the ctx patch (the "kernel-patch-ctx" deb) [05:00] I did a debian patch some time ago, maybe you should try that one? [05:00] yeah, i was going to try manually patching the kernel next [05:01] http://vserver.13thfloor.at/Experimental/patch-deb0.2-2.4.22-c17f.diff.bz2 [05:01] that is for 2.4.22-3 IIRC ... [05:01] i was just hoping maybe there was something i was missing that i could easily fix :) [05:01] we can have a look at your kernel if you want ... [05:02] well, i don't want you to go to that much trouble [05:02] what does 'grep __NR /proc/self/status' return? [05:03] nothing [05:03] hmm, maybe you didn't install this kernel then? [05:03] maybe you didn't patch it? [05:03] yeah, i'm running it now [05:03] what ctx patch did you use? [05:03] in the compile output i see "Patch /usr/src/kernel-patches/i386/apply/ctx processed fine" [05:04] i used the "kernel-patch-ctx" deb from the unstable tree [05:04] 17-1 [05:04] hmm, can you give me an url? [05:05] i just did an "apt-get update" and selected it through aptitude... but i'll see if i can find it on the web somewhere [05:05] maybe you can put it somewhere on the web then? [05:06] http://packages.debian.org/unstable/devel/kernel-patch-ctx.html [05:07] by the way, vserver is a really cool tool [05:07] thanks for making it happen :) [05:07] thanks for using it ... [05:08] my pleasure [05:09] + buffer += sprintf (buffer,"__NR_new_s_context: %d\n",__NR_new_s_context); [05:09] + buffer += sprintf (buffer,"__NR_set_ipv4root: %d rev2\n",__NR_set_ipv4root); [05:09] those two lines are added to your kernel .. if the patches are applied correctly .. [05:10] so you should see those lines in /proc/self/status ... [05:10] if not, they wheren't applied or the kernel wasn't booted ... [05:11] what does 'cat /proc/version' return, by the way? [05:12] Linux version 2.4.21.031024a (root@arcturus) (gcc version 3.3.2 20030908 (Debian prerelease)) #1 Fri Oct 24 17:21:49 PDT 2003 [05:12] that's the kernel i just compiled [05:13] hmm, well it should have a ctx-17 in the version ... [05:13] really? [05:14] I don't know the debian kernel building process, but the patches suggest so ... [05:14] what i did was: "fakeroot make-kpkg --append-to-version=.031024a --added-patches=ctx kernel_image modules_image" [05:16] well, I assume that is the right thing to do (I really don't know) but in all patches on the url you gave me the kernel version is changed to blabla-ctx-XX ... [05:16] but I don't see a 2.4.21 patch in there, only 2.4.18/19 and 20 .. so maybe this is your problem ... [05:17] IIRC debian stable (woody) is 2.4.20 kernel, right? [05:17] don't know [05:17] i only run unstable [05:17] okay, in this case the 2.4.22-3 should be yours ... [05:18] i do remember that there used to be ctx patches just up to the 2.4.20 kernel [05:18] so maybe that is the problem [05:18] well there are patches up to 2.4.23-pre7 ... [05:18] there are just no debian packages for that ... [05:18] i meant debs [05:18] right [05:19] well, it looks like i'll be compiling a kernel by hand [05:19] Action: blueshoe sighs [05:20] make-kpkg has spoiled me [05:20] http://packages.debian.org/unstable/base/vserver.html [05:21] that's 0.23-3 [05:21] i have 0.23-2 [05:21] that's only the tools, though [05:21] not the kernel patch [05:21] ah okay ... sorry ... [05:22] yeah, the package descriptions are a little confusing sometimes [05:22] http://www.linux-vserver.org/index.php?page=DebianVserver [05:22] nice :) [05:23] how is the unstable release called? [05:23] i think it's called "SID" [05:24] but don't quote me on that [05:24] there's also "testing", so maybe that's "SID" [05:24] okay .. you don't know what you use then? ;) [05:24] i know i use unstable... i just don't know the proper name for it :P [05:25] "the branch that breaks all the time" [05:25] well, as shakespeare said: "what's in a name ..." [05:31] ensc (~ensc@134.109.116.202) left irc: Ping timeout: 513 seconds [05:57] RH (~john877@CC3-24.171.21.47.charter-stl.com) joined #vserver. [05:57] Nick change: RH -> netrose [05:58] hi bobi! [07:00] okay .. I call it a day ... [07:00] Nick change: Bertl -> Bertl_zZ [07:02] goodnight Bertl :) [07:54] blueshoe (~cocoons@phylogenomics.Berkeley.EDU) left irc: Ping timeout: 485 seconds [09:25] shadow (~umka@212.86.233.226) joined #vserver. [09:25] hi all [09:26] hi [11:42] serving (~serving@213.186.190.64) left irc: Ping timeout: 480 seconds [12:21] JonB (~jon@129.142.112.33) joined #vserver. [13:20] mhepp (~mhepp@r72s22p13.home.nbox.cz) joined #vserver. [13:45] serving (~serving@213.186.189.91) joined #vserver. [13:51] mhepp (~mhepp@r72s22p13.home.nbox.cz) left irc: Ping timeout: 480 seconds [14:53] alekibango (~john@b59.brno.mistral.cz) left irc: Ping timeout: 485 seconds [15:00] alekibango (~john@b59.brno.mistral.cz) joined #vserver. [15:03] JonB (~jon@129.142.112.33) left irc: Quit: Client exiting [15:24] mhepp (~mhepp@r72s22p13.home.nbox.cz) joined #vserver. [17:45] Nick change: Bertl_zZ -> Bertl [17:46] hi all! [17:46] Bertl: Hi [17:47] Hi Herbert :) [17:49] hi alex! ready to continue? [17:53] after half hour.. it`s ok ? or i finish test and be ready.. [17:53] no problem .. let me know when you are ready ... [18:06] hmm, any interest in binding vps to CPUs? [18:07] mhepp (~mhepp@r72s22p13.home.nbox.cz) left irc: Remote host closed the connection [18:13] for run programs from vps to selected CPU`s ? [18:13] serving (~serving@213.186.189.91) left irc: Ping timeout: 485 seconds [18:13] yes .. like cpu_affinity only stronger ... [18:14] we can write it to scheduler command group - and if any peoples sending request - add it. [18:15] well, the thing is somebody wrote something called CPUSETS for 2.6 and probably 2.4 .. which does exaxctly this via a syscall ;) [18:33] herbert - what you opinion about open files in one context but file inode be owned in other context.. we can disable it or not ? [18:34] you mean with tagctx files? [18:35] (persistant context tagged files, like UID24/GID24) [18:36] for me - all files taged.. but ones in context_0, other in context with id 3 ... etc.. [18:37] okay, I had a poll, on the mailing list, how to handle inter context file access .. (means file is tagged ctx 7, ctx 3 wants to access) ... [18:38] and against my suggestion to handle this gracefully (silently migrate the context) the community decided that it would be far better to handle this as access violation ... [18:38] primary context 0 can be opened this files.. or not.. [18:38] context 0 can open all files, and context 0 files can be openend by all contexts ... [18:39] same goes for the other inodes ... [18:39] hm.. for open files in all context we can add special flag SHARED.. it do more security... [18:40] hmm, where would you like to put that, and how to handle? [18:40] and what exactly should it do? allow inter context access? [18:40] #define S_IMMUTABLE_LINK 128 /* Immutable links */ [18:40] #define S_SHARED 256 /* it's shared between contexts */ [18:41] hrm, I'm sure I don't want to do that, especially because the S_IMMUTABLE_LINK is not necessary with context tagging anyway ... [18:41] but in current i use it only for control diskusage in context.. [18:41] i not count shared files.. [18:42] but me can`t use same value for it. [18:43] no, what I mean is, I don't see a reason to have any one of those flags ... [18:44] look there is only one case, which actually benefits from S_IMMUTABLE_LINK, where one inode is linked into two contexts ... [18:44] mhepp (~mhepp@r72s22p13.home.nbox.cz) joined #vserver. [18:45] this case can be described as (file in ctx0) and (n_links > 1) [18:45] assuming that you are in a context != ctx0, this file should behave like S_IMMUTABLE_LINK set on it ... [18:46] when the S_IMMUTABLE_FILE is set ... (maybe also without it) [18:47] clearly the without S_IMMUTABLE_FILE case would fit your S_SHARED or if you prefer, both would ... [18:50] or do you see any 'other' use for S_SHARED / S_IMMUTABLE_LINK? [18:50] shared files not count in per context diskquotas [18:51] well ctx0 files (those would be shared) don't count either, right? [18:51] and can be in other types quots.. [18:51] but you can do ctx5 files shared for all ? [18:52] what would be the use of that? beside that it would screw up the UID/GID? [18:56] not :) but can. and check one bit more fast. [18:56] well, I would prefer _not_ to modify 6 filesystems with a flag which isn't used 8-) [18:58] also please apply for you small fix for disquota statitics.. [18:59] mdaur (mdaur@p50917C44.dip.t-dialin.net) joined #vserver. [18:59] what fix is this? [18:59] hi [18:59] in sync_diskquota [18:59] dqput(dquot); [18:59] put_dquot_ref(dquot); [18:59] remove dqput(dquot); [18:59] and add put_dquot_ref(dquot); [18:59] it fix statitics after sync [19:00] do 'sync' - and you seen "Number of still active inodes with quota " be lower [19:01] hihmm, we are talking about mq0.11? [19:01] than before 'sync' [19:01] or about vanilla kernel code? [19:01] i talk about _all_ diskquota [19:01] vanila.. rh.. other patchs.. [19:01] okay, give me a second to verify ... [19:01] okey. [19:02] for veryfy do [19:02] 1) mount -o remount,usrquota,grpquota .... [19:02] 2) quotaon .... [19:02] 3) start some program [19:02] 4) do sync [19:03] 5) quotaoff [19:04] my test [19:04] [root@uml root]# mount -o remount,usrquota / [19:04] [root@uml root]# quotaon -augv / [19:04] start mc... \ finish mc [19:04] [root@uml root]# sync [19:04] [root@uml root]# quotaoff -aug / [19:04] [root@uml root]# quotastats [19:04] Number of dquot lookups: 113 [19:04] Number of dquot drops: 114 [19:04] Number of still active inodes with quota : -1 [19:05] also do mount -o remount / - do not stop using diskquota but quotatools say - quota not used on fs. [19:07] hmm, where do you see this code? (the sync_disquota labeled one?) [19:07] fs/dquot.c [19:08] you mean vfs_quota_sync? [19:08] for new - can be it. [19:08] yes. [19:08] get_dquot_ref(dquot); [19:08] if (dquot->dq_flags & DQ_LOCKED) [19:08] wait_on_dquot(dquot); [19:08] if (dquot_dirty(dquot)) [19:08] sb->dq_op->sync_dquot(dquot); [19:08] dqput(dquot); [19:09] serving- (serving@213.186.189.188) joined #vserver. [19:09] ahh I see, it seems honza missed that, did you tell him? [19:09] for it - remove dqput(dquot); [19:09] not. [19:09] i not finished all test quota. [19:10] thnks for matt - how say about problem on it. [19:10] okay, if you want, I'll contact him ... [19:18] loger5 joined #vserver. [19:18] loger (~loger@213.159.118.2) left irc: Ping timeout: 485 seconds [19:18] Nick change: loger5 -> loger [19:20] mhepp (~mhepp@r72s22p13.home.nbox.cz) left irc: Remote host closed the connection [19:24] mdaur> it more corrently or not ? [19:24] @alex, hmm, this is tricky, but I guess it is intentional to use dqput() [19:25] why ? [19:25] probably only the accounting is wrong ... [19:26] have a look at dqput and how it works ... enable __DQUOT_PARANOIA and see _if_ you get the message ... I doubt it ... [19:26] shadow: when you have long vserver names you have to use virtuall network devices? [19:26] serving (~serving@213.186.190.167) left irc: Ping timeout: 501 seconds [19:27] mdaur not. i have virtual devices inside vps.. [19:27] actually the stats are the only wrong thing as far as I can see ... [19:29] shadow: the vserver script meanly ifconfig does not handle longe device names (so you can not have long vserver names) [19:30] one year ago - i create fork from main vserver project and add to this virtual networkdevices. i hope Herbet add it to vserver main stream. [19:31] if you cut it out, I'll add it the next day ;) [19:31] Bertl> i send to you all code....... [19:31] shadow: do you understand what i mean? [19:31] serving (~serving@213.186.191.180) joined #vserver. [19:31] @alex only the network code ... [19:32] [root@linux port_patch]# LANG=en; ls -l [19:32] total 776 [19:32] -rw-r--r-- 1 root root 153265 Jun 1 07:55 00-start.diff [19:32] -rw-r--r-- 1 root root 18949 Jun 1 08:28 01-alls-fs.diff [19:32] -rw-r--r-- 1 root root 7640 Jun 1 13:56 02-all-in-kernel.diff [19:32] -rw-r--r-- 1 root root 7821 Jun 2 10:06 03-file_lim.diff [19:32] -rw-r--r-- 1 root root 316728 Jun 3 07:50 04-network.diff [19:32] -rw-r--r-- 1 root root 3360 Jun 3 08:04 05-context_dq.diff [19:32] -rw-r--r-- 1 root root 95541 Jun 26 10:28 06-to-1056256121.diff [19:32] -rw-r--r-- 1 root root 149355 Jun 26 11:27 07-add_dq.diff [19:32] -rwxr-xr-x 1 root root 93 Jun 3 08:03 make_dif3 [19:32] drwxr-xr-x 5 root root 4096 Jun 3 08:32 not_include [19:32] -rw-r--r-- 1 root root 69 Jun 26 10:57 read.me [19:32] - 04 = network... [19:32] wow. where is this? [19:32] I obviously missed it ... [19:32] ok. i found in archive... [19:33] From: Alex Lyashkov [19:33] Organization: Positive Software Corporation [19:33] To: Herbert Poetzl [19:33] Subject: about porting my vserver [19:33] Date: Tue, 3 Jun 2003 21:43:32 +0300 [19:33] User-Agent: KMail/1.4.1 [19:33] X-KMail-Identity: psoft [19:33] MIME-Version: 1.0 [19:33] Message-Id: <200306030834.06221.shadow@psoft.net> [19:33] Content-Type: application/x-tbz; [19:33] name="port_patch.tar.bz2" [19:33] Content-Transfer-Encoding: base64 [19:33] Content-Disposition: attachment; filename="port_patch.tar.bz2" [19:34] resend ? [19:34] but i do port for 2.4.19 and have few changes in routing tables. [19:35] after it. [19:35] well it seems that this was my fault, I can't see how I missed it, but it is there ... [19:36] okay can we 'update' the code (regarding the network) to you current status? [19:37] in my release - Say added per context sockets lists.. and it be tested.. Matt have problems with it. [19:38] but it worked varitant from last - my release. [19:40] hmm, okay so are there no fixes/improvements you did to the network code since, then? [19:41] after release send to you changes in network.. [19:44] okey ? [19:44] or you need rediff after release ? [19:45] pardon, I do not exactly understand what you mean, could you explain? [19:45] you plan a release soon, right? [19:46] you have some changes pending for the network, right? [19:46] you'll send me the changes after the release, right? [19:46] what was the rediff part? [19:50] i can send only changed after who do after release ported - or can be create new rediff to vanila kernel.. [19:51] well I would say the difference between the version you ported and the current/release version should be sufficient ... [19:51] unless you changed _a lot_ of stuff ... [19:52] regarding the 'quota fix', what issues do you think to fix with that exactly? [19:52] maybe you could explain how you/matt detected this ... [19:53] if you have i can send to you my test script.. [19:53] please try to explain it to me ... [19:54] for test how work diskquotas i write script.. who conecting via ssh to host and run some commands on it.. [19:55] okay [19:55] after finish test - be started quotastats and output be analised in script.. [19:56] sounds reasonable ... [19:56] if acounting rigth - start second test. if wrong - stop with message. [19:56] okay, when is the accounting right? [19:57] when [19:57] 1) umber of still active inodes with quota = 0 [19:57] 2) Number of allocated dquots = 0 [19:57] 3) Number of free dquots = 0 [19:57] 4) Number of in use dquot entries (user/group) = 0 [19:58] it`s all after quotaoff. [19:58] okay, sounds reasonable, if you disabled quota ... [19:58] now which test does on vanilla kernel produce an error condition? [20:00] yes. [20:00] but i test not a vanila - but base RH 7.3 kernel. [20:00] 17:04 < shadow> 1) mount -o remount,usrquota,grpquota .... [20:00] 17:04 < shadow> 2) quotaon .... [20:00] 17:04 < shadow> 3) start some program [20:00] 17:04 < shadow> 4) do sync [20:00] 17:04 < shadow> 5) quotaoff [20:00] 17:05 < shadow> my test [20:00] 2.4.18-3 [20:00] this sequence should give wrong results, right? [20:00] yes [20:01] okay I'll test that ... brb ... [20:01] ok. [20:02] or if you already have fs with quotas - do sync. and quotaoff. [20:03] mhepp (~mhepp@r72s22p13.home.nbox.cz) joined #vserver. [20:03] netrose (~john877@CC3-24.171.21.47.charter-stl.com) left irc: Ping timeout: 485 seconds [20:19] i again test it on 2.4.18-3 - yes. error found. [20:40] hmm, can't verify on 2.4.23-pre8 (no patches) ... http://vserver.13thfloor.at/Stuff/qcheck-2.4.23-pre8.txt [20:41] hm.. [20:41] do you see any unusual results there? [20:45] http://vserver.13thfloor.at/Stuff/qcheck-2.4.23-pre8-mq0.11.txt [20:45] is the 37/39 change on this check, the bug you see? [20:46] hm. on first - i not seen bug :-\ [20:47] the second is with my quota hashes ... but I do not consider this a bug either ... [20:48] on old variant diskquotas = Number of still active inodes with quota = lockups - drops. [20:50] on second i see it change - who i see on my. [20:50] actually two quotas are 'created' so the difference on drop vs. lookup can be explained ... [20:50] I'm not sure if this holds, as the vanilla kernel does not show this behaviour ... [20:50] do analise vfs_sync_dquots - we _not_ do lockup, but do drop. [20:51] right, but only for those which already did lookup or where created ... [20:51] for it work correctly - need dquot->dq_count == 1 (after get_dquot_ref) [20:52] well any other case would throw the PARANOIA waring if enabled ... [20:57] well. i analize last rh kernel for 7.3 and 9.0 and found RH disable use o(1) scheduler for system who not have nptl threads in glibc.. [20:57] it can be impotant ... [20:58] hmm, is this to ensure that their nptl performs better ;) [20:58] but for nptl changed signal routing... [20:59] on what kernel is your current stuff based again? [21:05] loger1 joined #vserver. [21:05] loger (~loger@213.159.118.2) left irc: Read error: Connection reset by peer [21:05] Nick change: loger1 -> loger [21:05] .17 .27 = equval for me. patch not need changes.. [21:06] ahh okay ... [21:07] .3 need some changes because uses old o(1) scheduler and one function on it renamed. [21:18] Herber you need my test result with 2.4.18-3 (but it in all tested rh kernels) for talk with diskquota maintainer ? [21:18] well I send a mail, let's see what honza answers ... [21:19] s/send/sent/ [21:19] okey. if need - say to me. [21:20] I'm not even sure it is an accounting error ... as it neither shows in vanilla nor produces a warning (PARANOIA enabled) on my quota hash version ... [21:22] eh.. [21:23] i can do full log diskquota works - where show extra drops do in sync_dquots. [21:24] s/worls/job/ ? :-\ [21:25] s/works/job/ ? :-\ [21:27] the question is, is a dqput() on an otherwise unused dquot which received get_dquot_ref() a bug? [21:28] or is put_dquot_ref() just a weaker alternative to dqput() ? [21:29] (of course oversimplifying ;) [21:31] what really confuses me is the fact that vanilla and mq0.11 differ ... :-/ [21:31] for diskquotas how have more one referense = (but we have add one after get_quota_ref) dqput wait_dup + put_dqout_ref [21:32] Bertl - current i check vanila 2.4.20 - an see - in vanila inmplement different algoritm in dqput.. [21:33] but.... [21:35] Sorry but the code seems correct to me - we get reference to dquot by [21:35] get_dquot_ref() and than we put the reference by dqput(). dqput() is [21:35] correct because something nasty might happen in the mean time and so we [21:35] might be the last holders of the dquot. What do you think is wrong? [21:35] Honza [21:37] yes. refereces is correct but accounig wrong :) [21:38] what mail - Honza ? i send to him mail with logs :) [21:38] okay, what was your check calculation? drops = lookup+? [21:38] not my :) [21:39] quotatools [21:40] [root@linux uml]# quotastats; sync; quotastats; quotaoff -aug; qoutastats [21:40] Number of dquot lookups: 298331 [21:40] Number of dquot drops: 298313 [21:40] Number of still active inodes with quota : 18 [21:40] Number of dquot reads: 2 [21:40] Number of dquot writes: 2 [21:40] Number of quotafile syncs: 18 [21:40] Number of dquot cache hits: 25761 [21:40] Number of allocated dquots: 2 [21:40] Number of free dquots: 0 [21:40] Number of in use dquot entries (user/group): 2 [21:40] Number of dquot lookups: 298331 [21:40] Number of dquot drops: 298315 [21:40] Number of still active inodes with quota : 16 [21:40] Number of dquot reads: 2 [21:40] Number of dquot writes: 4 [21:40] Number of quotafile syncs: 19 [21:40] Number of dquot cache hits: 25761 [21:40] Number of allocated dquots: 2 [21:40] Number of free dquots: 0 [21:40] Number of in use dquot entries (user/group): 2 [21:40] bash: qoutastats: command not found [21:40] [root@linux uml]# quotastats [21:40] Number of dquot lookups: 298331 [21:40] Number of dquot drops: 298335 [21:40] Number of still active inodes with quota : -4 [21:40] Number of dquot reads: 2 [21:40] Number of dquot writes: 4 [21:40] Number of quotafile syncs: 19 [21:40] Number of dquot cache hits: 25761 [21:40] Number of allocated dquots: 0 [21:40] Number of free dquots: 0 [21:40] Number of in use dquot entries (user/group): 0 [21:40] [root@linux uml]# [21:40] [root@linux uml]# uname -a [21:40] Linux linux.shadowland 2.4.18-27.7.xsmp #1 SMP óÂÔ éÀÎ 7 07:05:32 EEST 2003 i686 unknown [21:41] [root@linux uml]# rpm -qa | grep quota [21:41] quota-3.03-1 [21:41] you can send it as log. [21:41] just send it yourself, I replied with a verbal explanation ... [21:41] #define __DQUOT_VERSION__ "dquot_6.5.0" [21:42] mail ? [21:42] he will answer in a few minutes ... [21:42] you should have received a copy of all mails ... [21:43] i not check mailbox :) [21:43] do check. [21:47] send log. [21:56] crazyimp (~crazyimp@p508B7450.dip.t-dialin.net) left irc: Ping timeout: 485 seconds [21:58] netrose (~john877@CC3-24.171.21.47.charter-stl.com) joined #vserver. [21:59] mhepp (~mhepp@r72s22p13.home.nbox.cz) left irc: Remote host closed the connection [22:05] mhepp (~mhepp@r72s22p13.home.nbox.cz) joined #vserver. [22:07] crazyimp (~crazyimp@p508B77AB.dip.t-dialin.net) joined #vserver. [22:14] Bertl: the machine is still up and running after 12 hours [22:14] great! [22:15] thanks for the testing ... [22:15] happy to be helpful. do you have any other tests you'd like preformed? [22:16] well, the quota stuff could use some SMP testing, but I guess this is too boring for you ... :( [22:17] heh, this is my first time with vserver, I had to fix a bunch of other problems before it'd run properly [22:18] just tell me what I need and I'll try it out [22:19] know what, I'll adapt the rmap15k to the latest 2.4 release, and add it to the O(1) scheduler + ctx of course ... how would that be for testing? [22:20] sounds fine to me [22:45] Bertl> you can answer to few questions about you diskhashes ? i not want do detail analize for it... [22:46] yup, go ahead, ask ... [22:49] you use standart arhitecture for store infomation ? on _disk_ have [usr/grp] quotas or _vps_ have [usr/grp] quotas ? [22:49] if you mean the quota files, they are per vps ... [22:51] not. i about count quota in vps... [22:52] sorry, obviously don't understand the question ... [22:56] ok. another. [22:57] if vps have mount inside - me have to diskhashes ? [22:57] one per mounts [22:58] s/to/two/ [22:58] hmm, maybe I should explain what the patches do first (mq,cx,cq) okay? [22:59] i don`t now.. i ask about concepts... [22:59] serving (~serving@213.186.191.180) left irc: Ping timeout: 480 seconds [23:00] the quota hash abstraction separates quota to so called hashes, in the mq case one hash per superblock ... [23:01] the cx stuff is the context tagging, we agreed on, and nothing more ... this itself is the basis for the disk limit patches ... [23:01] okey... [23:01] the cq uses the now per hash available quotas, to make one hash per context, or to be more precise, to allow one hash per superblock and context ... [23:02] those quota hashes are not allocated automatically, they have to be added before quota is activated and removed after deactivation ... [23:04] hm.. you don`t think about use one hash per context and store on it information from all superblocks where quota started ? [23:04] so each context has then one hash per superblock maximum, which is completely independant from everything else ... [23:05] that's the way it works, if you want to store more than one superblock in a hash, feel free to do so, but you have to modify the code ... [23:06] i think it need store pointer to hash not a superblock, but in context structure and it been easy :-\ [23:07] the reason why I separated by context _and_ superblock is that I do not want to have the quota/tagging stuff span over filesystems ... [23:08] context_0 can be have independent diskquotas... but for vps i see it way better. [23:10] ok... thinks for info... [23:11] no problem ... if you need anything, let me know ... [23:27] @MrBawb warm up your compiler, and get the latest 2.4.22-pre8 ... [23:28] :) [23:52] netrose (~john877@CC3-24.171.21.47.charter-stl.com) left irc: Ping timeout: 485 seconds [23:53] you're not waiting on me, are you? [23:54] nope, just fixed the last hunk ... [23:54] ok [23:55] how much do you want to test? ;) [23:56] heh [23:56] I'm not doing anything interesting right now [23:56] so I can test as much as you like :) [23:56] okay, because I you would like to test something now, you can test the rmap15k for pre8 ... okay? [23:56] s/I/if [23:57] sounds good to me [23:57] http://vserver.13thfloor.at/Experimental/patch-2.4.23-pre8-rmap15k.diff.bz2 [23:58] okay just compile it like this ... [23:58] make bzImage modules >../Build.log 2>../Build.err [23:59] ok [23:59] or you can leave out the 2>../Build.err and let me know about any results ... [23:59] so you just want the compile of rmap15k without the vserver patches? [00:00] --- Sun Oct 26 2003