| *** Theuni has joined #schooltool | 00:17 | |
| Theuni | howdi | 00:17 |
|---|---|---|
| Theuni | I don't suppose anybody to be alive right now, hmm? | 00:17 |
| * Theuni waves to Aiste | 00:18 | |
| Theuni | ok then. i'll just jump into my bed too ... | 00:23 |
| Theuni | i'll try again tomorrow | 00:23 |
| *** Theuni has quit IRC | 00:23 | |
| *** jinty has joined #schooltool | 00:37 | |
| *** Travis_ has joined #schooltool | 00:54 | |
| *** th1a has joined #schooltool | 01:20 | |
| *** jinty has quit IRC | 01:24 | |
| *** wrobel has quit IRC | 01:27 | |
| *** Travis_ has left #schooltool | 01:43 | |
| *** Travis_ has joined #schooltool | 04:02 | |
| *** Travis_ has left #schooltool | 04:04 | |
| *** jinty has joined #schooltool | 04:55 | |
| *** jinty has quit IRC | 07:59 | |
| *** wrobel has joined #schooltool | 09:35 | |
| *** mgedmin has joined #schooltool | 12:51 | |
| *** srichter has joined #schooltool | 12:53 | |
| *** alga has joined #SchoolTool | 13:20 | |
| *** strichter has joined #schooltool | 13:31 | |
| *** jinty has joined #schooltool | 13:36 | |
| *** ignas has joined #schooltool | 14:04 | |
| *** srichter has quit IRC | 14:04 | |
| *** jinty has quit IRC | 14:16 | |
| *** jinty has joined #schooltool | 14:21 | |
| *** jinty has quit IRC | 14:38 | |
| *** mgedmin has quit IRC | 14:51 | |
| *** strichter is now known as srichter | 15:02 | |
| *** mgedmin has joined #schooltool | 15:08 | |
| povbot | /svn/commits: * ignas committed revision 5695: | 15:09 |
| povbot | /svn/commits: Make SectionAttendance use the filtering provided by OOBTree. | 15:09 |
| * mgedmin cheers ignas | 15:13 | |
| *** mgedmin has quit IRC | 15:14 | |
| *** mgedmin has joined #schooltool | 16:02 | |
| ignas | full sample data ftest started swapping again :/ | 16:10 |
| mgedmin | ignas, shut down X and use links for development ;-) | 16:13 |
| ignas | mgedmin, won't help i am afraid, only_last_n_days = 5 is a lifesaver though ;) | 16:13 |
| *** srichter has quit IRC | 16:22 | |
| povbot | /svn/commits: * ignas committed revision 5696: | 17:43 |
| povbot | /svn/commits: Sample data for day attendance. | 17:43 |
| mgedmin | yay! | 17:44 |
| mgedmin | is there a way to pretty-print libxml2 nodes? | 17:44 |
| mgedmin | I've been thinking... | 18:03 |
| mgedmin | sample data plugins are utilities | 18:03 |
| mgedmin | utilities are created once and stored forever | 18:04 |
| mgedmin | so if a utility wants to keep state in attributes of `self`, it could end badly | 18:04 |
| povbot | /svn/commits: * mg committed revision 5697: | 18:08 |
| povbot | /svn/commits: List of absences per term. | 18:08 |
| povbot | /svn/commits: The checkin ought to have been split into smaller ones, if I had more time. | 18:08 |
| povbot | /svn/commits: One noteworthy bit is the way student-attendance.txt extracts a single <table> element from the HTML and pretty-prints it. This could be a useful addition to the schooltool.testing.analyze module. | 18:08 |
| mgedmin | jikes, test.py -f --level 2 eats 450 mb RSS now and is still growing | 18:32 |
| mgedmin | 520 megs now | 18:34 |
| mgedmin | 600 megs | 18:37 |
| mgedmin | 700 megs | 18:39 |
| mgedmin | gone | 18:39 |
| mgedmin | time ./test.py -pvC1 -s src/schooltool/ -f --level 2 | 18:39 |
| mgedmin | real 18m21.954s | 18:39 |
| mgedmin | user 14m39.909s | 18:39 |
| mgedmin | sys 0m12.675s | 18:39 |
| ignas | mgedmin, how is the object quantity different after the addition of day attendance ? | 18:41 |
| mgedmin | no idea | 18:42 |
| mgedmin | functional tests use an in-memory db | 18:42 |
| mgedmin | now I've changed the sample attendance code to store lists of person names instead of person object references | 18:42 |
| mgedmin | let's see if that changes memory usage at all | 18:42 |
| mgedmin | @ 2 minutes of cpu time: 250 megs | 18:44 |
| mgedmin | @ 4 minutes of cpu time: 285 megs | 18:47 |
| mgedmin | @ 6 minutes of cpu time: 360 megs | 18:49 |
| mgedmin | @ 8 minutes of cpu time: 455 megs | 18:52 |
| mgedmin | @10 minutes of cpu time: 540 megs | 18:55 |
| mgedmin | @12 minutes of cpu time: 660 megs | 18:57 |
| mgedmin | and done | 18:57 |
| mgedmin | mg@pitonas:~/src/schooltool $ time ./test.py -pvC1 -s src/schooltool/ -f --level 2 . sampledata/ftests/sampledata.txt | 18:57 |
| mgedmin | real 15m15.855s | 18:57 |
| mgedmin | user 11m34.066s | 18:57 |
| mgedmin | sys 0m11.973s | 18:57 |
| mgedmin | the question is: was the memory size decrease because of my change, or because I excluded all other functional tests? | 18:58 |
| mgedmin | ignas, want a diff? | 19:00 |
| mgedmin | here: http://schooltool.pastebin.com/525871 | 19:00 |
| mgedmin | it breaks unit tests that substitute strings for person objects | 19:00 |
| th1a | Talking to yourself, mgedmin? | 19:03 |
| mgedmin | let's try a live run! | 19:06 |
| ignas | th1a, nop | 19:06 |
| ignas | th1a, talking to me | 19:06 |
| * ignas was making food | 19:06 | |
| th1a | Yes, I saw. | 19:07 |
| th1a | ignas: I see it is warming up in Vilnius. | 19:07 |
| ignas | yep | 19:07 |
| * mgedmin wonders if it would be possible to leverage modern 3D accelerated graphics cards to speed up sample data generation | 19:07 | |
| ignas | we would need to adapt our data structures to ones used in 3D graphics | 19:08 |
| ignas | which would require too many changes | 19:08 |
| ignas | and we should spend the effort in just plainly optimizing the data structures in zope3 instead ;( | 19:09 |
| ignas | ;) i mean | 19:09 |
| mgedmin | btw those numbers were VIRT; RSS was about 20 megs lower | 19:10 |
| mgedmin | live instance has a much larger difference between RSS and VIRT | 19:10 |
| mgedmin | about 90 megs | 19:10 |
| mgedmin | hmm, buildbot is impatient again :) | 19:16 |
| mgedmin | RSS for live sample data is steady at 172 megs (VIRT at 258 megs) | 19:16 |
| mgedmin | those transaction.commit()s help when you're using a disk-based ZODB backend | 19:17 |
| povbot | /svn/commits: * mg committed revision 5698: | 19:20 |
| povbot | /svn/commits: Move the sampledata functional test to level 3, so that buildbot won't try to run it so often. | 19:20 |
| povbot | /svn/commits: This functional test currently requires 700 megs of free memory, and about 20 minutes on a 1.6 GHz Pentium M. If your machine does not have that much RAM, the ftest starts swapping and becomes unbelievably slow (buildbot kills it after waiting for 1 hour). | 19:20 |
| ignas | mgedmin, maybe setting the day limit to 5 would be a better idea ? | 19:26 |
| ignas | so we would at least test whether it actually works | 19:26 |
| mgedmin | it's done in 11 minutes (and at 186 megs RSS) | 19:27 |
| mgedmin | ignas, good idea | 19:27 |
| mgedmin | Data.fs is 400 megs | 19:27 |
| mgedmin | 300 megs are in current objects | 19:30 |
| ignas | mgedmin, what data should we log for attendance ? | 19:30 |
| mgedmin | ignas, you wanted object statistics? | 19:31 |
| mgedmin | http://schooltool.pastebin.com/525918 | 19:31 |
| mgedmin | re: loging -- why don't you ask th1a? | 19:31 |
| ignas | th1a: would "date, manager_id, student_id, action" be enough | 19:32 |
| ignas | or we need actual explanations | 19:32 |
| th1a | Oh... good point... | 19:32 |
| th1a | Don't include the explanations at this point. | 19:32 |
| * mgedmin discovers that is is not possible to pack the schooltool Data.fs, because ++etc++process sidesteps schooltool's authentication | 19:33 | |
| ignas | mgedmin, as far as i can see the amount of space required by the activities/ processes increased considerably | 19:34 |
| mgedmin | yes | 19:34 |
| ignas | that's because i am leaving most of the daily abscences unexplained, and each daily abscence generates 4-5 unexplained section abscences ... | 19:36 |
| th1a | Generally the business process of schools will probably be to resolve all absences after a reasonable period of time, say two weeks. | 19:37 |
| th1a | So we'll probably be adding that to the workflow somehow. | 19:37 |
| th1a | But in the meantime I wouldn't assume they're mostly unresolved in the sample data. | 19:38 |
| th1a | If that's what's ballooning the size of things. | 19:38 |
| ignas | actually - sectio abscences generated by day abscences are allways unresolved .. | 19:38 |
| th1a | Well, that's not good. | 19:38 |
| th1a | They need to be linked somehow, I guess. | 19:38 |
| *** tiredbones has left #schooltool | 19:42 | |
| povbot | /svn/commits: * ignas committed revision 5699: | 20:08 |
| povbot | /svn/commits: Added an optimization to the generation of sample attendance data. Moved day_absences into a parameter (temporary fix). | 20:08 |
| *** mgedmin has quit IRC | 20:13 | |
| *** alga has quit IRC | 20:26 | |
| *** Aiste has quit IRC | 20:28 | |
| *** tiredbones has joined #schooltool | 20:47 | |
| *** ignas has quit IRC | 20:58 | |
| *** erchache has joined #schooltool | 21:23 | |
| erchache | th1a: are you here? | 21:24 |
| th1a | erchache: Yes. | 21:24 |
| erchache | Do you investigate how to translate non-archetypes objects with linguaplone? | 21:25 |
| erchache | th1a | 21:25 |
| th1a | Stephan and I spent a while trying to figure it out. | 21:26 |
| th1a | And had no luck. | 21:26 |
| erchache | arrghh | 21:26 |
| erchache | i need to work on that....dont worry | 21:26 |
| erchache | i was working on my backup system...i finished....now i have more time to spend on schooltool | 21:27 |
| th1a | erchache: I'm starting to work on something you needed. | 21:27 |
| th1a | A way to script the setup of your entire school. | 21:28 |
| erchache | for? | 21:28 |
| th1a | So you can easily redo the whole thing if some kind of change needs to be done. | 21:28 |
| th1a | Although this will only work when you're initially setting up the site, I guess. | 21:28 |
| erchache | ahhh ok...a temporal solution to recursive events | 21:29 |
| erchache | ok | 21:29 |
| erchache | great | 21:29 |
| th1a | Or that's what it is designed for. | 21:29 |
| th1a | Well, no | 21:29 |
| erchache | im fighting with one of my bosses to get a payed full-time programer student to work on schooltool | 21:29 |
| th1a | Isn't there some kind of issue with your timetables that can't really be changed at this point? | 21:29 |
| th1a | erchache: That would be fantastic. | 21:30 |
| erchache | well.....recursive event greater than a month | 21:30 |
| th1a | If there is anything I could do to help make that happen (write a letter or something). | 21:30 |
| erchache | because on this university we planned classes 6 month before | 21:30 |
| erchache | we work with semester... | 21:30 |
| erchache | and when we try to put into schooltool.....breaks on start point....enters in a infinite loop and doesnt have a unique start poiint | 21:31 |
| erchache | dont worry.....next week i get time to plan my work and my realistic problems... | 21:32 |
| th1a | erchache: I'm confused about whether or not that bug has been fixed in svn. | 21:32 |
| erchache | mgedmin was working on that....but now i dont remember....sorry....my brain is like hot butter now | 21:33 |
| erchache | :-S | 21:33 |
| erchache | well i left....see all next monday :-D | 21:34 |
| erchache | bye | 21:34 |
| *** erchache has quit IRC | 21:34 | |
| *** th1a|inux has quit IRC | 22:34 | |
Generated by irclog2html.py 2.15.1 by Marius Gedminas - find it at mg.pov.lt!