~linaro-validation/lava-celery/trunk : changes

~linaro-validation/lava-celery/trunk » Changes from revision 32

From Revision 32 to 13

Rev	Summary	Authors	Tags	Date
32	post release bump post release bump	Michael Hudson-Doyle		11 years ago
31	release 0.4.1 release 0.4.1	Michael Hudson-Doyle	release-0.4.1	11 years ago
30	hack around problem preventing fast model jobs from starting hack around problem preventing fast model jobs from starting	Michael Hudson-Doyle		11 years ago
29	release 0.4 release 0.4 This should have all the celery changes we need to support fastmodel workers	Andy Doan	2012.07, release-0.4	11 years ago
28	improve exception handling issues improve exception handling issues While doing fastmodel testing I encountered some issues: 1) our task loop for dealing with the child process output wasn't handling all the exceptions that could happen. This leads to difficult debugging. 2) our command code for consuming the task messages wasn't handling exceptions well either making debugging difficult. 3) The data coming from the child process in the task code contained characters the celery serialization code was choking on. I addressed this by adding more exception handling logic into these loops so that things can continue even if we hit one hiccup during the execution of a task. I also added our own decode/encode logic which has an "errors='ignore'" parameter to skip over things we can't handle. The encode/decode logic is probably wrong. My quess is its wrong in two ways: 1) the decode in the task may need to pick something other than 'utf-8', but I don't know what. 2) the consumer side shouldn't need to deal with encoding, but the celery serializer (json based by default) seems to muck with things in a way that's forcing us to something.	Andy Doan		11 years ago
27	fix celery-schedulermonitor command entry fix celery-schedulermonitor command entry mwhudson caught this in the code review	Andy Doan		11 years ago
26	make _exec_command a little safer make _exec_command a little safer This adds some exception handling per mwhudson's review comments to help ensure we always properly exit the child process.	Andy Doan		11 years ago
25	retval is now handled in the _exec_command function retval is now handled in the _exec_command function	Andy Doan		11 years ago
24	add a celery-schedulermonitor command add a celery-schedulermonitor command This allows us to run the scheduler on a remote system where we can then execute a job for given device.	Andy Doan		11 years ago
23	fix error from previous commit fix error from previous commit	Andy Doan		11 years ago
22	change run-remote to fork/exec rather than run in process change run-remote to fork/exec rather than run in process Running remote commands in process has two down-sides: 1) celeryd already hijacks stdout/stderr and does some some weird things with them. Our code sometimes messes with stdout/stderr as well and causes conflicts 2) some of our commands have things like atexit clean-up functions Its just easier if we really fork this stuff off and avoid the complications we currently have.	Andy Doan		11 years ago
21	improvements to run_command task improvements to run_command task 1) it now allows files that are need in the remote to be specified in a dictionary of "file->contents" pairs 2) add some logging to know when the command is received and completes 3) add a catch-all exception handler	Andy Doan		11 years ago
20	post release bump post release bump	Andy Doan		11 years ago
19	release 0.3 release 0.3 2012.06	Andy Doan	2012.06, release-0.3	11 years ago
18	remove django-celery and add "lava celeryd" support remove django-celery and add "lava celeryd" support	Andy Doan		11 years ago
17	Open 0.3 for development Open 0.3 for development	Zygmunt Krynicki		12 years ago
16	Bump version to 0.2 Bump version to 0.2	Zygmunt Krynicki	2012.03, release-0.2	12 years ago
15	Merge lava-tool support for celery Merge lava-tool support for celery	Zygmunt Krynicki		12 years ago
14	Fix setup.py to include all packages, bump version to 0.1.1 Fix setup.py to include all packages, bump version to 0.1.1	Zygmunt Krynicki	release-0.1.1	12 years ago
13	Bump version to 0.1 Bump version to 0.1	Zygmunt Krynicki	release-0.1	12 years ago

Older »