Rodney Ewing [Wed, 14 Aug 2013 21:54:10 +0000 (14:54 -0700)]
catch processing exceptions and if entry_orig_state is processed, then ignore the exception
Rodney Ewing [Wed, 14 Aug 2013 20:47:39 +0000 (13:47 -0700)]
raise an error if the file failed to copy to public storage
catch copy_local_to_storage errors and raise PublicStoreFail, saving the keyname
Rodney Ewing [Wed, 14 Aug 2013 20:06:08 +0000 (13:06 -0700)]
force thumbnail creation of audio
Rodney Ewing [Wed, 14 Aug 2013 19:41:03 +0000 (12:41 -0700)]
size should be a tuple
Rodney Ewing [Wed, 14 Aug 2013 19:25:49 +0000 (12:25 -0700)]
rewind the file to the begining
Rodney Ewing [Wed, 14 Aug 2013 19:13:06 +0000 (12:13 -0700)]
-scale-to only takes 1 size, so choose the smallest
Rodney Ewing [Wed, 14 Aug 2013 18:34:31 +0000 (11:34 -0700)]
include '.png' in filename
Rodney Ewing [Wed, 14 Aug 2013 18:00:05 +0000 (11:00 -0700)]
oops, localized_file not local_file
Rodney Ewing [Wed, 14 Aug 2013 17:58:31 +0000 (10:58 -0700)]
use a tmp_pdf filename
Rodney Ewing [Wed, 14 Aug 2013 17:52:37 +0000 (10:52 -0700)]
don't include the '.' in the ext
Rodney Ewing [Wed, 14 Aug 2013 17:47:04 +0000 (10:47 -0700)]
forgot to change __init__ for new processing managers
Rodney Ewing [Wed, 14 Aug 2013 17:41:16 +0000 (10:41 -0700)]
Cleanup image common processor
Rodney Ewing [Wed, 14 Aug 2013 17:40:14 +0000 (10:40 -0700)]
added resizer for stl media
Rodney Ewing [Wed, 14 Aug 2013 17:38:13 +0000 (10:38 -0700)]
Added initial stl processor
Rodney Ewing [Wed, 14 Aug 2013 16:46:44 +0000 (09:46 -0700)]
add reprocess_manager to __init__
Rodney Ewing [Wed, 14 Aug 2013 16:40:47 +0000 (09:40 -0700)]
Use workbench for temp files, refactor _set_pdf_filename, and correct imports
Rodney Ewing [Wed, 14 Aug 2013 16:13:25 +0000 (09:13 -0700)]
added pdf Resizer
Rodney Ewing [Wed, 14 Aug 2013 16:09:35 +0000 (09:09 -0700)]
Added pdf Initial processor
Rodney Ewing [Wed, 14 Aug 2013 00:42:42 +0000 (17:42 -0700)]
added file argument to video resizer and added ascii resizer
Rodney Ewing [Wed, 14 Aug 2013 00:32:59 +0000 (17:32 -0700)]
Added initial processor for ascii media
Rodney Ewing [Tue, 13 Aug 2013 20:40:16 +0000 (13:40 -0700)]
added video transcoder
Rodney Ewing [Tue, 13 Aug 2013 20:31:48 +0000 (13:31 -0700)]
Added thumbnail resizer for video
Rodney Ewing [Tue, 13 Aug 2013 20:27:51 +0000 (13:27 -0700)]
use type=float for audio vorbis quality
Rodney Ewing [Tue, 13 Aug 2013 20:19:52 +0000 (13:19 -0700)]
Added Initial processor for video
Rodney Ewing [Tue, 13 Aug 2013 18:42:42 +0000 (11:42 -0700)]
added audio reprocessing transcoder
Rodney Ewing [Tue, 13 Aug 2013 18:34:05 +0000 (11:34 -0700)]
just use the default quality when creating a thumbnail or spectrogram
Rodney Ewing [Tue, 13 Aug 2013 18:30:18 +0000 (11:30 -0700)]
add audio thumbnail and spectrogram resizer
Rodney Ewing [Tue, 13 Aug 2013 18:29:44 +0000 (11:29 -0700)]
fetch spectrogram for thumbnail creation, create spectrogram if not found
Rodney Ewing [Tue, 13 Aug 2013 18:02:36 +0000 (11:02 -0700)]
forgot nargs=2
Rodney Ewing [Tue, 13 Aug 2013 17:51:21 +0000 (10:51 -0700)]
audio processing code cleanup
Rodney Ewing [Tue, 13 Aug 2013 17:36:30 +0000 (10:36 -0700)]
should store file as webm_audio instead of medium
Rodney Ewing [Tue, 13 Aug 2013 17:32:40 +0000 (10:32 -0700)]
media:thumb not medium:thumb :)
Rodney Ewing [Tue, 13 Aug 2013 17:28:12 +0000 (10:28 -0700)]
use name_builder with store_public, not create_pub_filepath
Rodney Ewing [Tue, 13 Aug 2013 17:13:26 +0000 (10:13 -0700)]
common_setup() must be the first processing step
Rodney Ewing [Tue, 13 Aug 2013 16:57:35 +0000 (09:57 -0700)]
Audio Initial Processor
Rodney Ewing [Mon, 12 Aug 2013 22:48:40 +0000 (15:48 -0700)]
remove old code
Rodney Ewing [Mon, 12 Aug 2013 22:45:09 +0000 (15:45 -0700)]
bulk_run reprocessing complete
Rodney Ewing [Mon, 12 Aug 2013 22:25:52 +0000 (15:25 -0700)]
Resize all processed thumbs
Rodney Ewing [Mon, 12 Aug 2013 21:57:45 +0000 (14:57 -0700)]
wrap get_entry_and_processing_manager in try, except block
Rodney Ewing [Mon, 12 Aug 2013 21:54:02 +0000 (14:54 -0700)]
run initial processing on all failed entries
Rodney Ewing [Mon, 12 Aug 2013 21:28:03 +0000 (14:28 -0700)]
add bulk_run, thumbs, and initial sub_commands
Rodney Ewing [Mon, 12 Aug 2013 18:57:47 +0000 (11:57 -0700)]
remove ProcessingState
Rodney Ewing [Mon, 12 Aug 2013 18:55:00 +0000 (11:55 -0700)]
delete existing file in store_public
Rodney Ewing [Mon, 12 Aug 2013 18:37:59 +0000 (11:37 -0700)]
Add image resizer and some cleanup of old code
Christopher Allan Webber [Mon, 12 Aug 2013 16:57:52 +0000 (11:57 -0500)]
Fix (by Rodney Ewing) for processing, specifically the way resize_tool was being called
Thanks for fixing, Rodney :)
Christopher Allan Webber [Mon, 12 Aug 2013 16:40:55 +0000 (11:40 -0500)]
Don't forget to run copy_original()! That's critical!
This commit sponsored by Tony Schmidt. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 16:27:43 +0000 (11:27 -0500)]
Fixing ./bin/gmg reprocess available, which I broke :)
Christopher Allan Webber [Mon, 12 Aug 2013 16:19:20 +0000 (11:19 -0500)]
Trying to fix the bug that's happening to rodney757 but not to me ;)
Christopher Allan Webber [Mon, 12 Aug 2013 16:13:00 +0000 (11:13 -0500)]
Revert "use parser.parse_known_args() instead of parser.parse_args()"
This reverts commit
029e779c468ba1a6bfd893679cfaae7f418f45dd.
(and a bit more!)
This wasn't needed anymore because we did a "rest" capture and passed
that over to the reprocess run command.
Conflicts:
mediagoblin/gmg_commands/assetlink.py
mediagoblin/gmg_commands/dbupdate.py
mediagoblin/gmg_commands/import_export.py
mediagoblin/gmg_commands/users.py
Christopher Allan Webber [Mon, 12 Aug 2013 16:00:15 +0000 (11:00 -0500)]
Fixing normal submission of media (well for images anyway)
Christopher Allan Webber [Mon, 12 Aug 2013 15:53:15 +0000 (10:53 -0500)]
A couple of fixes to stupid things I did while coding this. And it WORKS!
This commit sponsored by José María Serralde Ruiz. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 15:48:07 +0000 (10:48 -0500)]
Fixing the MediaProcessor context manager so it actually, you know, works :)
This commit sponsored by Mikiya Okuno. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 15:40:07 +0000 (10:40 -0500)]
Theoretically the last steps to get reprocessing working for initial & images
Haven't tested it yet though :)
This commit sponsored by Samuel Bächler. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 13:57:56 +0000 (08:57 -0500)]
Factored the get_orig_filename from processing state and put it to use.
This commit sponsored by Vincent Demeester. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 13:22:14 +0000 (08:22 -0500)]
Record the original state of the media entry in the processor
This allows our processor to make some informed decisions based on the
state by still having access to the original state.
This commit sponsored by William Rico. Thank you!
Christopher Allan Webber [Sun, 11 Aug 2013 21:53:37 +0000 (16:53 -0500)]
Marking the initial steps for processing
Christopher Allan Webber [Sun, 11 Aug 2013 20:22:43 +0000 (15:22 -0500)]
Renaming the processing manager stuff to be less ambiguous.
BONUS COMMIT to Ben Finney and the Free Software Melbourne crew. :)
IRONY: Initially I committed this as "media manager".
Christopher Allan Webber [Sun, 11 Aug 2013 19:48:21 +0000 (14:48 -0500)]
That manager.process() line no longer made sense
Christopher Allan Webber [Sun, 11 Aug 2013 19:34:45 +0000 (14:34 -0500)]
Updating to the point where we can allllmost run with the new reprocessing code
This commit sponsored by Odin Hørthe Omdal. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 22:30:52 +0000 (17:30 -0500)]
Should be enough to get to the point where you can actually initialize a processing command now.
However, it doesn't celery task-ify it...
This commit sponsored by Catalin Cosovanu. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 21:12:06 +0000 (16:12 -0500)]
Steps toward working "run" reprocessing command.
This commit sponsored by Philippe Casteleyn. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 19:15:18 +0000 (14:15 -0500)]
Moving celery setup to the right place
This commit sponsored by Jose Manuel Zueco Lazaro. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 19:10:52 +0000 (14:10 -0500)]
Whitespacin' it up.
Christopher Allan Webber [Fri, 9 Aug 2013 18:56:23 +0000 (13:56 -0500)]
`gmg reprocess available --action-help` now tells you processor arguments!
Every reprocessing action possible can inform you of its command line
argument stuff! Is that awesome or what?
Christopher Allan Webber [Fri, 9 Aug 2013 17:13:53 +0000 (12:13 -0500)]
"initial" reprocessing subcommand now works!
We are on our way now to a working reprocessing system under this
redesign!
This commit sponsored by Bjarni Rúnar Einarsson. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 16:20:21 +0000 (11:20 -0500)]
More progress towards the new reprocessing infrastructure: args updating
This commit sponsored by Elizabeth Webber. Thanks, sis!
Christopher Allan Webber [Thu, 8 Aug 2013 18:53:28 +0000 (13:53 -0500)]
More steps towards a working reprocessing system.
Fleshing out the base classes and setting up some docstrings. Not
everything is totally clear yet, but I think it's on a good track, and
getting clearer.
This commit sponsored by Ben Finney, on behalf of Free Software Melbourne.
Thank you all!
Christopher Allan Webber [Wed, 7 Aug 2013 22:07:19 +0000 (17:07 -0500)]
Documentation for the MediaProcessor
Christopher Allan Webber [Wed, 7 Aug 2013 20:01:46 +0000 (15:01 -0500)]
started coding basics of new processing code
Rodney Ewing [Tue, 6 Aug 2013 17:48:26 +0000 (10:48 -0700)]
fix storage paramater in get_orig_filename(), fix __init__ for ProceessImage, better description for --size flag
Rodney Ewing [Tue, 6 Aug 2013 16:47:09 +0000 (09:47 -0700)]
Refactor processing/reprocessing functions into ProcessImage class
Rodney Ewing [Tue, 6 Aug 2013 16:17:37 +0000 (09:17 -0700)]
forgot to change to a class from a function after the refactor
Rodney Ewing [Fri, 2 Aug 2013 22:20:59 +0000 (15:20 -0700)]
change get_queued_filename to get_orig_filename and modified function
Rodney Ewing [Fri, 2 Aug 2013 22:12:07 +0000 (15:12 -0700)]
added comments and did a little refactoring. not sure if it is actually any clearer though
Rodney Ewing [Fri, 2 Aug 2013 20:18:35 +0000 (13:18 -0700)]
very rough working version of image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 19:06:50 +0000 (12:06 -0700)]
add option to not run eagerly
Rodney Ewing [Fri, 2 Aug 2013 18:40:41 +0000 (11:40 -0700)]
added image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 15:02:14 +0000 (08:02 -0700)]
added a check_eligible function to image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 14:44:03 +0000 (07:44 -0700)]
added a parser for the image media_type reprocessing
Rodney Ewing [Thu, 1 Aug 2013 22:58:57 +0000 (15:58 -0700)]
end of day commit
Rodney Ewing [Thu, 1 Aug 2013 22:58:25 +0000 (15:58 -0700)]
pep 8
Rodney Ewing [Thu, 1 Aug 2013 22:55:39 +0000 (15:55 -0700)]
add command option for regenerating all thumbnails
Rodney Ewing [Thu, 1 Aug 2013 22:40:26 +0000 (15:40 -0700)]
make media_id an optional argument
Rodney Ewing [Thu, 1 Aug 2013 22:24:34 +0000 (15:24 -0700)]
refactored _run_reprocessing
Rodney Ewing [Thu, 1 Aug 2013 21:47:24 +0000 (14:47 -0700)]
added a set_media_state function. removed the --all flag (just don't enter any media_ids to process all media). slight refactor
Rodney Ewing [Thu, 1 Aug 2013 20:53:20 +0000 (13:53 -0700)]
Pep 8
Rodney Ewing [Thu, 1 Aug 2013 20:51:36 +0000 (13:51 -0700)]
Just raise standard exception. Pass print statement to gettext
Rodney Ewing [Thu, 1 Aug 2013 20:47:44 +0000 (13:47 -0700)]
added a _run_reprocessing function which handles the hook calls
Rodney Ewing [Thu, 1 Aug 2013 20:23:40 +0000 (13:23 -0700)]
add reprocess_all function. still need to add code to reprocess all failed entries
Rodney Ewing [Thu, 1 Aug 2013 19:35:49 +0000 (12:35 -0700)]
Added a set_media_type function that has checks to only reprocess one media_type at a time
Rodney Ewing [Thu, 1 Aug 2013 19:32:49 +0000 (12:32 -0700)]
Beginnings of a reprocess command
Rodney Ewing [Thu, 1 Aug 2013 18:11:04 +0000 (11:11 -0700)]
Throw an error if there are unrecognized arguments
Rodney Ewing [Thu, 1 Aug 2013 17:23:37 +0000 (10:23 -0700)]
use parser.parse_known_args() instead of parser.parse_args()
Rodney Ewing [Fri, 16 Aug 2013 18:49:33 +0000 (11:49 -0700)]
load js at the end of the page
Rodney Ewing [Fri, 16 Aug 2013 18:48:03 +0000 (11:48 -0700)]
use urlgen
Rodney Ewing [Fri, 16 Aug 2013 17:24:41 +0000 (10:24 -0700)]
Merge branch 'auth_docs'
Conflicts:
docs/source/index.rst
Rodney Ewing [Fri, 16 Aug 2013 00:36:56 +0000 (17:36 -0700)]
fix persona tests by using a correct query
Christopher Allan Webber [Thu, 15 Aug 2013 23:29:35 +0000 (18:29 -0500)]
Removing PyPump as we aren't using it yet and there's a dependency conflict ;|
Christopher Allan Webber [Thu, 15 Aug 2013 22:07:14 +0000 (17:07 -0500)]
Merge branch 'persona_resquash'
Christopher Allan Webber [Thu, 15 Aug 2013 20:17:02 +0000 (15:17 -0500)]
Removing the whitespace betwetween action= and its value