mediagoblin.git
12 years agofor some reason, the minimum thumbnail size for videos is 100 x 100
Rodney Ewing [Thu, 15 Aug 2013 16:29:11 +0000 (09:29 -0700)]
for some reason, the minimum thumbnail size for videos is 100 x 100

12 years agorefactor get_orig_filename to return an acceptable filename to the processor.
Rodney Ewing [Thu, 15 Aug 2013 15:54:09 +0000 (08:54 -0700)]
refactor get_orig_filename to return an acceptable filename to the processor.

If there is an original video file and we skip transcoding, delete the webm_640 file

12 years agomake medium dimensions a tuple
Rodney Ewing [Thu, 15 Aug 2013 15:11:29 +0000 (08:11 -0700)]
make medium dimensions a tuple

12 years agocheck medium_size arg in skip_transcoding, not config
Rodney Ewing [Thu, 15 Aug 2013 15:10:00 +0000 (08:10 -0700)]
check medium_size arg in skip_transcoding, not config

12 years agoonly try and delete queue file if it exists
Rodney Ewing [Wed, 14 Aug 2013 23:39:01 +0000 (16:39 -0700)]
only try and delete queue file if it exists

12 years agouse thumb_size
Rodney Ewing [Wed, 14 Aug 2013 23:30:52 +0000 (16:30 -0700)]
use thumb_size

12 years agoinclude a thumb_size string with each Resizer to run gmg reprocess thumbs
Rodney Ewing [Wed, 14 Aug 2013 23:25:44 +0000 (16:25 -0700)]
include a thumb_size string with each Resizer to run gmg reprocess thumbs

12 years agotypos
Rodney Ewing [Wed, 14 Aug 2013 23:07:27 +0000 (16:07 -0700)]
typos

12 years agoadd quality and filter args to image processors
Rodney Ewing [Wed, 14 Aug 2013 23:06:14 +0000 (16:06 -0700)]
add quality and filter args to image processors

12 years agoforgot to add the ascii resizer to the list of processors
Rodney Ewing [Wed, 14 Aug 2013 22:11:03 +0000 (15:11 -0700)]
forgot to add the ascii resizer to the list of processors

12 years agocatch processing exceptions and if entry_orig_state is processed, then ignore the...
Rodney Ewing [Wed, 14 Aug 2013 21:54:10 +0000 (14:54 -0700)]
catch processing exceptions and if entry_orig_state is processed, then ignore the exception

12 years agoraise an error if the file failed to copy to public storage
Rodney Ewing [Wed, 14 Aug 2013 20:47:39 +0000 (13:47 -0700)]
raise an error if the file failed to copy to public storage

catch copy_local_to_storage errors and raise PublicStoreFail, saving the keyname

12 years agoforce thumbnail creation of audio
Rodney Ewing [Wed, 14 Aug 2013 20:06:08 +0000 (13:06 -0700)]
force thumbnail creation of audio

12 years agosize should be a tuple
Rodney Ewing [Wed, 14 Aug 2013 19:41:03 +0000 (12:41 -0700)]
size should be a tuple

12 years agorewind the file to the begining
Rodney Ewing [Wed, 14 Aug 2013 19:25:49 +0000 (12:25 -0700)]
rewind the file to the begining

12 years ago-scale-to only takes 1 size, so choose the smallest
Rodney Ewing [Wed, 14 Aug 2013 19:13:06 +0000 (12:13 -0700)]
-scale-to only takes 1 size, so choose the smallest

12 years agoinclude '.png' in filename
Rodney Ewing [Wed, 14 Aug 2013 18:34:31 +0000 (11:34 -0700)]
include '.png' in filename

12 years agooops, localized_file not local_file
Rodney Ewing [Wed, 14 Aug 2013 18:00:05 +0000 (11:00 -0700)]
oops, localized_file not local_file

12 years agouse a tmp_pdf filename
Rodney Ewing [Wed, 14 Aug 2013 17:58:31 +0000 (10:58 -0700)]
use a tmp_pdf filename

12 years agodon't include the '.' in the ext
Rodney Ewing [Wed, 14 Aug 2013 17:52:37 +0000 (10:52 -0700)]
don't include the '.' in the ext

12 years agoforgot to change __init__ for new processing managers
Rodney Ewing [Wed, 14 Aug 2013 17:47:04 +0000 (10:47 -0700)]
forgot to change __init__ for new processing managers

12 years agoCleanup image common processor
Rodney Ewing [Wed, 14 Aug 2013 17:41:16 +0000 (10:41 -0700)]
Cleanup image common processor

12 years agoadded resizer for stl media
Rodney Ewing [Wed, 14 Aug 2013 17:40:14 +0000 (10:40 -0700)]
added resizer for stl media

12 years agoAdded initial stl processor
Rodney Ewing [Wed, 14 Aug 2013 17:38:13 +0000 (10:38 -0700)]
Added initial stl processor

12 years agoadd reprocess_manager to __init__
Rodney Ewing [Wed, 14 Aug 2013 16:46:44 +0000 (09:46 -0700)]
add reprocess_manager to __init__

12 years agoUse workbench for temp files, refactor _set_pdf_filename, and correct imports
Rodney Ewing [Wed, 14 Aug 2013 16:40:47 +0000 (09:40 -0700)]
Use workbench for temp files, refactor _set_pdf_filename, and correct imports

12 years agoadded pdf Resizer
Rodney Ewing [Wed, 14 Aug 2013 16:13:25 +0000 (09:13 -0700)]
added pdf Resizer

12 years agoAdded pdf Initial processor
Rodney Ewing [Wed, 14 Aug 2013 16:09:35 +0000 (09:09 -0700)]
Added pdf Initial processor

12 years agoadded file argument to video resizer and added ascii resizer
Rodney Ewing [Wed, 14 Aug 2013 00:42:42 +0000 (17:42 -0700)]
added file argument to video resizer and added ascii resizer

12 years agoAdded initial processor for ascii media
Rodney Ewing [Wed, 14 Aug 2013 00:32:59 +0000 (17:32 -0700)]
Added initial processor for ascii media

12 years agoadded video transcoder
Rodney Ewing [Tue, 13 Aug 2013 20:40:16 +0000 (13:40 -0700)]
added video transcoder

12 years agoAdded thumbnail resizer for video
Rodney Ewing [Tue, 13 Aug 2013 20:31:48 +0000 (13:31 -0700)]
Added thumbnail resizer for video

12 years agouse type=float for audio vorbis quality
Rodney Ewing [Tue, 13 Aug 2013 20:27:51 +0000 (13:27 -0700)]
use type=float for audio vorbis quality

12 years agoAdded Initial processor for video
Rodney Ewing [Tue, 13 Aug 2013 20:19:52 +0000 (13:19 -0700)]
Added Initial processor for video

12 years agoadded audio reprocessing transcoder
Rodney Ewing [Tue, 13 Aug 2013 18:42:42 +0000 (11:42 -0700)]
added audio reprocessing transcoder

12 years agojust use the default quality when creating a thumbnail or spectrogram
Rodney Ewing [Tue, 13 Aug 2013 18:34:05 +0000 (11:34 -0700)]
just use the default quality when creating a thumbnail or spectrogram

12 years agoadd audio thumbnail and spectrogram resizer
Rodney Ewing [Tue, 13 Aug 2013 18:30:18 +0000 (11:30 -0700)]
add audio thumbnail and spectrogram resizer

12 years agofetch spectrogram for thumbnail creation, create spectrogram if not found
Rodney Ewing [Tue, 13 Aug 2013 18:29:44 +0000 (11:29 -0700)]
fetch spectrogram for thumbnail creation, create spectrogram if not found

12 years agoforgot nargs=2
Rodney Ewing [Tue, 13 Aug 2013 18:02:36 +0000 (11:02 -0700)]
forgot nargs=2

12 years agoaudio processing code cleanup
Rodney Ewing [Tue, 13 Aug 2013 17:51:21 +0000 (10:51 -0700)]
audio processing code cleanup

12 years agoshould store file as webm_audio instead of medium
Rodney Ewing [Tue, 13 Aug 2013 17:36:30 +0000 (10:36 -0700)]
should store file as webm_audio instead of medium

12 years agomedia:thumb not medium:thumb :)
Rodney Ewing [Tue, 13 Aug 2013 17:32:40 +0000 (10:32 -0700)]
media:thumb not medium:thumb :)

12 years agouse name_builder with store_public, not create_pub_filepath
Rodney Ewing [Tue, 13 Aug 2013 17:28:12 +0000 (10:28 -0700)]
use name_builder with store_public, not create_pub_filepath

12 years agocommon_setup() must be the first processing step
Rodney Ewing [Tue, 13 Aug 2013 17:13:26 +0000 (10:13 -0700)]
common_setup() must be the first processing step

12 years agoAudio Initial Processor
Rodney Ewing [Tue, 13 Aug 2013 16:57:35 +0000 (09:57 -0700)]
Audio Initial Processor

12 years agoremove old code
Rodney Ewing [Mon, 12 Aug 2013 22:48:40 +0000 (15:48 -0700)]
remove old code

12 years agobulk_run reprocessing complete
Rodney Ewing [Mon, 12 Aug 2013 22:45:09 +0000 (15:45 -0700)]
bulk_run reprocessing complete

12 years agoResize all processed thumbs
Rodney Ewing [Mon, 12 Aug 2013 22:25:52 +0000 (15:25 -0700)]
Resize all processed thumbs

12 years agowrap get_entry_and_processing_manager in try, except block
Rodney Ewing [Mon, 12 Aug 2013 21:57:45 +0000 (14:57 -0700)]
wrap get_entry_and_processing_manager in try, except block

12 years agorun initial processing on all failed entries
Rodney Ewing [Mon, 12 Aug 2013 21:54:02 +0000 (14:54 -0700)]
run initial processing on all failed entries

12 years agoadd bulk_run, thumbs, and initial sub_commands
Rodney Ewing [Mon, 12 Aug 2013 21:28:03 +0000 (14:28 -0700)]
add bulk_run, thumbs, and initial sub_commands

12 years agoremove ProcessingState
Rodney Ewing [Mon, 12 Aug 2013 18:57:47 +0000 (11:57 -0700)]
remove ProcessingState

12 years agodelete existing file in store_public
Rodney Ewing [Mon, 12 Aug 2013 18:55:00 +0000 (11:55 -0700)]
delete existing file in store_public

12 years agoAdd image resizer and some cleanup of old code
Rodney Ewing [Mon, 12 Aug 2013 18:37:59 +0000 (11:37 -0700)]
Add image resizer and some cleanup of old code

12 years agoFix (by Rodney Ewing) for processing, specifically the way resize_tool was being...
Christopher Allan Webber [Mon, 12 Aug 2013 16:57:52 +0000 (11:57 -0500)]
Fix (by Rodney Ewing) for processing, specifically the way resize_tool was being called

Thanks for fixing, Rodney :)

12 years agoDon't forget to run copy_original()! That's critical!
Christopher Allan Webber [Mon, 12 Aug 2013 16:40:55 +0000 (11:40 -0500)]
Don't forget to run copy_original()!  That's critical!

This commit sponsored by Tony Schmidt.  Thank you!

12 years agoFixing ./bin/gmg reprocess available, which I broke :)
Christopher Allan Webber [Mon, 12 Aug 2013 16:27:43 +0000 (11:27 -0500)]
Fixing ./bin/gmg reprocess available, which I broke :)

12 years agoTrying to fix the bug that's happening to rodney757 but not to me ;)
Christopher Allan Webber [Mon, 12 Aug 2013 16:19:20 +0000 (11:19 -0500)]
Trying to fix the bug that's happening to rodney757 but not to me ;)

12 years agoRevert "use parser.parse_known_args() instead of parser.parse_args()"
Christopher Allan Webber [Mon, 12 Aug 2013 16:13:00 +0000 (11:13 -0500)]
Revert "use parser.parse_known_args() instead of parser.parse_args()"

This reverts commit 029e779c468ba1a6bfd893679cfaae7f418f45dd.
(and a bit more!)

This wasn't needed anymore because we did a "rest" capture and passed
that over to the reprocess run command.

Conflicts:
mediagoblin/gmg_commands/assetlink.py
mediagoblin/gmg_commands/dbupdate.py
mediagoblin/gmg_commands/import_export.py
mediagoblin/gmg_commands/users.py

12 years agoFixing normal submission of media (well for images anyway)
Christopher Allan Webber [Mon, 12 Aug 2013 16:00:15 +0000 (11:00 -0500)]
Fixing normal submission of media (well for images anyway)

12 years agoA couple of fixes to stupid things I did while coding this. And it WORKS!
Christopher Allan Webber [Mon, 12 Aug 2013 15:53:15 +0000 (10:53 -0500)]
A couple of fixes to stupid things I did while coding this.  And it WORKS!

This commit sponsored by José María Serralde Ruiz.  Thank you!

12 years agoFixing the MediaProcessor context manager so it actually, you know, works :)
Christopher Allan Webber [Mon, 12 Aug 2013 15:48:07 +0000 (10:48 -0500)]
Fixing the MediaProcessor context manager so it actually, you know, works :)

This commit sponsored by Mikiya Okuno.  Thank you!

12 years agoTheoretically the last steps to get reprocessing working for initial & images
Christopher Allan Webber [Mon, 12 Aug 2013 15:40:07 +0000 (10:40 -0500)]
Theoretically the last steps to get reprocessing working for initial & images

Haven't tested it yet though :)

This commit sponsored by Samuel Bächler.  Thank you!

12 years agoFactored the get_orig_filename from processing state and put it to use.
Christopher Allan Webber [Mon, 12 Aug 2013 13:57:56 +0000 (08:57 -0500)]
Factored the get_orig_filename from processing state and put it to use.

This commit sponsored by Vincent Demeester.  Thank you!

12 years agoRecord the original state of the media entry in the processor
Christopher Allan Webber [Mon, 12 Aug 2013 13:22:14 +0000 (08:22 -0500)]
Record the original state of the media entry in the processor

This allows our processor to make some informed decisions based on the
state by still having access to the original state.

This commit sponsored by William Rico.  Thank you!

12 years agoMarking the initial steps for processing
Christopher Allan Webber [Sun, 11 Aug 2013 21:53:37 +0000 (16:53 -0500)]
Marking the initial steps for processing

12 years agoRenaming the processing manager stuff to be less ambiguous.
Christopher Allan Webber [Sun, 11 Aug 2013 20:22:43 +0000 (15:22 -0500)]
Renaming the processing manager stuff to be less ambiguous.

BONUS COMMIT to Ben Finney and the Free Software Melbourne crew. :)

IRONY: Initially I committed this as "media manager".

12 years agoThat manager.process() line no longer made sense
Christopher Allan Webber [Sun, 11 Aug 2013 19:48:21 +0000 (14:48 -0500)]
That manager.process() line no longer made sense

12 years agoUpdating to the point where we can allllmost run with the new reprocessing code
Christopher Allan Webber [Sun, 11 Aug 2013 19:34:45 +0000 (14:34 -0500)]
Updating to the point where we can allllmost run with the new reprocessing code

This commit sponsored by Odin Hørthe Omdal.  Thank you!

12 years agoShould be enough to get to the point where you can actually initialize a processing...
Christopher Allan Webber [Fri, 9 Aug 2013 22:30:52 +0000 (17:30 -0500)]
Should be enough to get to the point where you can actually initialize a processing command now.

However, it doesn't celery task-ify it...

This commit sponsored by Catalin Cosovanu.  Thank you!

12 years agoSteps toward working "run" reprocessing command.
Christopher Allan Webber [Fri, 9 Aug 2013 21:12:06 +0000 (16:12 -0500)]
Steps toward working "run" reprocessing command.

This commit sponsored by Philippe Casteleyn.  Thank you!

12 years agoMoving celery setup to the right place
Christopher Allan Webber [Fri, 9 Aug 2013 19:15:18 +0000 (14:15 -0500)]
Moving celery setup to the right place

This commit sponsored by Jose Manuel Zueco Lazaro.  Thank you!

12 years agoWhitespacin' it up.
Christopher Allan Webber [Fri, 9 Aug 2013 19:10:52 +0000 (14:10 -0500)]
Whitespacin' it up.

12 years ago`gmg reprocess available --action-help` now tells you processor arguments!
Christopher Allan Webber [Fri, 9 Aug 2013 18:56:23 +0000 (13:56 -0500)]
`gmg reprocess available --action-help` now tells you processor arguments!

Every reprocessing action possible can inform you of its command line
argument stuff!  Is that awesome or what?

12 years ago"initial" reprocessing subcommand now works!
Christopher Allan Webber [Fri, 9 Aug 2013 17:13:53 +0000 (12:13 -0500)]
"initial" reprocessing subcommand now works!

We are on our way now to a working reprocessing system under this
redesign!

This commit sponsored by Bjarni Rúnar Einarsson.  Thank you!

12 years agoMore progress towards the new reprocessing infrastructure: args updating
Christopher Allan Webber [Fri, 9 Aug 2013 16:20:21 +0000 (11:20 -0500)]
More progress towards the new reprocessing infrastructure: args updating

This commit sponsored by Elizabeth Webber.  Thanks, sis!

12 years agoMore steps towards a working reprocessing system.
Christopher Allan Webber [Thu, 8 Aug 2013 18:53:28 +0000 (13:53 -0500)]
More steps towards a working reprocessing system.

Fleshing out the base classes and setting up some docstrings.  Not
everything is totally clear yet, but I think it's on a good track, and
getting clearer.

This commit sponsored by Ben Finney, on behalf of Free Software Melbourne.
Thank you all!

12 years agoDocumentation for the MediaProcessor
Christopher Allan Webber [Wed, 7 Aug 2013 22:07:19 +0000 (17:07 -0500)]
Documentation for the MediaProcessor

12 years agostarted coding basics of new processing code
Christopher Allan Webber [Wed, 7 Aug 2013 20:01:46 +0000 (15:01 -0500)]
started coding basics of new processing code

12 years agofix storage paramater in get_orig_filename(), fix __init__ for ProceessImage, better...
Rodney Ewing [Tue, 6 Aug 2013 17:48:26 +0000 (10:48 -0700)]
fix storage paramater in get_orig_filename(), fix __init__ for ProceessImage, better description for --size flag

12 years agoRefactor processing/reprocessing functions into ProcessImage class
Rodney Ewing [Tue, 6 Aug 2013 16:47:09 +0000 (09:47 -0700)]
Refactor processing/reprocessing functions into ProcessImage class

12 years agoforgot to change to a class from a function after the refactor
Rodney Ewing [Tue, 6 Aug 2013 16:17:37 +0000 (09:17 -0700)]
forgot to change to a class from a function after the refactor

12 years agochange get_queued_filename to get_orig_filename and modified function
Rodney Ewing [Fri, 2 Aug 2013 22:20:59 +0000 (15:20 -0700)]
change get_queued_filename to get_orig_filename and modified function

12 years agoadded comments and did a little refactoring. not sure if it is actually any clearer...
Rodney Ewing [Fri, 2 Aug 2013 22:12:07 +0000 (15:12 -0700)]
added comments and did a little refactoring. not sure if it is actually any clearer though

12 years agovery rough working version of image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 20:18:35 +0000 (13:18 -0700)]
very rough working version of image reprocessing

12 years agoadd option to not run eagerly
Rodney Ewing [Fri, 2 Aug 2013 19:06:50 +0000 (12:06 -0700)]
add option to not run eagerly

12 years agoadded image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 18:40:41 +0000 (11:40 -0700)]
added image reprocessing

12 years agoadded a check_eligible function to image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 15:02:14 +0000 (08:02 -0700)]
added a check_eligible function to image reprocessing

12 years agoadded a parser for the image media_type reprocessing
Rodney Ewing [Fri, 2 Aug 2013 14:44:03 +0000 (07:44 -0700)]
added a parser for the image media_type reprocessing

12 years agoend of day commit
Rodney Ewing [Thu, 1 Aug 2013 22:58:57 +0000 (15:58 -0700)]
end of day commit

12 years agopep 8
Rodney Ewing [Thu, 1 Aug 2013 22:58:25 +0000 (15:58 -0700)]
pep 8

12 years agoadd command option for regenerating all thumbnails
Rodney Ewing [Thu, 1 Aug 2013 22:55:39 +0000 (15:55 -0700)]
add command option for regenerating all thumbnails

12 years agomake media_id an optional argument
Rodney Ewing [Thu, 1 Aug 2013 22:40:26 +0000 (15:40 -0700)]
make media_id an optional argument

12 years agorefactored _run_reprocessing
Rodney Ewing [Thu, 1 Aug 2013 22:24:34 +0000 (15:24 -0700)]
refactored _run_reprocessing

12 years agoadded a set_media_state function. removed the --all flag (just don't enter any media_...
Rodney Ewing [Thu, 1 Aug 2013 21:47:24 +0000 (14:47 -0700)]
added a set_media_state function. removed the --all flag (just don't enter any media_ids to process all media). slight refactor

12 years agoPep 8
Rodney Ewing [Thu, 1 Aug 2013 20:53:20 +0000 (13:53 -0700)]
Pep 8

12 years agoJust raise standard exception. Pass print statement to gettext
Rodney Ewing [Thu, 1 Aug 2013 20:51:36 +0000 (13:51 -0700)]
Just raise standard exception. Pass print statement to gettext

12 years agoadded a _run_reprocessing function which handles the hook calls
Rodney Ewing [Thu, 1 Aug 2013 20:47:44 +0000 (13:47 -0700)]
added a _run_reprocessing function which handles the hook calls

12 years agoadd reprocess_all function. still need to add code to reprocess all failed entries
Rodney Ewing [Thu, 1 Aug 2013 20:23:40 +0000 (13:23 -0700)]
add reprocess_all function. still need to add code to reprocess all failed entries

12 years agoAdded a set_media_type function that has checks to only reprocess one media_type...
Rodney Ewing [Thu, 1 Aug 2013 19:35:49 +0000 (12:35 -0700)]
Added a set_media_type function that has checks to only reprocess one media_type at a time