mediagoblin.git
10 years agorename webm_640 to webm_video since it might be a different resolution
Rodney Ewing [Tue, 20 Aug 2013 17:29:38 +0000 (10:29 -0700)]
rename webm_640 to webm_video since it might be a different resolution

10 years agomake sure size is a tuple
Rodney Ewing [Fri, 16 Aug 2013 22:08:21 +0000 (15:08 -0700)]
make sure size is a tuple

10 years agoKeep the best quality file if there's no original
Rodney Ewing [Thu, 15 Aug 2013 19:40:19 +0000 (12:40 -0700)]
Keep the best quality file if there's no original

10 years agofor some reason, the minimum thumbnail size for videos is 100 x 100
Rodney Ewing [Thu, 15 Aug 2013 16:29:11 +0000 (09:29 -0700)]
for some reason, the minimum thumbnail size for videos is 100 x 100

10 years agorefactor get_orig_filename to return an acceptable filename to the processor.
Rodney Ewing [Thu, 15 Aug 2013 15:54:09 +0000 (08:54 -0700)]
refactor get_orig_filename to return an acceptable filename to the processor.

If there is an original video file and we skip transcoding, delete the webm_640 file

10 years agomake medium dimensions a tuple
Rodney Ewing [Thu, 15 Aug 2013 15:11:29 +0000 (08:11 -0700)]
make medium dimensions a tuple

10 years agocheck medium_size arg in skip_transcoding, not config
Rodney Ewing [Thu, 15 Aug 2013 15:10:00 +0000 (08:10 -0700)]
check medium_size arg in skip_transcoding, not config

10 years agoonly try and delete queue file if it exists
Rodney Ewing [Wed, 14 Aug 2013 23:39:01 +0000 (16:39 -0700)]
only try and delete queue file if it exists

10 years agouse thumb_size
Rodney Ewing [Wed, 14 Aug 2013 23:30:52 +0000 (16:30 -0700)]
use thumb_size

10 years agoinclude a thumb_size string with each Resizer to run gmg reprocess thumbs
Rodney Ewing [Wed, 14 Aug 2013 23:25:44 +0000 (16:25 -0700)]
include a thumb_size string with each Resizer to run gmg reprocess thumbs

10 years agotypos
Rodney Ewing [Wed, 14 Aug 2013 23:07:27 +0000 (16:07 -0700)]
typos

10 years agoadd quality and filter args to image processors
Rodney Ewing [Wed, 14 Aug 2013 23:06:14 +0000 (16:06 -0700)]
add quality and filter args to image processors

10 years agoforgot to add the ascii resizer to the list of processors
Rodney Ewing [Wed, 14 Aug 2013 22:11:03 +0000 (15:11 -0700)]
forgot to add the ascii resizer to the list of processors

10 years agocatch processing exceptions and if entry_orig_state is processed, then ignore the...
Rodney Ewing [Wed, 14 Aug 2013 21:54:10 +0000 (14:54 -0700)]
catch processing exceptions and if entry_orig_state is processed, then ignore the exception

10 years agoraise an error if the file failed to copy to public storage
Rodney Ewing [Wed, 14 Aug 2013 20:47:39 +0000 (13:47 -0700)]
raise an error if the file failed to copy to public storage

catch copy_local_to_storage errors and raise PublicStoreFail, saving the keyname

10 years agoforce thumbnail creation of audio
Rodney Ewing [Wed, 14 Aug 2013 20:06:08 +0000 (13:06 -0700)]
force thumbnail creation of audio

10 years agosize should be a tuple
Rodney Ewing [Wed, 14 Aug 2013 19:41:03 +0000 (12:41 -0700)]
size should be a tuple

10 years agorewind the file to the begining
Rodney Ewing [Wed, 14 Aug 2013 19:25:49 +0000 (12:25 -0700)]
rewind the file to the begining

10 years ago-scale-to only takes 1 size, so choose the smallest
Rodney Ewing [Wed, 14 Aug 2013 19:13:06 +0000 (12:13 -0700)]
-scale-to only takes 1 size, so choose the smallest

10 years agoinclude '.png' in filename
Rodney Ewing [Wed, 14 Aug 2013 18:34:31 +0000 (11:34 -0700)]
include '.png' in filename

10 years agooops, localized_file not local_file
Rodney Ewing [Wed, 14 Aug 2013 18:00:05 +0000 (11:00 -0700)]
oops, localized_file not local_file

10 years agouse a tmp_pdf filename
Rodney Ewing [Wed, 14 Aug 2013 17:58:31 +0000 (10:58 -0700)]
use a tmp_pdf filename

10 years agodon't include the '.' in the ext
Rodney Ewing [Wed, 14 Aug 2013 17:52:37 +0000 (10:52 -0700)]
don't include the '.' in the ext

10 years agoforgot to change __init__ for new processing managers
Rodney Ewing [Wed, 14 Aug 2013 17:47:04 +0000 (10:47 -0700)]
forgot to change __init__ for new processing managers

10 years agoCleanup image common processor
Rodney Ewing [Wed, 14 Aug 2013 17:41:16 +0000 (10:41 -0700)]
Cleanup image common processor

10 years agoadded resizer for stl media
Rodney Ewing [Wed, 14 Aug 2013 17:40:14 +0000 (10:40 -0700)]
added resizer for stl media

10 years agoAdded initial stl processor
Rodney Ewing [Wed, 14 Aug 2013 17:38:13 +0000 (10:38 -0700)]
Added initial stl processor

10 years agoadd reprocess_manager to __init__
Rodney Ewing [Wed, 14 Aug 2013 16:46:44 +0000 (09:46 -0700)]
add reprocess_manager to __init__

10 years agoUse workbench for temp files, refactor _set_pdf_filename, and correct imports
Rodney Ewing [Wed, 14 Aug 2013 16:40:47 +0000 (09:40 -0700)]
Use workbench for temp files, refactor _set_pdf_filename, and correct imports

10 years agoadded pdf Resizer
Rodney Ewing [Wed, 14 Aug 2013 16:13:25 +0000 (09:13 -0700)]
added pdf Resizer

10 years agoAdded pdf Initial processor
Rodney Ewing [Wed, 14 Aug 2013 16:09:35 +0000 (09:09 -0700)]
Added pdf Initial processor

10 years agoadded file argument to video resizer and added ascii resizer
Rodney Ewing [Wed, 14 Aug 2013 00:42:42 +0000 (17:42 -0700)]
added file argument to video resizer and added ascii resizer

10 years agoAdded initial processor for ascii media
Rodney Ewing [Wed, 14 Aug 2013 00:32:59 +0000 (17:32 -0700)]
Added initial processor for ascii media

10 years agoadded video transcoder
Rodney Ewing [Tue, 13 Aug 2013 20:40:16 +0000 (13:40 -0700)]
added video transcoder

10 years agoAdded thumbnail resizer for video
Rodney Ewing [Tue, 13 Aug 2013 20:31:48 +0000 (13:31 -0700)]
Added thumbnail resizer for video

10 years agouse type=float for audio vorbis quality
Rodney Ewing [Tue, 13 Aug 2013 20:27:51 +0000 (13:27 -0700)]
use type=float for audio vorbis quality

10 years agoAdded Initial processor for video
Rodney Ewing [Tue, 13 Aug 2013 20:19:52 +0000 (13:19 -0700)]
Added Initial processor for video

10 years agoadded audio reprocessing transcoder
Rodney Ewing [Tue, 13 Aug 2013 18:42:42 +0000 (11:42 -0700)]
added audio reprocessing transcoder

10 years agojust use the default quality when creating a thumbnail or spectrogram
Rodney Ewing [Tue, 13 Aug 2013 18:34:05 +0000 (11:34 -0700)]
just use the default quality when creating a thumbnail or spectrogram

10 years agoadd audio thumbnail and spectrogram resizer
Rodney Ewing [Tue, 13 Aug 2013 18:30:18 +0000 (11:30 -0700)]
add audio thumbnail and spectrogram resizer

10 years agofetch spectrogram for thumbnail creation, create spectrogram if not found
Rodney Ewing [Tue, 13 Aug 2013 18:29:44 +0000 (11:29 -0700)]
fetch spectrogram for thumbnail creation, create spectrogram if not found

10 years agoforgot nargs=2
Rodney Ewing [Tue, 13 Aug 2013 18:02:36 +0000 (11:02 -0700)]
forgot nargs=2

10 years agoaudio processing code cleanup
Rodney Ewing [Tue, 13 Aug 2013 17:51:21 +0000 (10:51 -0700)]
audio processing code cleanup

10 years agoshould store file as webm_audio instead of medium
Rodney Ewing [Tue, 13 Aug 2013 17:36:30 +0000 (10:36 -0700)]
should store file as webm_audio instead of medium

10 years agomedia:thumb not medium:thumb :)
Rodney Ewing [Tue, 13 Aug 2013 17:32:40 +0000 (10:32 -0700)]
media:thumb not medium:thumb :)

10 years agouse name_builder with store_public, not create_pub_filepath
Rodney Ewing [Tue, 13 Aug 2013 17:28:12 +0000 (10:28 -0700)]
use name_builder with store_public, not create_pub_filepath

10 years agocommon_setup() must be the first processing step
Rodney Ewing [Tue, 13 Aug 2013 17:13:26 +0000 (10:13 -0700)]
common_setup() must be the first processing step

10 years agoAudio Initial Processor
Rodney Ewing [Tue, 13 Aug 2013 16:57:35 +0000 (09:57 -0700)]
Audio Initial Processor

10 years agoremove old code
Rodney Ewing [Mon, 12 Aug 2013 22:48:40 +0000 (15:48 -0700)]
remove old code

10 years agobulk_run reprocessing complete
Rodney Ewing [Mon, 12 Aug 2013 22:45:09 +0000 (15:45 -0700)]
bulk_run reprocessing complete

10 years agoResize all processed thumbs
Rodney Ewing [Mon, 12 Aug 2013 22:25:52 +0000 (15:25 -0700)]
Resize all processed thumbs

10 years agowrap get_entry_and_processing_manager in try, except block
Rodney Ewing [Mon, 12 Aug 2013 21:57:45 +0000 (14:57 -0700)]
wrap get_entry_and_processing_manager in try, except block

10 years agorun initial processing on all failed entries
Rodney Ewing [Mon, 12 Aug 2013 21:54:02 +0000 (14:54 -0700)]
run initial processing on all failed entries

10 years agoadd bulk_run, thumbs, and initial sub_commands
Rodney Ewing [Mon, 12 Aug 2013 21:28:03 +0000 (14:28 -0700)]
add bulk_run, thumbs, and initial sub_commands

10 years agoremove ProcessingState
Rodney Ewing [Mon, 12 Aug 2013 18:57:47 +0000 (11:57 -0700)]
remove ProcessingState

10 years agodelete existing file in store_public
Rodney Ewing [Mon, 12 Aug 2013 18:55:00 +0000 (11:55 -0700)]
delete existing file in store_public

10 years agoAdd image resizer and some cleanup of old code
Rodney Ewing [Mon, 12 Aug 2013 18:37:59 +0000 (11:37 -0700)]
Add image resizer and some cleanup of old code

10 years agoFix (by Rodney Ewing) for processing, specifically the way resize_tool was being...
Christopher Allan Webber [Mon, 12 Aug 2013 16:57:52 +0000 (11:57 -0500)]
Fix (by Rodney Ewing) for processing, specifically the way resize_tool was being called

Thanks for fixing, Rodney :)

10 years agoDon't forget to run copy_original()! That's critical!
Christopher Allan Webber [Mon, 12 Aug 2013 16:40:55 +0000 (11:40 -0500)]
Don't forget to run copy_original()!  That's critical!

This commit sponsored by Tony Schmidt.  Thank you!

10 years agoFixing ./bin/gmg reprocess available, which I broke :)
Christopher Allan Webber [Mon, 12 Aug 2013 16:27:43 +0000 (11:27 -0500)]
Fixing ./bin/gmg reprocess available, which I broke :)

10 years agoTrying to fix the bug that's happening to rodney757 but not to me ;)
Christopher Allan Webber [Mon, 12 Aug 2013 16:19:20 +0000 (11:19 -0500)]
Trying to fix the bug that's happening to rodney757 but not to me ;)

10 years agoRevert "use parser.parse_known_args() instead of parser.parse_args()"
Christopher Allan Webber [Mon, 12 Aug 2013 16:13:00 +0000 (11:13 -0500)]
Revert "use parser.parse_known_args() instead of parser.parse_args()"

This reverts commit 029e779c468ba1a6bfd893679cfaae7f418f45dd.
(and a bit more!)

This wasn't needed anymore because we did a "rest" capture and passed
that over to the reprocess run command.

Conflicts:
mediagoblin/gmg_commands/assetlink.py
mediagoblin/gmg_commands/dbupdate.py
mediagoblin/gmg_commands/import_export.py
mediagoblin/gmg_commands/users.py

10 years agoFixing normal submission of media (well for images anyway)
Christopher Allan Webber [Mon, 12 Aug 2013 16:00:15 +0000 (11:00 -0500)]
Fixing normal submission of media (well for images anyway)

10 years agoA couple of fixes to stupid things I did while coding this. And it WORKS!
Christopher Allan Webber [Mon, 12 Aug 2013 15:53:15 +0000 (10:53 -0500)]
A couple of fixes to stupid things I did while coding this.  And it WORKS!

This commit sponsored by José María Serralde Ruiz.  Thank you!

10 years agoFixing the MediaProcessor context manager so it actually, you know, works :)
Christopher Allan Webber [Mon, 12 Aug 2013 15:48:07 +0000 (10:48 -0500)]
Fixing the MediaProcessor context manager so it actually, you know, works :)

This commit sponsored by Mikiya Okuno.  Thank you!

10 years agoTheoretically the last steps to get reprocessing working for initial & images
Christopher Allan Webber [Mon, 12 Aug 2013 15:40:07 +0000 (10:40 -0500)]
Theoretically the last steps to get reprocessing working for initial & images

Haven't tested it yet though :)

This commit sponsored by Samuel Bächler.  Thank you!

10 years agoFactored the get_orig_filename from processing state and put it to use.
Christopher Allan Webber [Mon, 12 Aug 2013 13:57:56 +0000 (08:57 -0500)]
Factored the get_orig_filename from processing state and put it to use.

This commit sponsored by Vincent Demeester.  Thank you!

10 years agoRecord the original state of the media entry in the processor
Christopher Allan Webber [Mon, 12 Aug 2013 13:22:14 +0000 (08:22 -0500)]
Record the original state of the media entry in the processor

This allows our processor to make some informed decisions based on the
state by still having access to the original state.

This commit sponsored by William Rico.  Thank you!

10 years agoMarking the initial steps for processing
Christopher Allan Webber [Sun, 11 Aug 2013 21:53:37 +0000 (16:53 -0500)]
Marking the initial steps for processing

10 years agoRenaming the processing manager stuff to be less ambiguous.
Christopher Allan Webber [Sun, 11 Aug 2013 20:22:43 +0000 (15:22 -0500)]
Renaming the processing manager stuff to be less ambiguous.

BONUS COMMIT to Ben Finney and the Free Software Melbourne crew. :)

IRONY: Initially I committed this as "media manager".

10 years agoThat manager.process() line no longer made sense
Christopher Allan Webber [Sun, 11 Aug 2013 19:48:21 +0000 (14:48 -0500)]
That manager.process() line no longer made sense

10 years agoUpdating to the point where we can allllmost run with the new reprocessing code
Christopher Allan Webber [Sun, 11 Aug 2013 19:34:45 +0000 (14:34 -0500)]
Updating to the point where we can allllmost run with the new reprocessing code

This commit sponsored by Odin Hørthe Omdal.  Thank you!

10 years agoShould be enough to get to the point where you can actually initialize a processing...
Christopher Allan Webber [Fri, 9 Aug 2013 22:30:52 +0000 (17:30 -0500)]
Should be enough to get to the point where you can actually initialize a processing command now.

However, it doesn't celery task-ify it...

This commit sponsored by Catalin Cosovanu.  Thank you!

10 years agoSteps toward working "run" reprocessing command.
Christopher Allan Webber [Fri, 9 Aug 2013 21:12:06 +0000 (16:12 -0500)]
Steps toward working "run" reprocessing command.

This commit sponsored by Philippe Casteleyn.  Thank you!

10 years agoMoving celery setup to the right place
Christopher Allan Webber [Fri, 9 Aug 2013 19:15:18 +0000 (14:15 -0500)]
Moving celery setup to the right place

This commit sponsored by Jose Manuel Zueco Lazaro.  Thank you!

10 years agoWhitespacin' it up.
Christopher Allan Webber [Fri, 9 Aug 2013 19:10:52 +0000 (14:10 -0500)]
Whitespacin' it up.

10 years ago`gmg reprocess available --action-help` now tells you processor arguments!
Christopher Allan Webber [Fri, 9 Aug 2013 18:56:23 +0000 (13:56 -0500)]
`gmg reprocess available --action-help` now tells you processor arguments!

Every reprocessing action possible can inform you of its command line
argument stuff!  Is that awesome or what?

10 years ago"initial" reprocessing subcommand now works!
Christopher Allan Webber [Fri, 9 Aug 2013 17:13:53 +0000 (12:13 -0500)]
"initial" reprocessing subcommand now works!

We are on our way now to a working reprocessing system under this
redesign!

This commit sponsored by Bjarni Rúnar Einarsson.  Thank you!

10 years agoMore progress towards the new reprocessing infrastructure: args updating
Christopher Allan Webber [Fri, 9 Aug 2013 16:20:21 +0000 (11:20 -0500)]
More progress towards the new reprocessing infrastructure: args updating

This commit sponsored by Elizabeth Webber.  Thanks, sis!

10 years agoMore steps towards a working reprocessing system.
Christopher Allan Webber [Thu, 8 Aug 2013 18:53:28 +0000 (13:53 -0500)]
More steps towards a working reprocessing system.

Fleshing out the base classes and setting up some docstrings.  Not
everything is totally clear yet, but I think it's on a good track, and
getting clearer.

This commit sponsored by Ben Finney, on behalf of Free Software Melbourne.
Thank you all!

10 years agoDocumentation for the MediaProcessor
Christopher Allan Webber [Wed, 7 Aug 2013 22:07:19 +0000 (17:07 -0500)]
Documentation for the MediaProcessor

10 years agostarted coding basics of new processing code
Christopher Allan Webber [Wed, 7 Aug 2013 20:01:46 +0000 (15:01 -0500)]
started coding basics of new processing code

10 years agofix storage paramater in get_orig_filename(), fix __init__ for ProceessImage, better...
Rodney Ewing [Tue, 6 Aug 2013 17:48:26 +0000 (10:48 -0700)]
fix storage paramater in get_orig_filename(), fix __init__ for ProceessImage, better description for --size flag

10 years agoRefactor processing/reprocessing functions into ProcessImage class
Rodney Ewing [Tue, 6 Aug 2013 16:47:09 +0000 (09:47 -0700)]
Refactor processing/reprocessing functions into ProcessImage class

10 years agoforgot to change to a class from a function after the refactor
Rodney Ewing [Tue, 6 Aug 2013 16:17:37 +0000 (09:17 -0700)]
forgot to change to a class from a function after the refactor

10 years agochange get_queued_filename to get_orig_filename and modified function
Rodney Ewing [Fri, 2 Aug 2013 22:20:59 +0000 (15:20 -0700)]
change get_queued_filename to get_orig_filename and modified function

10 years agoadded comments and did a little refactoring. not sure if it is actually any clearer...
Rodney Ewing [Fri, 2 Aug 2013 22:12:07 +0000 (15:12 -0700)]
added comments and did a little refactoring. not sure if it is actually any clearer though

10 years agovery rough working version of image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 20:18:35 +0000 (13:18 -0700)]
very rough working version of image reprocessing

10 years agoadd option to not run eagerly
Rodney Ewing [Fri, 2 Aug 2013 19:06:50 +0000 (12:06 -0700)]
add option to not run eagerly

10 years agoadded image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 18:40:41 +0000 (11:40 -0700)]
added image reprocessing

10 years agoadded a check_eligible function to image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 15:02:14 +0000 (08:02 -0700)]
added a check_eligible function to image reprocessing

10 years agoadded a parser for the image media_type reprocessing
Rodney Ewing [Fri, 2 Aug 2013 14:44:03 +0000 (07:44 -0700)]
added a parser for the image media_type reprocessing

10 years agoend of day commit
Rodney Ewing [Thu, 1 Aug 2013 22:58:57 +0000 (15:58 -0700)]
end of day commit

10 years agopep 8
Rodney Ewing [Thu, 1 Aug 2013 22:58:25 +0000 (15:58 -0700)]
pep 8

10 years agoadd command option for regenerating all thumbnails
Rodney Ewing [Thu, 1 Aug 2013 22:55:39 +0000 (15:55 -0700)]
add command option for regenerating all thumbnails

10 years agomake media_id an optional argument
Rodney Ewing [Thu, 1 Aug 2013 22:40:26 +0000 (15:40 -0700)]
make media_id an optional argument

10 years agorefactored _run_reprocessing
Rodney Ewing [Thu, 1 Aug 2013 22:24:34 +0000 (15:24 -0700)]
refactored _run_reprocessing

10 years agoadded a set_media_state function. removed the --all flag (just don't enter any media_...
Rodney Ewing [Thu, 1 Aug 2013 21:47:24 +0000 (14:47 -0700)]
added a set_media_state function. removed the --all flag (just don't enter any media_ids to process all media). slight refactor

10 years agoPep 8
Rodney Ewing [Thu, 1 Aug 2013 20:53:20 +0000 (13:53 -0700)]
Pep 8

10 years agoJust raise standard exception. Pass print statement to gettext
Rodney Ewing [Thu, 1 Aug 2013 20:51:36 +0000 (13:51 -0700)]
Just raise standard exception. Pass print statement to gettext