mediagoblin.git
11 years agocatch processing exceptions and if entry_orig_state is processed, then ignore the...
Rodney Ewing [Wed, 14 Aug 2013 21:54:10 +0000 (14:54 -0700)]
catch processing exceptions and if entry_orig_state is processed, then ignore the exception

11 years agoraise an error if the file failed to copy to public storage
Rodney Ewing [Wed, 14 Aug 2013 20:47:39 +0000 (13:47 -0700)]
raise an error if the file failed to copy to public storage

catch copy_local_to_storage errors and raise PublicStoreFail, saving the keyname

11 years agoforce thumbnail creation of audio
Rodney Ewing [Wed, 14 Aug 2013 20:06:08 +0000 (13:06 -0700)]
force thumbnail creation of audio

11 years agosize should be a tuple
Rodney Ewing [Wed, 14 Aug 2013 19:41:03 +0000 (12:41 -0700)]
size should be a tuple

11 years agorewind the file to the begining
Rodney Ewing [Wed, 14 Aug 2013 19:25:49 +0000 (12:25 -0700)]
rewind the file to the begining

11 years ago-scale-to only takes 1 size, so choose the smallest
Rodney Ewing [Wed, 14 Aug 2013 19:13:06 +0000 (12:13 -0700)]
-scale-to only takes 1 size, so choose the smallest

11 years agoinclude '.png' in filename
Rodney Ewing [Wed, 14 Aug 2013 18:34:31 +0000 (11:34 -0700)]
include '.png' in filename

11 years agooops, localized_file not local_file
Rodney Ewing [Wed, 14 Aug 2013 18:00:05 +0000 (11:00 -0700)]
oops, localized_file not local_file

11 years agouse a tmp_pdf filename
Rodney Ewing [Wed, 14 Aug 2013 17:58:31 +0000 (10:58 -0700)]
use a tmp_pdf filename

11 years agodon't include the '.' in the ext
Rodney Ewing [Wed, 14 Aug 2013 17:52:37 +0000 (10:52 -0700)]
don't include the '.' in the ext

11 years agoforgot to change __init__ for new processing managers
Rodney Ewing [Wed, 14 Aug 2013 17:47:04 +0000 (10:47 -0700)]
forgot to change __init__ for new processing managers

11 years agoCleanup image common processor
Rodney Ewing [Wed, 14 Aug 2013 17:41:16 +0000 (10:41 -0700)]
Cleanup image common processor

11 years agoadded resizer for stl media
Rodney Ewing [Wed, 14 Aug 2013 17:40:14 +0000 (10:40 -0700)]
added resizer for stl media

11 years agoAdded initial stl processor
Rodney Ewing [Wed, 14 Aug 2013 17:38:13 +0000 (10:38 -0700)]
Added initial stl processor

11 years agoadd reprocess_manager to __init__
Rodney Ewing [Wed, 14 Aug 2013 16:46:44 +0000 (09:46 -0700)]
add reprocess_manager to __init__

11 years agoUse workbench for temp files, refactor _set_pdf_filename, and correct imports
Rodney Ewing [Wed, 14 Aug 2013 16:40:47 +0000 (09:40 -0700)]
Use workbench for temp files, refactor _set_pdf_filename, and correct imports

11 years agoadded pdf Resizer
Rodney Ewing [Wed, 14 Aug 2013 16:13:25 +0000 (09:13 -0700)]
added pdf Resizer

11 years agoAdded pdf Initial processor
Rodney Ewing [Wed, 14 Aug 2013 16:09:35 +0000 (09:09 -0700)]
Added pdf Initial processor

11 years agoadded file argument to video resizer and added ascii resizer
Rodney Ewing [Wed, 14 Aug 2013 00:42:42 +0000 (17:42 -0700)]
added file argument to video resizer and added ascii resizer

11 years agoAdded initial processor for ascii media
Rodney Ewing [Wed, 14 Aug 2013 00:32:59 +0000 (17:32 -0700)]
Added initial processor for ascii media

11 years agoadded video transcoder
Rodney Ewing [Tue, 13 Aug 2013 20:40:16 +0000 (13:40 -0700)]
added video transcoder

11 years agoAdded thumbnail resizer for video
Rodney Ewing [Tue, 13 Aug 2013 20:31:48 +0000 (13:31 -0700)]
Added thumbnail resizer for video

11 years agouse type=float for audio vorbis quality
Rodney Ewing [Tue, 13 Aug 2013 20:27:51 +0000 (13:27 -0700)]
use type=float for audio vorbis quality

11 years agoAdded Initial processor for video
Rodney Ewing [Tue, 13 Aug 2013 20:19:52 +0000 (13:19 -0700)]
Added Initial processor for video

11 years agoadded audio reprocessing transcoder
Rodney Ewing [Tue, 13 Aug 2013 18:42:42 +0000 (11:42 -0700)]
added audio reprocessing transcoder

11 years agojust use the default quality when creating a thumbnail or spectrogram
Rodney Ewing [Tue, 13 Aug 2013 18:34:05 +0000 (11:34 -0700)]
just use the default quality when creating a thumbnail or spectrogram

11 years agoadd audio thumbnail and spectrogram resizer
Rodney Ewing [Tue, 13 Aug 2013 18:30:18 +0000 (11:30 -0700)]
add audio thumbnail and spectrogram resizer

11 years agofetch spectrogram for thumbnail creation, create spectrogram if not found
Rodney Ewing [Tue, 13 Aug 2013 18:29:44 +0000 (11:29 -0700)]
fetch spectrogram for thumbnail creation, create spectrogram if not found

11 years agoforgot nargs=2
Rodney Ewing [Tue, 13 Aug 2013 18:02:36 +0000 (11:02 -0700)]
forgot nargs=2

11 years agoaudio processing code cleanup
Rodney Ewing [Tue, 13 Aug 2013 17:51:21 +0000 (10:51 -0700)]
audio processing code cleanup

11 years agoshould store file as webm_audio instead of medium
Rodney Ewing [Tue, 13 Aug 2013 17:36:30 +0000 (10:36 -0700)]
should store file as webm_audio instead of medium

11 years agomedia:thumb not medium:thumb :)
Rodney Ewing [Tue, 13 Aug 2013 17:32:40 +0000 (10:32 -0700)]
media:thumb not medium:thumb :)

11 years agouse name_builder with store_public, not create_pub_filepath
Rodney Ewing [Tue, 13 Aug 2013 17:28:12 +0000 (10:28 -0700)]
use name_builder with store_public, not create_pub_filepath

11 years agocommon_setup() must be the first processing step
Rodney Ewing [Tue, 13 Aug 2013 17:13:26 +0000 (10:13 -0700)]
common_setup() must be the first processing step

11 years agoAudio Initial Processor
Rodney Ewing [Tue, 13 Aug 2013 16:57:35 +0000 (09:57 -0700)]
Audio Initial Processor

11 years agoremove old code
Rodney Ewing [Mon, 12 Aug 2013 22:48:40 +0000 (15:48 -0700)]
remove old code

11 years agobulk_run reprocessing complete
Rodney Ewing [Mon, 12 Aug 2013 22:45:09 +0000 (15:45 -0700)]
bulk_run reprocessing complete

11 years agoResize all processed thumbs
Rodney Ewing [Mon, 12 Aug 2013 22:25:52 +0000 (15:25 -0700)]
Resize all processed thumbs

11 years agowrap get_entry_and_processing_manager in try, except block
Rodney Ewing [Mon, 12 Aug 2013 21:57:45 +0000 (14:57 -0700)]
wrap get_entry_and_processing_manager in try, except block

11 years agorun initial processing on all failed entries
Rodney Ewing [Mon, 12 Aug 2013 21:54:02 +0000 (14:54 -0700)]
run initial processing on all failed entries

11 years agoadd bulk_run, thumbs, and initial sub_commands
Rodney Ewing [Mon, 12 Aug 2013 21:28:03 +0000 (14:28 -0700)]
add bulk_run, thumbs, and initial sub_commands

11 years agoremove ProcessingState
Rodney Ewing [Mon, 12 Aug 2013 18:57:47 +0000 (11:57 -0700)]
remove ProcessingState

11 years agodelete existing file in store_public
Rodney Ewing [Mon, 12 Aug 2013 18:55:00 +0000 (11:55 -0700)]
delete existing file in store_public

11 years agoAdd image resizer and some cleanup of old code
Rodney Ewing [Mon, 12 Aug 2013 18:37:59 +0000 (11:37 -0700)]
Add image resizer and some cleanup of old code

11 years agoFix (by Rodney Ewing) for processing, specifically the way resize_tool was being...
Christopher Allan Webber [Mon, 12 Aug 2013 16:57:52 +0000 (11:57 -0500)]
Fix (by Rodney Ewing) for processing, specifically the way resize_tool was being called

Thanks for fixing, Rodney :)

11 years agoDon't forget to run copy_original()! That's critical!
Christopher Allan Webber [Mon, 12 Aug 2013 16:40:55 +0000 (11:40 -0500)]
Don't forget to run copy_original()!  That's critical!

This commit sponsored by Tony Schmidt.  Thank you!

11 years agoFixing ./bin/gmg reprocess available, which I broke :)
Christopher Allan Webber [Mon, 12 Aug 2013 16:27:43 +0000 (11:27 -0500)]
Fixing ./bin/gmg reprocess available, which I broke :)

11 years agoTrying to fix the bug that's happening to rodney757 but not to me ;)
Christopher Allan Webber [Mon, 12 Aug 2013 16:19:20 +0000 (11:19 -0500)]
Trying to fix the bug that's happening to rodney757 but not to me ;)

11 years agoRevert "use parser.parse_known_args() instead of parser.parse_args()"
Christopher Allan Webber [Mon, 12 Aug 2013 16:13:00 +0000 (11:13 -0500)]
Revert "use parser.parse_known_args() instead of parser.parse_args()"

This reverts commit 029e779c468ba1a6bfd893679cfaae7f418f45dd.
(and a bit more!)

This wasn't needed anymore because we did a "rest" capture and passed
that over to the reprocess run command.

Conflicts:
mediagoblin/gmg_commands/assetlink.py
mediagoblin/gmg_commands/dbupdate.py
mediagoblin/gmg_commands/import_export.py
mediagoblin/gmg_commands/users.py

11 years agoFixing normal submission of media (well for images anyway)
Christopher Allan Webber [Mon, 12 Aug 2013 16:00:15 +0000 (11:00 -0500)]
Fixing normal submission of media (well for images anyway)

11 years agoA couple of fixes to stupid things I did while coding this. And it WORKS!
Christopher Allan Webber [Mon, 12 Aug 2013 15:53:15 +0000 (10:53 -0500)]
A couple of fixes to stupid things I did while coding this.  And it WORKS!

This commit sponsored by José María Serralde Ruiz.  Thank you!

11 years agoFixing the MediaProcessor context manager so it actually, you know, works :)
Christopher Allan Webber [Mon, 12 Aug 2013 15:48:07 +0000 (10:48 -0500)]
Fixing the MediaProcessor context manager so it actually, you know, works :)

This commit sponsored by Mikiya Okuno.  Thank you!

11 years agoTheoretically the last steps to get reprocessing working for initial & images
Christopher Allan Webber [Mon, 12 Aug 2013 15:40:07 +0000 (10:40 -0500)]
Theoretically the last steps to get reprocessing working for initial & images

Haven't tested it yet though :)

This commit sponsored by Samuel Bächler.  Thank you!

11 years agoFactored the get_orig_filename from processing state and put it to use.
Christopher Allan Webber [Mon, 12 Aug 2013 13:57:56 +0000 (08:57 -0500)]
Factored the get_orig_filename from processing state and put it to use.

This commit sponsored by Vincent Demeester.  Thank you!

11 years agoRecord the original state of the media entry in the processor
Christopher Allan Webber [Mon, 12 Aug 2013 13:22:14 +0000 (08:22 -0500)]
Record the original state of the media entry in the processor

This allows our processor to make some informed decisions based on the
state by still having access to the original state.

This commit sponsored by William Rico.  Thank you!

11 years agoMarking the initial steps for processing
Christopher Allan Webber [Sun, 11 Aug 2013 21:53:37 +0000 (16:53 -0500)]
Marking the initial steps for processing

11 years agoRenaming the processing manager stuff to be less ambiguous.
Christopher Allan Webber [Sun, 11 Aug 2013 20:22:43 +0000 (15:22 -0500)]
Renaming the processing manager stuff to be less ambiguous.

BONUS COMMIT to Ben Finney and the Free Software Melbourne crew. :)

IRONY: Initially I committed this as "media manager".

11 years agoThat manager.process() line no longer made sense
Christopher Allan Webber [Sun, 11 Aug 2013 19:48:21 +0000 (14:48 -0500)]
That manager.process() line no longer made sense

11 years agoUpdating to the point where we can allllmost run with the new reprocessing code
Christopher Allan Webber [Sun, 11 Aug 2013 19:34:45 +0000 (14:34 -0500)]
Updating to the point where we can allllmost run with the new reprocessing code

This commit sponsored by Odin Hørthe Omdal.  Thank you!

11 years agoShould be enough to get to the point where you can actually initialize a processing...
Christopher Allan Webber [Fri, 9 Aug 2013 22:30:52 +0000 (17:30 -0500)]
Should be enough to get to the point where you can actually initialize a processing command now.

However, it doesn't celery task-ify it...

This commit sponsored by Catalin Cosovanu.  Thank you!

11 years agoSteps toward working "run" reprocessing command.
Christopher Allan Webber [Fri, 9 Aug 2013 21:12:06 +0000 (16:12 -0500)]
Steps toward working "run" reprocessing command.

This commit sponsored by Philippe Casteleyn.  Thank you!

11 years agoMoving celery setup to the right place
Christopher Allan Webber [Fri, 9 Aug 2013 19:15:18 +0000 (14:15 -0500)]
Moving celery setup to the right place

This commit sponsored by Jose Manuel Zueco Lazaro.  Thank you!

11 years agoWhitespacin' it up.
Christopher Allan Webber [Fri, 9 Aug 2013 19:10:52 +0000 (14:10 -0500)]
Whitespacin' it up.

11 years ago`gmg reprocess available --action-help` now tells you processor arguments!
Christopher Allan Webber [Fri, 9 Aug 2013 18:56:23 +0000 (13:56 -0500)]
`gmg reprocess available --action-help` now tells you processor arguments!

Every reprocessing action possible can inform you of its command line
argument stuff!  Is that awesome or what?

11 years ago"initial" reprocessing subcommand now works!
Christopher Allan Webber [Fri, 9 Aug 2013 17:13:53 +0000 (12:13 -0500)]
"initial" reprocessing subcommand now works!

We are on our way now to a working reprocessing system under this
redesign!

This commit sponsored by Bjarni Rúnar Einarsson.  Thank you!

11 years agoMore progress towards the new reprocessing infrastructure: args updating
Christopher Allan Webber [Fri, 9 Aug 2013 16:20:21 +0000 (11:20 -0500)]
More progress towards the new reprocessing infrastructure: args updating

This commit sponsored by Elizabeth Webber.  Thanks, sis!

11 years agoMore steps towards a working reprocessing system.
Christopher Allan Webber [Thu, 8 Aug 2013 18:53:28 +0000 (13:53 -0500)]
More steps towards a working reprocessing system.

Fleshing out the base classes and setting up some docstrings.  Not
everything is totally clear yet, but I think it's on a good track, and
getting clearer.

This commit sponsored by Ben Finney, on behalf of Free Software Melbourne.
Thank you all!

11 years agoDocumentation for the MediaProcessor
Christopher Allan Webber [Wed, 7 Aug 2013 22:07:19 +0000 (17:07 -0500)]
Documentation for the MediaProcessor

11 years agostarted coding basics of new processing code
Christopher Allan Webber [Wed, 7 Aug 2013 20:01:46 +0000 (15:01 -0500)]
started coding basics of new processing code

11 years agofix storage paramater in get_orig_filename(), fix __init__ for ProceessImage, better...
Rodney Ewing [Tue, 6 Aug 2013 17:48:26 +0000 (10:48 -0700)]
fix storage paramater in get_orig_filename(), fix __init__ for ProceessImage, better description for --size flag

11 years agoRefactor processing/reprocessing functions into ProcessImage class
Rodney Ewing [Tue, 6 Aug 2013 16:47:09 +0000 (09:47 -0700)]
Refactor processing/reprocessing functions into ProcessImage class

11 years agoforgot to change to a class from a function after the refactor
Rodney Ewing [Tue, 6 Aug 2013 16:17:37 +0000 (09:17 -0700)]
forgot to change to a class from a function after the refactor

11 years agochange get_queued_filename to get_orig_filename and modified function
Rodney Ewing [Fri, 2 Aug 2013 22:20:59 +0000 (15:20 -0700)]
change get_queued_filename to get_orig_filename and modified function

11 years agoadded comments and did a little refactoring. not sure if it is actually any clearer...
Rodney Ewing [Fri, 2 Aug 2013 22:12:07 +0000 (15:12 -0700)]
added comments and did a little refactoring. not sure if it is actually any clearer though

11 years agovery rough working version of image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 20:18:35 +0000 (13:18 -0700)]
very rough working version of image reprocessing

11 years agoadd option to not run eagerly
Rodney Ewing [Fri, 2 Aug 2013 19:06:50 +0000 (12:06 -0700)]
add option to not run eagerly

11 years agoadded image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 18:40:41 +0000 (11:40 -0700)]
added image reprocessing

11 years agoadded a check_eligible function to image reprocessing
Rodney Ewing [Fri, 2 Aug 2013 15:02:14 +0000 (08:02 -0700)]
added a check_eligible function to image reprocessing

11 years agoadded a parser for the image media_type reprocessing
Rodney Ewing [Fri, 2 Aug 2013 14:44:03 +0000 (07:44 -0700)]
added a parser for the image media_type reprocessing

11 years agoend of day commit
Rodney Ewing [Thu, 1 Aug 2013 22:58:57 +0000 (15:58 -0700)]
end of day commit

11 years agopep 8
Rodney Ewing [Thu, 1 Aug 2013 22:58:25 +0000 (15:58 -0700)]
pep 8

11 years agoadd command option for regenerating all thumbnails
Rodney Ewing [Thu, 1 Aug 2013 22:55:39 +0000 (15:55 -0700)]
add command option for regenerating all thumbnails

11 years agomake media_id an optional argument
Rodney Ewing [Thu, 1 Aug 2013 22:40:26 +0000 (15:40 -0700)]
make media_id an optional argument

11 years agorefactored _run_reprocessing
Rodney Ewing [Thu, 1 Aug 2013 22:24:34 +0000 (15:24 -0700)]
refactored _run_reprocessing

11 years agoadded a set_media_state function. removed the --all flag (just don't enter any media_...
Rodney Ewing [Thu, 1 Aug 2013 21:47:24 +0000 (14:47 -0700)]
added a set_media_state function. removed the --all flag (just don't enter any media_ids to process all media). slight refactor

11 years agoPep 8
Rodney Ewing [Thu, 1 Aug 2013 20:53:20 +0000 (13:53 -0700)]
Pep 8

11 years agoJust raise standard exception. Pass print statement to gettext
Rodney Ewing [Thu, 1 Aug 2013 20:51:36 +0000 (13:51 -0700)]
Just raise standard exception. Pass print statement to gettext

11 years agoadded a _run_reprocessing function which handles the hook calls
Rodney Ewing [Thu, 1 Aug 2013 20:47:44 +0000 (13:47 -0700)]
added a _run_reprocessing function which handles the hook calls

11 years agoadd reprocess_all function. still need to add code to reprocess all failed entries
Rodney Ewing [Thu, 1 Aug 2013 20:23:40 +0000 (13:23 -0700)]
add reprocess_all function. still need to add code to reprocess all failed entries

11 years agoAdded a set_media_type function that has checks to only reprocess one media_type...
Rodney Ewing [Thu, 1 Aug 2013 19:35:49 +0000 (12:35 -0700)]
Added a set_media_type function that has checks to only reprocess one media_type at a time

11 years agoBeginnings of a reprocess command
Rodney Ewing [Thu, 1 Aug 2013 19:32:49 +0000 (12:32 -0700)]
Beginnings of a reprocess command

11 years agoThrow an error if there are unrecognized arguments
Rodney Ewing [Thu, 1 Aug 2013 18:11:04 +0000 (11:11 -0700)]
Throw an error if there are unrecognized arguments

11 years agouse parser.parse_known_args() instead of parser.parse_args()
Rodney Ewing [Thu, 1 Aug 2013 17:23:37 +0000 (10:23 -0700)]
use parser.parse_known_args() instead of parser.parse_args()

11 years agoload js at the end of the page
Rodney Ewing [Fri, 16 Aug 2013 18:49:33 +0000 (11:49 -0700)]
load js at the end of the page

11 years agouse urlgen
Rodney Ewing [Fri, 16 Aug 2013 18:48:03 +0000 (11:48 -0700)]
use urlgen

11 years agoMerge branch 'auth_docs'
Rodney Ewing [Fri, 16 Aug 2013 17:24:41 +0000 (10:24 -0700)]
Merge branch 'auth_docs'

Conflicts:
docs/source/index.rst

11 years agofix persona tests by using a correct query
Rodney Ewing [Fri, 16 Aug 2013 00:36:56 +0000 (17:36 -0700)]
fix persona tests by using a correct query

11 years agoRemoving PyPump as we aren't using it yet and there's a dependency conflict ;|
Christopher Allan Webber [Thu, 15 Aug 2013 23:29:35 +0000 (18:29 -0500)]
Removing PyPump as we aren't using it yet and there's a dependency conflict ;|

11 years agoMerge branch 'persona_resquash'
Christopher Allan Webber [Thu, 15 Aug 2013 22:07:14 +0000 (17:07 -0500)]
Merge branch 'persona_resquash'

11 years agoRemoving the whitespace betwetween action= and its value
Christopher Allan Webber [Thu, 15 Aug 2013 20:17:02 +0000 (15:17 -0500)]
Removing the whitespace betwetween action= and its value