Christopher Allan Webber [Thu, 22 Aug 2013 21:04:19 +0000 (16:04 -0500)]
Not sure why there wasn't a .commit() at the end of add_new_notification_tables()
... but it seems like there should be and it wouldn't hurt.
This commit sponsored by Julio Claudio Matus Ramirez. Thank you!
Christopher Allan Webber [Wed, 21 Aug 2013 21:00:48 +0000 (16:00 -0500)]
Merge remote-tracking branch 'refs/remotes/rodney757/notifications'
Rodney Ewing [Wed, 21 Aug 2013 19:38:12 +0000 (12:38 -0700)]
only use the width for video thumbnails to keep the correct scaling
Christopher Allan Webber [Wed, 21 Aug 2013 19:19:11 +0000 (14:19 -0500)]
Fixing migration name. webm not wemb :)
Christopher Allan Webber [Wed, 21 Aug 2013 17:39:31 +0000 (12:39 -0500)]
Merge remote-tracking branch 'refs/remotes/rodney757/reprocessing'
Conflicts:
mediagoblin/processing/task.py
mediagoblin/submit/lib.py
Rodney Ewing [Tue, 20 Aug 2013 17:29:38 +0000 (10:29 -0700)]
rename webm_640 to webm_video since it might be a different resolution
Rodney Ewing [Tue, 20 Aug 2013 15:25:26 +0000 (08:25 -0700)]
request object no longer contains notification functions
Rodney Ewing [Thu, 8 Aug 2013 22:07:07 +0000 (15:07 -0700)]
add user prefrence for insite notifications
Rodney Ewing [Thu, 8 Aug 2013 18:23:16 +0000 (11:23 -0700)]
use urlgen and store it in a variable
Rodney Ewing [Wed, 7 Aug 2013 22:21:08 +0000 (15:21 -0700)]
added test for mark all comment notifications seen
Rodney Ewing [Wed, 7 Aug 2013 19:50:59 +0000 (12:50 -0700)]
Pep 8
Rodney Ewing [Wed, 7 Aug 2013 19:44:43 +0000 (12:44 -0700)]
add the ability to mark all notifications read.
Rodney Ewing [Tue, 20 Aug 2013 14:52:12 +0000 (07:52 -0700)]
Oops, this accidently slipped in there
Revert "This patch checks for libs instead of programs in configure.ac for sqlite3 and postgesql."
This reverts commit
26da3271f6e6a880c0418998d5a4e5e71081e1f7.
Rodney Ewing [Tue, 20 Aug 2013 14:18:48 +0000 (07:18 -0700)]
use href='javascript:;' instead of href='#notifications', etc
Rodney Ewing [Tue, 20 Aug 2013 14:03:55 +0000 (07:03 -0700)]
This patch checks for libs instead of programs in configure.ac for sqlite3 and postgesql.
Patch submitted by amirouche
Rodney Ewing [Mon, 19 Aug 2013 21:57:00 +0000 (14:57 -0700)]
- need self.metadata with BaseProcessingFail
- pass feed_url into ProcessMedia run()
Rodney Ewing [Mon, 19 Aug 2013 19:58:00 +0000 (12:58 -0700)]
-update to latest master
- have mg generate task_id
remove
Sebastian Spaeth [Thu, 20 Dec 2012 13:09:02 +0000 (14:09 +0100)]
Remove specific celery version requirement
Any celery above 2.5 should work just fine.
Sebastian Spaeth [Thu, 20 Dec 2012 13:03:16 +0000 (14:03 +0100)]
Switch deprecated BROKER_HOST to new BROKER_URL
People will need to switch that setting in their mediagoblin.ini too.
Make sure we RELEASE NOTE this.
Signed-off-by: Sebastian Spaeth <Sebastian@SSpaeth.de>
Sebastian Spaeth [Thu, 20 Dec 2012 12:42:37 +0000 (13:42 +0100)]
Tweak Celery Task
- Make sure Exceptions are pickleable (not sure if this was not the
case but this is the pattern as documented in the celery docs.
- Don't create a task_id in the GMG code, but save the one
implicitely created by celery.
- Don't create a task-id directory per upload. Just store queued uploads
in a single directory (this is the most controversial change and might
need discussion!!!)
Signed-off-by: Sebastian Spaeth <Sebastian@SSpaeth.de>
Rodney Ewing [Mon, 19 Aug 2013 21:33:07 +0000 (14:33 -0700)]
-skip persona test is requests is not installed
- should use request.urlgen for location
Alon Levy [Fri, 16 Aug 2013 08:23:22 +0000 (11:23 +0300)]
media_confirm_delete: redirect to next, then prev, then user home
Instead of redirecting directly to user's home. Makes the flow for mass or just
a few deletions easier. For really large deletions it would still make sense to
have a dedicated view, but this is still way better then losing context by
jumping back to the home view.
Signed-off-by: Alon Levy <alon@pobox.com>
Rodney Ewing [Fri, 16 Aug 2013 22:08:21 +0000 (15:08 -0700)]
make sure size is a tuple
Rodney Ewing [Thu, 15 Aug 2013 19:40:19 +0000 (12:40 -0700)]
Keep the best quality file if there's no original
Rodney Ewing [Thu, 15 Aug 2013 16:29:11 +0000 (09:29 -0700)]
for some reason, the minimum thumbnail size for videos is 100 x 100
Rodney Ewing [Thu, 15 Aug 2013 15:54:09 +0000 (08:54 -0700)]
refactor get_orig_filename to return an acceptable filename to the processor.
If there is an original video file and we skip transcoding, delete the webm_640 file
Rodney Ewing [Thu, 15 Aug 2013 15:11:29 +0000 (08:11 -0700)]
make medium dimensions a tuple
Rodney Ewing [Thu, 15 Aug 2013 15:10:00 +0000 (08:10 -0700)]
check medium_size arg in skip_transcoding, not config
Rodney Ewing [Wed, 14 Aug 2013 23:39:01 +0000 (16:39 -0700)]
only try and delete queue file if it exists
Rodney Ewing [Wed, 14 Aug 2013 23:30:52 +0000 (16:30 -0700)]
use thumb_size
Rodney Ewing [Wed, 14 Aug 2013 23:25:44 +0000 (16:25 -0700)]
include a thumb_size string with each Resizer to run gmg reprocess thumbs
Rodney Ewing [Wed, 14 Aug 2013 23:07:27 +0000 (16:07 -0700)]
typos
Rodney Ewing [Wed, 14 Aug 2013 23:06:14 +0000 (16:06 -0700)]
add quality and filter args to image processors
Rodney Ewing [Wed, 14 Aug 2013 22:11:03 +0000 (15:11 -0700)]
forgot to add the ascii resizer to the list of processors
Rodney Ewing [Wed, 14 Aug 2013 21:54:10 +0000 (14:54 -0700)]
catch processing exceptions and if entry_orig_state is processed, then ignore the exception
Rodney Ewing [Wed, 14 Aug 2013 20:47:39 +0000 (13:47 -0700)]
raise an error if the file failed to copy to public storage
catch copy_local_to_storage errors and raise PublicStoreFail, saving the keyname
Rodney Ewing [Wed, 14 Aug 2013 20:06:08 +0000 (13:06 -0700)]
force thumbnail creation of audio
Rodney Ewing [Wed, 14 Aug 2013 19:41:03 +0000 (12:41 -0700)]
size should be a tuple
Rodney Ewing [Wed, 14 Aug 2013 19:25:49 +0000 (12:25 -0700)]
rewind the file to the begining
Rodney Ewing [Wed, 14 Aug 2013 19:13:06 +0000 (12:13 -0700)]
-scale-to only takes 1 size, so choose the smallest
Rodney Ewing [Wed, 14 Aug 2013 18:34:31 +0000 (11:34 -0700)]
include '.png' in filename
Rodney Ewing [Wed, 14 Aug 2013 18:00:05 +0000 (11:00 -0700)]
oops, localized_file not local_file
Rodney Ewing [Wed, 14 Aug 2013 17:58:31 +0000 (10:58 -0700)]
use a tmp_pdf filename
Rodney Ewing [Wed, 14 Aug 2013 17:52:37 +0000 (10:52 -0700)]
don't include the '.' in the ext
Rodney Ewing [Wed, 14 Aug 2013 17:47:04 +0000 (10:47 -0700)]
forgot to change __init__ for new processing managers
Rodney Ewing [Wed, 14 Aug 2013 17:41:16 +0000 (10:41 -0700)]
Cleanup image common processor
Rodney Ewing [Wed, 14 Aug 2013 17:40:14 +0000 (10:40 -0700)]
added resizer for stl media
Rodney Ewing [Wed, 14 Aug 2013 17:38:13 +0000 (10:38 -0700)]
Added initial stl processor
Rodney Ewing [Wed, 14 Aug 2013 16:46:44 +0000 (09:46 -0700)]
add reprocess_manager to __init__
Rodney Ewing [Wed, 14 Aug 2013 16:40:47 +0000 (09:40 -0700)]
Use workbench for temp files, refactor _set_pdf_filename, and correct imports
Rodney Ewing [Wed, 14 Aug 2013 16:13:25 +0000 (09:13 -0700)]
added pdf Resizer
Rodney Ewing [Wed, 14 Aug 2013 16:09:35 +0000 (09:09 -0700)]
Added pdf Initial processor
Rodney Ewing [Wed, 14 Aug 2013 00:42:42 +0000 (17:42 -0700)]
added file argument to video resizer and added ascii resizer
Rodney Ewing [Wed, 14 Aug 2013 00:32:59 +0000 (17:32 -0700)]
Added initial processor for ascii media
Rodney Ewing [Tue, 13 Aug 2013 20:40:16 +0000 (13:40 -0700)]
added video transcoder
Rodney Ewing [Tue, 13 Aug 2013 20:31:48 +0000 (13:31 -0700)]
Added thumbnail resizer for video
Rodney Ewing [Tue, 13 Aug 2013 20:27:51 +0000 (13:27 -0700)]
use type=float for audio vorbis quality
Rodney Ewing [Tue, 13 Aug 2013 20:19:52 +0000 (13:19 -0700)]
Added Initial processor for video
Rodney Ewing [Tue, 13 Aug 2013 18:42:42 +0000 (11:42 -0700)]
added audio reprocessing transcoder
Rodney Ewing [Tue, 13 Aug 2013 18:34:05 +0000 (11:34 -0700)]
just use the default quality when creating a thumbnail or spectrogram
Rodney Ewing [Tue, 13 Aug 2013 18:30:18 +0000 (11:30 -0700)]
add audio thumbnail and spectrogram resizer
Rodney Ewing [Tue, 13 Aug 2013 18:29:44 +0000 (11:29 -0700)]
fetch spectrogram for thumbnail creation, create spectrogram if not found
Rodney Ewing [Tue, 13 Aug 2013 18:02:36 +0000 (11:02 -0700)]
forgot nargs=2
Rodney Ewing [Tue, 13 Aug 2013 17:51:21 +0000 (10:51 -0700)]
audio processing code cleanup
Rodney Ewing [Tue, 13 Aug 2013 17:36:30 +0000 (10:36 -0700)]
should store file as webm_audio instead of medium
Rodney Ewing [Tue, 13 Aug 2013 17:32:40 +0000 (10:32 -0700)]
media:thumb not medium:thumb :)
Rodney Ewing [Tue, 13 Aug 2013 17:28:12 +0000 (10:28 -0700)]
use name_builder with store_public, not create_pub_filepath
Rodney Ewing [Tue, 13 Aug 2013 17:13:26 +0000 (10:13 -0700)]
common_setup() must be the first processing step
Rodney Ewing [Tue, 13 Aug 2013 16:57:35 +0000 (09:57 -0700)]
Audio Initial Processor
Rodney Ewing [Mon, 12 Aug 2013 22:48:40 +0000 (15:48 -0700)]
remove old code
Rodney Ewing [Mon, 12 Aug 2013 22:45:09 +0000 (15:45 -0700)]
bulk_run reprocessing complete
Rodney Ewing [Mon, 12 Aug 2013 22:25:52 +0000 (15:25 -0700)]
Resize all processed thumbs
Rodney Ewing [Mon, 12 Aug 2013 21:57:45 +0000 (14:57 -0700)]
wrap get_entry_and_processing_manager in try, except block
Rodney Ewing [Mon, 12 Aug 2013 21:54:02 +0000 (14:54 -0700)]
run initial processing on all failed entries
Rodney Ewing [Mon, 12 Aug 2013 21:28:03 +0000 (14:28 -0700)]
add bulk_run, thumbs, and initial sub_commands
Rodney Ewing [Mon, 12 Aug 2013 18:57:47 +0000 (11:57 -0700)]
remove ProcessingState
Rodney Ewing [Mon, 12 Aug 2013 18:55:00 +0000 (11:55 -0700)]
delete existing file in store_public
Rodney Ewing [Mon, 12 Aug 2013 18:37:59 +0000 (11:37 -0700)]
Add image resizer and some cleanup of old code
Christopher Allan Webber [Mon, 12 Aug 2013 16:57:52 +0000 (11:57 -0500)]
Fix (by Rodney Ewing) for processing, specifically the way resize_tool was being called
Thanks for fixing, Rodney :)
Christopher Allan Webber [Mon, 12 Aug 2013 16:40:55 +0000 (11:40 -0500)]
Don't forget to run copy_original()! That's critical!
This commit sponsored by Tony Schmidt. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 16:27:43 +0000 (11:27 -0500)]
Fixing ./bin/gmg reprocess available, which I broke :)
Christopher Allan Webber [Mon, 12 Aug 2013 16:19:20 +0000 (11:19 -0500)]
Trying to fix the bug that's happening to rodney757 but not to me ;)
Christopher Allan Webber [Mon, 12 Aug 2013 16:13:00 +0000 (11:13 -0500)]
Revert "use parser.parse_known_args() instead of parser.parse_args()"
This reverts commit
029e779c468ba1a6bfd893679cfaae7f418f45dd.
(and a bit more!)
This wasn't needed anymore because we did a "rest" capture and passed
that over to the reprocess run command.
Conflicts:
mediagoblin/gmg_commands/assetlink.py
mediagoblin/gmg_commands/dbupdate.py
mediagoblin/gmg_commands/import_export.py
mediagoblin/gmg_commands/users.py
Christopher Allan Webber [Mon, 12 Aug 2013 16:00:15 +0000 (11:00 -0500)]
Fixing normal submission of media (well for images anyway)
Christopher Allan Webber [Mon, 12 Aug 2013 15:53:15 +0000 (10:53 -0500)]
A couple of fixes to stupid things I did while coding this. And it WORKS!
This commit sponsored by José María Serralde Ruiz. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 15:48:07 +0000 (10:48 -0500)]
Fixing the MediaProcessor context manager so it actually, you know, works :)
This commit sponsored by Mikiya Okuno. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 15:40:07 +0000 (10:40 -0500)]
Theoretically the last steps to get reprocessing working for initial & images
Haven't tested it yet though :)
This commit sponsored by Samuel Bächler. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 13:57:56 +0000 (08:57 -0500)]
Factored the get_orig_filename from processing state and put it to use.
This commit sponsored by Vincent Demeester. Thank you!
Christopher Allan Webber [Mon, 12 Aug 2013 13:22:14 +0000 (08:22 -0500)]
Record the original state of the media entry in the processor
This allows our processor to make some informed decisions based on the
state by still having access to the original state.
This commit sponsored by William Rico. Thank you!
Christopher Allan Webber [Sun, 11 Aug 2013 21:53:37 +0000 (16:53 -0500)]
Marking the initial steps for processing
Christopher Allan Webber [Sun, 11 Aug 2013 20:22:43 +0000 (15:22 -0500)]
Renaming the processing manager stuff to be less ambiguous.
BONUS COMMIT to Ben Finney and the Free Software Melbourne crew. :)
IRONY: Initially I committed this as "media manager".
Christopher Allan Webber [Sun, 11 Aug 2013 19:48:21 +0000 (14:48 -0500)]
That manager.process() line no longer made sense
Christopher Allan Webber [Sun, 11 Aug 2013 19:34:45 +0000 (14:34 -0500)]
Updating to the point where we can allllmost run with the new reprocessing code
This commit sponsored by Odin Hørthe Omdal. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 22:30:52 +0000 (17:30 -0500)]
Should be enough to get to the point where you can actually initialize a processing command now.
However, it doesn't celery task-ify it...
This commit sponsored by Catalin Cosovanu. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 21:12:06 +0000 (16:12 -0500)]
Steps toward working "run" reprocessing command.
This commit sponsored by Philippe Casteleyn. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 19:15:18 +0000 (14:15 -0500)]
Moving celery setup to the right place
This commit sponsored by Jose Manuel Zueco Lazaro. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 19:10:52 +0000 (14:10 -0500)]
Whitespacin' it up.
Christopher Allan Webber [Fri, 9 Aug 2013 18:56:23 +0000 (13:56 -0500)]
`gmg reprocess available --action-help` now tells you processor arguments!
Every reprocessing action possible can inform you of its command line
argument stuff! Is that awesome or what?
Christopher Allan Webber [Fri, 9 Aug 2013 17:13:53 +0000 (12:13 -0500)]
"initial" reprocessing subcommand now works!
We are on our way now to a working reprocessing system under this
redesign!
This commit sponsored by Bjarni Rúnar Einarsson. Thank you!
Christopher Allan Webber [Fri, 9 Aug 2013 16:20:21 +0000 (11:20 -0500)]
More progress towards the new reprocessing infrastructure: args updating
This commit sponsored by Elizabeth Webber. Thanks, sis!