pictuga
/
morss
1
1
Fork 0
Code Issues Pull Requests Actions Packages Releases Activity
995 Commits
1 Branch
2 Tags
3.5 MiB
Commit Graph

187 Commits (8e9cc541b0145c83f779df83991148721d982bec)

Author SHA1 Message Date
pictuga ae7ba458ce README fixes 2020-10-03 20:56:40 +02:00
pictuga bd0bca69fc crawler: ignore ssl via env var 2020-10-03 19:57:08 +02:00
pictuga 8abd951d40 More sensible default values for cache autotrim (1k entries, 1min) 2020-10-03 19:55:57 +02:00
pictuga 5cd6c22d73 Reorganise the README file 2020-10-01 22:25:53 +02:00
pictuga e1b41b5f64 Typo in README 2020-10-01 00:18:48 +02:00
pictuga 6192ff4081 gunicorn with --preload 
To only load the code once (and start autotrim once)
 2020-10-01 00:05:39 +02:00
pictuga eed949736a crawler: add ability to limit cache size 2020-09-30 23:59:55 +02:00
pictuga b290568e14 README: decent line length 
Obtained from the output of:
python -m morss --help | cat
 2020-09-15 23:01:42 +02:00
pictuga 9ecf856f10 Add :resolve to remove (some?) tracking links 2020-09-15 22:57:52 +02:00
pictuga 504ede624d Logo CC BY-NC-SA 4.0 2020-09-03 13:17:58 +02:00
pictuga d57f543c7b README: remove todo 2020-08-24 21:17:31 +02:00
pictuga fba112147c README: make it clear that the internal server is _very_ basic 2020-08-24 21:14:48 +02:00
pictuga 8697c3f0df Remove remaining --debug from README 2020-08-24 19:39:27 +02:00
pictuga 598a2591f1 Dockerfile: remove confusing one-liner code 2020-08-23 18:59:16 +02:00
pictuga e76ab2b631 Update gunicorn instructions 2020-08-23 18:59:02 +02:00
pictuga 0d62a7625b Define http port via env vars as well 2020-08-23 18:50:18 +02:00
pictuga 4dfebe78f7 Pick caching backend via env vars 2020-08-23 18:43:18 +02:00
pictuga 0ac590c798 Set MAX_/LIM_* settings via env var 2020-08-23 16:09:58 +02:00
pictuga fa1b5aef09 Instructions for DEBUG= use 2020-08-23 15:31:11 +02:00
pictuga 7f6309f618 README: :silent was explained twice 2020-08-23 14:34:04 +02:00
pictuga f65fb45030 :debug completely deprecated in favour of DEBUG= 2020-08-23 14:33:32 +02:00
pictuga 7a560181f7 Use env var for DEBUG 2020-08-23 14:23:45 +02:00
pictuga f79938ab11 Add :silent to readme & argparse 2020-08-22 00:02:08 +02:00
pictuga bd182bcb85 Move cli code to argParse 
Related code changes (incl. :format=xyz)
 2020-08-21 23:52:56 +02:00
pictuga c628ee802c README: add docker-compose instructions 2020-07-13 20:50:39 +02:00
pictuga f18a128ee6 Change :first for :newest 
i.e. toggle default for the more-obvious option
 2020-07-06 19:25:17 +02:00
pictuga 15951d228c Add :first to NOT sort items by date 2020-07-06 11:39:08 +02:00
pictuga 038f267ea2 Rename :theforce into :force 2020-05-13 11:49:15 +02:00
pictuga b6000923bc README: clean up deprecated code 2020-04-28 22:31:11 +02:00
pictuga 27a42c47aa morss: use final request url 
Code is not very elegant...
 2020-04-28 22:30:21 +02:00
pictuga c186188557 README: warning about lxml installation 2020-04-28 21:58:26 +02:00
pictuga 4a9b505499 README: update python lib instructions 2020-04-27 18:12:14 +02:00
pictuga 41a63900c2 README: improve docker instructions 2020-04-19 13:01:08 +02:00
pictuga ec8edb02f1 Various small bug fixes 2020-04-19 12:54:02 +02:00
pictuga 4ce3c7cb32 Small code clean ups 2020-04-19 12:50:05 +02:00
pictuga 7e45b2611d Disable multi-threading 
Impact was mostly negative due to locks
 2020-04-19 12:29:52 +02:00
pictuga 4f44df8d63 Make all ports default to 8080 2020-04-18 17:15:59 +02:00
pictuga 497c14db81 Add dockerfile & how to in README 2020-04-18 17:04:44 +02:00
pictuga 4a2ea1bce9 README: add gunicorn instructions 2020-04-15 22:31:21 +02:00
pictuga bffb23f884 README: how to use cli 2020-04-14 18:21:32 +02:00
pictuga 59139272fd Auto-detect the location of www/ 
Either ../www or /usr/share/morss
Adapted README accordingly
 2020-04-14 18:07:19 +02:00
pictuga 39b0a1d7cc setup.py: fix deps & files 2020-04-14 17:36:42 +02:00
pictuga f3d1f92b39 Detect encoding everytime 2020-04-07 10:38:36 +02:00
pictuga 0ae0dbc175 README: mention csv output 2020-04-07 09:24:32 +02:00
pictuga f1d0431e68 morss: drop :html, replaced with :reader 
README updated accordingly
 2020-04-07 09:23:29 +02:00
pictuga 31cac921c7 README: remove ref to iTunes 2020-04-05 22:20:33 +02:00
pictuga d90756b337 morss: drop 'keep' option 
Because the Firefox behaviour it is working around is no longer in use
 2020-04-05 16:37:27 +02:00
pictuga 4a88886767 morss: get_page to act as a basic proxy (for iframes) 2020-04-04 16:37:15 +02:00
pictuga ae3bd58386 README: clarify newsreader hook syntax 2020-03-20 11:43:19 +01:00
pictuga e3be9b5a9e README: improve layout 2020-03-20 11:41:43 +01:00
pictuga f8c09af563 README: improve syntax highlighting 2020-03-20 11:33:52 +01:00
pictuga 48beeede97 README: update cache part 2020-03-20 11:27:05 +01:00
pictuga b3b90c067a morss.py: remove "useless" functions 
Have to keep the code clean
 2020-03-20 11:19:06 +01:00
pictuga a1c8093b6e README: improve md layout 2020-03-19 23:06:25 +01:00
pictuga e681dd56c2 README: reflect new code location 2020-03-19 23:04:21 +01:00
pictuga ab145813d6 README: remove ref to dropped deps 2020-03-18 16:48:07 +01:00
pictuga 9dbe061fd6 Remove markdown-related code 
Time to clean up the code and stop with those non-core features
They just make the code harder to maintain
 2020-03-18 16:47:00 +01:00
pictuga 4536902530 README: make new licence clear 2018-11-11 16:13:32 +01:00
pictuga 3c09dbdf31 README: list some non-obvious features 2018-09-30 21:56:30 +02:00
pictuga ba673392d7 README: test website no longer online 2018-09-30 21:56:03 +02:00
pictuga d091e74d56 crawler: add MySQL backend 
With extra dependency
 2017-11-04 14:51:41 +01:00
pictuga e0092387b1 Add "six" as a requirement in README 
Actually a dependency of "chardet", but since people (including me) might just send file onto their server instead of installing the libs properly, it's a nice reminder (not in requirements.txt since that one is automatic)
 2017-07-30 16:58:53 +02:00
pictuga d3bc2926fc Remove :hungry 
Mostly usless. If you need it, you might as well not need to use morss in the first place...
 2017-03-25 13:52:58 -10:00
pictuga 6024728341 README: mention / > | in webserver 2017-03-20 21:05:40 -10:00
pictuga c929ce6278 README: update about options.items 2017-03-20 21:02:25 -10:00
pictuga beec6469cc README: link to todo-list 2017-03-18 22:38:50 -10:00
pictuga 10fef6be4e README: "update" markdown format 
Thanks GitHub for changing what you accept
 2017-03-18 22:36:32 -10:00
pictuga 3385198f4f README: remove removed :force 2017-03-08 19:20:43 -10:00
pictuga 92b4a5c57c README: remove :smart doc as it was dropped 2017-03-08 17:38:00 -10:00
Florian Muenchbach 543ae89e22 Added new 'encoding' option to README. 2017-03-08 17:38:00 -10:00
pictuga 795a0b281f README: add wheezy.template as dep 2017-03-08 15:25:45 -10:00
pictuga af66ab5980 README: simplify the sample file tree for mod_cgi 
So that it never gets outdated again...
 2017-03-08 15:21:26 -10:00
pictuga fe3f6b7e33 README: Fetch->FeedFetch 2017-03-08 15:17:40 -10:00
pictuga 2b4269e1ac README: add chardet 2017-03-08 11:45:13 -10:00
pictuga 52661985d1 Remove one more readability fork reference 2017-02-28 19:25:59 -10:00
pictuga 47d33099b2 Remove readability fork from deps 
Since we now use our own, faster, implementation
 2017-02-28 19:21:51 -10:00
pictuga 466d8e47d6 Also make buriy's readability port compatible 
Should be faster, and it now supports py3
 2015-08-29 18:33:12 +02:00
pictuga 9b911213b6 Convenient README update 
Break lines, update info, say something about uwsgi
 2015-08-29 12:45:36 +02:00
pictuga 554bdb4650 Fix "typo" in README 2015-08-29 12:32:40 +02:00
pictuga 5a9d3ff0bd Add xpath idea to README 2015-05-04 22:23:08 +08:00
pictuga ec7184b8f6 README: python3 supported 2015-04-07 19:01:41 +08:00
pictuga 32aa96afa7 Cache HTTP content using a custom Handler 
Much much cleaner. Nothing comparable
 2015-04-06 23:26:12 +08:00
pictuga b3572e143d New way of calling the program 
python -m morss, python morss/main.py
 2015-03-11 14:23:14 +08:00
pictuga 6ae60d0343 2to3: py3-compatible readability fork 2015-03-03 01:03:03 +08:00
pictuga 7a66115012 README: use py -m morss.morss 
Needed for 2to3 relative imports
 2015-02-25 11:56:34 +08:00
pictuga d5269964fc Make :theforce also bypass http errors 2015-02-21 01:58:16 +08:00
pictuga ef946c0712 XML pretty-print in separate option 
Who reads plain XML anyway?
 2015-02-20 17:38:39 +08:00
pictuga f46576168a Add :mono to disable multithreading 
Convenient to have linear logging
 2014-11-10 23:14:54 +01:00
pictuga c5e3aa664a Update README after After split 2014-11-08 20:32:34 +01:00
pictuga dedb7fa5a4 Add :smart to README 2014-11-07 18:42:57 +01:00
pictuga aed2a9bdd3 Add new options to README 2014-11-07 10:20:33 +01:00
pictuga 5f8288eecb Add :hungry to fill feeds with long intros 2014-06-28 01:43:31 +02:00
pictuga 484432d804 Add :callback for JSONP calls 2014-06-28 00:59:57 +02:00
pictuga 226441d821 Add :cors for cross-domain XHR (with README update) 2014-06-28 00:59:13 +02:00
pictuga 230659a34b Reenable args with values 2014-06-28 00:58:37 +02:00
pictuga 3c859423b3 Add requirements, edit setup.py and README 2014-06-21 16:38:48 +02:00
pictuga 3fbeb892ca Fix typo in README 2014-06-21 16:30:18 +02:00
pictuga 7211093cc5 Add :smart :noref modes, update README 2014-06-16 14:00:02 +02:00
pictuga 814ff46fbd README: explanation of what morss.process is 2014-05-24 19:17:58 +02:00
pictuga 1728e3902c README: cache no longer mandatory 2014-05-24 19:14:12 +02:00