Skip to content

Releases: hoarder-app/hoarder

0.19.0

09 Nov 16:22
@MohamedBassem MohamedBassem
v0.19.0
0f59cb6
Compare
Choose a tag to compare
0.19.0 Latest
Latest

Welcome to the 0.19.0 release of Hoarder! This release is packed with a lot of new features! The long awaited REST APIs, RSS subscriptions, AI summarization, Image OCR, archiving videos, importing from Omnivore, and more!

If you're enjoying Hoarder, you can consider supporting it here ☕️.

New Feature

  • RSS Subscriptions 🧪: You can now subscribe to RSS feeds and Hoarder will automatically pull them every hour.
    • You can use this to auto hoard stuff from your favourite blogs, subreddits, or youtube channels.
    • This feature is still experimental and haven't been tested on a a wide variety of feeds. Please file issues whenever you face any problems using it.
  • The long awaited REST API is here. You can view the API docs here.
    • You can view the OpenAPI spec here in case you want to generate clients for it. I'm planning to offer an official Typescript SDK some time in the future.
  • AI Summarization: Hoarder now has the ability to generate summaries for the links that you hoard! Check the screenshots section to see it in action.
    • Currently, summarization is a manual action. In the future, we'll add support for auto summarization.
  • Video downloads: For ultimate hoarding, Hoarder now has the ability to download videos from the links that you hoard (e.g. youtube) thanks to @kamtschatka.
    • Given that videos can be huge, this is an opt-in feature. You can enable it with CRAWLER_VIDEO_DOWNLOAD=true. Find more configuration options here.
    • Hoarder uses ytdl under the hood, and you can find their list of supported files here.
  • Omnivore Imports: Omnivore is shutting down. You can now import your bookmarks from Omnivore into Hoarder. Check the documentation here.
  • User Management: Admins can now reset user passwords, change their roles and even create new users thanks to @kamtschatka.
  • Image OCR: Hoarder will now attempt to read and index text in the images that you hoard! Check the configuration variables here.
  • Others:
    • @kamtschatka Added authentication failure logging in case you want to configure fail2ban against hoarder logs.

UX Improvements

  • We have a new redesigned settings page to better support the new options we're adding. Check it out in the screenshot section.
  • You can use Cmd/Ctrl + K to quickly focus on Hoarder's searchbar.
  • We reverted the mobile apps to again view webpages inline, but now added buttons for quick actions underneath it.

Fixes

  • Single new lines in notes were getting lost in markdown. @kamtschatka fixed that.
  • Pocket switched their export format to CSVs instead of their old format. Hoarder now supports importing the new format.
  • Tags that had numbers or dashes in them were getting skipped, this is now fixed. Thanks @MakeSomeGood for the bug report and investigation!
  • The All Tags page was getting very slow when there's a lot of tags. This turned out to be a small misconfiguration in the database that we fixed.
  • Custom prompts had a max length of 100, which wasn't enough to some people. The new limit is 500.

Screenshots

AI Summarization

Screen.Recording.2024-11-09.at.4.12.35.PM.mov

RSS Feeds & New Settings Page

Screenshot 2024-11-09 at 4 11 59 PM

Admin User Management

Screenshot 2024-11-09 at 4 15 47 PM

Upgrading

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Contributors

bjornmonnens, MohamedBassem, and 3 other contributors
Assets 2
Loading
0 Join discussion

0.18.0

13 Oct 14:50
@MohamedBassem MohamedBassem
v0.18.0
43ed698
Compare
Choose a tag to compare
0.18.0

Welcome to the 0.18.0 release of Hoarder! This release introduces customizable tagging rules (aka customizing the prompt), new UI look, selective full page archives, infinite scrolling, more bulk actions and more! As usual, we'd like to welcome our first time contributors @jarednipper, @Trugamr, @cedmax and @CrypticC3s4r! We also have @lucius346346 working behind the scene on improving the UX of Hoarder with amazing designs! And finally, we have our usual contributors @kamtschatka and @mdsaban! Also thanks to @Papierkorb for the help in suggestions to improve the LLM prompt!

We also now have a public roadmap which you can check for the features that we're planning to deliver here. Go upvote the features that you're waiting for!

If you're enjoying Hoarder, you can consider supporting it here ☕️.

New Feature

  • Introducing customizable tagging rules: You can now customize the prompt that we use to generate the tags to your linkings and add custom rules for the LLM to adhere to!
    • You can use this to define your tagging rules in natural language and let the LLM take care of applying it.
  • If you don't want to enable "Full page archives" by default, you can now selectively archive particular pages that you want to keep forever thanks to @kamtschatka!
  • You can now export your bookmarks from Hoarder and re-import them back in another instance (note: currently images and pdfs are not exported).
  • You can now customize the context length of the inference model using the INFERENCE_CONTEXT_LENGTH flag:
    • The bigger this value is, the more of your content the model will see and will be able to give you better tagging.
    • However, the bigger the context window, the more expensive the request is for OpenAI money-wise and for ollama resource-wise.
    • The current default is 2048 tokens (~2048 words).
  • Better asset tracking and management:
    • We're now currently correctly accounting for all asset sizes in the database. You can view the usage of every user now in the admin panel.
    • Old assets are not automatically accounted for and you'll have to click the new Compact Asset button in the admin panel to backfill that data. This button also removes assets that are dangling (aka not linked to any bookmark).
    • This work is in preparation for supporting better privacy checks in the future when we implement public and collaborative lists.
  • You can now attach custom image banners to your notes.
    • Those banners will appear at the top of your notes when you expand them as well as in the List layout.
    • We're still figuring out a good way to render them in the grid and masonry layouts.

UX Improvements

  • We have a refreshed UI looks thanks to amazing designs by @lucius346346!
    • We now have a sticky navbar for better experience in bulk editing thanks to @mdsaban.
    • We also have a new profile options dropdown in the header where the user and admin settings buttons got moved to.
  • We now have infinite scrolling for pagination so that you no longer need to click the Show more button.
  • Bulk actions improvements:
    • There's now a Select all button to select all the currently visible bookmarks.
    • Copy links is also a thing to bulk copy the source links of a bunch of bookmarks thanks to @kamtschatka.
  • You can now trigger AI tag regeneration for all bookmarks or the ones that that failed only in the admin panel.
  • When you hoard text from other webpages by the extension (by highlighting text -> right click -> add to hoarder) the source link will now be preserved with the text.
  • We have a new tabbed user settings page as it was getting quite long.
  • Sidebar items were not clickable around the boarder which was annoying. @Trugamr fixed that!

Fixes

  • For those who want to go all-in on Oauth, you can now set DISABLE_PASSWORD_AUTH=true which will forbid any password-based authentication/signup. This is implemented by @kamtschatka.
  • The All Tags page was taking too long to load when you have too many tags. @kamtschatka landed some improvements to the performance of this page.
  • Editing lists from the sidebar was broken, now it's fixed.
  • When you wipe your hoarder's database while still logged in the browser, users were getting some confusing behavior with confusing database errors. This is now fixed, and hoarder will automatically log you out if your account is no longer there.
  • @Mxrk Added docker healthchecks to the dockerfile and also source label so that hoarder's updates can be correctly reflected in stuff like renovate.

Screenshots

The new UI Look

Screenshot 2024-10-13 at 3 16 59 PM

Profile Options

Screenshot 2024-10-13 at 3 49 02 PM

AI Settings and Tagging Rules

Screenshot 2024-10-13 at 3 18 55 PM

New Import/Export Buttons

Screenshot 2024-10-13 at 3 19 46 PM

Num Bookmarks & Asset Sizes in Admin Panel

Screenshot 2024-10-13 at 3 22 13 PM

New Admin Actions

Screenshot 2024-10-13 at 3 22 21 PM

Upgrading

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Read more

Contributors

jarednipper, cedmax, and 9 other contributors
Assets 2
Loading
1 Join discussion

0.17.1

27 Sep 08:41
@MohamedBassem MohamedBassem
v0.17.1
7cc2f8b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
0.17.1

This is a small hotfix for the 0.17.0 release.

🐞 Fixes

  • When importing bookmarks from a netscape html file, there was a bug that would result in the importing bookmarks getting all of your tags. This is fixed in 12d3371 & 4db50c2.
  • A "name" is no longer required from SSO providers. @kamtschatka fixed that in e1feece.

Contributors

kamtschatka
Assets 2
Loading

0.17.0

22 Sep 16:25
@MohamedBassem MohamedBassem
v0.17.0
d0e7ca2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
0.17.0

Welcome to the 0.17.0 release of Hoarder. We have a bunch of new features and UX improvements including SSO support (finally), bulk tag/list actions, better bookmark importing experience, and bunch of other stuff. In this release, we're welcoming @nghduc97 and @Mxrk as first time contributors!

If you're enjoying Hoarder, you can consider supporting it here ☕️.

New Features

  • Single Sign On (SSO) support is finally here for OIDC compliant providers. This was the most requested feature and it's now here thanks to @kamtschatka. You can read about how to configure it here.
  • We've done multiple improvements to the bookmark importing experience:
    • Bookmark importing now live in the settings page.
    • You can now import bookmarks from a Pocket export.
    • Imported bookmarks will keep their title, tags and creation date.
    • A new list will be created that will include all your newly imported bookmarks. You can remove/rename this list after making sure that everything went according to plan.
  • You can now customize the banner image for links and manipulate all its other attachments in the bookmark preview page.
  • You can now bulk add/remove tags and lists to bookmarks.
  • Some mobile app improvements:
    • In case you were facing issues connecting to hoarder from the app, there's now a "Connection testing" functionality that shows you a more descriptive issue about the problem you're hitting.
    • The app was by default following the theme (e.g. light/dark mode) of the system. You can now configure explicitly the theme that you want in the settings.
    • There's a new floating quick add button to quickly save new bookmarks from within the app.
  • For ollama users, you can now configure the timeout of the inference worker in case ollama's responses are slow. You can also configure a model keep alive TTL so that ollama can drop the model from memory if it's not used for that configure period.
  • We have a new compact layout to quickly skim through your bookmarks.

UX Improvements

  • In the tags editor, you can now quickly remove the last tags by pressing backspace.
  • The tags editor will now feel much faster by optimistically applying the changes before they are committed on the server.
  • On the mobile app, server errors (e.g. connection errors) will have a much better UI indicating the problem and giving you an option to retry.
  • Lists are now sorted alphabetically thanks to @kamtschatka.
  • Signup dialog now shows a less confusing message when signups are disabled thanks @nghduc97

Fixes

  • Completely deleting a tag was broken, now it's fixed.

Screenshots

New Mobile Settings Page

Screenshot 2024-09-22 at 4 58 33 PM

Connection Testing

Screenshot 2024-09-22 at 4 52 07 PM

SSO Support

Screenshot 2024-09-22 at 4 52 33 PM

Compact Layout

Screenshot 2024-09-22 at 4 53 46 PM

New Import UI

Screenshot 2024-09-22 at 4 57 14 PM

New Bulk Actions

Screenshot 2024-09-22 at 4 55 52 PM

New Attachments Section

Screenshot 2024-09-22 at 4 55 14 PM

Upgrading

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Contributors

MohamedBassem, Mxrk, and 2 other contributors
Assets 2
Loading
3 Join discussion

0.16.0

31 Aug 18:44
@MohamedBassem MohamedBassem
v0.16.0
a13c552
Compare
Choose a tag to compare
0.16.0

Welcome to the 0.16.0 release of Hoarder. Sorry for the long delay since the last release! We'd like to welcome to our first time contributors @Mxrk, @j-fuentes & @rootly-be!

NOTE: This release is backward compatible with the previous release, but it's highly recommended that you check out the Upgrading section in the release notes.

New Features

  • Deploying Hoarder is now simpler. We're getting rid of two containers in this release:
    • Redis is no longer needed as a dependency and is replaced by a sqlite-backed queue implementation.
    • There's now a new container that acts as both the web and workers container. You no longer need two different hoarder containers.
    • The old images will continue to work just fine for the foreseeable future to make this release backward compatible. Upgrading to the new image is highly recommended though.
  • gpt-4o-mini is now the default OpenAI model. This model is 3X cheaper than the previous default!
  • The mobile app received a bunch of overdue updates:
    • Added the ability to manage bookmark lists from the app.
    • You can now add/remove lists from the app.
    • You can view full notes by tapping on the notes card and you can now edit them as well
    • You can zoom into uploaded images.
    • You can add/view attached notes to bookmarks.
    • There's now a unified editor for new links and notes. Still pretty basic though.
    • You can now configure the image quality of the uploaded images. Keep in mind that for large images, you might want to increase MAX_ASSET_SIZE_MB from the default of 4MB, otherwise, you'll get an Asset too big error.
  • Hoarder's notes now support checklists, tables and auto-links in markdown thanks to @kamtschatka
  • If you have the browser extension installed, you'll find now a new Add to Hoarder button that you can use to send links, texts, images, to hoarder directly. Note: If you're using chrome, you'll need to be on v127 or older. Thanks @kamtschatka!
  • @j-fuentes added kubernetes installation instruction to the wiki.

UX Improvements

  • When renaming bookmark titles or tags, pressing Enter will save the changes.

Fixes

  • Importing a lot of URLs from the UI used to error, this no longer the case thanks @kamtschatka.
  • SVG weren't correctly loading in full page archives using monolith, @kamtschatka fixed it.
  • Bulk deletion confirmation dialog wasn't automatically dismissed after the deletion. This is now fixed by @kamtschatka.
  • On the mobile app, login fails if your server URL had an extra slash at the end. @Mxrk fixed that!

Upgrading

⚠️ If you have ongoing crawlings/inference/indexing jobs in Hoarder, you'll need to re-enqueue them from the admin panel after the upgrade.

As mentioned in the release notes, this release removes the need for the redis container and the worker container. Although the migration is optional given that the old images will work, it's highly recommended, to migrate, you'll need to do the following:

  1. Remove the redis container and its volume if it had one.
  2. Move the environment variables that you've set exclusively to the workers container to the web container.
  3. Delete the workers container.
  4. Rename the web container image from hoarder-app/hoarder-web to hoarder-app/hoarder.

The diff for the compose file will look something like this:

diff --git a/docker/docker-compose.yml b/docker/docker-compose.yml
index cdfc908..6297563 100644
--- a/docker/docker-compose.yml
+++ b/docker/docker-compose.yml
@@ -1,7 +1,7 @@
 version: "3.8"
 services:
   web:
-    image: ghcr.io/hoarder-app/hoarder-web:${HOARDER_VERSION:-release}
+    image: ghcr.io/hoarder-app/hoarder:${HOARDER_VERSION:-release}
     restart: unless-stopped
     volumes:
       - data:/data
@@ -10,14 +10,10 @@ services:
     env_file:
       - .env
     environment:
-      REDIS_HOST: redis
       MEILI_ADDR: http://meilisearch:7700
+      BROWSER_WEB_URL: http://chrome:9222
+      # OPENAI_API_KEY: ...
       DATA_DIR: /data
-  redis:
-    image: redis:7.2-alpine
-    restart: unless-stopped
-    volumes:
-      - redis:/data
   chrome:
     image: gcr.io/zenika-hub/alpine-chrome:123
     restart: unless-stopped
@@ -37,24 +33,7 @@ services:
       MEILI_NO_ANALYTICS: "true"
     volumes:
       - meilisearch:/meili_data
-  workers:
-    image: ghcr.io/hoarder-app/hoarder-workers:${HOARDER_VERSION:-release}
-    restart: unless-stopped
-    volumes:
-      - data:/data
-    env_file:
-      - .env
-    environment:
-      REDIS_HOST: redis
-      MEILI_ADDR: http://meilisearch:7700
-      BROWSER_WEB_URL: http://chrome:9222
-      DATA_DIR: /data
-      # OPENAI_API_KEY: ...
-    depends_on:
-      web:
-        condition: service_started
 
 volumes:
-  redis:
   meilisearch:
   data:

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Contributors

MohamedBassem, Mxrk, and 3 other contributors
Assets 2
Loading
1 Join discussion

0.15.0

06 Jul 11:01
@MohamedBassem MohamedBassem
v0.15.0
d7fff89
Compare
Choose a tag to compare
0.15.0

Welcome to the 0.15.0 release of Hoarder! It's been a while since the previous release, but this release is packed with a lot of new quality of life improvements and features. This releases wouldn't have been possible without the tons of contributions from @kamtschatka, @mdsaban & @AhmadMuj. I also want to welcome our first time contributors @kou029w & @devome. If you're interested in helping us develop hoarder, you can join our #development channel on hoarder's discord.

New Features

  • Bulk actions are now a thing thanks to a contribution from @mdsaban. You can now bulk favourite, archive or delete bookmarks. In the next release, you'll be able to bulk add/remove bookmarks from lists.
  • Full page archival is now here (powered by monolith). This will download everything that's in the page so that you can have an offline copy of that page even if that page disappears from the internet afterwards. The archives are typically quite large, so this feature is disabled by default. If you're a true hoarder, you can enable it with CRAWLER_FULL_PAGE_ARCHIVE=true.
  • When you hoard a URL that points to a pdf or an image, Hoarder will now treat them as pdfs/images instead of links while keeping a reference to their original source. This will also allow automatic tagging to work correctly on those links. (thanks @kamtschatka!)
  • You can now import your chrome bookmarks (or any Netscape compatible bookmark file) by exporting them from chrome, then drag and drop the exported file to hoarder. All links in the export will be imported. (thanks @kamtschatka!)
  • For those hoarding code snippets, @kamtschatka added syntax highlighting to code blocks and a way to quickly copy the block.
  • Hoarder is now available on arch linux's user repo (AUR) and is maintained by @devome. A new wiki page with installation instructions is now available.

UX Improvements

  • @mdsaban revamped how both the user and admin settings pages look like.
  • In the list layout, the editor will expand as you type longer notes thanks to @AhmadMuj.
  • You can now paste images directly in the editor card and they'll get automatically uploaded thanks to @AhmadMuj.

Fixes

  • The layout selector is now more clearly shown above the bookmark grid thanks to @mdsaban.
  • Tags that were added manually were not correctly propagating to the search index. This is now fixed by @kamtschatka. You might want to trigger a reindex from the admin page if you've attached some manual tags.
  • @kamtschatka fixed a long standing bug that prevented firefox users from using the browser extension without a valid HTTPS certificate.
  • The editor card previously allowed you to save empty notes, this has now been fixed by @mdsaban.
  • Increased list name max size to 40 chars up from 20.
  • We previously had an upper limit on note sizes that we removed a while ago. However, we forgot to remove it when editing a note. @AhmadMuj fixed that.
  • The CLI was previously printing invalid JSONs. Now there's a proper JSON mode thanks to @kamtschatka.
  • For CJK environments, there's now a sans-serif fallback font thanks to @kou029w.
  • Automatically inferred tags could have contained an extra space in the beginning of the tag, @kamtschatka fixed that.

Screenshots

Bulk Editing in Action

Screen_Recording_2024-06-26_at_10.46.49_AM.mp4

Revamped Admin Page

image

Revamped Settings Page

image

Full Page Archives

Screenshot 2024-07-06 at 11 47 31 AM

PDF/Image URL recognition

Screen.Recording.2024-07-06.at.11.50.14.AM.mov

Upgrading

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

  • fix(web): Add sans-serif fallback for Inter font in CJK environments (#272) by @kou029w in #72f03b2
  • fix: Renaming full page archive asset file doesn't work inside docker. Fixes #273 by @MohamedBassem in #5e9b04a
  • feat: Add bulk edit option for bookmarks. Fixes #84 (#259) by @mdsaban in #d193d9b
  • fix: fixed an issue that would half the textarea in grid layout after submitting a bookmark (#269) by @kamtschatka in #bf92fa3
  • refactor: fixed typos in BookmarkTypes (#268) by @kamtschatka in #4e70fe3
  • refactor: drag and drop improvements (#264) by @kamtschatka in #9cd6170
  • fix: Increase list name size to max 40 chars up from 20. Fixes #254 by @MohamedBassem in #9883c6b
  • fix: Fix duplicate bookmarks in links with assets by @MohamedBassem in #3d495cd
  • refactor: added the bookmark type to the database (#256) by @kamtschatka in #e648646
  • refactor: remove redundant code from crawler worker and refactor handling of asset types (#253) by @kamtschatka in #ccbff18
  • ui: refactor admin settings page (#249) by @mdsaban in #e107f8b
  • ui: Changes for user settings page (#251) by @mdsaban in #a637130
  • feature: Automatically transfer image urls into bookmared assets. Fixes #246 by @MohamedBassem in #1071095
  • ui(web): move layout selector to main screen (#252) by @mdsaban in #8f0e9b1
  • refactor: extract assets into their own database table. #215 (#220) by @kamtschatka in #9ce6958
  • fix(landing): image width on landing page (#250) by @mdsaban in #0f54a18
  • feature: add support for PDF links. Fixes #28 (#216) by @kamtschatka in #be1b7f7
  • fix(web): Fix save action on empty card. Fixes #225 (#243) by @mdsaban in #ccfff6b
  • ui: Improve landing page for homepage (#238) by @mdsaban in #16f21bf
  • feature(web): Enhance the bookmark textarea in the list layout (#247) by @AhmadMuj in #ac05ecf
  • readme: broken readme links (#233) by @mdsaban in #348bd80
  • fix: Remove the bookmark update text limit (#244) by @AhmadMuj in #671fc32
  • fix(web): text paste bug introduced with image paste (#232) by @mdsaban in #23faf46
  • docs: add Arch Linux installation docs (#223) by @devome in #dc19313
  • feature(web): support pasting image in the Editor Card (#228) by @AhmadMuj in #6823caf
  • release(cli): Bump CLI version to 0.13.5 by @MohamedBassem in #219329b
  • release(cli): Bump CLI version to 0.13.4 by @MohamedBassem in #5f263a3
  • fix(cli): Bookmark list output is not a valid JSON. Fixes #150 (#181) by @kamtschatka in #cde9726
  • refactor: Extract the bookmark polling logic into a separate shared component by @MohamedBassem in #6928800
  • fix: Trigger search re-index on bookmark tag manual updates. Fixes #208 (#210) by @kamtschatka in #546139e
  • feature(web): Add syntax highlighting to code blocks and a quick copy button. Fixes #195 (#197) by @kamtschatka in #be1bb38
  • fix(cli): Fix CLI version in help message. Fixes #139 by @MohamedBassem in #f7a7753
  • feature(extension): Add a context menu to open your hoarder saves. Fixes #188 (#206) by @kamtschatka in #2d0af0b
  • fix(web): Changed the toast to contain a more detailed error message in case the bookmark is already part of the list. Fixes #179 (#213) by @kamtschatka in #049e79d
  • fix(workers): AI infered tags can contain " " at the beginning. Fixes #184 (#194) by @kamtschatka in #be8b91f
  • fix(crawler): Only update the database if full page archival is enabled by @MohamedBassem in #9d89f98
  • docs: Document the new CRAWLER_FULL_PAGE_ARCHIVE flag by @MohamedBassem in #9198c1b
  • feature: Full page archival with monolith. Fixes #132 by @MohamedBassem in #dedc5fb
  • feature: Allow import Netscape HTML format (#163) by @kamtschatka in #033e8a2
  • build: Let the upload-artificat action do the compression by @MohamedBassem in #bb431be
  • release(extension): Bump extension version to 1.2.1 by @MohamedBassem in #8688dd4
  • build: Add a workflow to build the extension by @MohamedBassem in #c9b1307
  • fix(extension): Drop the https restriction in firefox. Fixes #23 by @kamtschatka in #875cc35
  • fix(cli): Switched to cursorV2 to make use of the fix for #140 and prevent infinite loops (#176) by @kamtschatka in #6dc67cf

Contributors

kou029w, MohamedBassem, and 4 other contributors
Assets 2
Loading
8 Join discussion

0.14.0

24 May 00:02
@MohamedBassem MohamedBassem
v0.14.0
eac54e6
Compare
Choose a tag to compare
0.14.0

Welcome to the 0.14.0 release of Hoarder! I want to welcome our two new contributors @kamtschatka who added a bunch of quality of life improvements and @lilacpixel who fixed a bunch of cosmetic issues in Hoarder! I also want to thank @Collectathon who published Hoarder's template on unraid which was a very popular request from unraid users!

Note: You probably want to read the Upgrading section for that release. No breaking changes, but some recommendations are mentioned.

Announcements

  • Hoarder is now available on the unraid store thanks to @Collectathon! The docs now include an unraid installation section here.
  • The iOS app has finally been accepted in the app store (link). Thanks a lot to all the beta testers during that time! You can still continue using TestPilot if you want the latest versions fasters, but you can also now switch to the prod version if you want stability.

New Features

  • Link deduping is here. When adding a link that you've hoarded before, it won't be re-added and instead you'll be prompted to go to your original link. When adding it from the browser extension, the existing bookmark's tags and lists will be shown allowing you to alter them if needed.
    • Note: Unless you're on the latest mobile version, a deduped link will be silently ignored (without any visual indications). Upgrade to the latest version to get a message telling you that it already exists.
  • To quickly merge tags, @kamtschatka added support for dragging and dropping tags on each others to merge them together! To aid with the merging, you can now sort the tags in the "All tags" page by name instead of count.
  • You can now batch add multiple links to the bookmark editor card (one per line) and hoarder will import them in one go.
  • Hoarder can now take full page screenshots (instead of only the top of the page) thanks to @kamtschatka. This is disabled by default as it consumes a lot of space, but can be enabled by setting CRAWLER_FULL_PAGE_SCREENSHOT=true.
  • In the list management dialog, you can now quickly archive a bookmark after adding it to lists. This is useful to those who follow Inbox Zero for their homepage.
  • Hoarder is now using openai's new model gpt-4o by default for image tagging. It's faster and 50% cheaper!

Fixes

  • Local tagging with Ollama is now more robust thanks to @kamtschatka refactoring the prompt a bit so that model doesn't lose context on what the instructions actually are.
  • Bookmarks that were created in the same second (usually as part of a mass import) were sometimes skipped between pages. This is now fixed.
  • A lot of cosmetic touches by @lilacpixel:
    • Clicking on images in the bookmark list now opens the bookmark preview popup.
    • Clicking on an image in the preview popup will open it in full quality in a new browser tab.
    • Long titles used to overflow in modals and in the bookmark grid. This is also fixed by @lilacpixel.
    • The bookmark preview popup's input fields now have full width to better show the available tags.
  • The tags in the tags editor are now sorted lexicographically.

Screenshots

Link Deduping

Screenshot 2024-05-24 at 12 40 28 AM

New Archive Button in "Manage Lists" Dialog

Screenshot 2024-05-24 at 12 41 05 AM

Multi-URL import

Screenshot 2024-05-24 at 12 41 41 AM

Drag and Drop tag merging

Untitled.mov

Upgrading

  • The repo got moved to its own organization, and the docker images unfortunately didn't get moved. which means you might want to update the docker images to the new urls. I'll keep updating the old images for the foreseeable future though. In your docker-compose file, change:
    • ghcr.io/mohamedbassem/hoarder-web to ghcr.io/hoarder-app/hoarder-web
    • ghcr.io/mohamedbassem/hoarder-workers to ghcr.io/hoarder-app/hoarder-workers
  • To improve chrome's stability for large pages, add --disable-dev-shm-usage to the existing list of arguments of the chrome container.

To upgrade:

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

All Commits

Contributors

MohamedBassem, kamtschatka, and 2 other contributors
Assets 2
Loading
0 Join discussion

0.13.1

26 Apr 18:50
@MohamedBassem MohamedBassem
v0.13.1
afefbe3
Compare
Choose a tag to compare
0.13.1

This is a dummy hotfix release for 0.13.0 just to fix the missing docker images for linux/arm64. No changes in the app itself.

Assets 2
Loading

0.13.0

26 Apr 17:54
@MohamedBassem MohamedBassem
v0.13.0
5d805e2
Compare
Choose a tag to compare
0.13.0

Welcome to the 0.13.0 release of Hoarder! This release is packed with a lot of new features to better organize your bookmarks. This includes: Nested lists, tag merging, a new suggested cleanups page, and more! Crawler also now takes screenshots and downloads the banner images locally. The CLI is now more powerful giving you ability to do mass modifications (e.g. archiving/adding to lists) until the mutli-select feature is developed.

Note: You probably want to read the Upgrading section for that release. No breaking changes, but some nice recommendations are mentioned.

Announcements

  • The android app has been finally released on the play store (link)! Thanks a lot to all the beta testers during that time! Go check it out (and maybe give it a review while you're there 😉). The iOS app is still stuck in apple's review queue unfortunately, so you still need to use the beta version for now.
  • The new chrome/firefox extensions allow you to quickly add tags and lists to your newly saved bookmarks!

New Features

  • Nested lists are here! When you're creating a new list, you can choose a parent for that list and it'll be nested under it. The All lists page has been revamped to support showing the list tree.
  • Merging tags is now a thing.
  • A new Cleanups page that will suggest to you ways to cleanup your collection. As a start, it now detects potentially duplicate tags and suggests merging them. Currently, the algorithm is very simple and will detect duplicates if they have different cases (e.g. Chess and chess), and also tags that differ by at most one character (e.g. web-devopment and Web development). The inference job now is also fixed to avoid creating those duplicates in the first place.
    • In the future, tag duplication detection will be able to suggest merging semantically equivalent tags.
  • The crawler now by default downloads the banner images. This is to protect against bookmarked links going away, but also to get around rate limits when you have multiple bookmarks from the same website (e.g. github). This will result into a larger storage space utilization. If you don't care about that, you can disable by setting CRAWLER_DOWNLOAD_BANNER_IMAGE=false.
  • The crawler also will now take screenshots of the website it crawls and allows you to see them in the preview page. The screenshots will also be used as a fallback banner for links that don't have an image. Again, this will use some extra storage, so if you don't want screenshots, you can disable them with CRAWLER_STORE_SCREENSHOT=false.
  • You can now edit lists to change its name or update its parent.
  • You can now see (and manage) all the bookmarks a list is in from the new Manage Bookmarks drop down option.
  • You can now delete tags from the All tags page. The All tags page will also show you the "unused" tags and gives you a quick way to mass delete them.
  • The CLI got a lot of new commands. You can now update bookmarks from the CLI (e.g. to archive or favourite them), and you can add or remove bookmarks from lists. You can have a look on the updates docs page here. Also, you can now get the CLI directly from NPM using npm install -g @hoarderapp/cli. The CLI is very useful for now to do mass actions on your bookmark while we develop the multi-select feature #84.

Fixes

  • When you preview a bookmark (using the maximize button), the address bar of the browser will now show a unique link for that bookmark.
  • The crawler now can correctly find the images in amazon links.
  • The search indexing worker was in some rare cases incorrectly reporting success while it actually failed. This is now fixed.

Screenshots

The new Cleanups page

Screenshot 2024-04-26 at 2 19 02 PM Screenshot 2024-04-26 at 2 17 28 PM

Viewing and mass deleting unused tags

Screenshot 2024-04-26 at 2 18 21 PM

Nested lists

Screenshot 2024-04-26 at 6 41 00 PM Screenshot 2024-04-26 at 5 44 11 PM

The new extension capabilities

image

Quick tag deletion

Screenshot 2024-04-26 at 6 40 31 PM

Viewing the screenshots

Screenshot 2024-04-26 at 7 18 11 PM

Upgrading

  • If you're using HOARDER_VERSION=release, run docker compose pull && docker compose up -d.
  • If you're pinning it to a specific version, upgrade the version and then run docker compose pull && docker compose up -d.

After Ugprading:

  • Now that we're taking screenshots for pages, you'll want to tell chrome to hide scrollbars by adding --hide-scrollbars to the command section under the chrome container. Check the update docker compose (here) for reference on how to do it.
  • Apparently, meillisearch collects analytics by default unless you opt out. Add MEILI_NO_ANALYTICS=true in the environment section of the meillisearch container if you don't want that. Check the update docker compose (here) for reference on how to do it. Thanks for the report and fix @vivekmiyani!
  • The release introduced the ability to download banner images and take screenshots from webpages. Those will be applied only on newly crawled pages. if you want to do the same for your old bookmarks, you can re-crawl all the links from the admin panel by pressing on the Recrawl All Links (Without Inference). Make sure you click the (Without inference) button otherwise you'll be re-running automatic tagging which can be expensive.

All commits

  • docker: Attempt to improve build times by changing cache backend by @MohamedBassem in #5d805e2
  • fix(inference): Attempt to reuse existing identical tags by @MohamedBassem in #b4c7de2
  • feature: Allow users to delete all unused tags in one go by @MohamedBassem in #7d163f2
  • fix: Fix error when merging empty tags by @MohamedBassem in #0b02f94
  • fix: Change tag listing API to return unused tags by @MohamedBassem in #5aabbec
  • fix: Re-index affected bookmarks when one of their tags gets updated by @MohamedBassem in #4efcac7
  • feature(crawler): Allow increasing crawler concurrency and configure storing images and screenshots by @MohamedBassem in #a91aff2
  • feature: A new cleanups page to suggest ways to tidy up your bookmarks by @MohamedBassem in #9dace18
  • feature(web): Add ability to rename, merge and fast delete tags. Fixes #105 (#125) by @MohamedBassem in #d07f2c9
  • docs: Update docs to include the links to the android app by @MohamedBassem in #da6df7c
  • fix(web): Fix hydration error in the bookmark preview page by @MohamedBassem in #92cff68
  • ui(web): Show bookmark URL when maximizing a bookmark by @MohamedBassem in #ec15d20
  • docs: Update the CLI docs to reference the published NPM package by @MohamedBassem in #4804f98
  • style(cli): Change all help messages to lowercase by @MohamedBassem in #ac2f78f
  • build(cli): Prepare for publishing CLI to npm by @MohamedBassem in #3352a3e
  • feature(cli): Add ability to manipulate lists, tags and update bookmarks by @MohamedBassem in #af0cf9c
  • fix(crawler): Better extraction for amazon images by @MohamedBassem in #5dac180
  • fix(docs): Update the social image from the generic docusaurus image by @MohamedBassem in #ab92969
  • feature(web): Change the AddList modal to allow adding and removing bookmarks from lists by @MohamedBassem in #88b92d8
  • fix(workers): Increase robustness of search worker and add extra logging. Fixes #118 by @MohamedBassem in #c1baada
  • fix(workers): Set a modern user agent and update the default viewport size by @MohamedBassem in #cca81ca
  • release(extension): Release version 1.2.0 by @MohamedBassem in #3d1eeef
  • feature(extension): Allow adding tags and lists to newly hoarded bookmarks by @MohamedBassem in #77b1aba
  • fix(web): Fix missing link card image in list view by @MohamedBassem in #0e26095
  • ui(extension): Use shadcn and better dark mode support by @MohamedBassem in #7ddcb5f
  • fix(mobile): Add a bigger button to collable the nested list by @MohamedBassem in #5f599f2
  • fix: Update docker-compose.yml (#119) by @Rosin1 in #cbdaf56
  • docker: Disable meilisearch analytics (#117) by @vivekmiyani in #9b9cdcf
  • fix: Ensure that downloaded asset images are from the allowed content types by @MohamedBassem in #12c682b
  • fix: Use next/image for serving bookmark images by @MohamedBassem in #e12fe02
  • feature: Allow recrawling bookmarks without running inference jobs by @MohamedBassem in #4c589d4
  • feature: Download images and screenshots by @MohamedBassem in #4402e6f
  • mobile: Bump mobile version to 1.5 by @MohamedBassem in #b4a13ce
  • fix(mobile): Fix the color of the collapsible triangle...
Read more

Contributors

MohamedBassem, Rosin1, and vivekmiyani
Assets 2
Loading
7 Join discussion

0.12.2

17 Apr 09:02
@MohamedBassem MohamedBassem
v0.12.2
bb44ebc
Compare
Choose a tag to compare
0.12.2

Another small hotfix for the 0.12.0 release.

Fixes:

  • Preferred layout was getting lost when the browser is closed and reopened. This is fixed in this release.

Commits:

  • fix: Fix user local settings cookie to have max age as by default it's a session cookie. Fix #104 by @MohamedBassem in bb44ebc

Contributors

MohamedBassem
Assets 2
Loading