Doesn't Seem to Work on Nextcloud 23 on Local Storage / Nextcloud 24 on External Storage

[janusn]

Synopsis:

Folders from external storage acquired with local method is not excluded. I am not sure whether the non-external folders since I use it mainly on external storage.

Procedures performed:

• files_excludedirs was chown'ed and chmod'ed
• app installed and enabled
• Settings (sorry for the ugly syntax. It is required to run inside the container)
  # sudo -u abc -s /bin/bash -c "php7 /config/www/nextcloud/occ config:app:set files_excludedirs exclude --value '[\"@eaDir\",\"#snapshot\",\".*\"]'"
Config value exclude for app files_excludedirs set to ["@eaDir","#snapshot",".*"]
• clean up the table oc_filecache with
  DELETE FROM oc_filecache WHERE oc_filecache.path = '@eaDir';
DELETE FROM oc_filecache WHERE oc_filecache.path = '#snapshot';
DELETE FROM oc_filecache WHERE oc_filecache.path LIKE '._%';

Expected result:

No folder with the name "@eadir" or "#snapshot" shows up.

Actual result:

Folders with the name "@eadir" or "#snapshot" are still visible.

Environment:

• files_excludedirs version 1.0.0.beta
• Hardware: Synology DS918+ and DX517, 16 GB RAM
• Host: Synology DSM 7.1-42661 Update 4
• Nextcloud: linuxserver/nextcloud 24.0.5
• Database: linuxserver/mariadb 10.5.17

[wonx]

My previous test that I mentioned in nextcloud/server#26651 (comment) was also applied to an external storage and didn't work, the folders were scanned to the database.

[GuyPaddock]

@wonx Thanks for filing this! I'll do more testing on NC v24. We are also using it almost exclusively with external storage and it's working for us in v23, so I'll have to see if I can identify what's different.

[GuyPaddock]

@wonx The work item for this finally came up in my sprint queue so I could take another look at this. I can confirm that this does not appear to work in NC 24 even with local storage. I am looking to see what changed between 23 and 24 here.

[GuyPaddock]

I'm able to reproduce this issue on local storage in NC 23, even though it was working for me with SMB-mounted external storage in NC 23 previously.

[GuyPaddock]

@janusn @wonx Can you try this new release? https://github.com/Inveniem/nextcloud-files-excludedirs/releases/tag/v1.0.1-beta

Again, this will only affect new files not files that NC already knows about, so just bear that in mind.

[wonx]

I did a quick test and seems to ignore the specified folder, so, so far so good! I'll write back if I find any issues.

[janusn]

@GuyPaddock
I would love to help.
A question though. In case of a problem arise, could I uninstall it simply by removing the app directory to restore Nextcloud?

Thanks in advance.

[GuyPaddock]

@janusn I would recommend disabling it through the occ app:disable CLI command first, if you can.

[janusn]

@GuyPaddock

Sorry for the late reply. My NAS was a bit funky and it took me quite a while to get it back to work.

I can say the v.1.0.1 beta does not crash my NextCloud setup. I can log on it without an error. I cannot confirm the functionality yet as I am still cleaning up the filecache table. It takes much longer than I expect. I will report back once I have completed.

Thanks for your effort.

[wonx]

From my part, it seems to be working just fine. The complete directory scan, which used to take around 45-50 minutes, lowered to less than 20 minutes after excluded a folder with tens of thousands of subfolders, so I couldn't be happier.

[janusn]

@GuyPaddock

Sorry for the long waiting. I have reinstalled every thing related nextcloud including swag, redis, mariadb, duckdns...

I am happy to report that after 3 days of running, the app seems to work well. Thank you.

...
A little more question though. How do I exclude any file or directory starting with a dot? I have tried "/.*" , ".*" and "*/.*" but any one of them prevented the root of docker volumes in external storage from working. strangely, the subdirectories worked fine.

for example:
with a docker-compose.yaml

version: "2.1"
services:
  nextcloud:
    image: linuxserver/nextcloud:latest
    container_name: nextcloud
    volumes:
      - /volume2/docker/nextcloud/config:/config
      - /volume2/nextcloud/data:/data
      - /volume2/Media:/mnt/media
    restart: unless-stopped

and settings of
$ php /config/www/nextcloud/occ config:app:set files_excludedirs exclude --value '["/.*"]'
The occ is located there on the container linuxserver/nextcloud image.

An external storage to /mnt/media via local method throw an error and cannot be opened on nextcloud.
But an external storage to /mnt/media/bin via local method works totally fine.

[GuyPaddock]

@janusn Wonderful!

Can you open a separate issue for your question? I'm actually not 100% sure of the answer since I did not write the original globbing support; I just fixed it up for this version. But if we have a separate issue for it someone else may be able to chime in before I find out :)

[janusn]

@GuyPaddock I have created #3 as requested.

Furthermore, I filed another bug #4 as well.

Thanks a ton for this wonderful app!

[rightsaidfred99]

I can confirm this bug exists still with 24.

[rightsaidfred99]

On new folders, @eadir pops up 100% of the time.