social.heise.de ist einer von vielen unabhängigen Mastodon-Servern, mit dem du dich im Fediverse beteiligen kannst.
Der Mastodon-Server von und für Heise Medien und insb. die Nachrichten von heise online.

Serverstatistik:

38
aktive Profile

#rclone

0 Beiträge0 Beteiligte0 Beiträge heute

Nach langer Suche habe ich endlich S3 cloudstorage Client Software gefunden, die macht, was ich brauche.

Für Linux ist es #rclone mit dem rclone browser und für grapheneOS ist es #exfilac.

Hauptproblem mit anderer Software war die Konfiguration des Zugriffs auf alternative storage Anbieter (statt #AWS). Bei den beiden Tools funktioniert es. Für Linux würde ich mir wünschen, daß #beyondcompare endlich alternative S3 storage Anbieter unterstützt 🤨

#linux#android#s3storage
Antwortete im Thread

@holgi

#rclone mit GUI für macOS gibt es auch und heißt #rclonebrowser

github.com/kapitainsky/RcloneB

Ich würde die Daten unabhängig von nextcloud mit Rclone(Browser) kopieren und über Nextcloud einmal die Daten neu indexieren. Bei Kopieren ist der Zielpfad der Nextcloud-Pfad in dem die Benutzerdaten der Nextcloud-Instanz liegen.

Zum Neuindexieren muss man per SSH* mit

sudo -u www-data php occ files:scan --all

durchführen.

*(SSH-Konsole, in den Nextcloud-Pfad, wo es die Datei "occ" gibt.)

GitHubGitHub - kapitainsky/RcloneBrowser: Simple cross platform GUI for rclone. Supports macOS, GNU/Linux, BSD family and Windows.Simple cross platform GUI for rclone. Supports macOS, GNU/Linux, BSD family and Windows. - kapitainsky/RcloneBrowser

Hey #linux #debian people: it’s occurring to me that #rclone might not actually be the best way to do what I’m doing. So: if you had two Debian servers on a vpn, both with 1 gig fiber links to the internet, in cities 100 km apart, how would you go about having shared filesystems between them? Right now I am using rclone mount with sftp. Is there a less janky way?

A deeply annoying discovery I made today: if you have an #rclone mount that needs to be restarted, any running #docker writing to that mount is now writing to your filesystem without warning. I get that if the mount is gone, of course it has to write to the local filesystem. But when the mount comes back, it continues writing to the local filesystem, but if you change into the mounted directory, ls will show the contents of the mount, not the contents of the local filesystem that docker is busy writing to, and you will have no idea what black hole your files are falling into, because /mnt/offsite shows it's mounted, your docker agrees that it's writing to /mnt/offsite, and yet the files are nowhere to be found when you go to /mnt/offsite! They only suddenly appear when you umount the directory.

I use a an open-source tool called "rclone" to back up my data to the AWS S3 service; this data is then quickly migrated from the base S3 storage tier to another tier called "Glacier", which is less expensive.

The tradeoff for the savings is that files in the Glacier class are not immediately available; in order to be able to restore them I need to request that they be restored in S3 so I can copy them. Typically you restore them for a limited number of days (enough time for you to grab a copy) before it then reverts back to Glacier class.

The other wrinkle is: The files are encrypted. Not just the files but the file names and the file paths (enclosing folders/directories).

Here is the tricky part: The backup software does not have the ability to request a file be restored from files stored in the Glacier tier. I have to do that using the aws command line or the console. This is doubly tricky because I will have to request the exact file using the encrypted filename and path... not the name I actually know the files as.

So it turns out that rclone can actually tell me the encypted filename and path if I ask it correctly because of course they've dealt with this problem already. :)

I thought to myself "Here is a chance for ChatGPT to show its quality".

I'll skip to the chase:

ChatGPT gave me exactly the *opposite* instructions of what I asked for.

Instead of telling me how to get the encrypted filename path from the unencrypted equivalent it, instead, told me how to get the plaintext from the encrypted filename - which I didn't have. This is using the latest ChatGPT 4o, the very latest.

I question the usefulness of this kind of tool (meaning ChatGPT) for anyone who isn't an expert. I've done this long enough that I know of other sources to look at (such as the manual pages) but if you aren't that savvy I'm not sure how you would find the right answer.

The ability to regurgitate unstructured data with LLMs is amazing - almost magical when I compare it to other efforts to do the same that I have been involved in previously.

But the ability to summarize and present the data in an accurate, useful form is nowhere near acceptable.

#ai#llm#llms