this post was submitted on 26 Jul 2023
94 points (98.0% liked)

Selfhosted

39987 readers
458 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

I would like to REALLY archive some older e-mail-folders. Archive seems not to be the right word, because i work with empty inboxes, so every completed or answered e-mail is still archived in a folder (with the name of the year), but i use IMAP so all archived emails are still on the server.

Now i want to EXPORT the years 2018-2019 to my selfhosted-backup-server so that i can delete the emails on the mail-server.

a) Which format make most sense? EML? mbox? Another one? Would be nice if i can search the archived stuff without too many effort. b) Should i export directly from the UI of my mailprovider (if possible) or is exporting from thunderbird-client ok.

top 20 comments
sorted by: hot top controversial new old
[–] [email protected] 10 points 1 year ago

93000 mails since 2008 are just 2,1 GB. I have an archive on my home server where I also host my main IMAP server. I just move them from the inbox to Archives.YEAR.

[–] [email protected] 9 points 1 year ago

Commenting because I too am interested in this. I also would like to see if anyone has solved the issue with Thunderbird and Yahoo email where only 10,000 emails are kept. I have an inbox with about 20+years of emails, and with the 10k cap, I realized Thunderbird was literally deleting the oldest ones. Since I wisely told it not to delete them on the server when it copied them, I didn't lose them, but with that volume of emails, I really don't want to have to manually move them into folders. Guess this turned into a ramble, but it would be nice to have a backup since you never know when one day you will wake up to be told service x is shutting down.

[–] [email protected] 5 points 1 year ago

Hi,

i do a simple 1:1 backup with offlineimap, which saves the mails in plain text files (similar what you get when look at the source in thunderbird).

These files are backed up regularily with restic.

Both backups are running automatic, and on multiple machines...

[–] [email protected] 5 points 1 year ago* (last edited 1 year ago)

MBOX is a standard format, which is text based, (like the emails themselves are) and should be compatible across multiple email clients. It can contain entire folders.

EML is also a standard text format, but usually contains a single email in each file.

In the worst case, you can just open up either one in a text editor if you need to find something.

[–] [email protected] 4 points 1 year ago (1 children)

I’ve been meaning for years to set up a solid archiving system that I don’t have to manually babysit. I’ve had my eye on mailpiler (https://www.mailpiler.org/), but haven’t found the time to get up to speed on it. I’m the meantime, I drag messages to a local folder like a barbarian.

[–] [email protected] 1 points 1 year ago

Interesting project! I’ll spin it up in the next couple of days and check it out

[–] [email protected] 3 points 1 year ago

I've been using imap-backup for many years without issue, it backs up to mbox files that it can restore onto any IMAP server because it also stores IMAP metadata on the side. I then backup the dir itself using borg. It deduplicates and compresses so the backup archives themselves are extremely small.

[–] [email protected] 2 points 1 year ago

I think that is the way I want to go! Thunderbird on my PC is the „central mail client“, so I just have to draw the archived years (imap) to a local folder. The advantages: If I look for an older mail, I do not have to search in seperate archived files (mbox/eml). And with backing up thunderbird, I have a backup of all my settings AND mails!

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

You could use mbsync to automate this. You can configure it so that it downloads new mail with IMAP, but keeps them even if they are deleted from the server.

Then you will have a Maildir that you can manage with any mail client, index with notmutch, etc.

[–] [email protected] 1 points 1 year ago (1 children)

What does the Thunderbird logo have to do with this?

[–] [email protected] 1 points 1 year ago

My Lemmy-client forces me to add a picture. I was pretty sure to find a solution with thunderbird - what I did

[–] [email protected] 1 points 1 year ago (1 children)
[–] [email protected] 2 points 1 year ago

That's me! I got dovecot in docker working for email archive, and moved all my old emails there. I access them through thunderbird on pc and k-9 mail on phone. Works great!

It took a bit of time to set up the passwords, and understanding the configuration. I used the lets encrypt certs from caddy.

I had to look at some different examples of the dovecot config file to get it right

[–] [email protected] 1 points 1 year ago

copy and paste it into a text file and stick it in a folder. I encounter an email that is worth archiving approximately once every year or so. Most just get deleted once they serve their purpose.

[–] [email protected] 1 points 1 year ago
[–] [email protected] 1 points 1 year ago

Sync to Thunderbird. Tools > Export.

I know it is not ideal, but it works as long as Thunderbird is around.

[–] [email protected] 1 points 1 year ago

An interesting question, and something I never really thought about because I host my own mail server which has daily backups.

Do you actually have an option to export folders from Thunderbird? I couldn't find anything so maybe you're using a plugin to perform that function?

As for format, I think the .eml files are more universally recognized if you want to transfer your message to another client. I have avoided mbox for years because it packs everything into a single large file -- handy if you want to copy it somewhere else, but a pain to work with if you're trying to find a specific message and the more emails you have stored, the slower it gets. Another option which you didn't mention, but maybe you have available (this is what I use on my mail server), is the maildir format. This stores every email as individual files in their named folders, and in plaintext format so you can open them up in a text editor or search through the files with command line tools. Since there is no compression it takes up a lot of space but I find it worth the storage.

If you have mbox or maildir file backups, one option would be to spin up a local mailserver of your own that acts as a relay to your email provider (or even multiple providers or mailboxes). This option might also work to download a copy of all your folders without having to do a full backup from your client, but that probably depends on how the server is configured. The point, however, is that if you have a local mail server running with a full copy of all your emails, then you would now have the option to simply back up the server files as a whole. You can even do recursive backups from a daily script so the task is completely automated and then you don't have to remember to perform the task on a regular basis.

Anyway, just some things to think about.

load more comments
view more: next ›