mersenneforum.org  

Go Back   mersenneforum.org > Other Stuff > Forum Feedback

Reply
 
Thread Tools
Old 2021-07-27, 16:13   #12
a1call
 
a1call's Avatar
 
"Rashid Naimi"
Oct 2015
Remote to Here/There

215210 Posts
Default

Quote:
Originally Posted by paulunderwood View Post
What about viruses and macros?

Quote:
Originally Posted by Xyzzy View Post
We just added support for .doc files.

If we can find suitable (16Γ—16) icons for the others we will add those.

Quote:
Some macro viruses are annoying but not harmful; others can be very destructive. Also, Word macro viruses can spread across platforms; for example, the macro virus can infect files on the Windows platform as well as on the Macintosh platform.
https://support.microsoft.com/en-us/...3-26f115d7290a


Sound like an unnecessary liability to me.
A disclaimer at the minimum seems like a must.

ETA FTR, I am not likely to knowingly download any documents posted by random users anytime soon even utilising sandboxes and antivirus. If they can't protect banks and credit agencies, my defenses don't stand much of a chance either.

Last fiddled with by a1call on 2021-07-27 at 16:27
a1call is offline   Reply With Quote
Old 2021-07-27, 16:46   #13
Xyzzy
 
Xyzzy's Avatar
 
Aug 2002

201738 Posts
Default

Quote:
Originally Posted by kriesel View Post
Could the zip file formats' max size be doubled?
The forum currently uses half of its allocated storage. Moving beyond that requires a total system change. We haven't done the change because we don't know what will break and also because we are lazy.

So we are letting things ride as they are while hoping that the day to change over never arrives. Keeping file attachments "small" helps.

Xyzzy is offline   Reply With Quote
Old 2021-07-27, 18:07   #14
masser
 
masser's Avatar
 
Jul 2003
Behind BB

3×577 Posts
Default

Quote:
Originally Posted by Xyzzy View Post
The forum currently uses half of its allocated storage. Moving beyond that requires a total system change. We haven't done the change because we don't know what will break and also because we are lazy.

So we are letting things ride as they are while hoping that the day to change over never arrives. Keeping file attachments "small" helps.

Would it be possible to reduce the forum's current usage by removing old attachments of little-to-no worth?

Can you see a list of the largest files in storage?

Last fiddled with by masser on 2021-07-27 at 18:07
masser is online now   Reply With Quote
Old 2021-07-27, 18:36   #15
M344587487
 
M344587487's Avatar
 
"Composite as Heck"
Oct 2017

25·33 Posts
Default

Quote:
Originally Posted by Xyzzy View Post
The forum currently uses half of its allocated storage. Moving beyond that requires a total system change. We haven't done the change because we don't know what will break and also because we are lazy.

So we are letting things ride as they are while hoping that the day to change over never arrives. Keeping file attachments "small" helps.

How hard would it be to re-compress all zip into .tar.xz (or LZMA/2 .7z if you must)? Zip is archaic, it doesn't matter that it can support more modern algorithms if DEFLATE is still mostly what's used for compatibility. I'm all for annoying windows users that can't be bothered to install a proper archiver (if I was the compression czar I'd rule with a well-compressed iron fist).

While we're talking formats, JpegXL (.jxl) should become the new standard image format for lossless and lossy images (by merit, standardisation and common sense, so I give it a 50% chance). It can losslessly recompress lossy jpegs with a significant size saving, and is far better than png at compressing lossless images. I encourage compression nerds to try it out even though it's going to be many years before it's commonplace in the wild.
M344587487 is offline   Reply With Quote
Old 2021-07-27, 20:43   #16
Xyzzy
 
Xyzzy's Avatar
 
Aug 2002

5·1,663 Posts
Default

The forum has 20GB allocated to it and it is using ~10GB.

Every year disk space costs less.

We figure by the time we get close to using it up, they might roll the system into a new instance with a bigger drive.

Or we'll face the system jump, which could be entirely painless.

All of the easy disk space optimizations have been done.

The forum mersenne.org download mirror uses 3.7GB so as we close in on the limit we can buy some breathing room by deleting that.

Deleting old attachments is possible but we prefer not to do it. (Just like old posts!)

We can see the biggest attachments. (We are guilty of having most of the large ones!)

In short: The forum is doing okay, but we see no need to introduce larger attachments. However, we will consider it and if you have something big to post just send it to us and we'll attach it manually. Maybe it will turn out that 8MB zip files are needed.

Attached Thumbnails
Click image for larger version

Name:	attachments.png
Views:	40
Size:	181.2 KB
ID:	25338  
Xyzzy is offline   Reply With Quote
Old 2021-07-27, 21:29   #17
drkirkby
 
"David Kirkby"
Jan 2021
Althorne, Essex, UK

3×149 Posts
Default

Quote:
Originally Posted by Xyzzy View Post
We have added .odp, .ods, .odt, .ppt and .xls to the list.

We think we have the mime types input correctly.

Please check to see if they work.

In order to check if they work, here are 3 LibreOffice attachments. The checksums are in the filenames. Looking at LibreOffice, it has a "Math" tool, which saves files with the extension .odf, which is probably worth supporting, given the nature of the forum. An icon is here
https://github.com/LibreOffice/core/.../apps/math.svg

There's also a drawing tool, which saves in .odg format too.

EDIT. I downloaded the 3 files, and they opened fine in LibreOffice - there was no need to select the application, as the application was suggested. They opened in "read-only" mode. I also saved the files and compared their md5 checksums, to those of the files I uploaded. The checksums agree.

Last fiddled with by drkirkby on 2021-07-27 at 21:41 Reason: Confirm that the files I attached do behave as expected.
drkirkby is offline   Reply With Quote
Old 2021-07-27, 21:34   #18
xilman
Bamboozled!
 
xilman's Avatar
 
"π’‰Ίπ’ŒŒπ’‡·π’†·π’€­"
May 2003
Down not across

97×113 Posts
Default

Quote:
Originally Posted by Xyzzy View Post
We have added .odp, .ods, .odt, .ppt and .xls to the list.

We think we have the mime types input correctly.

Please check to see if they work.

With all due respect, I think this is a bad idea.

Let someone else carry the can for hosting malware-infected files.

Spreadsheets can be exported as TSV or CSV files. PDF works well for most everything else.

Last fiddled with by xilman on 2021-07-27 at 21:35
xilman is online now   Reply With Quote
Old 2021-07-27, 23:52   #19
kriesel
 
kriesel's Avatar
 
"TF79LL86GIMPS96gpu17"
Mar 2017
US midwest

22×1,453 Posts
Default

Quote:
Originally Posted by Xyzzy View Post
We can see the biggest attachments. (We are guilty of having most of the large ones!)

In short: The forum is doing okay, but we see no need to introduce larger attachments. However, we will consider it and if you have something big to post just send it to us and we'll attach it manually. Maybe it will turn out that 8MB zip files are needed.

Initial reason I asked about larger attachments is #8 of https://www.mersenneforum.org/showpo...0&postcount=26. I have exhausted most but not quite all possibilities, but have not yet achieved compilation small enough that will fit in a 4MB compressed archive. Then got distracted by other things.
See also https://mersenneforum.org/showpost.p...2&postcount=24, in which the trailing "soon" should now be read as "some month or year". https://mersenneforum.org/showpost.p...7&postcount=30 says the compiled and compressed were running around 8MB.

My custom program for log analysis, error alerting, results gathering, and other features yet to be added for multiple instances of multiple common GPU applications is >3.4MB compressed, and growing.

Re: largest total accumulated size of attachments: Whoo-hoo, made the top 5 without even trying!
If/when total space gets tight, I'd gladly advise on which Gpuowl Windows builds could be dropped first.
Quote:
Originally Posted by xilman View Post
Let someone else carry the can for hosting malware-infected files.
Spreadsheets can be exported as TSV or CSV files. PDF works well for most everything else.
I'm not fond of making malware spread easier either. But note that spreadsheets with graphs or font formatting don't export fully in TSV or CSV. I use PDF for them. Storage efficiency is sometimes poor in PDF. As an example, a 55 KB .odt produces a 267 KB pdf, nearly 5x as large.

Last fiddled with by kriesel on 2021-07-28 at 00:28
kriesel is online now   Reply With Quote
Old 2021-07-28, 00:09   #20
chalsall
If I May
 
chalsall's Avatar
 
"Chris Halsall"
Sep 2002
Barbados

2×5×997 Posts
Default

Quote:
Originally Posted by xilman View Post
With all due respect, I think this is a bad idea.
Security vs. Convenience is an ongoing balance. No one is ever happy. And most are not nearly paranoid "enough".

Quote:
Originally Posted by xilman View Post
Spreadsheets can be exported as TSV or CSV files.
Doesn't easily retain equations for cells. This can both be a good thing (no attack vectors) and bad (no "rich content").

Quote:
Originally Posted by xilman View Post
PDF works well for most everything else.
PDFs can contain code that can in some cases be considered an attack vector.

Are we there yet?
chalsall is online now   Reply With Quote
Old 2021-07-28, 00:23   #21
Uncwilly
6809 > 6502
 
Uncwilly's Avatar
 
"""""""""""""""""""
Aug 2003
101Γ—103 Posts

2·32·557 Posts
Default

Quote:
Originally Posted by chalsall View Post
Doesn't easily retain equations for cells. This can both be a good thing (no attack vectors) and bad (no "rich content").
"This is cell A1","25","100"
"The total is","=SUM(B1:C1)"

The user can choose to go to cell B2 and hit enter. Boom, we have a formula. Complex formulas can mess with that (but then again placing your literal values in cells and referencing them can fix many of those problems). Fixed width or using an alternate separator can help.
Uncwilly is offline   Reply With Quote
Old 2021-07-28, 00:50   #22
xilman
Bamboozled!
 
xilman's Avatar
 
"π’‰Ίπ’ŒŒπ’‡·π’†·π’€­"
May 2003
Down not across

97·113 Posts
Default

Quote:
Originally Posted by chalsall View Post
Doesn't easily retain equations for cells. This can both be a good thing (no attack vectors) and bad (no "rich content").
Works for me.

I created three columns of ten rows. Col A has numbers 1..10 and Col B 4..40 by 4. Col C is the sum of Col A and Col B.

Saves just fine in CSV format and reads back in with precisely the expected behaviour.

Here is the spreadsheet in question:

Quote:
1,4,"=SUM(A1:B1)"
2,8,"=SUM(A2:B2)"
3,12,"=SUM(A3:B3)"
4,16,"=SUM(A4:B4)"
5,20,"=SUM(A5:B5)"
6,24,"=SUM(A6:B6)"
7,28,"=SUM(A7:B7)"
8,32,"=SUM(A8:B8)"
9,36,"=SUM(A9:B9)"
10,40,"=SUM(A10:B10)"
Please give it a try by cutting and pasting everything within the QUOTE tags as test.csv and loading that file into the spreadsheet program of your choice. Alternatively, open the attachment. Each should give the same result.
Attached Files
File Type: csv test.csv (191 Bytes, 30 views)
xilman is online now   Reply With Quote
Reply

Thread Tools


Similar Threads
Thread Thread Starter Forum Replies Last Post
New documents at FermatSearch ET_ FermatSearch 0 2017-04-17 16:59
An Open Access Library of Mathematical Documents flouran Math 10 2009-08-14 04:50
HomePrime spreadsheets roger Factoring 69 2009-05-30 06:23
LATex Documents Numbers Lounge 8 2005-12-31 09:33
Attachments! Xyzzy Lounge 5 2002-10-21 00:03

All times are UTC. The time now is 19:15.


Wed Oct 27 19:15:35 UTC 2021 up 96 days, 13:44, 0 users, load averages: 1.15, 1.41, 1.65

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, Jelsoft Enterprises Ltd.

This forum has received and complied with 0 (zero) government requests for information.

Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.
A copy of the license is included in the FAQ.