BetaArchive Logo
Navigation Home Database Screenshots Gallery Image Uploader Server Info FTP Servers Wiki Forum RSS Feed Rules Please Donate
UP: 7d, 18h, 7m | CPU: 19% | MEM: 6646MB of 12287MB used
{The community for beta collectors}

Post new topic Reply to topic  [ 27 posts ]  Go to page 1, 2  Next
Author Message
 PostPost subject: The importance of including checksum files...        Posted: Thu Jan 22, 2009 11:35 pm 
Reply with quote
Administrator
User avatar
Offline

Joined
Tue Feb 12, 2008 5:28 pm

Posts
7625
I've seen a lot of you members uploading stuff to BA. Great! And many thanks to you all for providing great releases!

However one thing bugs me. When do I know when an upload is complete? When do I know if an upload is 100% error-free and identical to the one you got on your drive? I don't.

This is why you people need to include a checksum file with your uploads! The checksum file will tell me a lot of things. It will allow me to check if an upload is completed. It will allow me to check if the upload (which may be completed) is really properly uploaded (a lot of things can go bad during an upload, things you can't notice unless you count the bytes yourself).

From now on I will ignore any upload that hasn't been bundled with a checksum file. I will allow a release to be uploaded in a ZIP, RAR or 7z file.. The archive itself will let me know if the upload is complete, since otherwise I'll get an error during unpack. You don't have to bundle a checksum file if you zip, rar or 7z it up. Some member uploaded a rar file with the checksum file INSIDE, which was pretty hilarious, since that made the checksum file reduntant.

Anyway, I prefer MD5 checksums. They don't suffer the 32bit problems CRC32 has, and they are also more accurate. You can also make a small PAR2-set out of the files and send that up as well. ANY way is good as long as I can verify that everything reached BA.

Recap: I will ignore and eventually delete any file that isn't in an archive (ZIP, RAR, 7z) or that doesn't come bundled with a checksum file (MD5, PAR2). If you upload anything exotic then please include a textfile explaining what it is.

Thanks a lot!

_________________
Image
Official guidelines: The Definitive Guide to BetaArchive :: Abandonware
Tools: Alcohol120% (Portable)
Listings: BetaArchive Database (beta)
Channels: Discord :: Twitter


Top  Profile  WWW
 PostPost subject: Re: The importance of including checksum files...        Posted: Fri Jan 23, 2009 12:26 am 
Reply with quote
Donator
Offline

Joined
Sun May 13, 2007 12:42 am

Posts
2406
This also should solve many other problems that annoy people.


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Fri Jan 23, 2009 12:57 am 
Reply with quote
FTP Access
User avatar
Offline

Joined
Sat Aug 19, 2006 7:45 pm

Posts
550
It's still important to make sure most ISOs from Microsoft have a proper AutoCRC checksum. Those solve many problems with errors on burning plus shows you have a genuine release

_________________
I am here in the shadows


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 24, 2009 6:58 am 
Reply with quote
FTP Access
Offline

Joined
Tue Feb 19, 2008 7:46 pm

Posts
292
There is a functionality added called adding '(finished)' after your uploadfolder.


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 24, 2009 9:42 am 
Reply with quote
FTP Access
User avatar
Offline

Joined
Sun Aug 27, 2006 11:03 am

Posts
386

Location
Australia

Favourite OS
Windows 7 Ultimate
dexter152 wrote:
There is a functionality added called adding '(finished)' after your uploadfolder.

That doesn't really mean anything, for all the uploader knows the upload could have still been corrupted whist uploading or if their internet connection was disrupted it may have became corrupt while resuming.....


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 24, 2009 10:48 am 
Reply with quote
FTP Access
Offline

Joined
Tue Feb 19, 2008 7:46 pm

Posts
292
How the F... could you make a MD5 checksum?


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 24, 2009 11:50 am 
Reply with quote
Administrator
User avatar
Offline

Joined
Tue Feb 12, 2008 5:28 pm

Posts
7625
First of all watch your language... replacing the word with dots doesn't make it more proper...

Second, you can use any application that creates md5 checksums out of files. Or you make a small par2-set using quickpar and upload. I don't have any specific MD5 application examples because I am using Total Commander (which has this feature built in) and also a command line tool I coded specifically to aid me with BA and TBG files. Or just rar up the files and add a "-finished" to the folder when it's done. The rar itself will tell me if the file has errors.

_________________
Image
Official guidelines: The Definitive Guide to BetaArchive :: Abandonware
Tools: Alcohol120% (Portable)
Listings: BetaArchive Database (beta)
Channels: Discord :: Twitter


Top  Profile  WWW
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 24, 2009 12:16 pm 
Reply with quote
FTP Access
Offline

Joined
Tue Feb 19, 2008 7:46 pm

Posts
292
I can't use the interface of Total Commander :(


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 24, 2009 12:21 pm 
Reply with quote
Donator
Offline

Joined
Sat Feb 24, 2007 4:14 pm

Posts
6612

Location
United Kingdom

Favourite OS
Server 2012 R2
I personally recommend using Hashtab, if like me, a GUI wins over CLI any day :P

Image

Edit: Andy, any chance of the uploader supporting transparent PNGs? At least on the full resolution image, since that no longer reduces quality?

_________________
BuildFeed - the ultimate collaborative NT build list - Windows Longhorn - a look at a defining Microsoft project


Top  Profile  WWW
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 24, 2009 1:20 pm 
Reply with quote
Donator
User avatar
Offline

Joined
Sat May 12, 2007 1:05 pm

Posts
5271

Location
The Collection Book

Favourite OS
Windows & Phone
Cool!

[off-topic]
I also saw a tab for ICON view or something, does anybody know it?
[/off-topic]

_________________
Image
http://www.thecollectionbook.info
Subscribe to our Image for updates and like us on Image.

Reading Mode only, PM's possible.


Top  Profile  WWW
 PostPost subject: Re: The importance of including checksum files...        Posted: Sun Jan 25, 2009 12:04 am 
Reply with quote
Administrator
User avatar
Offline

Joined
Tue Feb 12, 2008 5:28 pm

Posts
7625
hounsell wrote:
I personally recommend using Hashtab, if like me, a GUI wins over CLI any day :P


Great! Thanks for the tip, have been actually looking for one of these apps and even wanted to code one, but now I don't have to. =)

_________________
Image
Official guidelines: The Definitive Guide to BetaArchive :: Abandonware
Tools: Alcohol120% (Portable)
Listings: BetaArchive Database (beta)
Channels: Discord :: Twitter


Top  Profile  WWW
 PostPost subject: Re: The importance of including checksum files...        Posted: Sun Jan 25, 2009 1:22 am 
Reply with quote
Donator
User avatar
Offline

Joined
Thu Aug 24, 2006 8:03 am

Posts
1115

Location
Germany
I prefer HashCheck ( http://www.ktechcomputing.com/hashcheck/ ).

Last year I also made this suggestion, because some files were damaged. Great that is now required when uploading files.

_________________
"Theory is when you know something, but it doesn't work. Practice is when something works, but you don't know why. Programmers combine theory and practice: Nothing works and they don't know why."


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sun Jan 25, 2009 10:02 am 
Reply with quote
FTP Access
Offline

Joined
Tue Feb 19, 2008 7:46 pm

Posts
292
Hmmm, that one of Luckie is better than that one of TotalCMD and HashTab (H) .


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 31, 2009 2:53 pm 
Reply with quote
FTP Access
Offline

Joined
Tue Feb 19, 2008 7:46 pm

Posts
292
mrpijey wrote:
Or just rar up the files and add a "-finished" to the folder when it's done.


That means I may add '(finished)' behind the folder instead of including a checksum file with the upload?


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 31, 2009 3:19 pm 
Reply with quote
Donator
User avatar
Offline

Joined
Sat May 12, 2007 1:05 pm

Posts
5271

Location
The Collection Book

Favourite OS
Windows & Phone
dexter152 wrote:
mrpijey wrote:
Or just rar up the files and add a "-finished" to the folder when it's done.


That means I may add '(finished)' behind the folder instead of including a checksum file with the upload?


Just include the checksum file, it's only a few bytes (takes about <1 seconds to upload).
And mrpijey is sure then that the file is OK.

And add FINISHED if you are done with it.

_________________
Image
http://www.thecollectionbook.info
Subscribe to our Image for updates and like us on Image.

Reading Mode only, PM's possible.


Top  Profile  WWW
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 31, 2009 7:00 pm 
Reply with quote
FTP Access
Offline

Joined
Tue Feb 19, 2008 7:46 pm

Posts
292
Do you need to create it on your computer and upload it after you uploaded your files?


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 31, 2009 7:06 pm 
Reply with quote
Donator
User avatar
Offline

Joined
Tue Jan 06, 2009 11:35 am

Posts
1107

Favourite OS
Windows Neptune Build 5111
hounsell wrote:
I personally recommend using Hashtab, if like me, a GUI wins over CLI any day :P



thanks for that link , will help me vertify files upload to my server


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Fri Jan 08, 2010 4:22 am 
Reply with quote
Donator
Offline

Joined
Mon Nov 16, 2009 4:27 am

Posts
1478
Sorry for the bump, but how do you make a checksum file?

_________________
It's called a hustle, sweetheart.


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 09, 2010 1:30 am 
Reply with quote
FTP Access
User avatar
Offline

Joined
Sun Aug 27, 2006 11:03 am

Posts
386

Location
Australia

Favourite OS
Windows 7 Ultimate
Hashtab (Google It)


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Sat Jan 09, 2010 2:12 am 
Reply with quote
Administrator
User avatar
Offline

Joined
Tue Feb 12, 2008 5:28 pm

Posts
7625
There are many applications and ways you can make checksum files. One way is using the application mentioned by merty. The applications I use are QuickSFV and the built in function in Total Commander. But HashTab seems like a capable application so I suggest you go with it.

With the next BetaArchive release I will be uploading a few tools some member has assembled for us. With those tools will be a few applications to make checksum files as well as parity files. That way BA members can get the tools directly from us. Be sure to update me if there are updates to the applications since I won't be checking for new versions every week :).

As for checksumming tools I will upload the following applications:

FSum: MD5 Checksum calculation and verification utility. Runs under win32. Good for scripting checksums.
HashTab 3.0: The application mentioned by merty. I've included both Win and Mac versions. Creates MD5, SHA1, SHA2, RipeMD, HAVAL and Whirlpool hashes.
QuickPar 0.9.1: Not so much a checksumming tool but creates parity files. Parity files can be used to verify the consistency of a set of files as well. I use par2-files as a recovery backup solution.
par2cmdline: Same kind of app as above, but for win32 command line use. Perfect for scripting parity file creations or verifications.
QuickSFV 2.36: Verifies checksum files. Supports a lot of formats including MD5, CRC32 and others. 32bit and 64bit Windows editions included.

If anyone got any other tools to recommend then please upload them and I'll add them. Remember that I have not tried all these tools so I can't guarantee they will work with every system configuration.

_________________
Image
Official guidelines: The Definitive Guide to BetaArchive :: Abandonware
Tools: Alcohol120% (Portable)
Listings: BetaArchive Database (beta)
Channels: Discord :: Twitter


Top  Profile  WWW
 PostPost subject: Re: The importance of including checksum files...        Posted: Tue Feb 08, 2011 7:42 am 
Reply with quote
Donator
User avatar
Offline

Joined
Mon Jun 14, 2010 7:42 am

Posts
3764

Location
Napa, CA, USA

Favourite OS
OS/2 Warp 4 (14.098b_W4)
Just a heads up, the Hash Tab link mentioned earlier is permanently down and the website it was previously hosted on, beeblebrox.org, redirects to this site which has Hash Tab:

Hash Tab New Download Link


Top  Profile  WWW
 PostPost subject: Re: The importance of including checksum files...        Posted: Mon May 30, 2011 10:58 am 
Reply with quote
FTP Access
Offline

Joined
Sat May 21, 2011 7:13 am

Posts
20

Favourite OS
Windows 7 Ultimate x64
why do i need checksum files?

_________________
abcd1234a

WINDOWS COLLECTOR
BetaArchive Advanced Member

Offtopic Comment
BetaArchive is AMAZING!!


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Mon May 30, 2011 2:36 pm 
Reply with quote
Administrator
User avatar
Offline

Joined
Fri Aug 18, 2006 11:47 am

Posts
12498

Location
Merseyside, United Kingdom

Favourite OS
Microsoft Windows 7 Ultimate x64
abcd1234a wrote:
why do i need checksum files?


Did you really just ask that question? Did you BOTHER to read the topic at all?

_________________
Image

BetaArchive Discord: https://discord.gg/epK3r6A


Top  Profile  WWW
 PostPost subject: Re: The importance of including checksum files...        Posted: Fri Jan 20, 2012 2:19 pm 
Reply with quote
FTP Access
Offline

Joined
Thu Dec 22, 2011 2:51 pm

Posts
69

Favourite OS
NeXTStep/OpenStep
There's also my own written HashGenerator (http://www.betaarchive.com/forum/viewtopic.php?f=32&t=23365). It can generate MD5 and SHA256 Checksums. CRC/MD5/SHA1 should not be used since it they have known weaknesses [1],[2].

SHA256 is a good alg.
Always use the newest version of HashGenerator.

SHA256 chksums are also used by the FreeBSD makers.

[1] http://www.schneier.com/blog/archives/2005/02/sha1_broken.html
[2] http://en.wikipedia.org/wiki/MD5#Collision_vulnerabilities

_________________
Collector of old Windows SDKs (or generally of rare SDKs). My collection could be accessed here.


Top  Profile
 PostPost subject: Re: The importance of including checksum files...        Posted: Fri Jan 20, 2012 3:53 pm 
Reply with quote
FTP Access
Offline

Joined
Tue Sep 21, 2010 12:47 pm

Posts
240

Favourite OS
IRIX 5.3 XFS 12/94
marmmm wrote:
CRC/MD5/SHA1 should not be used since it they have known weaknesses [1],[2].

MD5/SHA1 weaknesses are serious issues for tasks like hashing passwords, where an attacker invests time into finding a collision, but that's probably not a suitable scenario for the contents of a regular upload


Top  Profile
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 27 posts ]  Go to page 1, 2  Next




Who is online

Users browsing this forum: No registered users and 3 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  

All views expressed in these forums are those of the author and do not necessarily represent the views of the BetaArchive site owner.

Powered by phpBB® Forum Software © phpBB Group

Copyright © 2006-2019

 

Sitemap | XML | RSS