Free Rainbow Tables | Forum

Home of the Distributed Generator and Cracker
It is currently 19 Apr 2014, 04:12

All times are UTC + 1 hour [ DST ]




Post new topic Reply to topic  [ 44 posts ]  Go to page 1, 2, 3  Next
Author Message
 Post subject: RTP 0.2b
PostPosted: 09 Nov 2011, 04:24 
Offline
MΩth √G∑∏∫∪≤

Joined: 03 Dec 2007, 11:37
Posts: 1059
I think it is bug free. Oops just noticed I forgot to uncomment "#define NDEBUG" which removes asserts. Forgot to do a final spell check so there might be some funny ones.

Ohh right if it's still CPU limited then there is one more thing I can do to make it faster.

Edit: removed rtp0.2b.zip see below for a newer version

_________________
http://www.tobtu.com/


Last edited by Sc00bz on 10 Nov 2011, 06:23, edited 1 time in total.

Top
 Profile  
 
 Post subject:
Posted: 09 Nov 2011, 04:32 


Top
  
 
PostPosted: 09 Nov 2011, 04:32 
Offline
Total Hash Enlightenment

Joined: 15 Jul 2009, 22:38
Posts: 1483
Location: Dallas, TX, USA
Sc00bz wrote:
I think it is bug free. Oops just noticed I forgot to uncomment "#define NDEBUG" which removes asserts. Forgot to do a final spell check so there might be some funny ones.

Ohh right if it's still CPU limited then there is one more thing I can do to make it faster.


Makefiles are really awesome :D

Giving it a try.


Top
 Profile  
 
PostPosted: 09 Nov 2011, 05:46 
Offline
MΩth √G∑∏∫∪≤

Joined: 03 Dec 2007, 11:37
Posts: 1059
I knew I forgot something.

_________________
http://www.tobtu.com/


Top
 Profile  
 
PostPosted: 09 Nov 2011, 22:50 
Offline
Guesser

Joined: 23 Oct 2011, 19:52
Posts: 25
Ouch, this doesn't compile cleanly on Linux with gcc. Any chance of work being done in this direction?


Top
 Profile  
 
PostPosted: 10 Nov 2011, 06:21 
Offline
MΩth √G∑∏∫∪≤

Joined: 03 Dec 2007, 11:37
Posts: 1059
It should now compile with Linux and fixed 64 bit compatibility.


Attachments:
rtp0.2b.zip [137.47 KiB]
Downloaded 436 times

_________________
http://www.tobtu.com/
Top
 Profile  
 
PostPosted: 10 Nov 2011, 07:32 
Offline
Total Hash Enlightenment

Joined: 15 Jul 2009, 22:38
Posts: 1483
Location: Dallas, TX, USA
Sc00bz wrote:
It should now compile with Linux and fixed 64 bit compatibility.


Not quite but only required the addition of
Code:
#include <strings.h>
to getargs.h. Quite a few warnings but builds on linux and NetBSD. Will have to wait until tomorrow for testing though as I should be asleep :D

Thanks!


Top
 Profile  
 
PostPosted: 11 Nov 2011, 07:05 
Offline
Total Hash Enlightenment

Joined: 15 Jul 2009, 22:38
Posts: 1483
Location: Dallas, TX, USA
Not quite there yet...but the weekend is coming.

Code:
frt@iris:~/finalization/146$ ~/src/rtp0.2b/src/rtperfect0.2b64 -v --input crt -s
=65535 ~/results/146/result/ 146_%u_%u.rt
Error no '*.crt' input files found in directory '/home/frt/results/146/result/'.

frt@iris:~/results/146/result$ for RT in *.rt; do mv "$RT" `echo $RT | sed 's/\.rt$/\.crt/'`; done

frt@iris:~/finalization/146$ ~/src/rtp0.2b/src/rtperfect0.2b64 -v ~/results/146/result/ 146_%u_%u.rt
Error WriteCRT::writeChain(): Trying to write unsorted data.
frt@iris:~/finalization/146$ rm temp.rt
frt@iris:~/finalization/146$ ~/src/rtp0.2b/src/rtperfect0.2b64 -t 1 -v ~/results/146/result/ 146_%u_%u.rt
Error WriteCRT::writeChain(): Trying to write unsorted data.



This is data that is the output of a perfecting run with our old perfecter.


Top
 Profile  
 
PostPosted: 11 Nov 2011, 08:02 
Offline
MΩth √G∑∏∫∪≤

Joined: 03 Dec 2007, 11:37
Posts: 1059
In writecrt.cpp replace:
Code:
fprintf(stderr, "Error WriteCRT::writeChain(): Trying to write unsorted data.\n");
with:
Code:
fprintf(stderr, "Error WriteCRT::writeChain(): Trying to write unsorted data %016"PRIx64" >= %016"PRIx64".\n", m_prevEndpt, chain->endpt);

Also could you do this:
Code:
for CRT in *.crt; do head -c 288 "$CRT" > `echo $CRT | sed 's/\.crt$/\-head.crt/'`; done; tar -czf heads.crt.tar.gz *.crt

_________________
http://www.tobtu.com/


Top
 Profile  
 
PostPosted: 11 Nov 2011, 08:25 
Offline
MΩth √G∑∏∫∪≤

Joined: 03 Dec 2007, 11:37
Posts: 1059
Just remembered to say this, "146_%u_%u.rt" should be "146_%llu_%u.rt" or "146_%I64u_%u.rt" in windows.

_________________
http://www.tobtu.com/


Top
 Profile  
 
PostPosted: 11 Nov 2011, 08:32 
Offline
Total Hash Enlightenment

Joined: 15 Jul 2009, 22:38
Posts: 1483
Location: Dallas, TX, USA
We should probably split this off into a dev topic...

In any case changes applied and heads of crts created. Please find it all attached including make output and source modifications.

output of run:
Code:
frt@iris:~/finalization/146$ ~/src/rtp0.2b/src/rtperfect0.2b64 -v ~/results/146/result/ 146_%llu_%u.rt
Error WriteCRT::writeChain(): Trying to write unsorted data. 0000000074f19c31 >= 0000000074f19c31.


the %u (what we've always used vs the %llu made no difference)

Hrm! That isn't unsorted just matching :D

Code:
NetBSD iris.ziaspace.com 5.99.56 NetBSD 5.99.56 (GENERIC) #0: Fri Oct  7 09:24:36 UTC 2011  builds@b6.netbsd.org:/home/builds/ab/HEAD/amd64/201110070720Z-obj/home/builds/ab/HEAD/src/sys/arch/amd64/compile/GENERIC amd64

frt@iris:~/src/rtp0.2b/src$ g++ -v
Using built-in specs.
COLLECT_GCC=g++
Target: x86_64--netbsd
Configured with: /usr/src2/tools/gcc/../../external/gpl3/gcc/dist/configure --target=x86_64--netbsd --enable-long-long --enable-threads --with-bugurl=http://www.NetBSD.org/Misc/send-pr.html --with-pkgversion='NetBSD nb1 20110620' --enable-__cxa_atexit --with-tune=nocona --with-mpc=/var/obj/mknative/amd64/usr/src2/destdir.amd64/usr --with-mpfr=/var/obj/mknative/amd64/usr/src2/destdir.amd64/usr --with-gmp=/var/obj/mknative/amd64/usr/src2/destdir.amd64/usr --disable-multilib --disable-symvers --disable-libstdcxx-pch --build=x86_64-unknown-netbsd5.99.55 --host=x86_64--netbsd
Thread model: posix
gcc version 4.5.3 (NetBSD nb2 20110806)


Attachments:
File comment: data
rtp0.2b_info.tar.gz [59.75 KiB]
Downloaded 393 times


Last edited by quel on 11 Nov 2011, 08:34, edited 1 time in total.
oh ya os/g++ details
Top
 Profile  
 
 Post subject: RTP 0.2b
PostPosted: 11 Nov 2011, 09:35 
Offline
MΩth √G∑∏∫∪≤

Joined: 03 Dec 2007, 11:37
Posts: 1059
quel wrote:
output of run:
Code:
frt@iris:~/finalization/146$ ~/src/rtp0.2b/src/rtperfect0.2b64 -v ~/results/146/result/ 146_%llu_%u.rt
Error WriteCRT::writeChain(): Trying to write unsorted data. 0000000074f19c31 >= 0000000074f19c31.

That is very weird since writeChain() is only called when the endpoint changes. Also the 146_1958416930_5-head.crt file has an endpoint of 0015d447fc3c2f8d.

I looked through the 6??-head.crt files and there isn't an endpoint of "000000000000cd1a" but there is one in 146_4294901760_0-head.crt

146_4294901760_0-head.crt:
Code:
0000000: f32a84230c000000 1acd000000000000 0000  .*.#..............
0000012: 6629d3c10b000000 418e020000000000 f6dc  f)......A.........
0000024: 57256f5802000000 05e1020000000000 6386  W%oX............c.
0000036: ad32994813000000 97c0050000000000 e010  .2.H..............
0000048: a8129b330e000000 4a60070000000000 e264  ...3....J`.......d
000005a: 094fd7440c000000 1f91080000000000 de6d  .O.D.............m
000006c: 44b570ab03000000 f5770a0000000000 cde1  D.p......w........
000007e: 48aef71c06000000 bb64160000000000 c6f8  H........d........
...

1111-0.crt (using 6??-head.crt)
Code:
0000000: 9d08c71418000000 0000000000000000 0000  ..................
0000012: 624bb1fc15000000 418e020000000000 ddeb  bK......A.........
0000024: 76a823bd15000000 05e1020000000000 f43a  v.#..............:
0000036: eb8964a017000000 4a60070000000000 41f6  ..d.....J`......A.
0000048: 4a83c52b16000000 e3ef210000000000 02e7  J..+......!.......
000005a: d025ab8317000000 fcc8390000000000 cad8  .%........9.......
000006c: 8d748c7415000000 b100410000000000 7048  .t.t......A.....pH
000007e: 5a38670416000000 e450530000000000 9e7a  Z8g......PS......z
...

_________________
http://www.tobtu.com/


Top
 Profile  
 
 Post subject: Re: RTP 0.2b
PostPosted: 11 Nov 2011, 19:31 
Offline
Total Hash Enlightenment

Joined: 15 Jul 2009, 22:38
Posts: 1483
Location: Dallas, TX, USA
The whole table is files 1.rt to 1254.rt each with 18 byte chains (CPs) and each 2.5G sorted. Due to the speed of perfecting we split it into 100 or 200 file chunks (including the files from the last perfecting run) and continue until we finish. Each run is ~/bin/rtperfecter0 -v -s=65535 ~/results/146/result 146_%u_%u.rt and the output except the last file is 72G. The result dir is cleared after a run, 146_* output files moved to result and more rt files moved there and off we go again. Though -s has a different meaning in the old tool and the new tool. In any case none of this is conversion just perfecting.


Top
 Profile  
 
 Post subject: Re: RTP 0.2b
PostPosted: 11 Nov 2011, 21:48 
Offline
Total Hash Enlightenment

Joined: 15 Jul 2009, 22:38
Posts: 1483
Location: Dallas, TX, USA
So it is assuming everything is sorted ie perfecting is completed and now it is ready to convert formats? Each input file for perfecting is sorted on EPs but they have to be merged as each file isn't sequential as it is taking WUs as it gets them during generation. Am I missing something as this is the merging during perfecting we've always done.


Top
 Profile  
 
 Post subject: Re: RTP 0.2b
PostPosted: 12 Nov 2011, 00:46 
Offline
MΩth √G∑∏∫∪≤

Joined: 03 Dec 2007, 11:37
Posts: 1059
Here are some changes that should help find the bug. I think I'm going to run a more thorough test on my end because everything is working. You said something about there being a lot of warnings can you post them. I think there might be something that works in VC++ but not in GCC like this was the first time I ever ran into "deleting a void* is undefined." Ohh wait they don't want you to do "Class *p = new Class(); void *q = p; delete q;" because the destructor isn't called.


Attachments:
rtp0.2b-test.zip [4.92 KiB]
Downloaded 418 times

_________________
http://www.tobtu.com/
Top
 Profile  
 
 Post subject: Re: RTP 0.2b
PostPosted: 12 Nov 2011, 00:58 
Offline
Total Hash Enlightenment

Joined: 15 Jul 2009, 22:38
Posts: 1483
Location: Dallas, TX, USA
Sc00bz wrote:
Here are some changes that should help find the bug. I think I'm going to run a more thorough test on my end because everything is working. You said something about there being a lot of warnings can you post them. I think there might be something that works in VC++ but not in GCC like this was the first time I ever ran into "deleting a void* is undefined." Ohh wait they don't want you to do "Class *p = new Class(); void *q = p; delete q;" because the destructor isn't called.


I'll give it a shot. I attached the complete build output in the .tar.gz. I think I called it make.out. I fixed up a lot of the warnings by proper defines for UINT64 and PRIx64. One of the defines you had in the WIN32 block only and 1 define was missing altogether. It's really obnoxious before you include the header file you have to define things to make it work correctly. This is also why I attached my modified source.


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 44 posts ]  Go to page 1, 2, 3  Next

All times are UTC + 1 hour [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB® Forum Software © phpBB Group