Posts by TJM

log in
1) Message boards : News : Scheduled upgrades (Message 4954)
Posted 17 hours ago by Profile TJM
The server requires BOINC server code upgrade to support GPU app,
Per-app credits, application selection and a couple of other things.

I have scheduled the upgrade for this weekend, the server will be stopped on saturday, in worst case it might even go completely offline for a couple of hours.
2) Message boards : Number crunching : Enigma AV fails immediately (Message 4917)
Posted 4 days ago by Profile TJM
I've just updated the app to 1.05, this version should fix the problem with missing libraries. There is also default x86_64 app which is about 15% faster.

windows_intelx86 app requires i686 or better CPU. There is almost no performance gain on x86 with SSE or SSE2 enabled (less than 0,5%).

windows_x86_64 app requires 64bit CPU with SSE2.
3) Message boards : Number crunching : Algorithm optimization in the enigma app (Message 4916)
Posted 5 days ago by Profile TJM
To run both apps you need app_info like this one:


<app_info>
<app>
<name>enigma_m4_2</name>
<user_friendly_name>Enigma 0.76b-Opt</user_friendly_name>
</app>
<app>
<name>enigma_m4_3</name>
<user_friendly_name>Enigma AV</user_friendly_name>
</app>
<file_info>
<name>wrapper_5.22_windows_intelx86.exe</name>
<executable/>
</file_info>
<file_info>
<name>enigma_0.76_windows_intelx86.exe</name>
<executable/>
</file_info>
<file_info>
<name>job_1.22.xml</name>
</file_info>
<file_info>
<name>wrapper_1.05_windows_x86_64.exe</name>
<executable/>
</file_info>
<file_info>
<name>enigma3_1.05_windows_x86_64.exe</name>
<executable/>
</file_info>
<file_info>
<name>job_1.51.xml</name>
</file_info>

<app_version>
<app_name>enigma_m4_2</app_name>
<version_num>522</version_num>
<file_ref>
<file_name>wrapper_5.22_windows_intelx86.exe</file_name>
<main_program/>
</file_ref>
<file_ref>
<file_name>enigma_0.76_windows_intelx86.exe</file_name>
<open_name>enigma2_0.76_windows_intelx86.exe</open_name>
</file_ref>
<file_ref>
<file_name>job_1.22.xml</file_name>
<open_name>job.xml</open_name>
</file_ref>
</app_version>

<app_version>
<app_name>enigma_m4_3</app_name>
<version_num>105</version_num>
<file_ref>
<file_name>wrapper_1.05_windows_x86_64.exe</file_name>
<main_program/>
</file_ref>
<file_ref>
<file_name>enigma3_1.05_windows_x86_64.exe</file_name>
<open_name>enigma_av.exe</open_name>
</file_ref>
<file_ref>
<file_name>job_1.51.xml</file_name>
<open_name>job.xml</open_name>
</file_ref>
</app_version>
</app_info>


executables and job file can be downloaded from:
http://download.enigmaathome.net/enigma3_1.05_windows_x86_64.exe
http://download.enigmaathome.net/wrapper_1.05_windows_x86_64.exe
http://download.enigmaathome.net/job_1.51.xml

or if you need 32bit version, replace windows_x86_64 with windows_intelx86 in both app_info and download links.

intelx86 version requires 32bit 686 CPU.
x86_64 version requires 64bit CPU with SSE2. It's up to 15% faster.
4) Message boards : Number crunching : A GPU version of Enigma software (Message 4895)
Posted 8 days ago by Profile TJM
Unigrams result in somewhat higher success rate than bigrams.


Actually it's much higher:



run # bigram unigram
1 66 147
2 13 66
3 245 140
4 68 68
5 53 143
6 599 52
7 17 66
8 587 80
9 1266 4
10 131 100
11 196 58
12 82 134
13 75 16
14 383 120
15 370 25
16 379 86

average 283 81



81 vs 283 average number of passess. I was using unigr.u534 and bigr.u534 both created from the same sample.
5) Message boards : Number crunching : Enigma AV fails immediately (Message 4877)
Posted 10 days ago by Profile TJM
It's just a standard build from Visual Studio 2017. AV is just an abbreviation from author's forum name.
6) Message boards : Bug reports : Enigma AV download errors (Message 4846)
Posted 11 days ago by Profile TJM
Yep, the old server was doing daily snapshots and most recent changes were not backed up when it went down. It should be fixed already.
7) Message boards : Bug reports : Every new top scores posted twice to the forum thread (Message 4845)
Posted 11 days ago by Profile TJM
I think it's fixed already but we will know for sure when top score changes again.
8) Message boards : Number crunching : A GPU version of Enigma software (Message 4844)
Posted 11 days ago by Profile TJM
Since this version is not compatible with standard app, it could be added as a third app, with different keyspace/workunit distribution system (the app that runs uniscore as a first pass shares work generator with 'old' app).

What's the proper command line to run a test against M4 message ? I'd like to see how fast it is because app speed determines min/max workunit key range.

9) Message boards : News : Web server moved to new location (Message 4842)
Posted 12 days ago by Profile TJM
Old server worked flawlessly for nearly 10 years, it never had any serious issues and downtimes were usually caused by scheduled maintenance windows or hardware/software upgrades.

On the 1st of May something broke and it seems like they're unable to fix the problem. AFAIR at some point, years ago, larger company bought the one where I had my service and since then VPS servers are not even listed on their website anymore. Maybe they just had a bunch of VPS servers for old customers with no one maintaining them anymore, and they ran until first serious failure.



10) Message boards : News : Web server moved to new location (Message 4839)
Posted 13 days ago by Profile TJM
Since May 1st my VPS (which is running the web server) was unreachable almost half of the time and it eventually died. The tech support was unable to fix the problem so I decided to move somewhere else.

The server now runs on Amazon Lightsail with a new IP address - 34.203.18.49
11) Message boards : Number crunching : A GPU version of Enigma software (Message 4620)
Posted 17 days ago by Profile TJM
The server is almost ready to support the new app. For testing I added only the 32bit win version, but once the backend is finished it will be easy to add other platforms.
I'll add a couple of test tasks today just to check if the work generator is working and the server can receive results.

EDIT: everything seems to be working (app versions below 1.04 are broken, also some of the released workunits are also broken). The message I used for test (72 letters M4, search on known wheel order with unknown rings, key and stecker) is solved already, even though just a few results were returned.
I'm going to work on validator today.
12) Message boards : News : The reason why work generator is stopped (Message 4618)
Posted 21 days ago by Profile TJM
Just a side effect of preparing the second app - another set of dictionaries assigned to the same message.
It is a short batch and nearly half of it is done already.
The next one will be running second app: http://www.enigmaathome.net/forum_thread.php?id=814

P.S. The server downtimes during the last few days are caused by some kind of technical problems at the company that hosts my frontend, not the hardware maintenance work I have scheduled.
13) Message boards : Number crunching : Algorithm optimization in the enigma app (Message 4617)
Posted 21 days ago by Profile TJM
So I ran series of tests against real M4 messages truncated to 72 letters.

The app is much faster than standard version, however in some scenarios it also requires significantly more walks over the same keyrange to find the solution. On the other hand, some of the tests which are hard to break with the standard app, this one breaks more easily with less restarts.

I used "U534 version 1" dictionary set which was generated from real messages, with the unidict generated from the same plaintexts.

I'm going to add it as a second app. It was scheduled for this weekend but the company that hosts my front end server has some technical problems (as you might have noticed the server was unreachable most of the time during past few days) so probably there will be a delay.

The biggest challenge is to get the work generator (the thing that automatically splits keyrange into workunits and inserts them into BOINC) patched so it could run two or more different app at once. I have already started working on this and perhaps it will be done in a few days.
14) Message boards : News : The reason why work generator is stopped (Message 4461)
Posted 30 days ago by Profile TJM

About mentioned tweaked apps. Does this mean optimized clients will stop working?


It's possible that I'll add support for this app -> http://www.enigmaathome.net/forum_thread.php?id=814 and it'll run as second application with it's own workunit set, but first I need to see what needs to be changed on the server side.
15) Message boards : Number crunching : Algorithm optimization in the enigma app (Message 4460)
Posted 30 days ago by Profile TJM
I'm going to test this app against a set of test files. After upcoming server upgrade it might be possible to add it as a second application with it's own workunit set.
16) Message boards : News : The reason why work generator is stopped (Message 4459)
Posted 30 days ago by Profile TJM

++ interested in when the WU's will begin flowing again??


I don't know yet.
I have planned major update for some of the backend code to fix serious performance bottleneck, after that I'll run a short batch of test work just to verify that everything is still working.

Also, there will be a server/website downtime lasting anywhere from couple of hours to a full day - I'm going to test the hardware and maybe replace the last HDD with another SSD RAID5 setup.
17) Message boards : Number crunching : Old (August 2016) validated tasks not removed (Message 4458)
Posted 30 days ago by Profile TJM
It was a result of hardware failure, there were ~4,5k damaged workunits in the db which just could not be fixed.
18) Message boards : News : The reason why work generator is stopped (Message 4420)
Posted 36 days ago by Profile TJM
I have stopped the work generator because IMO it does not make sense to continue the batch that runs with the original ("naval") dictionary set, where upgraded dictionary sets have already failed with similar number of target restarts.

IMO it's better to try with another dictionary set and tweaked app.
Both cases, however, require major upgrades on the server side - for performance reasons, I have removed some of the functionalities it originally had and now I have to add them back. It's going to take 2-4 weeks because my job leaves me very little spare time. I'm also going to clean the database from any leftovers, there are still over 20k workunits in the db, probably most of them are broken WUs that accumulated over time (at some point there was a sudden failure of SSD drive where the database filesystem is located, it was replaced by RAID5 setup with the data restored from backup, but ~4500 workunits/results ended in messed up state). I'll wait a few days and then all the orphaned workunits / results will be removed.

Also, all future (larger) batches will be split into a group of smaller sub-batches. While the batch is running, the server requires access to all the results that were returned and if the database gets to big, performance suffers. It also makes creating 'offline' backups harder due to the amount of data in the db dump.

In a few days I'll post downloadable results from the previous batches in case anyone wants to take a look.
19) Message boards : News : Planned maintenance on April 18th (Message 4178)
Posted 194 days ago by Profile TJM
And you've just quoted a spammer, which is deleted already. Now I have to edit your post to remove his stupid link :D
20) Message boards : Bug reports : Unable to change or fix profile (Message 4112)
Posted 241 days ago by Profile TJM
Fixed, the button was gone because I upgraded recaptcha lib to the latest code and it was incompatible with the recaptcha calls in create_profile.php

For now I removed recaptcha from profile creation page, as it requires non-zero RAC which is better protection anyway.


Next 20

Return to Enigma@Home main page


Copyright © 2017 TJM