• Some users have recently had their accounts hijacked. It seems that the now defunct EVGA forums might have compromised your password there and seems many are using the same PW here. We would suggest you UPDATE YOUR PASSWORD and TURN ON 2FA for your account here to further secure it. None of the compromised accounts had 2FA turned on.
    Once you have enabled 2FA, your account will be updated soon to show a badge, letting other members know that you use 2FA to protect your account. This should be beneficial for everyone that uses FSFT.

HFM multiple installs

M

Mike_Shaffer

n00b
Joined
Sep 13, 2013
Messages
38
All:

I had installed HFM on three different PC's so I could monitor WU's depending on my location. I recently realized that the wuhistory.db3 on each PC has data that the other two do not. I have looked through the HFM site on google, this site, foldingforum, and SQLite site and have tried the following:
  1. Exported the data from each wuhistory.db3 data to .sql and .csv
  2. Attempted to merge the exported .sql data using
    sqlite3.exe wuhistory.db3 <wuhistory2.sql
    but get an error due to duplicate key fields.
  3. Successfully merged the csv files but the data is pretty messy in this format. I haven't figured out how to write that back to a db3 file yet.
  4. Attempted to merge data using
    sqlite3.exe wuhistory.db3
    .import wuhistory2.db3

I have already shut down the HFM installations on the other two PC's but kept the data.

I found this thread: https://foldingforum.org/viewtopic.php?f=14&t=9903&start=465 but it does not appear that the solution was found.

It also appears that there are already requests to HFM to add import/export capability, so my question here might be a long shot.

Has anyone has found a command line solution to consolidate the data?



sigimage.php
 
Can you tell us what you are ultimately trying to accomplish here? Are all of your machines on the same network? Is each HFM install only monitoring one machine's folding?

I was playing around with THIS this morning, and it looks like you could pretty easily export the db3's to csv's, combine the csv's in Excel, then reimport to combined file back into a db3 from the database viewer. That is a lot of manual manipulation, so it would depend on what you are trying to do as to whether it would be an option.
 
Musky,

The machines are effectively running on the same network, through a VPN. They were monitoring each other but there were long periods of time between when they were monitoring. So for example, PC 1 has the data for 10/14-10/16 but PC 2 has that data missing because HFM was off. Another example is PC 1 has data from when I first started folding heavily in September, but PC 2 has none of that data. PC 3 is missing most of the data but has some unique data.

I would like to have it consolidated to have the historical data a year from now as I upgrade, change or sell equipment. But mainly, I want to know how much I've contributed to certain projects. Going forward I have created a VM with HFM to monitor all the clients that will be on and accessible through VPN connections.

I worked this morning for an hour or two before I posted and did get all the data consolidated into a CSV file with unique key fields, but the data looks like:

INSERT INTO "WuHistory" VALUES(1 8581 1 1 3 'FOLD1 Slot 01' '192.168.0.117-36330' 'Mike_Shaffer' 33 2.27E+00 100 555 1 '2013-09-07 21:05:59Z' '2013-09-08 17:51:29.799445Z');

There are some duplicate data points which I can clean. I have a total of 1070 data points and at first glance more than 90% are unique. I can automate cleaning up the data in Excel.

I was using the command line of sqlite3. I will look at the database browser this evening. The next step is to get that data back to a db3 format and have HFM read it. My initial tests at the command line to do this have been unsuccessful; maybe the database browser you linked will work.

Thank you for your help! I may not be able to reply again until late tonight (10PM EDT).
 
Last edited:
Now that I know the process, it is as easy as Musky had pointed out. Going through the process step-by-step, trial and error... I ended up with something like this (I'll add / correct if anyone has a question on a particular step and sorry, I did this in Windows):

  1. Gather all the WuHistory.db3 files from any HFM client from C:\Users\User\AppData\Roaming\HFM before uninstalling.
  2. Download an sqlite3.exe version and the sqlitebrowser that Musky refers to above.
  3. For each WuHistory.db3 from each monitoring client, do the following command line with sqlite3.exe
    • sqlite3.exe wuhistory.db3
    • sqlite3> .separator ","
    • sqlite3> .output wuhistory-num.csv
    • sqlite3> .dump
    • sqlite3> .output stdout
    • sqlite3> .exit
  4. Combine all the data (copy-paste) into one wuhistory.csv file in Excel
  5. Remove duplicate data points with various manual or comparitive =if statements or write a macro. I used conditional statements and then manually removed based on logical tests.
  6. Starting with one of the wuhistory.db3 files, use the sqlitebrowser to remove data but keep the table and formatting. This was a critical step for me because I couldn't set the data types in the the browser program.
  7. At a command prompt in the directory that the blank wuhistory.db3 file and the combined csv file are located:
    • sqlite3.exe wuhistory.db3
    • sqlite3> .separator ","
    • sqlite3> .import wuhistory.csv wuhistory
    • sqlite3> select * from wuhistory;
    • sqlite3> .exit
  8. Close HFM
  9. Rename the existing wuhistory.db3 in C:\Users\User\AppData\Roaming\HFM on the computer that will monitor from this point forward.
  10. Paste the new (all data combined) wuhistory.db3 into this directory.
  11. Start HFM and hit CTRL+H or Tools-Work Unit History Viewer.

If you did everything right, HFM will open the history.

Here are references:

Command Examples
Other Command Examples
Sqlite3
Sqlitebrowser
 
You must log in or register to reply here.
Back
Top