Something wrong with ADRIA. It's not checkpointing. After 7 hours - it's 99.5% done, but slowed to a crawl. I had to reboot, and it restarted from 0%.

they run for a long time. my RTX 2070 took like 17hrs to complete. just let it go.
____________

I just got my first WU and the clock is climbing. It's taken 1:40:00 for 6%, the estimated time is now at 26h and climbing.

GTX 980 Ti

Update: It reached 10% at 2h50m elapsed.

I have one running on my power limited RTX 2080 Ti.
It's at 3.333% after 26m 30s, so it will take around 11h 45m.
Perhaps it will take a bit less than that as the progress indicator restarted after a few minutes.
TBH this is the "usual" lenght of a long workunit. (maybe it's 50% longer than the usual).
EDIT:
I have another one running on another RTX 2080 Ti (It's not power limited, also it's a Linux based host)
The progress indicator falls back to 0.666% after 4 minutes, then goes up by 0.666% increments raughly by every 4 minutes so it will take raughly 10 hours on that host.

The progress indicator falls back to 0.666% after 4 minutes, then goes up by 0.666% increments raughly by every 4 minutes so it will take raughly 10 hours on that host.

The progress indicator falls back to 0.666% after 4 minutes, then goes up by 0.666% increments raughly by every 4 minutes so it will take raughly 10 hours on that host.

For the first minute, progress will be shown as zero. The next three minutes (variable according to the speed of your device) will be pseudo-progress invented by BOINC: no significance should be attached to the value shown.

The 0.666% value and onwards will be genuine values, and can be used for estimating the final run time - as you have done.

They show the points where the app writes a checkpoint file - I'm seeing "restart.chk" files being written in the slot directories.

But the app doesn't appear to be able to detect or use these files to resume computation after a restart.

The progress indicator falls back to 0.666% after 4 minutes, then goes up by 0.666% increments raughly by every 4 minutes so it will take raughly 10 hours on that host.

For the first minute, progress will be shown as zero. The next three minutes (variable according to the speed of your device) will be pseudo-progress invented by BOINC: no significance should be attached to the value shown.

The 0.666% value and onwards will be genuine values, and can be used for estimating the final run time - as you have done. They show the points where the app writes a checkpoint file - I'm seeing "restart.chk" files being written in the slot directories.

But the app doesn't appear to be able to detect or use these files to resume computation after a restart.

What about the wrapper_checkpoint.txt file in the slots. Is that the file used to checkpoint restart with wrapper apps?

Or is it always the restart.chk or restart.chk.bkp files that are used to restart a task?

This task must have used the checkpoint files. It also was able to switch between devices without erroring out.
https://www.gpugrid.net/result.php?resultid=32507970

This task must have used the checkpoint files. It also was able to switch between devices without erroring out.
https://www.gpugrid.net/result.php?resultid=32507970

And here. One on a 1050 Ti was swapped out after 24 hours (that was enough in the good old days ...), but didn't lose the 35% done on restart.

I do wish the devs could notify us when they've fixed reported problems. Toni?

The one task I referenced that was able to switch and restart on a different device may have been a fluke or something.

I have another task that errored out for restarting on a different device already.
https://www.gpugrid.net/result.php?resultid=32509275

The one task I referenced that was able to switch and restart on a different device may have been a fluke or something.

I have another task that errored out for restarting on a different device already.
https://www.gpugrid.net/result.php?resultid=32509275

Up until this one task outlier, I have always thrown an error when restarting on a different device type. Two of my three hosts are mixed gpus types, different generations.

This daily driver has the same gpu type of all cards, RTX 2080 Hybrids.

I have never had an restart failure on any task on this host. Countless tasks have restarted on a different device ID and properly restarted and completed.

Datapoint: My progress has been in 0.333% increments. (GTX 980 Ti)

No luck so far with this new ADRIA WUs so far!
This computer with a GTX2070 http://www.gpugrid.net/result.php?resultid=32508594
Produced an ERROR:

AFAIK, there is no way to undervolt an Nvidia card.

AFAIK, there is no way to undervolt an Nvidia card.

You cant undervolt in Linux directly, but you can lower the power limit if all you are trying to do is use less power.

check stock power limit with
nvidia-smi
~151W for my 1070
~170W for my 2060

set new power limit with
nvidia-smi --power-limit=***
*** is desired power limit in Watts

My 2060 is completing these tasks in around 69500-70000seconds or 19.4hours


EDIT: I was brave and restarted my Win10 rig with one task at 54.667% complete and it restarted the task at the same percentage. I will check it when its done to see if there are any errors, but there is definitely a checkpoint being used.

My first WU completed and validated. Finally.

https://www.gpugrid.net/workunit.php?wuid=27023218

Sent 10 Feb 2021 | 17:42:37 UTC
Received 12 Feb 2021 | 2:30:35 UTC
Credit 435,937.50 (wow!)

GTX 980 Ti

My next WU is a retry of a failed attempt by another system. It's running A LOT faster than my first WU. I'll report back when it completes.

https://www.gpugrid.net/workunit.php?wuid=27025153

You cant undervolt in Linux directly, but you can lower the power limit if all you are trying to do is use less power.

check stock power limit with
nvidia-smi
~151W for my 1070
~170W for my 2060

set new power limit with
nvidia-smi --power-limit=***
*** is desired power limit in Watts

My 2060 is completing these tasks in around 69500-70000seconds or 19.4hours


EDIT: I was brave and restarted my Win10 rig with one task at 54.667% complete and it restarted the task at the same percentage. I will check it when its done to see if there are any errors, but there is definitely a checkpoint being used.

My next WU is a retry of a failed attempt by another system. It's running A LOT faster than my first WU. I'll report back when it completes.

https://www.gpugrid.net/workunit.php?wuid=27025153

I was able to exit/restart the client at 54% and it continued as expected. (Win64)

And...scene.

Run time 106,374.11
CPU time 106,292.60
Validate state Valid
Credit 348,750.00

https://www.gpugrid.net/workunit.php?wuid=27025153

Be happy if they finish at all. Mine (3 at this time) ran between 5,000 and 90,000 sec on a GTX 1660 Super and all errored out. I aborted the last WU in progress now...

Be happy if they finish at all. Mine (3 at this time) ran between 5,000 and 90,000 sec) on a GTX 1660 Super and all errored out.

Thanks Ian for the diagnostics! Just did revert back to the stock settings. Hope I'll catch a resend and can try again. Still weird as all other apps do work with the mild OC setting just fine. Never had a single error thrown so far, except on MLC. But that's mostly due to the inherent nature of these tasks where occasionally a WU results in a NaN error.

About that restarted WU on the other device. I noticed that too, and noticed that due to dry spell here I forgot to set up the <exclude gpu> poilicy in my cc_config file on this new host and the slow 750Ti just happend to pick it up. That's solved as well for now.

I'll see how the 1660 Super handles tasks in the future!

A reduced amount of a new kind of ADRIA tasks seems to be in the field.
My host #557889 received one of them, named "e1s45_homeodomain_folded_100ns_44-ADRIA_HomeoFolded100ns-0-1-RND7761_0"
Progress for this task is about 66% after 5,5 hours on a GTX 1650 GPU.
Therefore, initial estimation is pointing that these tasks are much shorter than previous ones.
I'm not testing for the moment whether they checkpoint right or not...

i also received a couple of these tasks, and concur that they complete in less time. my 2080ti completed them in about 9,000s vs ~36,000s on the longer running tasks.

payout is 76,500cred
____________

In the case of my GTX 1650 and mentioned task, 30,471 seconds versus ~170,000 seconds for the previous ADRIA tasks in this device.
The same amount of 76,500 credits was awarded, since result was returned in time for full bonus.

e1s45_homeodomain_folded_100ns_44-ADRIA_HomeoFolded100ns-0-1-RND7761_0