myGrid

Long running workflows

Details

  • Type: New Feature New Feature
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Fixed
  • Affects Version/s: None
  • Fix Version/s: 1.6
  • Component/s: None
  • Description:
    Hide

    http://www.mygrid.org.uk/wiki/Techreq/LongRunningWorkflows

    Also covers T2 requirement ui10 - Ability to connect and reconnect to a remote enactment service. This really should be part of the current release but probably too much effort to do this for little reward given the poor scalability of the current enactor.

    Show
    http://www.mygrid.org.uk/wiki/Techreq/LongRunningWorkflows Also covers T2 requirement ui10 - Ability to connect and reconnect to a remote enactment service. This really should be part of the current release but probably too much effort to do this for little reward given the poor scalability of the current enactor.

Issue Links

Activity

Hide
Stian Soiland-Reyes added a comment - 2006-08-15 17:27

ALLOCATED to Stuart

Show
Stian Soiland-Reyes added a comment - 2006-08-15 17:27 ALLOCATED to Stuart
Hide
June Finch added a comment - 2006-10-16 14:43

Stian - This should be on you (but not until after the 1.5.) Please make reference to Stuart throughout this process as discussed previously. June.

Show
June Finch added a comment - 2006-10-16 14:43 Stian - This should be on you (but not until after the 1.5.) Please make reference to Stuart throughout this process as discussed previously. June.
Hide
June Finch added a comment - 2007-01-04 09:29

Assigned to Stuart as overall architect responsible for this solution (to be worked on by both Stuart and Stian)

Show
June Finch added a comment - 2007-01-04 09:29 Assigned to Stuart as overall architect responsible for this solution (to be worked on by both Stuart and Stian)
Hide
Stian Soiland-Reyes added a comment - 2007-01-31 11:03

I've added a module "taverna-service" to CVS with the miniservice I tried to make, however I currently have problems launching this through Eclipse..

Show
Stian Soiland-Reyes added a comment - 2007-01-31 11:03 I've added a module "taverna-service" to CVS with the miniservice I tried to make, however I currently have problems launching this through Eclipse..
Hide
Stian Soiland-Reyes added a comment - 2007-02-01 13:31

Has:

  1. Create a web-service using X-fire (or axis) that accepts a workflow and its inputs - 1 day
  2. Implement queing mechanism - 1 day
  3. Queue listener that triggers the running of a workflow if none are already running, and also collects the next workflow if available on a queue when one has finished - 2 days
Show
Stian Soiland-Reyes added a comment - 2007-02-01 13:31 Has:
  1. Create a web-service using X-fire (or axis) that accepts a workflow and its inputs - 1 day
  2. Implement queing mechanism - 1 day
  3. Queue listener that triggers the running of a workflow if none are already running, and also collects the next workflow if available on a queue when one has finished - 2 days
Hide
Stian Soiland-Reyes added a comment - 2007-08-08 11:19

0.4.0 tagged and snapshot-released to CARMEN.

Email from Stuart 2007-08-07:

Hi Georgios.

I've now deployed the Remote Execution plugin for Taverna that I said I would provide to you. Taverna 1.5.2 is required to install the plugin, and can be installed by

  • Open Tools/Plugin Manager
  • Click Find New Plugins
  • Click Add Plugin Site
  • Add the following URL for the site, and provide a name of your choosing. This is a temporary plugin definition until Taverna 1.6 is released.
    http://www.cs.man.ac.uk/~sowen/plugins/
  • You should now should now get the option to add the Plugin "Remote Taverna Execution 0.4.0". Click the checkbox and select Install. It may take a little while to download all the plugin components. When I was testing I found it took about 5 minutes.

The server component can be downloaded from:
http://www.cs.man.ac.uk/~sowen/files/remotetaverna.war
and we've put together some installation and configuration instructions here:
http://www.cs.man.ac.uk/~sowen/files/remotetaverna.html

Once the plugin is installed and the server is installed and running you then need to configure the plugin. Whilst on the "Execute Remotely" perspective within Taverna select "New". You now need to provide a new and the URI of the server. This is the baseURL you provided when setting up the server, with '/v1/' appended (this is a REST convention). I believe the trailing slash is necessary at the moment. You must also provide a username and password for a user you added whilst setting up the server. You will know you are successfully connected when at the bottom of this screen there is the log message: "Loaded Jobs from <name>". (Whilst writing this I've noticed that you sometimes have to resize the Taverna window for this log panel to become visible).

To run a workflow simply click the "Run workflow remotely" button, and also provide any inputs if required.

Once a workflow has been submitted it is placed on a Queue. In this version the queue is monitored every 20 seconds, after which the workflow will enter the DEQUEUED state. For your first run you may find this takes some time as the Taverna invocation module will need to download some dependencies to the Taverna Home location you configured whilst configuring the server. After this the workflow will start running and you can view its progress by clicking on its entry in the list and selecting the View Progress button. Once the workflow has finished running it will be marked as COMPLETE and you can view the results by clicking on the same button. It is not possible to close the progress in the version for 1.5.2 since this requires core Taverna changes, so unfortunately you currently have to restart Taverna to view the results if you've been monitoring the workflow progress.

You can refresh the view by clicking the refresh button, and clicking on the entries in the list will expand them to allow you to delete a waiting job, view its progress or view its final results.

Please let us know how you get on. I am away on holiday as from Thursday but you can contact Stian or June whom I've also CC'd this email to.

regards,
Stuart.

Awaiting further bug reports and feature requests for finalisation with Taverna 1.6 release

Show
Stian Soiland-Reyes added a comment - 2007-08-08 11:19 0.4.0 tagged and snapshot-released to CARMEN. Email from Stuart 2007-08-07:
Hi Georgios. I've now deployed the Remote Execution plugin for Taverna that I said I would provide to you. Taverna 1.5.2 is required to install the plugin, and can be installed by
  • Open Tools/Plugin Manager
  • Click Find New Plugins
  • Click Add Plugin Site
  • Add the following URL for the site, and provide a name of your choosing. This is a temporary plugin definition until Taverna 1.6 is released. http://www.cs.man.ac.uk/~sowen/plugins/
  • You should now should now get the option to add the Plugin "Remote Taverna Execution 0.4.0". Click the checkbox and select Install. It may take a little while to download all the plugin components. When I was testing I found it took about 5 minutes.
The server component can be downloaded from: http://www.cs.man.ac.uk/~sowen/files/remotetaverna.war and we've put together some installation and configuration instructions here: http://www.cs.man.ac.uk/~sowen/files/remotetaverna.html Once the plugin is installed and the server is installed and running you then need to configure the plugin. Whilst on the "Execute Remotely" perspective within Taverna select "New". You now need to provide a new and the URI of the server. This is the baseURL you provided when setting up the server, with '/v1/' appended (this is a REST convention). I believe the trailing slash is necessary at the moment. You must also provide a username and password for a user you added whilst setting up the server. You will know you are successfully connected when at the bottom of this screen there is the log message: "Loaded Jobs from <name>". (Whilst writing this I've noticed that you sometimes have to resize the Taverna window for this log panel to become visible). To run a workflow simply click the "Run workflow remotely" button, and also provide any inputs if required. Once a workflow has been submitted it is placed on a Queue. In this version the queue is monitored every 20 seconds, after which the workflow will enter the DEQUEUED state. For your first run you may find this takes some time as the Taverna invocation module will need to download some dependencies to the Taverna Home location you configured whilst configuring the server. After this the workflow will start running and you can view its progress by clicking on its entry in the list and selecting the View Progress button. Once the workflow has finished running it will be marked as COMPLETE and you can view the results by clicking on the same button. It is not possible to close the progress in the version for 1.5.2 since this requires core Taverna changes, so unfortunately you currently have to restart Taverna to view the results if you've been monitoring the workflow progress. You can refresh the view by clicking the refresh button, and clicking on the entries in the list will expand them to allow you to delete a waiting job, view its progress or view its final results. Please let us know how you get on. I am away on holiday as from Thursday but you can contact Stian or June whom I've also CC'd this email to. regards, Stuart.
Awaiting further bug reports and feature requests for finalisation with Taverna 1.6 release
Hide
Stian Soiland-Reyes added a comment - 2007-08-08 12:16

Marked as Fixed, anything else goes as separate isssues

Show
Stian Soiland-Reyes added a comment - 2007-08-08 12:16 Marked as Fixed, anything else goes as separate isssues

People

Dates

  • Created:
    2006-07-12 16:15
    Updated:
    2007-08-08 12:16
    Resolved:
    2007-08-08 12:16