Another Ultifail issue

That was it…

I’ll have a look at it.

[quote=Wg Cdr Trg]ULTILEARN

Ultilearn is currently, our virtual learning environment (VLE), and the HQ staff - both TG and IT - continue to work on its development and believe that many problems will be resolved when we implement the ‘fix’ from Ultimedia.

It is important, however, to make a distinction between the current technical issues of the delivery platform and the quality of the content that it holds. Many complaints received relate to this content rather than the platform. Content issues can be raised in a Change Request through BADER and these are normally actioned within 10 working days. In addition, over the past year TG1 and the BADER Helpdesk Manager have visited 6 wgs/rgns to advise and deliver training. These visits have been received exceptionally well and more are planned this year.

When I took over the TG Branch I inherited an MS Access-based system, written on the back of a fag packet which had no IT support package and which was very unstable. For example, it was impossible to edit or update exam questions. At that time, the RAF was using the CERT system at its training establishment and we spent much time and effort assessing whether it would meet our requirements. Matters were not helped by the high turnover of the CERT RAF staff and the usual perception that our needs were unimportant because ‘it was only cadets’. Moreover, promises of no cost to the ACO were not kept.

Ultilearn was recommended to us by Rgnl Comdt North at the end of 2009. There was an initial set-up cost of £35K with an annual support package of £7K. When Ultilearn came online in 2010, many volunteers expected it to provide brand new, all-singing, all-dancing training material. While this would have been ideal, it was not practicable given our perennial lack of staff resources. The material, after all, does not write itself. The short-term solution was to allow CFAVs to provide most of the material. The result is a collection of lesson packs that vary in quality and style. With the aid of a number of SMEs (including some members of the RAF) we are reviewing our training material in order to bring it up-to-date and develop it for the future. This is a slow process and, inevitably, one that is not given a high priority outside the ACO.

As far as a replacement for Ultilearn is concerned, other VLEs are available. However, after the lessons learned from the procurement of Ultilearn we would not want to rush into adopting an alternative VLE without proper research - otherwise we may find ourselves migrating from the frying-pan to the fire. In any case, a change of delivery platform would not change the content.

We have identified Moodle as a potential replacement system. This is a free VLE currently used world-wide by over 70,000 sites including the RAF and DLP. I have 2 RAFVR(T) Project Officers continuing this research but investigation is still in its infancy. The BADER team have not done any security testing or looked at the possibility of linking the software to BADER. Moodle is an ‘open-source code’ system and we have a site that is for demonstration only. Further development is required to see its full potential and I have laid down no timescale for its introduction. Should you wish to see Moodle in action I can lay on a demo.

To summarise, Ultilearn is currently our VLE. The plan is to continue to develop Ultilearn and make it work for us. However, we are carrying out research and development work on Moodle as a potential replacement should it become necessary. We would not consider any change in VLE until we were satisfied that the replacement was fit for our purpose, provided value for money, and, overall, represented a better solution than our current system.

Regardless of the delivery system, work is in hand to improve the quality of the content – ie the training material. However, this will be a long job.

As an aside, most civilian companies introducing a major new training system such as Ultilearn would have appointed a full-time project team - perhaps even the RAF does this. I just have TG1, supported by the IT staff, and whatever willing volunteers we can find. Not ideal but we do our best.[/quote]

Very interesting.

That rather confirms what I’d heard.

I do find this quote to be quite telling:

It certainly suggests that in hindsight they feel that they rushed into Ultilearn on one reccomendation without properly considering our needs and it’s ability to meet them.

I rather suspect that there are a number of people who could have steered them away from an unwise £35k + expenditure, if they’d been given the opportunity to comment.

A simple, "We are considering ultilearn as our new learning environment. It is envisioned that ‘x, y, z’ will be possible. We welcome comments directed to…"
Where upon they may have recieved advice based upon previous experience with the system which could have helped them make a more informed decision.

The desire to ‘make something fit’ is natural but almost always more costly, and often fails to deliver the desired outcome.

We had a client once who was insistant the we attempt to rework what they had in place already (against our advice).
As they decided they wanted other little tweaks, fixes and features along the way, they continually found that the constraints were such that they had to settle for ‘almost but not quite’ what they wanted.
The project ended up costing somewhere around 25% more than a scratch built system to their initial specifications would have…and they still weren’t entirely happy with it.

Now I know the piece of dross behind the DLP. In my view, this does not recommend moodles use with us.

I wonder if Wg Cdr Trg has spoken to the ACF?

I was told recently that the ACF plans to introduce Ultilearn for adult staff training ‘in the near future’ - this is for things like Protecting Information (which I am aware the ACO does on Ultilearn already), Red Book Tests (of which we are mercifully free), &c. A bit alarming as it’s not exactly been a success so far. CCFs are still not really up and running with Ultilearn but I’ve watch our local ATC sqn trying to do exams (they borrowed a computer room from us for the purpose - I strongly recommend contacting your local CCF if that’s something you’d like to do, as it means you can do them all at the same time on a parade night).

T

Having read the report from TG1, no wonder we are where we are.

The points on here about using staff around the Corps who do things professionally in their real lives shouldn’t be too difficult. Apart from anyone else, we have IT bods, teachers, trainers, project managers all within the staff cadre and as, or, more knowledgeable than HQAC sitters, but because they’re CFAV, their views and opinions would be overlooked. How could a “lowly” CI who works on IT systems or manages projects day in day out, know more than a senior officer, preposterous. I know there are moves to have CFAV involved directly at HQAC, but I can’t help but think they’d be vetted for their Churchill the dog qualities. I’ve spoken to Region Staff who resent meetings at HQAC as they are effectively told to do what they are told and not make any waves, because as one said HQAC staff think they know best, despite never having operated on an ATC sqn. A line that comes up on here consistently.

You have to wonder where and in what context this was seen operating to make anyone at HQAC think it was suited to our circumstances and what makes anyone at HQAC the expert on such matters. Unless it was seen as a VLE working across a large company / organisation with multiple locations (and visiting these locations to speak to people on the ground) all trying to access it at the same time across a large geographic area, controlled from a central location, then I’m afraid it was never going to work for us. When looking on the ultimedia website this wouldn’t have been too hard, but obviously as our masters are not accustomed to this sort of thing, something that never crossed their minds. Given the amount of money involved when buying software, it should have been stage one of the feasibility/suitability study. We were looking to buy some specialist software, for which there were 2 options, so we looked at the companies websites to see who used it and then contacted the users to arrange visits to see it working and ask questions, with our IT technical people with us, who could talk to their IT people. We presented the findings to our dept management who then gave us the OK to contact the firm we thought preferential and start the acquisition. This was an 18 month project, which included the visits, testing and staff training before we started to use it. I’m no expert on these matters, but I think we did a pretty good job as since we acquired it, apart from 3 times when something went awry and the company were with us the next day to sort it out and stayed at no cost as it’s included in the support paid for by the licensing fee. I very much doubt, given acquisition was by TG1’s letter on one man’s say so, any of this was done. I fail to comprehend with something so pivotal to the Corps, that basic acquisition and project management procedures seem to have gone out of the window. Looking on Ultimedia’s website there are commercial users who should have been visited. The analogy here is would you a car without test driving it and maybe 1 or 2 others?

As for the comment about not rushing into another one, I can’t see the problem. This one doesn’t work and the time spent faffing around with fixes and patches, means the software equivalent of an old inner tube, it might last for years or it might last a day. Why they didn’t have a clause in the contract with Ultimedia that if it didn’t work as I imagine it was promised, they could get money back or at least have their support people on site until it’s sorted, baffles me. If they had done Ultimedia would have requested proper testing and trials by HQAC to avoid extra cost to them, let alone what should have been full and proper testing on due diligence grounds by HQAC. Is this contract renewable, I can’t imagine there isn’t an annual licensing cost involved, at which point HQAC say we’re not paying it. To carry on with tweaks is pure folly as the cadets are the ones who are suffering and how many times are we going to get announcements with the word ‘apology’ in there somewhere, as it that makes up for the frustration.

I’ve just said to the sqn staff we are going to have to do exams at the weekend, as at least then we might be able to get on the poxy thing.

Has anyone looked at the website of the developers of Ultilearn?

Ultimedia Limited
Houldsworth Mill
Houldsworth Street
Reddish
Stockport
Cheshire
SK5 6DA

[quote=“scotty101” post=5099]Has anyone looked at the website of the developers of Ultilearn?

Ultimedia Limited
Houldsworth Mill
Houldsworth Street
Reddish
Stockport
Cheshire
SK5 6DA

Conveniently placed in North Region… I hope RC(N) doesn’t have any personal links to the company.[/quote]

I’m sure he didn’t mean it the way it sounds, but does this come across of accusing someone of impropriety? RC(N) is known for being a bit keen when it comes to hunting people down who do this.

Your thoughts?

I’ve removed the last post whilst the mod team have a think about it. Assuming there are no concerns it will be restored.

Anyone fed up of Ultilearn might be interested in my Moodle proof-of-concept.

End shameless plug.

I’m afraid I simply get “access denied”.

hmmm, could well be construed that way, I’d leave the first line and snip the rest out, that way people can make their own minds up?

cheers

DJ

Done. Left the address as that’s freely available through google.

Have PM’d Scotty101

[quote]Scotty,

Your message about Ultimeadia and the RC was trimmed following a mod consideration. If people want to come up with that opinion themselves, that’s up to them but suggesting the RC has been improper could lead to lots of issues, none of which we (or you probably) want.

Please refrain from this type of slander in future.

Thanks
ON[/quote]

[quote=“wdimagineer2b” post=5109]I’m afraid I simply get “access denied”.[/quote]So, comparable with Ultilearn then?

Apologies for that.

Somebody important saw it, and the announcement has been removed whilst various things are integrated.

I forgot to remove the post that I made on this thread.

An announcement will follow within the next week or so. I hope you like it! :mrgreen: