Log in to see any non-public content on this page
Athabasca University | AU Student/Staff Login | Invited Guest Login
Athabasca University | AU Student/Staff Login | Invited Guest Login
Why so many questions?
At Athabasca University, our proposed multi-million dollar investment in a student relationship management system, dubbed the 'Student Success Centre' (SSC), is causing quite a flood of discussion and debate among faculty and tutors at the moment. Though I do see some opportunities in this if (and only if) it is very intelligently and sensitively designed, there are massive and potentially fatal dangers in creating such a thing. See a previous post of mine for some of my worries. I have many thoughts on the matter, but one thing strikes me as interesting enough to share more widely and, though it has a lot to do with the SSC, it also has broader implications.
Part of the justification for the SSC is that an alleged 80% of current interactions with students are about administrative rather than academic issues. I say 'alleged' because such things are notoriously hard to measure with any accuracy. But let's assume that it actually is accurate.
How weird is that?
Why is it that our students (apparently) need to contact us for admin support in overwhelming numbers but actually hardly talk at all about the complicated subjects they are taking? Assuming that these 80% of interactions are not mostly to complain about things that have gone wrong (if so, an SSC is not the answer!) then it seems, on the face of it, more than a bit topsy turvy.
One reasonable explanation might be that our course materials are so utterly brilliant that they require little further interaction, but I am not convinced that this sufficiently explains the disparity. Students are mostly spending 100+ hours on academic work for each course whereas (I hope) at most a couple of hours are spent on administrivia. No matter how amazing our courses might be, the difference is remarkable. It is doubly remarkable when you consider that a fair number of our courses do involve at least some required level of interaction which, alone, should easily account for most if not more than all of that remaining 20%. In my own courses it is a lot more than that and I am aware of many others with very active Landing groups, Moodle forums, webinar sessions, and even the occasional visit to an immersive world.
It is also possible that our administrative processes are extremely opaque and ill-explained. This certainly accords with my own experience of trying to work out something as simple as how much a course would cost or the process needed to submit project work. But, if that is the case, and assuming our distance, human-free teaching works as well as we believe it does, then why can we not a) simplify the processes and b) provide equally high quality learning materials for our admin processes so that students don’t need to bother our admin staff so much? If our course materials are so great then that would seem, on the face of it, very much more cost-effective than spending millions on a system that is at least as likely to have a negative as a positive impact and that actually increases our ongoing costs considerably. It is also quite within the capabilities of our existing skillset.
Even so, it seems very odd to me that students can come to terms with inordinately complex subjects from philosophy to biochemistry, but that they are foiled by a simple bit of bureaucracy and need to seek human assistance. It may be hard, but it is not beyond the means of a motivated learner to discover, especially given that we are specialists in producing high quality learning materials that should make such things very clear. And in motivation, I think, lies the key.
Other people matter
Other people are wonderful things when you need to learn something, pretty much across the board. Above all they matter when there is no obvious reason that you should be interested or care about it for its own merits, and bureaucratic procedures are seldom very interesting. I have known only one person in my whole life that actually likes filling in forms (I think it is a meditative pursuit - my father felt much the same way about dishwashing and log sawing) but, for the most part, this is not a thing that excites most people.
I hypothesize that our students tend to need less academic than bureaucratic help at least partly because, by and large, for the coursework they are very self-motivated people learning things that interest them whereas our bureaucracy is at most a means to an end, at worst a demotivating barrier. It would not help much to provide great teaching materials for bureaucratic procedures because 99% of students would have no intrinsic interest in learning about them, and it would have zero value to them in any future activity. Why would they bother? It is far easier to ask someone.
Our students actually like the challenge of facing and solving problems in their chosen subjects - in fact, that's one of the great joys of learning. They don't turn to tutors to discuss things because there are plenty of other ways of getting the help they need, both in course materials and elsewhere, and it is fun to overcome obstacles. The more successful ones tend to have supportive friends, families or colleagues, or are otherwise very single-minded. They tend to know why they are doing what they are doing. We don't get many students that are not like this, at least on our self-paced courses, because either they don't bother coming in the first place or they are among the scarily large percentage that drop out before starting (we don't count them in our stats though, in fairness, neither to face-to-face universities).
But, of course, that only applies for students that do really like the process of learning and most of what they are learning, that know how to do it and/or that have existing support networks. It does not apply to those that hit very difficult or boring spots, that give up before they start, that hit busy times that mean they cannot devote the energy to the work, that need a helping hand with the process but cannot find it elsewhere, or that don't bother even looking at a distance option at all because they do not like the isolation it (apparently) entails. For those students, other people can help a lot. Even for our own students, over half (when asked) claim that they would appreciate more human interaction. And those are the ones that have knowingly self-selected a largely isolated process and that have not already dropped out.
Perhaps more worryingly, it raises concerns about the quality of the learning experience. Doing things alone means that you miss out on all the benefits of a supportive learning community. You don't get to argue, to explain, to question, save in your own head or in formal, largely one-way, assignments. You don't get multiple perspectives, different ways of seeing, opportunities to challenge and be challenged. You don't get the motivation of writing for an audience of people that you care about. You don't get people that care about you and the learning community providing support when times are hard, nor the pleasure of helping when others are in difficulty. You don't get to compare yourself with others, the chance to reflect on how you differ and whether that is a good or bad thing. You don't get to model behaviours or see those behaviours being modelled. These are just some of the notable benefits of traditional university systems that are relatively hard to come by in Athabasca's traditional self-paced model (not in all courses, but in many). It's not at all about asking questions and getting solutions. It's about engaging in a knowledge creation process with other people. There are distinct benefits of being alone, notably in the high degree of control it brings, but a bit of interaction goes a long long way. It takes a very special kind of person to get by without that and the vast majority of our successful students (at least in undergraduate self-paced courses) are exactly that special kind of person.
If it is true that only 20% of interactions are currently concerned with academic issues, that is a big reason for concern, because it means our students are missing out on an incredibly rich set of opportunities in which they can help one another as well as interact with tutors. Creating an SSC system that supports what is therefore, for those that are not happy alone (i.e. the ones we lose or never get in the first place), an impoverished experience, seems simply to ossify a process that should at least be questioned. It is not a solution to the problem - it is an exacerbation of it, further entrenching a set of approaches and methods that are inadequate for most students (the ones we don't get or keep) in the first place.
A sustainable future?
As a university seeking sustainability we could simply continue to concentrate on addressing the needs of self-motivated, solitary students that will succeed almost no matter what we do to them, and just make the processing more cost-efficient with the SSC. If we have enough of those students, then we will thrive for some time to come, though I can’t say it fits well with our open mission and I worry greatly about those we fail to help. If we want to get more of those self-guided students then there are lots of other things we should probably do too like dropping the whole notion of fixed-length courses (smaller chunks means the chances of hitting the motivation sweet-spot are higher) and disaggregating assessment from learning (because extrinsic motivation kills intrinsic motivation).
But, if we are sticking with the idea of traditional courses, the trouble is that we are no longer almost alone in offering such things and there is a finite market of self-motivated, truly independent learners who (if they have any sense) will find cheaper alternatives that offer the same or greater value. If all we are offering is the opportunity to learn independently and a bit of credible certification at the end of it, we will wind up competing on price with institutions and businesses that have deeper coffers, cheaper staff, and less constraints. In a cut-throat price war with better funded peers, we are doomed.
If we are to be successful in the future then we need to make more of the human side of our teaching, not less, and that means creating richer, more direct channels to other people in this learning community, not automating methods that are designed for the era of correspondence learning. This is something that, not uncoincidentally, the Landing is supposed to help with, though it is just an exemplar and at most a piece of the puzzle - we ideally want connection to be far more deeply embedded everywhere rather than in a separate site. It is also something that current pilot implementations of the SSC are antagonistic towards, thanks mainly to equating time and effort, focusing on solving specific problems rather than human connection, failing to support technological diversity, and standing as an obstacle between people that just need to talk. It doesn't have to be built that way. It could almost as easily vanish into the background, be seamlessly hooked into our social environments like email, Moodle and the Landing, could be an admin tool that gives support when needed but disappears when not. And there is no reason whatsoever that it needs to be used to pay tutors by the recorded minute, a bad idea that has been slung on the back of it that has no place in our culture. Though not what the pilot systems do at all, a well-designed system like this could step in or be called upon when needed, could support analytics that would be genuinely helpful, could improve management information, all without getting in the way of interaction at all. In fact, it could easily be used to enhance it, because it could make patterns of dialogue more visible and comprehensible.
In conclusion
At Athabasca we have some of the greatest distance educators and researchers on the planet, and that greatness rubs off on those around them. As a learning community, knowledge spreads among us and we are all elevated by it. We talk about such things in person, in meetings, via Skype, in webinars, on mailing lists, on the Landing, in pubs, in cafes, etc. And, as a result, ideas, methods and values get created, transformed and flow through our network. This makes us quite unique - as all learning communities are unique - and creates the distinctive culture and values of our university that no other university can replicate. Even when people leave, they leave traces of their ideas and values in those that remain, that get passed along for long after they have gone, become part of the rich cultural identity that defines us. It's not mainly about our structures, processes and procedures: except when they support greater interaction, those actually get in the way much of the time. It's about a culture and community of learning. It's about the knowledge that flows in and through this shifting but identifiable crowd. This is a large part of what gives us our identity. It's exactly the same kind of thing that means we can talk about (say) the Vancouver Canucks or Apple Inc as a meaningful persistent entity, even though not one of the people in the organization is the same as when it began and virtually all of its processes, locations, strategies and goals beyond the most basic have changed, likely many times. The thing is, if we hide those people behind machines and processes, separate them through opaque hierarchies, reduce the tools and opportunities for them to connect, we lose almost all of the value. The face of the organization becomes essentially the face of the designer of the machine or the process and the people are simply cogs implementing it. That's not a good way forward, especially as there are likely quite a few better machine and process designers out there. Our people - staff and students - are the gold we need to mine, and they are also the reason we are worth saving. We need to be a university that takes the distance out of distance learning, that connects, inspires, supports and nurtures both its staff and its students. Only then will we justly be able to claim to have a success centre.
Jon Dron
still learning, never learning enough
About me
I am a full professor and Associate Dean, Learning & Assessment in the School of Computing & Information Systems, and a member of The Technology-Enhanced Knowledge Research Institute at...
- Weary, old, a little broken, but not letting go of the dream: edtech in the 21st Century
June 30, 2022 - 10:10pm
Jon Dron - Hot off the press: Handbook of Open, Distance and Digital Education (open access)
January 4, 2023 - 9:55pm
Jon Dron - We need help: Athabasca University is facing an existential threat from the government of Alberta
August 5, 2022 - 4:26pm
Jon Dron - Some meandering thoughts on 'good' and 'bad' learning
December 20, 2022 - 7:39pm
Jon Dron
Jon Dron
still learning, never learning enough
Tag cloud
social software, social media, education, e-learning, learning, elearning, lms, Virtual learning environments, Social software etc, journal, Journals, technology, Complexity, teaching, learning technology, learnng, Complexity and education, online learning, university, soft technology, higher education, motivation, hard technology, pedagogy, athabasca, goal, network, control, social network, social computing, assessment, design, course, distance learning, Papers etc, landing, CMC etc, mooc, learning design, connectivism, research, government, elgg, structure, evolution, Software, Opportunities, CFPs etc, collective, conference, change11
Comments
I suspect one of the reasons for the claim (wild guess?) that such a high percentage of student questions are administrative ones is the same reason any of the "studies" I've seen that conclude that the original School of Business Contact Centre is better than the other options; i.e., they don't seriously consider any other options but phone tutoring and email, perhaps because they didn't know that anything else exists and don't ask. CCISM and CCIS (now SCIS) began using a "bulletin board system" many years ago in some courses, and decided in 2001 to test using a more full-fledged system--now Moodle, previously Bazaar, and before that one whose name I no longer recall. I have done all my tutoring in the SCIS and now AU CMS since 2001, and without actually counting would guess that fewer than 5% of posted questions are administrative--about the same as COMP 266 R3 on the Landing. Never was I asked to collect and submit any stats for any of the courses I've tutored that way.
The ALEC Learning Support Working Group (I and II) didn't have the time or other resources to do a thorough job of clarifying this, and the second LSWG appeared to have abbreviated both their study and report after having decided that resistance to the SSC was futile and that we would all be assimilated.
I submit that the type of 'best case' student you describe in your post would rather quickly figure out that direct contact with the tutor is infinitly superior to the call center, and act accordingly. Whether they use direct email, or moodle forums, or the landing for courses that employ it, self-starting students would quickly figure out that eliminating the middle level (call center) is optimum.
Except moodle, email and the landing are not (yet) locked into the call center analytics, so of course the end result is a (probably) bogus statistic such as you've reported. Or rather, not a bogus stat, but simply a very, very incomplete stat.
Thanks Wayne and Richard!
I'm more than a little sceptical of the 80/20 claim. But perhaps it is true for some courses, or as an overall average, even if it bears no resemblance at all to those we teach. After all, the fact that we are on the Landing and in SCIS (which has long provided tools for supporting richer online communities) does make us atypical. But, in the unlikely event that it is true, it certainly shouldn't be. At worst, it should be the inverse and, if it is not, we need to fix a broken system rather than make the breakage into a virtue.
Indeed, the call centre, as currently implemented, is a barrier and most students I'm aware of bypass it completely: that was the original idea, as our then-VPA presented it, and it makes sense. There was a reply to this post from a student that was later deleted that seemed to confirm it as a barrier. It's also ridiculous to separate out process issues from academic concerns and so much more useful to provide that support where it actually matters and will be read by many (e.g. on the Landing or Moodle).
In committees I sit on (including those making decisions about it) we have been told in no uncertain terms that resistance to the SSC is futile. But that doesn't mean that the future system has to look anything like the ones we have now and it absolutely doesn't have to be a call centre at all. It could simply sit as a service, quietly observing activity (not tracking every email or real-time call, but perhaps bcc'd on those that are relevant), providing a bit of management data, offering an admin FAQ, making it simpler to redirect queries we cannot easily answer, and collecting information for a learning analytics tool. That could help us to spot problems before they become serious, could grease the social wheels, and help us to improve our courses. If it could be hooked into a learning record store then it might be useful to record evidence of learning too. It might even make it possible to engage our admin staff on our social sites - Moodle, the Landing, ePortfolio, etc - by allowing them to see and respond to relevant messages as they came through. That would enrich the community and be great for knowledge flow. Everyone would be a winner, and the only people that would even need to be more than subliminally aware of it would be those that would actually find it useful.
Of course, should we choose a proprietary off-the-shelf system from GreyMatter (as seems probable) any of that would be fiendishly hard and incredibly expensive to do, if it could be done at all. My guess is that it would be impossible without spending many millions more. We need to say no to idiotic ideas like that as loudly as we can.
If it could be hooked into a learning record store then it might be useful to record evidence of learning too
Well, given the fact that it is unlikely we will ever see the moodle gradebook hooked to the Newton grading system, I really doubt any other hookup will occur.
We seem to becoming a really great "tail wags the dog" university. SCC is by/of/for admins and not academics and especially not tutors, email is going away - at least functional email is likely to disappear soon IMO, and so many other systems are driven by anything except academic requirements. Academics are in danger of becoming an extinct species around this place.
Thanks for the post Jon. The 20/80 split btw academic and administrative is a red hering.I have no doubt that the split switches for tutors because we call tutors for academic questions and call centres for admin help. Seems reasonable. Context is important.
The key measure is the actual frequency of academic calls (emails, phone, ?) compared to actual tutor numbers that we don't collect or reliably report. Does the SSC inhibit academic contact? I suspect it does since it certainly generates alternate paths to AE contact.
I also agree that siphoning resources away from the academic side to service a real student admin need will further weaken our ability to engage students.
I would like to see the consolidation bewteen the Info centre, helpdesk and the admin side of the SSC consolidate so that scale and efficiencies could be realized. Regardless of the split, the numbers from SSC reveal, at the very least, there is a real need by students for this type of service, a service that should be funded by admin side, not the academic side.
Thanks Bob - I'm not sure where the 20/80 figure came from but it has surfaced in almost every discussion when the idea has been challenged as a justification, which seems very wrong-headed to me. It's like noticing there are lots of sick people dying of an easily preventable disease and choosing to increase the efficiency of hospital treatments instead of preventing it in the first place.
Consolidation makes sense - one place to shout 'help' with the assurance of being heard seems quite reasonable to me: it could be the start of a bit of useful relationship-nurturing if we did it right. I'm much in favour of a better help tool that could help to connect people as well as to provide answers and generate useful data to support improved learning. It could be done, though it would be foolish, slow and costly to attempt to do it with GreyMatter or any other off-the-shelf CRM tool.
@Richard - I think the Gradebook problem (which should at last be resolved this year) is largely due to the over ambitious attempt to replace Newton in one fell swoop. Integration would have been a much safer and quicker approach and could have eventually led to replacement at a later date. As long as we use open standards and tools, and we don't outsource the wrong things, incremental evolution works better in IT systems most of the time. The trouble is that, from an IT departmental perspective, replacement looks cheaper. This is because the cost of maintaining integrated systems can be quite high, thanks to all those interlinked dependencies, which can really tie up an IT department with inadequate resources and tortuous waterfal processes (ie us). It's just a local saving though. The cost to the organization as a whole of making people adapt to machines rather than vice versa, at least when the organization is fairly large, typically far outweighs the IT department's savings. It's localized thinking that causes the dog-wagging problem. Systems theory should be a prerequisite course for all IT managers. At the very least, all should be required to read Sytemantics!