Video: Transforming Learning with EchoExam | Duration: 1800s | Summary: Transforming Learning with EchoExam | Chapters: Introduction to Echo Exam (5.92s), Echo Exam Features (171.43501s), Echo Exam Features (282.87997s), Benefits of Echo Exam (397.61502s), Creating Echo Exam Tests (488.955s), Exam Configuration Settings (999.875s), Exam Reporting Features (1316.1799s), Reporting and Summary (1615.255s)
Transcript for "Transforming Learning with EchoExam":
Hello, everyone, and welcome. Thanks so much for joining today's session, transforming assessment with echo exam. My name is David Kaplan, product expert here at Echo360. And over the next thirty minutes, I'll walk you through how echo exam, part of Echo360 echo system, is helping institutions deliver more scalable, secure, and insight driven assessment experiences across every modality, in person, remote, and hybrid. I'll begin with a brief slide overview to introduce the core benefits of echo exam, how How it enables instructors to create high quality exams more quickly using smart metadata and 19 available question types, including question types such as NCLEX NGN, format specifically for nursing and life sciences. Then I'll show a live demo of key capabilities in action, including our streamline exam creation process using aforementioned metadata and question banks, support for NCLEX questions like Bowtie and Select Matrix, secure exam delivery using browser lock and video proctoring, and powerful reporting tools that provide real time insights for administrators, instructors, and learners alike. This session is designed to be interactive, so feel free to drop your questions and comments into the q and a or chat area on the right hand side of your screen at any time. I'll do my best to address them during the session or at the end, but we'll make sure to get to them in follow-up if we if we're unable to. So without further ado, let's jump over and start talking about echo exam. So Echo360, we reached 2,000 customers, over 486,000 educators, 56,000 administrators, and over 5,000,000 learners. And we drive impact through student engagement, comprehension of, class material, and driving accessibility and enabling everybody to be able to access our content wherever they may be. And so we bring an integrated video engagement, solution, dynamic assessments, AI generated polling content, and an engagement system for students. And we do this through the ecosystem, which is the world's first learning transformation platform. Now in previous sessions that you've you've maybe attended, you've seen that we've gone through Echo360 for corporate, for that specific audience. We've gone through Echo360 for higher ed, focusing on how to how to bring video learning to a broad audience. And then we focused on Echo360 for a formative assessments. These are things like polling in the classroom and making sure that learners are keeping up with the demands of, what they're learning in class. Today, we're focusing on Echo360, which is our summative assessment solution. It allows us to create high stakes exams in seconds using an industry leading summative assessment solution, and that's what we're gonna focus on today. So like I said, Echo360, creating, distributing, and grading high stakes exams instantly. And some of the problems that we seek to solve with Echo360 include creating exams. Right now, it's too tedious and time consuming. Creating the content takes a lot of time, and that's time away from learners with instructors not having as much time from one on one, time with their, with their instructor with their learners within the course. The test content that exists today, even though it may exist and you're pulling things and you're using, content that you already have to create more exams in the future, It's spread across disparate locations and it's hard to find. It's not stored in one place that everybody has access to as a single repository. With AI tools and an ever expanding, way that, learners can be academically dishonest. Academic integrity is harder than ever to protect, and we're seeing that more and more. This is a big problem with summative assessments, and I'm sure many of, your institutions are facing this as well. Nursing programs struggle to implement NCLEX and GN formats. These are really complex question types, and not every solution has a way to deliver them in a seamless way that make sure that you're able to pull in exactly what those accreditation resources look like. And lastly, reporting on and grading exams requires hours of grading and then data analysis, and all of that is time away from for instructors to actually be one on one with learners and helping them actually get more out of their class. Right? We wanna we wanna make sure that instructors aren't forced to have to spend so much of their day reporting and grading exams. And so Echo360 exam seeks to solve these shortcomings. We can manage and we can store 19 available question types and assets like images, case studies. That's in addition to the question banks that keep all the summative assessment materials in one place as a single source of truth. Creating test content. Echo360 Exam saves all of that, content with an instructor view, and it allows you to seamlessly create that, new assessment from an interface, which I'll show you, from our test generator interface. We have secure exam proctoring. So Echo360 Exam is built with security in mind. We have browser lock by Respondus. We have, the gold standard in video content management with Echo360 Video that works alongside Echo360 Exam for video proctoring as well. Additionally, we have, the ability to use Microsoft Teams, Zoom, and Google Meet interoperably to deliver that video proctoring experience, when desired. And Echo360 Exam includes reporting functionality for instructors and learners to glean insights regarding performance. So instructors can look at macro trends and see how certain questions may have been performing across the entire, group of students or learners. The individual student or learner can see how they performed, what sorts of questions they got wrong, what were those questions, what was the content within those questions they struggled the most with to help them inform future future learning. And, really, this is key because that ecosystem, radial circle that I showed you earlier, we're our goal is to help you create, engage, and assess, and that creates a a circle of learning. And when we're able to deliver these reporting and analytics, it completes that circle and continues to make sure that the the content creation and the engagement that goes forward in the future has taken those insights and, used them going forward. So the benefits of Echo360 exam, building off of that key functionality, we help you create exams in less than two minutes. Your stored question banks, your tagged metadata, the 19 available question types that we support including NCLEX, all of that serves the purpose of helping us create content in less than two minutes. We have a we have an accessible environment. Learners are presented with an open open and accessible environment to test in. They have access to the user way widget, that they can take that they can make use of so that they they can see the content in a way that's best for them. But in addition, instructors and admins have the ability to allot one and a half or two x time to learners who qualify for specific accommodations. The results are trusted. Since Echo360 exam is built with integrity at the core of the functionality that it's delivering, instructors and learners can trust the results as a true reflection of learner knowledge. And we deliver automatic grading and reporting so that assessments are graded automatically, less time grading, less time running data analysis, more time on the instruction process and lesson building and focusing on what that key content is going to be. So with that, let's dive right into the solution and I'll give you a taste of what Echo360 exam may be able to do for your institution. So right now, we are in the Echo360 exam, main library area, and this is from an instructor's point of view. So the first part of this, demonstration is gonna be focused specifically on what the instructor would see as they go through the process of creating and storing their content and managing it as they look to assign it to their learners. Really simply, our library is where we where we store our past tests, publisher titles that we may have, may have access to in terms of question banks and content that we've gotten specifically from a publisher partner that we're using. Questions individually or question banks, groups of questions that we've stored, files, images, things of that nature that would that would specifically build into the testing content. We also have our case studies. So these are gonna be case studies that are attached to questions and give you the flexibility to provide the case studies in addition to the question themselves. Metadata. So this is really tagged information. All of these are stored within your library as well. Topics, keywords, standards, difficulty, reference material, all things that help to, build our test content based on some specific standards that we have. And then lastly, we have shared functionality. Now this is brand new. It's really exciting. Administrators and instructors now have the ability to share content amongst themselves across departments, etcetera, to make sure that, the best practices are being leveraged across the entire institution. And so by default, you'll see that I'm looking at my my content is here by default as the owner, as it as it appears right now. So all of this is gonna be my content. But if I hit the x on this and I clear the filters, all of the content across the entire organization that I have access to will become visible. But let's just go ahead and and reapply that filter for my content. Perfect. So these are all of our tests that have already been generated, but let's show you how easy it is to create a test in less than two minutes. And the way we do that is by clicking on new test. Now by default, it's gonna ask us to name our test. So in this case, we can say transforming learning with Echo360 exam. I'm sure everybody who has had the pleasure of trying to type in a webinar has experienced, the typos. I'm gonna go ahead transforming learning with Echo360 exam, and we have two options. The first is we can create, a test using a blank test. We can start from scratch. We can pull in questions and build it as we go. That's one option. But the second option and my personal favorite is the test generator. And what the test generator allows us to do is it simplifies the test creation process into a simple three step process. The first step in this process is to select our question banks that we wanna pull from. So let's just say we wanna pull in science related questions. So I'm gonna go through and I'm just gonna look for anything science related. Biochem, some sample science, etcetera. And what's really great is when we go in and we actually pull from our available banks that we have, on the bottom left, you're gonna see we 263 questions available. Now that means that that's the entirety, of our of our question universe that we can pull from when we're creating this test, within the generator. As we start to filter down more and more, you'll see that number start to get smaller, as we choose more, potential, filters. So the second step is filtering by metadata. This is that tagged information that I referenced earlier. And so this includes things like topics, keywords, other standards, difficulty, reference material, learning objectives, really anything that you wanna have attached to your questions. And so if we click through here, we'll see, you know, we can filter by keywords if we want to use a photosynthesis, Mars, Earth, solar system, but we really wanna make sure we're honing in on a specific kind of science or a specific area of study. You can also go into standards if the content that you're looking to, pull from is is listed in a specific standards body, as well as difficulty level and reference material and learning objectives. For the purposes of this, I'm actually gonna keep it open ended. I'm gonna leave it open so that we maintain the the the broadest amount of questions that we can pull from. And then lastly, what you're gonna see, the third step is selecting our question types. So this is gonna be, where you can access the 19 available question types that I referenced earlier. Things like NCLEX, Bowtie questions, bimodal questions, choice matrix, drag and drop, drop down table. But we also have simpler questions, that you've come to expect, like multiple choice, multiple select, true false, short answer. And all of this seeks to help you, make sure that you're asking questions in the ways that, are best for the subjects and for the areas of of research and study that you're coming from. Hot spot questions are particularly, popular for users of Echo360 exam. This allows you to choose an image and select an area of the image that would be the proper answer, and we can get really granular about the specific area of a hot spot question that you can tap on that counts for it, whatever shape you actually want. So those are just a few of our question types. I'm gonna go through and I'm gonna just select. Let's say we wanna make a 25 question, test. I'm gonna choose two hot spot questions. I'm gonna I'm gonna choose, let's say, one bow tie question. I'll do, let's say, 15 multiple choice. We'll do six true false. That gets us 24. Let's do one more question. We'll have a short answer question. And right there on the bottom left, you're gonna see now we have 25 questions selected. So literally, in less than two minutes, you're able to go from idea to exam. Now once we've actually generated that test, you're gonna see all of the questions appear here, in this in this simple navigate view here on the left. And if you're interested in looking at what specific questions have been pulled from, you can go in and and you can optimize that exactly, as you want. If you notice that there's a typo or something that you wanna fix in any of these questions, you can go ahead and make any edits that you'd want to. So I'm gonna remove the y here. If we want to, we go ahead and hit save. What's really great is that when we make a change in one place, it takes effect everywhere. So if you really notice something that needs to be updated or needs to be changed, you don't have to go to the question bank or the question and update it there and then update it everywhere it takes place. One stop editing makes it really simple. For the purpose of this, I'm gonna I'm gonna it was correct the first time, so I'm gonna put the y back. And so let's just say, we want to take a look at, some other options within the question itself. You'll see on the right hand side, we can decide if we want to allow calculator use where a calculator will actually appear in line with the test content for for learners. We can also reference the the specific tag information that's here. We can add more if we want to. And then lastly, we have the ability as an instructor to create feedback or rationale or specific annotations that remain private to the instructor that are shared potentially with the learner if you would like, as part of the reporting process so they can see, you know, why their question was maybe right or wrong depending on if they chose the correct or the incorrect response or rationale for why the answer to that question was such. So this is really helpful for providing feedback to large groups of ins of learners, specifically when we think about a lecture hall at a at a at a major university. Really, all the way down to a smaller class with maybe twenty twenty learners or even fewer. So in addition to this, we can set time limits. We can group questions together, to configure groups for the test if we want to, if all the questions are related to one another, specifically if there's a case study that you wanna link it all to. But we can also enable time limits for the test if we want to. So we can set it by question or for the overall test. And this is really where that accessibility comes in as well because if we set a time limit for an hour and there's students or learners on your roster that qualify for accommodations, they will automatically get ninety minutes or two hours to complete that hour long test in the event of, supplying that amount of time. But let's just say for the purposes of this, I'm happy. I wanna go ahead and create the new exam from the test content that we have now. So I'm gonna go ahead and do so. I'm gonna click new exam. And that launches our, exam wizard, and this allows us to select the specific course that we want this to go to, this test that we're, that we're generating here. So let's just say, in this case, we are gonna put it into science. I'm gonna call this the transforming learning exam, and I'm gonna go hit next. Now we can set the availability, the start and the due date for when we want this content to become available and close. In this case, I'm gonna leave it open ended. It also set scoring thresholds at risk review and passing. What's really great about this is for an instructor, they can automatically determine, based on the scoring of this, how their content is being received and how their learners are performing so that they can start to think about, which of their learners they should be focusing on maybe as the as the course continues on for who they should be focusing on most for improving. Next, we get to the settings area. This is perhaps the most beneficial screen in the entire solution for all of our customers, and and we get a lot of great feedback about this. This is where you can really get into the nitty gritty and assign specific settings that you want to make sure that learners and instructors are getting the most out of Echo360 exam. First and foremost, we have our exam settings. This allows or disallows backward navigation in the exam, and you can turn that on or off at your discretion. We can select first answer only if we don't want learners to be able to change their answers after they've selected one. We can decide if we wanna show the feedback that the instructors are leaving, based on some of the questions that we, that we had before for that correct and incorrect response. We can also, look at integrity settings. This is really where we start to combat some of those, academic dishonesty, methods that we referred to earlier. So first and foremost, we can go ahead. We can randomize the questions and answers. That way, no two learners are getting the same exact test. We can also block, cut, copy, and paste. So people can't have, a window open with maybe their favorite AI tool in the other corner, copying and pasting answers in from other sources. So we can cut that immediately. But if you wanna go even further, we have browser lock. And what browser lock enables is it turns on our Respondus, our browser lock by Respondus integration, and it ensures that learners are not able to access anything else outside of the window that they are, participating, in the exam. Except if they want to allow external applications or specific URLs. Now why would an instructor wanna do that? Why would they wanna have specific content available if we're turning on browser lock? The reason is because you'll see in the bottom right, we have these external applications that are specific. Things like Microsoft Teams, Zoom, Google Meet, Read and Write, and Echo360 Video. The reason you may wanna use these tools is to enable video proctoring with your exams. So maybe you wanna have browser lock on, but you also wanna be able to use echo video and take advantage of the learning transformation platform in order to ensure academic integrity, with your settings. And so if you want to, you can go ahead and you can select echo video. You can also, allow specific URLs. Maybe there's a specific link that you want people to be able to use as an as a source. You don't want them to have an open book test, but you want them to be able to access a website. You can go ahead and make that URL open as well, and they can access that within the browser lock environment. And then lastly, we can enable an exam password. This allows us to make sure that if learners are taking this, if it's being taken online, but you wanna make sure that all the learners in one space are the ones who are actually able to access the test. You can have a password that is required that can be written on a whiteboard or a smart board or whatever, and that specific password is actually required to gatekeep the test so that you can't have folks, logging in from home maybe if you don't want them to to take that. So these are all just safeguards that we put in place. And then lastly, when it comes to our reporting, we allow report download, show the final score, show the question content, show question results. We can allow specific visibility if an instructor doesn't want learners to have as much visibility into the reporting, that will show as well, if they don't want to. Lastly, we can assign to the roster, the entire organization or specific learners. In this case, it's just gonna go to me, so I'm gonna hit save. And when I get to my course, what you're gonna see is I can scroll down and actually access the specific test or the specific exam that I want to that I want to launch here. And we should oh, here's my transforming learning exam. I looked right past it. I'm gonna go ahead and I'm gonna click assign. When I assign that, at this point, that that exam is now available to all the learners in that course. And so now I'm actually gonna flip, and I'm gonna switch to my learner profile. And when I do so, it's gonna bring up the environment that a learner would see when they were accessing, their materials. So I'm gonna go down to science. I'm gonna open that course, and I'm gonna see my transforming learning exam. Gonna see that it's not started yet. I'm gonna go ahead and I'm gonna hit start. Now immediately, what you're gonna see is we've required Respondus browser lockdown to complete this exam. So that application is already up on my computer. I have the ability to go ahead and start it, and and it'll it'll take me into that, environment. Now because we're in a webinar, because it's a browser lock exam, if I actually launch this, it's gonna close out of all my windows. It works really well. Right? It's very secure. And so I'm not actually going to go through and actually start the exam, but as a learner, this is the screen that I would get to. Reason I wanted to pull this up is there's one specific area of this, screen that I wanted to call out for everybody's attention. And that's this little blue circle with the accessibility menu here. This is our user way widget. And what it enables us to do for every learner screen in the entire solution, they can make sure that they are accessing the content and material in a way that works best for the way that they learn. So things like learning differences are accounted for with dyslexia friendly fonts. You can make the cursor as big as you want. There's a reading mask that makes makes it so that you can actually read content more clearly, as as well as a reading guide with this pointer. So it makes it really easy to focus on the specific content if you so choose. Now additionally, we can change the contrast and highlight links. We can pause the animations or create bigger text spacing. And all of these settings are specific to the learner themselves. So every individual learner can choose how they want to interact with the content that best suits their needs. So it's a really helpful way that we are committed to ensuring an accessible environment for everybody to use our solutions. But at this point, I'm gonna go ahead and I'm gonna hit exit. And let's pretend that I've gone through and I've actually taken that exam at this point. Gonna switch back to my instructor perspective now because now it's time to actually look at the reporting functionality with an Echo360 exam. I'm gonna go ahead. I'm gonna click on my, reports. And you're gonna see here that this transforming learning exam is in progress. There's two participants, and we don't have an average score yet because it hasn't been taken. But let's go to a let's go to an exam that has been completed. In this case, life sciences, this midterm exam. And we see 45.45% average score, which is not great. We're gonna probably have to, speak to, the folks who might have taken this and make sure that they are truly studying what they need to know. We're gonna go in and we're gonna click view results. And what you're gonna see is a screen that includes a summary, questions, roster, and learners. Now this reporting view is available to, instructors, and a version of this can be made available to, learners as well so that they can see how they've individually performed on the content. So for the purposes of, this one, let's look at the summary page. We can see what the average score was across, the, the entire course. 45.5 was the high score. The average was 9.1. You can see the student performance spread out here as well as the, question summary. So, you know, what percent were incorrect, what percent were correct. And then you can also even see how much time was taken per question. Were certain questions skipped? Was there an average number of points that was created or given for any one question? And then you can see individual student performance, on this drop down to see the learner summary themselves. Now in addition to the summary, there's additional functionality and additional visibility that's provided as part of this report. So if you go into the questions, we can take a deep dive on what the correct answer was and just get an overall view, on, how this question appeared. If if maybe you're seeing there's a discrepancy in what you might have expected. Seeing, you know, that's a low score for that question. That that's not what I necessarily would expect. You can go ahead and open it up, see how the question was written, what answer was correct, etcetera, and see maybe if there was something a little bit confusing about the way the question was worded, etcetera. But this is a really great way for instructors to, at a glance, understand, how their questions were received and how they were answered and really make sure that, everything is being addressed as expected and that their learners are getting the most out of the content and that the test is fair as well. Can look at a roster report as well and see, a, a, standardized view of all the questions, one to 25. So there would be one single order. Even though everybody answered these in different order, it's all standardized, and normalized in one order based on how it appeared in the test generator itself in that editor view. And you can see the specific questions that were right or wrong at a glance. And then lastly, we have a learner report that shows how they ranked, what their status was, if it was at risk, what percentile they were, and how they actually performed on specific metadata too. Now this is one of the key areas of the reporting that's very helpful for learners. Because if you think of the report as a way to study for future tests and exams, you can use this as a way to understand what specific aspects of the exam I struggle with. Right. Can Yep. Can you, share the correct screen? I think you're sharing the incorrect screen. The the participant's saying they can't see the right screen. Oh, sorry about that. No worries. Sorry about that. Sorry about that. Yes. So this is our, this is our summary screen. Apologies for that. The tab, I don't think, was being shared. So here is our reporting. So this is the summary page that I was referring to earlier. We can go in and we can see, the entire view here. We can see the individual questions, on this view right here, to to dive into those question reports as I as I stated. We have the roster report that I referred to. And then lastly, this is the learner report that, individual learners will be able to access about themselves. And this is the metadata I was referring to where you can look at the review, the at risk, or the on track metadata to focus on study and, areas of best practice going forward, that learner should be focused on as they prepare for maybe a midterm or final exam if this content is gonna be repurposed or reused again. So that's a really brief high level overview of Echo360 exam from the creation, the delivery, and the recording of that content. Apologies, for, the the, the confusion there with the with the tab being shared. But, if there are any questions, I'd be happy to address them in the chat. I know we have about a minute or so left. Let's see, what we've got. Can you print exams? If so, what kind of options do you have for printed exams? Yes. You can print exams. You can randomize them, and we also have, the ability to use bubble sheets as well. So if you want to, you can use printed exams. This is not limited to online. We do support both fully. Great question. And I know we're getting to the bottom of the hour here. We will absolutely distribute this content. Thank you very much, Kara. Absolutely. And if there are any questions, please feel free to drop in the chat. We will get to them in follow-up emails. We'll address them in the future. So, no worries there. Thank you all for joining us. We really appreciate your time. And if there are any questions, that are best directed for demo requests or other things, where you wanna learn more about Echo360 exam, feel free to reach out to our team as well, and we can work on, getting larger demo sessions set up individually to really, nail down any specific questions or concerns that any folks have. And with that, thank you all for joining. And, we look forward to seeing you next time on transforming learning with Echo360.