Christopher Pope: Hello, my name is Chris Pope and I serve as chief of the data collection and analysis unit at the Rehabilitation Services Administration.
On behalf of my RSA colleagues and my colleagues who serve with me on the rehab data work group. I am excited to kick off this webinar and share our second data tool related to pre employment transition services in the students who receive them through the VR program.
When we established the rehab data work group, following the rethink VR performance initiative we identified three major functions of the work group one of those functions is to share data tools with VR agencies.
Who may use them to gauge performance and help make performance data actionable.
Our first out a tool which covered measurable skill gains was well received by the our agencies and other stakeholders and we're optimistic that this data tool will be too.
Especially in our fourth year of collecting and reporting this data by now. This data is maturing and we're beginning to see how the provision of pre employment transition services is shaping students lives in the VR program itself.
On the next slide, you'll see that the rehab data work group consists of the our agency staff from combined general and blind agencies, along with representation from our technical assistance providers.
And my RSA colleague Suzanne Mitchell and me this slide list email addresses for all of our members and we encourage you to reach out to any or all of us with your feedback or suggestions for future projects.
For this webinar. I'm really happy to be joined by Rachel Anderson Scott Dennis and Bill Colombo from the work group.
The worker has also been fortunate to exploit the expertise of two very special guests. I want to personally thank both Randy deal from Maryland VR who built this data tool.
And Melissa deal, who was instrumental in shaping the data tool as an expert in pre employment transition services representing our technical assistance providers.
Thank you both for joining this Webinar today too. So let's get to it. I'll turn things over to Rachel to introduce us to the data tool, Rachel.
Rachel Anderson: Thanks Chris and Hi, everyone. Thanks for watching this presentation, we are really excited about this tool. I want to say.
Randy might, correct me. But I feel like we've been working on this tool for almost a year and it hasn't been almost a year. It feels like an entire here.
So we're going to chalk that up to another 2020 event. So we want to just give you a little bit of information to let you know what this tool is intended to do, and what this tool is not intended to do.
So a couple of highlights this tool is going to include state to be our agencies data for all four of the program your 2017 program your 2018 and programming. Your 2019 so
Already I hope you can see how this tool is going to have a lot of information in it. And when I say a lot. You're going to potentially be overwhelmed when you look at the tool, but
We think it's going to be valuable. And we hope that you can choose what you want to gain from it and maybe what you don't want to look at. So
The tool is intended to provide national and state level data related to the provision of pre employment transition services to students with disabilities.
Provide a resource for state via agencies to analyze their pre employment transition services implementation service delivery and compare it to national similar states and or agencies and a variety of additional ways
And to share a pre populated tool that any VR program can use, including those who may not have the support of data technology experts to build a similar tool in house.
What the tool is not intended to do, is a couple of things similar to the previous tool that Chris mentioned on measurable skill gains.
We want to make it clear that this, this really is a tool to just help add value to what you're already doing. It's not something that should replace any of your other requirements related to
The performance accountability provisions regulations or sub regulatory guidance and that also includes any of your pre employment transition service requirements.
It's not intended to replace the need for VR programs to analyze their are saying 911 data.
It using their case management system. Other reporting resources, quality assurance activities, etc. And Scott and bill today are going to talk a little bit about all the additional things they're doing
To this tool itself. So, and then also tell the whole story related to pre employment transition services and other outcome data. So it's not intended to
cover anything about your internal controls or the source documentation that should
Be attached to any of these data points or your policy and procedures or staff training. So it really is just a tool with a lot of data and a lot of different ways to look at your pre employment transition services.
And national pre implant transition services.
So with that being said, I am going to hand it over to Randy. He's going to share his screen and share the tool with you and he's going to be able to give you a lot more information, since he is the one that built the tool so Thanks Randy and take it away.
Randy: Welcome everybody. My name is Randy deal and I'm the MRIs director for the Maryland division of rehabilitation services. First off,
I want to say that it was an honor to be asked to develop this tool. I hope you find it beneficial in both evaluating how you're delivering pre employment transitioning services in the past as well as projecting what services may need to be realigned in the future.
Second, thanks to Rachel Anderson and Melissa do for their assistance in developing their specifications that went into this tool as well as the rehab data workgroup
Finally, I want to acknowledge RSA and in particularly particular Yang Yang Shay from RSA for taking the time to compile this data.
The data using this tool is comprised of RSA 911 data for programs here 2017 2018 and 29
When new data is released from RSA, it will be added to the tool, resulting in a consistent year to year comparison. I also want to point out that the tool was created with accessibility and
Melissa Diehl: We're really excited to have a three year comparisons. Since program year 17 pre employment transition services data.
was incomplete for some state be our agency have as many agencies were still working to get their procedures in place for staff and providers to accurately report.
Each student with a disability. They were serving the number receiving pre employment transition services and each pre employment transition service that was provided
In addition, agencies were still working with their case management systems to accurately report these new services. So one of the things that we're just really excited to be able to do is have all three years of the last data so far. So thank you, Randy.
Randy: Okay, the first sheet in the tool is the dashboard.
Which allows you to navigate to any data page on the tour. Consequently, each data page also contains a link to to take you back credit or return to dashboard.
Making navigation Matt navigating the school tool rather seamlessly, you will find this link in the upper right hand corner of the sheet if you prefer, you can also utilize the tabs at the bottom of the workbook to quickly navigate between tours.
The tool is comprised of a total of 15 sheets and includes the dashboard. I just spoke about a table description, a glossary and the data which is broken down into two distinct tables.
An additional 15 sheets of the raw data provided by RSA from the RSA 911 is also provided for reference in the back of the work.
Melissa Diehl: So following this workbook is the table descriptions, which are provided really for your reference. The first column or column A is either the column cell identifier.
Which is the letter that's associated with each description that you will want to self select on the compare tools and we'll show you that in a few minutes for each category or the acronym for each pre employment transition service.
And column B is its associated description. And then in that last column. That's where the table descriptions is the method for the formula used to derive the data.
And following this page is the glossary where this is just providing reference and includes the term, the definition and the calculation from the RSA 911 if applicable.
Randy: Table one provides a snapshot of data related to students with disabilities during program years 2017 2018 and 2019 were table to
provides detailed breakdowns of the type of pre employment transitioning services provided to AUSTIN'S WITH DISABILITIES the agency service.
Table one data has four tools.
The first tool for cable one provides national data by agency as it relates to the 11 corresponding categories.
Your convenience. The category descriptions, along with its column identifier is provided on each page of the tool.
To select which category you want to view nationally by agency select from the drop down list provided to change categories at the top of the sheet. You'll select the category to view the drop down menu.
By default, you will notice a dialog box which displays with instructions.
Changing the column to get rid of the instruction on dialog box, simply press the Escape key changing the columns so identifier will instantly change the data.
I'm sorry, changing the column that identifier is just showing will instantly change the date on the seat, as well as the title.
For the data displayed depending on the category selected, you will be supplied with either numeric values.
Or percentages.
Also know several of these
Of the results have na
Na signifies that there was no data supply the RSA in the 911 for that particular program here.
Maybe a bit and made it very low that chart.
Is a visual
Right, maybe like the load the data is a chart, allowing for quick visual representation of
The second tool under cable. One is similar to the first. However, rather than looking at the national data by state VR agency displays national data by state.
Under table one allow you to compare up to four agencies or states data by category, respectively, along with a national median values.
Similar to the previous tools and first select the category you want to compare by its corresponding identifier. You can then select the agencies, you want to compare. If you want to compare less than four agencies.
As shown
Simply
Click on the drop down, go to the very top and select the blind.
Once again, and and a data value represents no data supplied to RSA for the given program here.
And once again, below underneath.
Is a visual representation chart that shows both the the values as well as the RSA. I mean, as well as the national medium for each program you
Melissa Diehl: Know if we want to look at an example and Randy, select the category column letter i which is the number of potentially eligible students with disabilities who applied to the VR program.
We can see for example you know he's selected Alaska here, which has in program year 1834 students with disabilities who applied to the VR program.
But then when I asked, Randy to select GA, which is the number of potentially eligible students who applied to the VR program and received a pre employment transition service.
That number and program you're 18 goes to 21 so I can do a quick comparison for my own state of how many of my potentially eligible students that apply to VR.
Are also those students that receive a pre employment transition service and then that's I can compare that with the other states. I've selected.
And then make some determinations with my other data that I have an information to see whether or not I need to dig a little deeper, or if that is an expected number. And what I want to do about that in my agency.
Randy: Eternal the dashboard. And so let's show you what's available under table to
As you can say
Table two has a different pools.
The first tool displays table to national agency data. The first one by category. And the second one by create brand poem and transitioning service required services.
When selecting the category bias column identifier. This tool display each and every agencies data for each of the five employment transition services.
You will also know one plus
Beside the five required services. The one plus displays the number of students with disabilities who receive more than wine reimbursement transitioning service and a program year
You'll also notice it also displays the percentage difference between the debt, the most current year compared to the previous year.
And na four zero percent change indicates a zero value submitted in the previous year.
In short, you can't divide by zero. So instead of giving an error message. You'll get a
Melissa Diehl: Right. And the second tool is very similar to the first except it gives you an opportunity to view each pre employment transition service and the resulting data for each category.
So as an example, we have Randy selecting Workplace Readiness training to display for the agencies and that's further broken down by each of the categories, you see. So as an example.
If we look at arkansas general you'll see that 895 potentially eligible students received Workplace Readiness training.
While 64 students with disabilities received Workplace Readiness training under an IP.
So again, it's another way to kind of look at the same data but in different through different lenses. So you can kind of see is that what you are, in fact, expecting art. Where are their trends.
How do we really look at the VR system as a continuum of services for students and ensure that they're moving through the pipeline to get what they need to be successful as they transition
Randy: Okay.
The next four tools gives you the opportunity to compare data between two to four agencies or states. The first of these tools display agency comparison by category.
The other three are agency comparison by pre pre employment transitioning services.
State comparison by category and stay comparison by creates
Similar to the comparison tool usage Table one. You first select the category you want to evaluate and select the agencies want to compare
This tool will display data for the five required Korea for employment transitioning services as they relate to the category selected. There are also multiple charts.
Providing a quick visual assessment of the data. The first grouping of charts breaks down into Greek and Roman transitioning service by category selecting the final chart.
displays all five services grouping together the agency selected for each of the five required to implement transitioning services by program here.
Melissa Diehl: And this is a really nice way to see how services are being provided for each of the required services across the three program years to compare by agency.
So for example, if we wanted to just peek at Maryland, we can see that there was this steady increase over the program years 1718 and 19 for. Let's see. Job exploration counseling and we can then see how does that compare if I'm Maryland with other like states that I might be selecting
Randy: The last two tools concentrate on the percentage appropriate services delivered by agency or state based on the categories selected.
In other words, either the five required pre at services. How does your agency or state compare with others in the provision of inquired services using the selected category both tools display the results and the raw data as well as graphical representation
Let's take a look at agency comparison percentage of Korea Korean Korean the transition services.
Melissa Diehl: Alright. So in this example, we're comparing by VR agency and Randy is selecting category C two, which is the number of students who received a pre employment transition service under an IP.
And he selected his for agencies to compare, which then displays the total number and percentage of each required pre employment transition service provided
So here we could look at, for example, I can take main general where you can see that they're
Looking at cross at what percentage of each of the five services, we might want to make note that we have a much higher percentage of job exploration counseling and work based learning experiences being provided.
And not so much in counting on enrollment and post secondary opportunities and self advocacy.
So this is a trend we tend to see in more agencies than not, but it might also be again as we use this as Rachel shared with other data and other information we have available.
Help us plan. And as we look at outcomes or the other performance indicators and ways we might use pre employment transition services to increase the likelihood of students earning
credentials and skills games and things like that for those that apply for VR. So again, just another way to look at the data and and look at what's happening across your program.
So, depending upon the categories you select and compare this tool can be really useful, particularly when you combine it with additional information.
Even your reserve and your expenditure information for pre employment transition services or education data, which provides that unduplicated child count in your state.
So you might want to look and see the rough percentage or the total number of students with disabilities that you're serving in your state.
And whether that number is increasing or decreasing over time. When you combine that with the fiscal data, you can more accurately forecast plan.
And determine whether or not your current model and methods of service delivery are sustainable and meeting the needs of the students in your state.
You could ask yourself questions as you're looking at this information, like, Are there clear gaps and services.
When comparing expenditures that you have available in your financial systems with the number of students receiving services and the types of pre employment transition services provided
Are we spending more or less compared to one particular service over another.
Or even looking at your case management system and the data and looking by how the services are being provided and whether they're being provided in house or via purchase service.
You know, is one more likely to yield an outcome versus another. So there's lots of different ways you can combine this tool with other data that you have available to look at how how this is impacting the students that you're serving
And while this tool doesn't address all of those questions, it does allow you to start asking the questions and looking at your other resources and tools to begin to find the answers.
Randy: Okay. And as we mentioned at the beginning of the presentation or data was gracefully supplied from RSA and generated
Through the VR agency RSA 911 some nibbles for each fiscal year. Do you have some reason the question of the liberty of the data display for the role, RSA 911 date. I can be found in the sheets P why he won by agency for ke y te to by state sheets displayed at the end for your reference.
So these are the sheets at the very end.
That you can use to validate. If you have any questions.
And Rachel, I believe we are finished with presenting the tool.
And I'm turning it back over to you.
Rachel Anderson: Thank you, Randy, let me figure out this screen to share again me one sec. So thank you so much, um, to both Missy, and Randy. It's so nice to actually hear
From people who built the tool and Randy telling us how to use it and how we can validate it, and different ways to
To use it but also Missy your expertise in pre employment transition services really valuable input and suggestions to everybody on how to use it. So, really appreciate your perspective there as well.
You know,
Of course, I'm going to have issues.
Okay, so now we're going to turn it over to Scott and to Bill. So they're going to give us a little bit more information about how they use the tool and a little bit more about
How they intend to supplement it with the tools that they're using in their own agencies and the value they see from a state VR perspective. So here's some of the questions that they're going to answer for us today.
So in your opinion, what value does the tool provide to state here agencies.
Also, how do you intend to use the tool in your program, how might be our counselors even use the tool and what additional tools and approaches are you using in your program to analyze performance related
To serving students with disabilities. And how do you incorporate the fiscal data into your service planning. So first up, we've got Scott from Maryland.
Scott Just check in. If you're on, he might be muted.
Scott Dennis: Thank you, Rachel, want to
Thank RSA for the opportunity to continue to the, I think, what is the valuable work that's being done as far as data is concerned.
Realistically, in this day and age, the use of data. I feel is vitally important in the management of of our agencies because we're faced with a lot of challenges and real and we can only really understand some of those challenges, through the use of data.
Next slide please.
In Maryland when we talk about what value does this tool provide to Maryland.
I use this tool, really, to look at states that are comparable size and different graphics and identify in look at some of the
The services that are being provided and trying to gain an understanding of where our strengths lie in Maryland, as well as where we need to kind of take a look at
Where we need to do improvement.
For example,
Marilyn has a very strong history and work based learning with an established work based learning program throughout the state, while on the other hand, if we take a look at
The data.
We have not really fully developed as the counseling on post secondary educational opportunities. Next slide please.
The chart.
That you see here kind of shows you know the four states that have a similar type of funding level as the state of Maryland.
Can taking into consideration, both as a combined state as well as those that are general states, if we take a look at the work based learning experiences in Maryland, we
You know, we feel proud of the fact that we have a fairly high level of students participating in those that type of program. But when we take a look at the counting on post secondary enrollment.
We I've got concerns, especially when I take into consideration the number of
apprenticeship programs that are in the state of Maryland two year and four year institutions that are in the state of Maryland.
We obviously need to do a little bit better job in this area. Next slide please.
You know, so when we take a look at it. Marilyn has probably no reporting knows our presets in that particular area.
By our staff. So we probably need to be taking a look at what type of information we're providing to our staff what training opportunities, we need to be taking a look at to make sure staff understands the importance of, you know, this
This particular measurement and why it's important for the students to have an understanding of what opportunities might exist for them other than
What has traditionally been available to him. We also kind of maybe need to take a look at our case management system.
Are we properly recording it. Do we have the settings on the back end of our case management system set to the proper settings for it to be picked up. So these are just some of the areas that potentially the tool can provide for us.
At a national level.
We see the service delivery trends across the country now allows agency to compare itself to the rest of the nation also allows us to notice trends in our state and see if those trends are only happening in our state, or is this a trend that is happening in other states as well.
Example,
If we were to take a look at under the tab to one national data by state letter age students with disabilities applicants to and moving to VR programs in Maryland, there was a decrease in
17 through 19 when we take a look at that, there's this trend followed was a national trend by other states across the country. Next slide please.
Data Analysis decide points to areas that require deeper dive into some of the case, the cases behind the numbers. So in some cases we need me need to look at
Get really get into some of these cases and see whether or not what is really going on with the case, again, is this a matter of training. Is this a matter of US reviewing current policy and practices in areas that we see concerns.
Does it mean taking a look at existing programs for us and seeing whether those programs that are providing those services are underperforming
Or do we need again, take a look at our staff development and see what we need to do to provide clarification to our staff. Next slide please.
Now, how might this help our counselors.
Looking how they might focus their attention on maybe one particular or two particular pre Ed services versus all five services. The purpose of pre as it is to have
a wealth of have the have the services provided for all five that are important. So in some cases we might be having counselors just focusing strictly on one or two and ignoring the rest
Also in my mean we may need to look to contact with our provincial our providers to see whether or not they might be able to provide the services that we might be lacking in particular area.
Next slide please.
Next slide.
What additional tool.
approaches are you using in your program to analysis to to analyze performances in Maryland, we use Power BI to do additional deep dives into our data and do data analytics to assist in or to assist with our projections
We use this to take a look at, again, the data trends, looking at particular areas within County and regional areas that this tool.
Only takes a look at the state level or a national level. So we use these additional tools to kind of see if there's a specific trend and very specific areas state.
We also for the physical standpoint, we also use the fiscal dated to to evaluate spending habit patterns in geographic areas in specific program areas which helps with the budgeting process as we move forward from year to year.
So we have found this tool and a very short order to be very beneficial. It's been shared across the agency and we've received a lot of positive feedback from those end users.
So I hope that you all find this tool to be just as valuable that that we have, we have already found in the short time we've had to use it. So with that, I want to thank you and I'll turn it over to Bill now.
Thank you, Scott appreciate that Rachel. Next slide please.
So I'd like to start out
Acknowledging the work and the tremendous job that the building team has done so a standing ovation to Randy Melissa and Rachel for all the work that they've done in building this incredible tool.
What value does it have for Michigan will foremost in half the size of better decisions by infusing data into our decision making cycle.
This type of data really minimizes gut level decisions and perhaps legacy practices I grounding actions in facts.
Is similar to the movie Moneyball. Some of you may have seen it was the Oakland A's were transformed into playoff contenders using data and analytics in new ways. We believe the tool we're looking at today offer similar value to VR.
Next it disrupts the status quo by encouraging critical thinking in curiosity serving pure state data sets begs the question, why or what if
The tool points to best or promising practices, which in turn leads to further discovery and then ultimately curiosity seeds innovation which we value.
Third, it helps direct resource allocations either up or down and guides fiscal stewardship over our 15% reserve.
The snapshots help to inform prioritize or balance pre employment transition services and resource investments.
For it offers a gauge for comparison between VR agencies that would be difficult or impossible to create independently.
It's a nice parameter that really gives perspective and there's comfort in knowing we're not alone, we see each other through this data.
And then finally, it's a model that can be replicated either in full or Park down to the local level.
We'd be challenged to create such as a tool from scratch. But we're happy to borrow bits and pieces from all the work that's been put into this
Next slide please.
So I selected two examples that I wanted to share and there are loads of value in a comparison of the data. This really stood out to me. So where am I am in tier one, which is the first tab.
In the four tabs of the Tier one series.
I looked over at the key and selected see and I and then went to the drop downs and inserted see to pull the data for Michigan, the number of potentially eligible students with disabilities within a program here for comparison. I also added I on the right.
So to set the stage. I think it's, I need to point out that that we are Pure Michigan, which is our tagline. We're the only state in which eligibility for special education services extends to 26 years of age.
Plus we've elected a lower minimum age for the provision of pre employment transfers or transition services to 14. This creates up to a 12 year period of potential eligibility.
So I thought it would be interesting to take a look at the number of students that we have who are potentially eligible compared to the number of potential eligible students that apply for VR services and those are the two data sets that I have up
So the populates for me in this is that on average over the three years about 20% of potentially eligible students with disabilities apply for VR services that lends itself to some of the points that Missy was talking about. Why is that is that on target. Should there be adjustments.
Doesn't have to do with the population size and capacity based on 12 years of being potentially eligible
So these are just a few questions with 12 points listed the combination represent a deep Data Catalog that lead itself too much further inquiry.
Next slide please.
So in this slide I navigated to the first tab of aid in the t two series that Randy described
I selected see one, which is the number of potential eligible eligible students who received a service and then one for drop down to populate it
And I pulled out Michigan generals data. So you can look again. So again, as an example, interest points really popped out to me.
So the first one is the impact of covert
Which is very clear in program you're 19 across the board with dramatic decreases.
The second piece that I would want to look at is, I want to keep an eye on Java exploration counseling.
We've wondered reporters in that area. It will be add the new program your data, I would suspect to see that trend line going up because we're now capturing services provided by staff, which we had never previously.
There's a greater focus on counseling in Roman post secondary education that's consistent with the types of things that are important to the state goals and initiatives.
There's an interesting correlation between worth reading this trading and work based learning experiences and are those percentages on trap typically one leads to the other.
And then, in general, across the board, if I begin to compare these two other states if my point to areas of interest that would be beneficial to inquire further
This is just the tip of the iceberg. There's much more discovery that's possible with the tool itself.
Next slide please.
So how do we intend to use the tool we've already talked about Michigan's uniqueness.
But first of all, as an add on to a bundle which includes real physical data.
Case management system data and reports and the Michigan Department of Education student count data.
This results in a much more three dimensional view of pre employment transition services and students with disabilities.
Secondly, we can use it as a foundation to negotiating and establishing goals benchmarks and dashboards, we just engaged in a negotiation with our department for the DSA and such matters.
So some of the department schools include increased participation in post secondary training and education to build and keep talent in Michigan.
assist students with disabilities to experience the world of work earlier in their education.
Well, both of these points have actionable items based on percentage increases in the provision of pre employment transition services, the tool provided an easily accessible baseline to negotiate and set those goals with our department.
As Scott mentioned will also use the tool to educate train and inform staff and PR agency leadership and personnel.
It's beneficial to support efforts to bend the curve in the States 16 by 30 initiative.
Which is a 60% goal of the working population possessing post secondary credentials by 2030 of course kelsang and post secondary opportunities as important to achieve that goal.
And then finally, it's a view finder. That looks at state by state landscape.
So it allows us to search for and reach out to other states with data points of interest.
Next slide please.
Well, first of all, again, it's a VR window that's either comforting or concerning and not readily available to counselors are frontline staff, it allows them to step out of local silos through the lenses of other states data.
We think it's also a spark to drive innovation cross culture sharing curiosity and critical thinking.
It's helpful to direct prioritize and facilitate program development with local providers partners and other key stakeholders.
Can help target pre employment transition services which align and support broader state goals or initiatives.
And then finally, collectively adjust trends that positively impact outcomes and better meet the VR needs improve outcomes for students with disabilities and Michigan.
Next slide please.
So a few final top top thought. So what are some of the tools approaches that we use to analyze performance while we use our case management system data reports. We also utilize tablo and the Michigan Department of Education student count data.
In addition to that, we embrace support Rachel Missy, and other technical assistant subject matter experts and their support.
And then finally, I think it's important to note that
Unlike Randy, we continue to build our subject matter expertise.
Internally specific to data and analytics. So I would consider us elementary at this point and honor the work that Randy you and the team have put into this effort.
How do you incorporate fiscal data into your service planning.
Well, the pre employment transition services slash students with disabilities data bundle.
Allows for more targeted resource allocation models based on student populations are pre employment transition services reserved and other department or bureau goals and priorities. So we're really building a micro meter for fiscal stewardship and impact.
So those are some final thoughts from Michigan. Thank you for the opportunity. Thank you are safe for continuing to support these types of endeavors. And at this point, I'm going to turn it back to Rachel. Rachel.
Rachel Anderson: Thank you so much, Bill and I just, I really appreciate you and Scott both taking the time to share how much value. This tool can have in your agencies.
And can really just meet you where you're at and can help you deep dive and can just be so valuable added to all the other work that you're doing in your state. So,
I know that your peers out there really love hearing from people that are in their same circumstances, so I can't thank you enough for being willing to share that personal perspective.
And then also, Randy and Missy your expertise. It's just been fantastic. And we know that you'll be getting questions to
Help support states as a look at this data, especially for states that are our new or green when trying to analyze some of their own data. So
As Chris said at the beginning of the presentation, feel free to reach out to any of the work group members. If you have questions or know any of us.
But in addition, we wanted to make sure that you still knew that you could access
All of the tools and information for the rehab data work group. So we did give you a link to our essays website where they have a rehab data work group resource page.
This is where you're going to see the other measures that matter, you'll see the MSG tool. You'll also see this as soon as it gets posted
And then also on the wind tech website. We've got all the same information posted up there will be adding this therefore now.
Some of you may or may not know, but the wind tech website will be up and running for the next five years, you can access it there, but
As the VR tack on quality management gets up and running, we will be moving these rehab data work group tools to that page as well. So I wanted to give you a placeholder there.
Also, for those of you that know about the new intact, the collaborative as they start building their website.
They will have some of these tools and resources related to not just pre employment transition services, but all things transition for education and VR so
Please feel free to access any of these resources at any of those given places. And with that, I'm going to hand it back off to Chris to wrap us up.
Christopher Pope: Thanks a lot, Rachel. So what is next. We're currently in the process of adding the program year 2019 data to the measurable skill gains data tool.
And we hope to share that update soon. And believe it or not, our third data tool is also in the works related to the first of the other measures that matter.
Sustaining employment after exit. So looking at individuals who exit with employment and their employment status in the second and fourth quarters after they've left the VR program.
And very soon you'll be seeing agency specific data for three of the other measures that matter in our essays quarterly data dashboards for the first time with the program your 20 Q1 reports.
Will continue to share our work with everyone as its developed and we look forward to brainstorming with you. Other ways that we can build data tools and support your needs.
Thank you all very much for the great feedback we receive on the other measures that matter presentation at CSC VRS fall conference, you'll see on this slide.
That the presentation is available along with a video recording of that. So in closing on please keep in touch. We want our work to be useful to you and we of course always welcome your feedback. Thank you very much for joining us and happy holidays.