Grayassociates

Basic system navigation and definitions are covered in the PES Economics and Outcomes - Navigation, Tips, and Tricks guide. If you have not yet completed that training guide, please start there.

PES Economics - Demo - Summary | Sheet - Qlik Sense

Custom Step Color

All visualizations are for illustrative purposes only and do not represent an institution.

Note: You can also select the summary icon in the app overview screen.

This guide will start on the summary tab. To open it click on Summary in the blue navigation banner at the top of your screen.

The Summary Tab is a high-level overview of some of the key metrics in the Economics tool.

We define these metrics as: Gross Revenue: The sum of gross tuition and fees charged to the students Discounts: The sum of the institutional discounts or scholarships given to the students State Appropriations: Funding provided by any governmental agency Net Revenue: Gross revenue minus discounts Instructional Cost: The sum of Full-time and adjunct faculty salary, benefits, and additional pay plus the sum of department costs that have all been classified as instructional cost Contribution: Net revenue minus instructional cost Definitions for all metrics within the system can be found on the Definitions tab.

Below the filters, you will find some key metrics.

All years of data will be shown cumulatively unless you filter to a specific year. It may be helpful for you to filter to the most recent year. Click on the Year filter.

In our system, a program is the sum of all courses taken by enrolled students. Revenue follows the student, and all costs will be brought back to the major that the student comes from, including any courses that those students took outside of the major. In other words, a student gets a fair share of the cost of the class regardless of which department taught the course.

The first row of filters is what we refer to as “Program Filters,” meaning that they filter down to the program (major) that a student is a part of.

Select the most recent Academic Year of data in the system.

This will include all students enrolled in these courses regardless of program. For example, if an Accounting course was taken by students from other majors, those students would be included here. Here, costs are calculated directly using the instructor’s pay and workload units for each course, while revenue is a fair share calculation from each student who took the course.

The second row of filters is what we refer to as “Course Filters,” which are all courses taught by a department. 

Click on the check mark to confirm your selection.

Below the key metrics you can select what measure (Total $ or per SCH (student credit hours)) you would like to view the charts in, as well as the option to toggle between Program, Course Department, Course Subject, and Course.

The summary tab includes two sets of visuals. The top row of visuals shows you how some of the Key Metrics have changed over time. You can see graphs for Net Revenue, Instructional Cost, and Contribution

As you change between Totals and Per SCH or between Program/ Department/ Course Subject/ Course, the data in the graphs will update. These graphs will also re-calculate as you select any filters.

The bottom row of visuals shows you the top programs for each of the Key Metrics.

To move to the Rank tab click on Rank in the blue navigation banner at the top of your screen.

The Rank tab is an expanded view of the Summary Tab. This will let you view various metrics across your entire portfolio of programs.

Similar to the Summary tab, all years of data will be shown cumulatively unless you filter to a specific year. It may be helpful for you to filter to the most recent academic year.

Navigating this tab is also very similar to the Summary tab. Below the Key Metrics row, you will find the selections for what you would like to view in the charts.

If you have selected View economics by Program you should limit yourself to the Program filters. If you have selected View economics by Department/ Course Subject/ Course you should limit yourself to the Course filters.

Once you have chosen your selections, you can select the corresponding filters at the top of the page. One caution is to match the “View economics by” selection to the set of filters that you use.

For example, if you select that you would like to view economics by Program, you should only filter by the program filters at the top of the page. Doing this will ensure that you have not cross-filtered out a segment of data.

Now, you can toggle between each metric you would like to view across your entire portfolio of programs.

The left hand chart shows you your selected metric across the entire portfolio of programs. You can scroll down and find each program ranked by your selected metric.

To move to the Scorecard click on Scorecard in the blue navigation banner at the top of your screen.

The main strength of the Scorecard is that it allows you to compare one program against your entire portfolio of programs.

To view data, start by filtering to a single academic year of data. Click on the Year filter.

Select the academic year you would like to view data for.

Click on the check mark to confirm your selection

Next, select the Program you would like to view data for. Click on the Program filter.

Select the program you would like to view data for.

You read this chart by moving from the left-hand side to the right-hand side. This chart shows you how the Key Metrics directly interact with each other to result in this particular program’s Contribution.

There are three sets of visuals on this tab. First is a waterfall chart that shows you exactly how the Contribution from this program has been calculated.

A percentile is a comparison score between a particular score and the scores of the rest of a group. It shows the percentage of scores that a particular score surpassed.

The second visual is the Percentiles. This shows you how the selected program compares to your entire portfolio in each Key Metric.

When looking at the Percentiles, it can be helpful to toggle between Totals and Per SCH.

To illustrate this, let's swap to Per SCH and see how the percentile values for the same program change. Click on Per SCH.

When we looked at this program in terms of Totals, we saw that it was in the 83rd percentile in terms of Contribution. However, when we look in terms of Contribution Per SCH this program is in the 36th percentile.

The third set of visuals shows you each key metric graphed over time for your selected program. Like everything else on the Scorecard, as you change between Totals and Per SCH or select different filters, the graphs will update.

To move to the Analysis tab click on Analysis in the blue navigation banner at the top of your screen.

This scatter plot will always be color-coded so that red represents programs/ departments/ course subjects/ courses with a negative Contribution. As you make different selections, this color coding will stay with you.

The Analysis tab allows you to create your own scatterplot graph for your entire portfolio and quickly compare how a program, department, course subject, or course compares to each other.

You can toggle the View economics by options in order to graph different areas of interest in the scatterplot.

Just like with all other tabs, you can easily toggle between Totals and Per SCH.

You can choose the variable you would like on the Y axis between: Net Revenue, Instructional Cost, or Contribution.

On the X axis, you can choose either Student Credit Hours or Instructional Cost.

Once you have made your selections, there are several options for how to zoom in on a particular section of the scatterplot. To use the lasso tool, click on any blank space within the scatterplot.

Select the lasso tool icon.

Click and drag to use the lasso tool to make a circle around the section of the graph you would like to select. This will apply a filter to select the programs within your lasso.

This will result in the scatterplot zooming in on the region you indicated with the lasso tool. 

You will also notice, that a filter has been applied. This is indicated at the top of your screen.

For example, if you would like to select programs with a negative Contribution, you could start at $0 and drag down the Y-axis.

Another helpful function of some visuals (the Analysis tab in particular) is clicking and dragging along either the X or Y axis. Click and drag the range you would like to select.

You will also notice, that a filter has been applied. This is indicated at the top of your screen.

This will result in a zoomed-in scatterplot of the region you highlighted.

To move to the Data Table click on Data Table in the blue navigation banner at the top of your screen.

The data table is a self-built, customizable view that will allow you to dive into the data at a granular level.

To populate the table, you will need to select dimensions on the left-hand side of the screen.

Once you have made your selections, click on the check mark to confirm your selections.

As you continue to make selections you will see more fields appear in the table.

Next, you need to select the metrics you would like to include in the table.

In addition to Time and Program attributes, you can also select Course attributes.

Selecting metrics works the same way as selecting dimensions. Once you have made your selections click the check mark to confirm your selections.

Student Attributes can also be selected here.

In addition to the Economic Metrics, you can select various Rates and Shares.

Various other metrics can be found under the Units menu.

Nearly everything within the Economics system can be exported in a variety of formats. You have the option to export charts, and visuals, as well as to create custom tables and export them to Excel. Right-click on the table that you would like to export.

Click on Download as...

Click on Export Formatted Data to Excel to download your export.

This will open up a menu of preset bookmarks, each of which can be a helpful view within the system.

You also have the option to save views within the system. This can be done using the Bookmark icon. Select the Bookmark icon at the top of your screen.

This will open up a menu of preset bookmarks, each of which can be a helpful view within the system.

To save a new Bookmark, select the “Create new bookmark” option that appears in the top right corner of the bookmark menu.

Any bookmarks that you save will only be visible in your account. If you create a view that you would like to share across your institution, reach out to us, and we can help to publish it for your institution so that everyone can access it.

name your bookmark something distinctive so you can easily find it again. Once you are done, hit the green “Create” button.

The “Save Layout” option is often helpful as it will save any sorting or formatting that you have done. For example, if you have a table that is sorted based on a specific metric, the “Save Layout” option will keep that sorting when you return to it.

To save your bookmark click on the green Create button.

Lastly, confirm that you would like to save your bookmark by clicking on the green check mark.

Now, you will see a new bookmark in the menu under the section called My Bookmarks. Anytime you select that bookmark it will re-open the table or view you have saved.

The Additional Analysis tabs allow you to dive deeper into a variety of areas. To access these tabs, select “Additional Analysis” in the blue banner at the top of your screen. We will start with the DFW tab.

The DFW rate is the share of students that receive a D, F, or Withdrew from a course. The DFW tab allows you to break down DFW rates by department, program, course, demographics, year, and course level, as well as a variety of other ways.

Across the top of this tab, you will see a row of key metrics that will provide you with an overview of the data.

The first visual shows you how DFW rates have trended over time. In this case, we can see that in 2018, there was a 12% DFW rate, and in 2021 there was a 10% DFW rate.

You can adjust the slider to remove courses with 1, 2, 3, or 4 enrolled students.

As you scroll down the page, you’ll also find visuals for DFW rates by Course, Course Level, and Programs.

The next two visuals will allow you to look at DFW rates by either demographics or by departments.

You can Zoom in on a specific area by selecting a filter at the top of the page. For example, if you filter to an Academic Unit, the data in each visual will reflect your selection.

To move to the Section Analysis tab, open the Additional Analysis drop-down menu from the blue navigation banner and select Section Analysis.

The Section Analysis tab provides you with insight into instructional trends at your institution. There are four charts to explore on this page.

This chart shows whether trends in enrollment are aligned with trends in the number of sections taught. In this example, there has been an 8% decline in the count of students but a 2% increase in the count of Unique Sections. This could indicate a potential inefficiency.

The first one looks at Instructional Trends over time. You can see how the count of Unique Sections, Students, and SCH have changed over time in relation to the initial year of data.

This chart shows you Section Count by Section Size and Type. The distribution emphasizes the number of sections taught with five students or fewer. This gives you insights into how large various types of sections tend to be, as way as a way to identify small and large sections

You can hover over a bar in the chart to see a breakdown of the section types.

In this example, we can see that fewer SCHs are delivered as the course level increases and that the Cost Per SCH trends upward as the course level increases. At the developmental level (0), cost per SCH is higher than net revenue:&nbsp;indicating that course level has a negative contribution.

The next chart shows Net Revenue and Cost Per SCH By Course Level. This allows you to see how several key metrics change across course levels.

The first insight is what section size generates the largest number of SCHs. In this case, sections between 21 and 25 students account for the largest number of SCHs.We can also focus on the cumulative % of SCH line and % of Sections line. These show you the aggregate % of the bar chart to the left of each point. For example, we can see that 50% of SCH's are delivered in sections that have 25 or fewer students and represent 65% of the total sections offered.

The last chart on this tab shows SCH by Section Size. There are several insights that we can gain from diving into this chart. 

To move to the Prog-Dept Matrix, open the Additional Analysis drop-down menu from the blue navigation banner and select Prog-Dept Matrix.

Reminder: a program is the sum of all courses taken by enrolled students. Revenue follows the student, and all costs will be brought back to the major that the student comes from, including any courses that those students took outside of the major. And a Department is a collection of courses which includes all students enrolled in these courses regardless of their program.

The Program-Department (Prog-Dept) Matrix shows you the interaction between programs and courses. The matrix provides insight into which departments serve the entire institution or those that primarily serve specific programs.

In this example, we can see that the Department of Business (column) taught students from a wide range of programs.If we read the same chart horizontally across the row for the program of Computer Science (Bachelor’s), we can identify all of the departments in which Computer Science majors took courses.

To read this matrix, it is best to look at either a full row or a full column. Each row represents a program (the major a student is a part of), and each column represents a department (containing all courses taught by that academic department).

This tab also gives you the option to toggle between SCH, Net Revenue, Instruction Cost, and Contribution to look at various KPIs in the matrix.

PES Economics and Outcomes - User Guide