Using Analytics To Profile Classes

A 12minute guided tour of the new Class Profile reports in PowerBI

Over the last twelve months St Andrew’s College has invested significant resourcing into developing web based reporting tools delivered via Microsoft’s PowerBI.com interface, to be used by both teachers, managers and administration staff alike. It’s worth reading some earlier posts about the rationale and features of why we have gone down this path, however some of the key reasons we settled on this solution include:

  • It’s browser based – you can access it from “anywhere” and see live data. You can also bookmark certain reports in your browser for near instant access.
  • There is also an app available (iPhone/iPad/Android/Windows10) so the data is accessible anytime / anywhere
  • We can tweak reports / visuals quickly and easily, based off feedback from stakeholders
  • Being browser based, you don’t need a local file on your computer that is “out of date” once a new version with improved features is built. What you see is always the “latest version”
  • It’s part of our existing Office365 Suite, so our existing username/password logs you into the reports.
  • Security permissions are centrally managed based off AD users and role based groups, including use SQL Row Level Security.
  • It connects to our on-premise MS-SQL Server, allowing for scheduled data updates (hourly / daily).

Throughout the duration of Term 3 the team have been focused on delivering a new set of reports for Mr Dean McKenzie one of the Assistant Principal’s at the College with responsibilities for Data Analysis. He had provided some concept designs for how he would like to see the reports look, along with the location of the majority of the data in our Student Management System (Synergetic). Additionally, there had been changes to how the Grade Credit Average (GCA) was going to be calculated moving forward, which would see individual subject’s have a GCA calculated for the first time along with more rigid definitions of how various credits would be counted.

All of this logic had to be encoded into the ETL process that transferred the raw data from Synergetic’s MS-SQL database and into our Data Warehouse, automatically calculating the results on a daily basis and making them available to staff via the web interface of PowerBI. The end result is the following pages in a single report:

Subject GCAs Per Student:

 Showing the results for a student in the current year and the previous year (click to enlarge)

This report is designed to allow a teacher to quickly select a student in their class and compare their GCA subject by subject, along with seeing how they performed the previous year. If you click the left hand image above to enlarge you will see numbers which represent:

  1. A selector for the current or previous year of GCA data for a student
  2. The teacher code (for full time classroom teachers this is automatically locked to their username meaning they only see the students in their classes. For Academic Deans or managers, they can see across a wider set of students).
  3. A year level filter, allowing a teacher to quickly narrow the selection of students down by the year level e.g. their Yr12 Maths students or Yr13 History students.
  4. The list of students arranged alphabetically that are taught by the teacher in the year level they have selected. Note these are colour coded pink/blue to give a visual cue to the teacher if they are looking for a male/female student in their class.
  5. A table showing each subject taken by the selected student, and their GCA (either current year or previous year depending on selection in #1 above)
  6. A bar graph visually displaying the same data as #5 but designed to quickly identify subjects of particular strength or weakness for the selected student. Note that the subjects are listed alphabetically and not by highest GCA to lowest, allowing for a “cityscape” effect.
  7. The name of the current student that is selected and the class code of the teacher who is browsing the report (useful if a teacher happens to teach a student a number of different classes).

The aim of this report is to allow a classroom teacher to quickly scan through the students in their class and identify their relative strengths/weaknesses in different subjects. It also enables them to answer a common question of teachers “I’ve a student who I think is underperforming in my class – how are they doing in other classes?”

GCA – Then and Now:

gca-then-and-now

This report allows a teacher to quickly see the individual students in their class ranked by GCA from highest to lowest and compare the current year GCA in the teacher’s subject with the student’s overall GCA from the previous year. This allows a teacher, at a glance, to see who are their best performing students based off completed assessment but to also pick up if there is significant variance between previous and current performance.

In the above example, the top bar graph shows the 4th ranked student in the class (in pink) was actually the 6th ranked student (relative to the class) the previous year. Whilst this is a very small sample size, what this can show is a student who is possibly underperforming or showing improved performance relative to the students in their class – all helpful information for a teacher to consider.

The red numbers in the report are:

  1. Showing the classes taught by the logged in teacher. Note that this also includes co-curricular options that the teacher coaches/manages, allowing them to review academic performance for all students that they have contact time with (this was actually the #1 request we had from teachers after launching the Tutor Quadrant Dashboard earlier this year – the ability to see results for students in all areas of their involvement at school).
  2. A gender score card. This is simply showing the number of males / females in the class.
  3. Bar graph (ranked) showing students by GCA, highest to lowest for the subject taught by the teacher and in the current year.
  4. Bar graph (ranked) showing the same students but their previous year GCA across all subjects, again ranked highest to lowest.
  5. A table giving a break down of the students in the class and their GCA in individual subjects. This is helpful if a teacher wanted to compare how a student was doing in a similar subject e.g. an English teacher seeing if a student was performing comparably in other literacy intensive subjects such as History.

Comparative Scores:

This was perhaps one of the most complex and ambitious pages to put together as it was potentially combining academic data from Yr9 Entrance Testing, PAT results (Yr9-10), MidYis Results (Yr9-11) and NCEA data by GCA. Additionally, this needed to give a break down of priority learners based on identified learning needs as well as ethnicity.

The real challenge was thrown down by Mr McKenzie when he said in an ideal world he would like a teacher to be able to select from any of the historical data and have it displayed on the same graph. We explored a wide range of ideas on how we could best implement this vision and in the end the following is what was achieved:

 Showing the results for a Yr13 Calculus class; on the left is the students’ Yr9 English Entrance testing and on the right their Yr13 Calculus GCA (click to enlarge)

Visually, there is a lot going on in this report and it will take the user quite some time to fully understand how best to extract what they are looking for. For this reason, all pages on these reports have user guides in text boxes and we have labelled each selection field numerically in the order that a teacher should select their data. This helps guide them through the process. In the left hand screenshot above (click to enlarge) I have added red numbers to highlight features of this report:

  1. The academic “score type” and “sub-score type” the teacher is wanting to see. If a teacher chose Yr9 PAT then the sub-score type would automatically display what options were available (i.e. English, Maths and Vocabulary). Similarly, if a teacher chose GCA as the score type they could choose the GCA for whatever subject they wished to check. The recent addition of search boxes from PowerBI make this process far easier to manage when there is a lot of options to choose from.
  2. Priority Learners – this is still being developed, but for now it highlights any students with data recorded in Synergetic, from diagnosis through to strategies to use in the classroom to support their learning.
  3. Ethnicity breakdown for the students in the class displayed in a pie chart and table below, along with the names of Māori and Pasifika students in the two boxes in the bottom right of the report.
  4. The bar chart that shows the students ranked by whichever score type the teacher has selected. Note that there are no axes on this graph, a necessary requirement given the academic data does not always share identical measures/scores. However, by placing the cursor over a student you can easily see their score e.g. a stanine for a PAT test, or a 2 decimal place GCA score for NCEA results. Additionally, there are visual cues on this graph that further help identify students with listed learning support needs or who identify as Māori or Pasifika.

A reminder that all of this data refreshes automatically each night so the teacher is always seeing the latest information on their students. Should a student leave/join the class the data is refreshed to reflect this.

NCEA Results Analysis By Standard:

One of the most requested features by the Senior Leadership Group and Heads of Department at St Andrew’s is an easy way to compare, standard by standard, how our students and teachers went compared to similar schools around New Zealand (similar schools has been defined as Decile 8-10). One of the challenges has been getting access to neatly formatted data that contains all NCEA standards, not just individual results which could be downloaded from the NZQA website.

After working with NZQA’s statistics team, we have been able to obtain this data and run it through our ETL process into the data warehouse, thus allowing this comparison to be easily done by classroom teachers:

ncea-analysis

Again, a classroom teacher would select a class they teach, and then narrow it down to a NCEA standard they wished to compare by following the numerical work flow selections on the left hand side of report. Once completed, this presents the four horizontal bar charts that show:

  • Top left = All students being compared, the top bar is comparative schools nationally (all students who sat this NCEA standard in Decile 8-10 schools). The middle bar is the performance of the St Andrew’s cohort, in this case all other Yr12 history students taught by all teachers. The bottom bar is the performance of the students in this teacher’s class.
  • Bottom left = Performance of Māori/Pasifika students (again broken down by national data, cohort and individual classroom teacher).
  • Top right = male students.
  • Bottom right = female students.

The results for these standards can be filtered to show either internal assessments only or formative assessment results for not-yet-sat external exams, providing students with a comparative score with the national data for that external standard from the previous year. This could work as a motivator for them before their external exams.

The red numbers in the screenshot are:

  1. Search box for the teacher to select the class code they want to analyze (again, searching is making this really easy), There are two pre-selected options visible which are the previous year’s national data and the StAC cohort data. A teacher could, in theory, turn these off if they simply want to display only their own class results and not compare them.
  2. Once a class is selected, this table automatically shows only standards that have a result recorded in the Synergetic database. This helps a teacher know which standard number to search for.
  3. Using the knowledge above, the teacher searches for the standard they want to analyse e.g. “HIST2” would show all Level 2 history standards allowing a teacher to quickly click through their results.
  4. The comparative graphs (as explained above). One of the neat features of this is if a teacher wanted to drill down and see which students in their class gained a certain result, they need only click the result and the list of students in the table filters immediately:
filtering-ncea

By clicking the silver “merit” grade in the bottom right graph (females) the table down the bottom filters to show the name of the student(s), allowing a teacher to quickly search through student names by result.

Detailed NCEA Results By Standard:

This final report is another one that is designed to quickly profile the range of ability of the students a teacher sees. However, it also delivers on one of the other most common requests from teachers e.g “I want to know how my Level 3 Geography students did in Level 2 Geography at the start of the year / or an internal assessment so I can better differentiate the teaching to meet their needs.” To date, we have struggled to graphically display a ranked past/present comparison tool for teachers and the security relationships is actually quite complex (just because you’re teaching the student for Level 3 Geography, for instance, does not mean you were their Level 2 Geography teacher).

This has now been displayed in the following reports:

 Showing the results for a Yr13 Geography class internal assessment 3.3 (91428) on the left; on the right is the students’ performance from the previous year for the internal assessment 2.3 (91242). (click to enlarge)

These reports contain a number of visual cues. In keeping with all our NCEA reporting in PowerBI, the colour coding is consistent: Gold = Excellence; Silver = Merit; Bronze = Achievement; Red = Not Achieved. Additionally, the bars are varied in height and ranked highest to lowest allowing a teacher to very quickly pick up the grade spread of their class at a glance. The red numbers in the screenshot on the left (click to enlarge) are:

  1. The teacher selects the NCEA standard they wish to analyse
  2. They select which of their classes they wish to filter by (many of our senior teachers teach two of the same year level/subject so this is helpful). The list of classes is pre-populated automatically, based on the username the teacher signs in as making this a very simple process.
  3. The bar chart orders the students by result, highest to lowest (as explained above).

Concluding Thoughts:

As evidenced above, a huge amount of work and effort has gone into these reports and they certainly represent the progression of thought over the last few years in terms of what is the key data we need to be able to provide to classroom teachers. A key objective of this analytics project at St Andrew’s is to provide easy access to the data for teachers on an “anytime, anywhere” basis and for it to be easily comprehensible.

As more teachers start to use these reports on a regular basis I anticipate feedback will flow and new feature requests will emerge. The beauty of the setup currently is we can release this version of reporting to teachers and then easily add new features which will become automatically available to teachers next time they log in – there is no need to update or install new files for the teacher. To further support teachers, we are now embedding a “Tour of the Dashboard” video into the landing page of each new report:

dashboard-tour

One of the great things about being browser based is the ability to embed third party content, in this case a YouTube video explaining to teachers how they can use this new report.

These embedded videos mean that should teachers forget how to use the report, or are new to the College, they can essentially “self-train” on how they can use the report with their classes.

I am genuinely excited about this level of reporting and the benefits it will have not just for our teachers, but for our students too!

 

Tech Advice A Click Away

This post first appeared in the September 2016 edition of the College’s Regulus Magazine

fountain-of-knowledgeThree computer whiz kids in Year 8 are acting as technology mentors for the entire Preparatory School student body, and even quite a few teachers. Caleb, Cameron and Mitchell run twice weekly Fountain of Knowledge technology training sessions, with students able to book appointments on a sophisticated website set up by Caleb. “I took over the project from its founder Ward (now Year 10) when I was in Year 6. We have seven mentors including the three of us, and are training up some Year 6 students so they can run the sessions next year,” says Caleb.

The students help with everything from setting up the internet on laptops, phones and tablets, to installing anti-virus software, and helping students to get the most out of OneNote. They also teach students how to use the cameras and other equipment in the TV studio. Their teacher Ms Melissa Rennell says she sometimes has teachers knocking on her door seeking technical help from one of the boys, or asking for assistance with their Activboards. “They often go to these students first before the ICT Department.” Caleb has even rebuilt an old laptop from the Preparatory School and connected it up to an active board on which students can share their projects.

As they get ready to hand over the Fountain of Knowledge at the end of the year, Caleb, Cameron and Mitchell are thinking about which equally enthusiastic young technology experts they will pick as its new leaders, and are already training Year 6 student Nicholas. “We’re proud of the programme and have had a lot of support from Mr Dekkers, who will be the teacher in charge of it again next year,” says Caleb.

Cameron says he enjoys technology but isn’t planning on a career in the field at this stage. However Caleb and Mitchell hope to one day own their own technology companies, “like Apple, or Google”.

Managing Minecraft In A School

minecraft-bannerNote: this is quite a lengthy and, at times, technical post about configuring and deploying Minecraft in a school when choosing not to use the new Microsoft Education Edition. The following is the structure of the blog if you want to jump to a particular point of interest:

  1. The Background Situation: existing Minecraft usage and identified problems.
  2. The Opportunity: what we felt we needed to deliver to run our own Minecraft server securely and easily.
  3. The Technical Setup:
    1. Server
    2. Mods
    3. Client Installation & Deployment
  4. Where To From Here:

Minecraft, the hugely popular game with students of all ages, is described as:

A game about placing blocks and going on adventures. Explore randomly generated worlds and build amazing things from the simplest of homes to the grandest of castles.

The Background Situation:

houseA number of our teachers have already integrated Minecraft into teaching units in the past, most notably Mr Wilj Dekkers with his creative writing units and Kiwiana-themed parks and Ms Donna Jones exploring a Centenary related project.

Despite this initial success there has always been some problems with administering Minecraft, particularly around easily and securely allowing student interaction and collaboration in these virtual worlds. To date, teachers have had to rely on students using the Minecraft Personal Edition meaning it was essentially single player mode only, removing the ability to collectively work on a project together. To promote greater student engagement and allow the key competencies to be fully utilized in learning through Minecraft, alternatives needed to be identified.

In late September 2014, Microsoft purchased Minecraft for $2.5billion which held out the possibility of a deeper integration into Office365 and Microsoft’s wider Education strategies. It took just under two years before Minecraft Education version was released, during which time an alternative Minecraft Edu was essentially shut down and absorbed into Microsoft’s new Education version. This was a shame as the Edu version was very good, allowing the use of numerous custom mods (modifications to improve/customise the game play) and it could be run on a hosted server, not just on the student’s personal device.

Surprisingly, the announced version of Minecraft Education in January 2016 ended up having some key functionality removed, arguably for the sake of simplicity:

  • There was no ability to host the game on a stand alone server – now it would be installed and hosted via the teacher’s laptop computer (this raised significant security concerns for us and ultimately was a show stopper).
  • There was no custom mod support whatsoever. Over time, it was the ability to modify and customise the game play that had contributed to the enduring appeal of Minecraft and without this, the default game play was less appealing.

The upside, however, was that licensing was incredibly easy to manage and, if you were prepared to overlook security concerns, deployment for a teacher in a basic network would also be simplified.

An example of students using Minecraft Pocket Edition in previous years

The Opportunity:

After the initial disappointment of realising we would not deploy Minecraft Education as soon it was released, Mr Wilj Dekkers engaged in a number of discussions with myself and Mr Joshua Harrison from the St Andrew’s College ICT Services Team to explore how we might progress forward with Minecraft. Very quickly, some key features were identified:

  • Teacher Control: teachers would need the ability to easily manage students within the game. Without this, the chances of students running amok and getting into mischief was very real. This would require third party mods to achieve and a strategic plan around how Digital Citizenship teaching could be included into the Minecraft worlds.
  • The Minecraft server needed to be hosted centrally so that it could be controlled by the ICT services team, whilst still allowing the delegation of in-game management to teachers and to those students identified as leaders who could be student administrators.
  • Teacher/Student administrators needed the ability to maintain / deploy approved mods and perform low level administration work e.g. restarting worlds, creating/deploying new worlds.
  • Finally, the issue of how to deploy a pre-configured client onto student BYOD devices in a quick and simple manner, without disrupting any existing installations of Minecraft they may have already installed.

The above list of requirements needed addressing if we were going to be able to  build a sustainable environment for integrating Minecraft into the eLearning strategies at the College. Joshua decided he would explore various options based on his prior knowledge administering various Minecraft servers in his own time and see if there could be some suitable solutions to use at St Andrew’s.

Technical Setup:

Server:

For the proof of concept, we decided to use an existing HP Compaq 6000 that was spare. The specifications of this machine were pretty light weight, having only a Core2 Duo CPU and 4GB of RAM. It remains to be seen if this will be sufficient and we anticipate needing to increase the resources of this machine as more users and worlds join.

After exploring various different versions of Minecraft, Joshua settled on 1.7.10 1.10.2 (this version is required to be compatible with Sponge. The earlier version was needed for supporting Bukkit which we are no longer using – see below). To support the deployment of these mods, two frameworks were necessary:

  1. Forge 
  2. Bukkit This has been replaced with Sponge due to a potential copyright issue; this has resulted in dropping KCauldron as well.

These are essentially APIs that allow other mods to run on the Minecraft server and normally a Minecraft administrator would use only one or the other of Forge or Bukkit. However, as will be seen, it was necessary to use both and to achieve this an additional third party tool called KCauldron was necessary to enable the use of different mods on the same platform to work nicely together. With the use of Sponge, there is no need for third party tools like KCauldron, as Sponge integrates directly into Forge.

Minecraft Server Dashboard

Minecraft Server Dashboard

Another important tool was MC Dashboard which allowed Joshua to use a graphical user interface (GUI) rather than a traditional command line interface (CLI) to administer the Minecraft server. This tool provides easy oversight into server resource usage, connected users and other important information.

Mods:

As mentioned earlier, it is really the mods that create the key appeal of Minecraft in schools, as it allows for customisation of the worlds and gameplay and, sadly, was something that Microsoft chose to remove from their Education edition. It’s easy to see why, however, because mods are also one of the trickier components and can easily lead to problems of version compatibility and contribute to a poor user experience. There are three key mods that Joshua has deployed for the StAC Minecraft server:

  1. Multiverse: Project Worlds: (Project Worlds replaces Multiverse due to the changes above relating to Bukkit – everything following remains the same) This is a key one as it allows us to run parallel worlds on the same server, whilst enabling teachers and/or students to jump between worlds at will. Put practically, a teacher could create a world for a collaborative social studies project where students need to work towards an assessment or project, whilst having a separate world for “free play” and experimentation. Without Multiverse, projects would need to be separated spatially within the same world which would inevitably lead to problems, such as having to walk a long way to go from one project to another – it all takes time!
  2. PermissionsEX: PermissionManager: (PermissionManager replaces PermissionsEX due to the changes above relating to Bukkit – everything following remains the same) This mod allows for differing levels of user permissions groups, and the following four were setup for school usage:
    1. Student – a basic user who can only do the default game play such as build/place etc
    2. Student Administrator – have slightly elevated controls such as the ability to move other student users around, freeze them and do other temporary modifications. These permissions are designed to support a Digital Citizenship component where students can be educated and entrusted to self-manage as much as possible within the game. The assigned permissions here were carefully selected by Joshua to prevent a student who had prior knowledge of how Minecraft administration works from being able to execute any command.
    3. Teacher – has access to most of the Minecraft server administration, can create new worlds, can kill off users, teleport users between worlds and other main administration functions.
    4. Administrator – aimed at superusers and, at this stage, reserved for ICT staff to support the server installation as necessary.
  3. ICY Admin: The Minecraft Macro/Keybind Mod (This was used to replace ICY Admin due to the version change of Minecraft) This is the key mod to bring the above together into a user-friendly GUI allowing for in-game administration from a graphical menu for the above user groups. The available menu options in ICY Admin The Minecraft Macro/Keybind Mod have been built from scratch by Joshua and are controlled by a config file on the Minecraft server itself. Users access the menu system during game play by hitting the tilde key (~) and this replaces the need to execute console / CLI commands within the game. This makes it significantly easier for new users to engage with the game and reduces the barrier-to-entry for teachers who may wish to administrate but know none of the commands.
    1. Some of the controls available via ICY Admin The Minecraft Macro/Keybind Mod include things such as “freeze” a user/all users in place (useful if you effectively want to pause the game for a break), teleportation of a single user / all users to a shared starting point or, for example, if you wanted them all to be in the same place to work on the same project. Additionally, environmental settings can be controlled in this way e.g. make it rain or snow, or set it to always be night time.
sponge-gui

The control interface for teachers and student-admins when using The Minecraft Macro/Keybind Mod (which replaced ICY Admin)

These three core mods are what allows the overall setup and administration and, through conversations with Mr Dekkers, are probably sufficient to enable most scenarios of how Minecraft might be used at this stage. Two in-game mods specifically requested by Mr Dekkers were IndustrialCraft and ComputerCraft both of which allow for significant learning opportunities. IndustrialCraft supports things like electricity generation and storage through batteries and transferring into different parts of the game, whilst ComputerCraft is essentially a full programming language accessible by computers in the game.

 

Client Installation & Deployment:

Windows installation batch script

Windows installation batch script

With the setup of the Minecraft server achieved, the final part of the solution was how to easily deploy this to the individual student BYOD laptops. St Andrew’s College has a choice within parameters for BYOD, meaning students can bring either a Windows 10 laptop or an Apple MacBook running OS X.

It was important that there was an easy, stress-free way for teachers and students to install this version of Minecraft onto laptops that did not necessarily need to involve the ICT Services helpdesk team at the College. Joshua was pretty confident he would be able to write some batch scripts for Windows and I suggested he check out OS X’s Automator  as a way of scripting installation for the MacBooks. Interestingly, he found that he was able to script the installation on MacBooks with Automator in about half the time it took to write a batch file for Windows.

The tasks in the Automator script to install onto a MacBook running OS X

The tasks in the Automator script to install onto a MacBook running OS X

The key to making this happen was Minecraft MultiMC, an open source launcher for Minecraft that allows users to run completely separate installations of Minecraft with ease, meaning that we could confidently encourage students to install this version without affecting any other installation of Minecraft they may already have on their laptop.

MultiMC Interface

MultiMC Interface

Essentially, a student is provided with a USB key that has an installer launcher that copies MultiMC and a Java installation into a new folder, whilst setting up short cuts in their Applications folder so they can run the game.

Interestingly, Joshua opted to not include a copy of the Minecraft client application itself within this installer file, instead relying on students having to enter their own Minecraft credentials (linked with their personal paid licensed copy) which would then trigger the download of the client application of Minecraft. This way, we are not distributing any commercial software illegally and the download only adds 1-2minutes to the overall installation process. The key benefit, however, was that MultiMC is already configured to point the installation to the College’s on-premise Minecraft server meaning there was no additional configuration required for students. Additionally, Joshua set this up to run on a non-standard port so that if other students were using Minecraft at school they could not accidentally connect to the school’s Minecraft server and become a nuisance.

All up, it takes less than 5 minutes for a student to install this version of Minecraft from a USB key provided by the teacher.

Where To From Here?

industrialcraft-windmill-and-furnaceI am always really happy when members of the ICT Services Team have an opportunity to use their prior experience or personal interests to contribute to the teaching and learning at the College in ways like this. It is one of the unique things about delivering ICT in schools compared to other environments and the ability to be involved in this way is enjoyed by the staff. Talking with Joshua he admitted to being a bit worried about how to deliver what needed to be a very simple solution that could be managed by students and teachers whilst still being secure and stable:

I had a huge sense of personal satisfaction with the finished solution because I was a bit worried about how I would be able to deliver all of this at the start, or even if it was possible. Ultimately, it was ICY Admin that made it all possible and this was something I found only through researching for this project. It’s nice to know that the hundreds of hours I’ve spent administering Minecraft servers in my own time have paid off and could be used in an educational context.

Mr Joshua Harrison

For me, it is pleasing to know that we have a secure, robust and extensible platform which teachers will be able to use relatively painlessly thanks to the efforts of Joshua in this area. It remains to be seen what interesting curriculum uses arise from this and I’ll certainly be posting a followup blog highlighting this.

Of course, as Microsoft continue to develop their Augmented Reality HoloLens solutions, then perhaps the future of Minecraft will be 3D as this video shows:

Online Voting For Student Leaders

The aim of this blog is always to share some of the things going on with technology at St Andrew’s College and, wherever possible, provide some ideas and inspirations for other schools as well. Some of these innovations take considerable planning and resources such as our work with PowerBI for Educational Analytics, whereas others like this post about online voting are relatively simple.

Recently, the College’s new Head of Senior College Mr John Ruge approached me about moving Prefect voting to an online system. Immediately, there were some questions around how to do his securely and fairly. Paramount in my thinking was ensuring:

  • Results were anonymous
  • Students and staff could only vote once
  • Restrictions could be placed on the number of potential Prefects one could vote for
  • Time limits could be enforced for when voting stopped.

A number of people recommended using something like Google Forms or Office365 Forms, both of which are excellent products when used for what they were designed for. The major limitation, however, was there is no way to ensure the voting would be both anonymous and limited to one vote per person. I decided to cast my net a little wider and utilise the excellent Techies For Schools NZ Google Group as well as the Australian MITIE Forum and see if I could crowdsource some alternatives. Some of these included:

It was the latter that caught my attention because it was suggested that using some of the more advanced features around emailing would achieve my main aims of anonymity and restrictions to one vote per person.

SurveyMonkey Setup For Prefect Voting:

We used a basic MS-Query to extract student and staff email addresses and first/last names from Synergetic, our Student Management System. We then loaded these into a CSV file with the first row indicating the header fields:

CSV

We needed to analyse votes from three different groups of people:

  • Secondary School Teaching Staff
  • Current Year 13 Prefects
  • Current Year 12 Students

Consequently, we decided to make three identical surveys, but have the different groups above loaded into separate CSV files. Upon setting these up in SurveyMonkey we needed to select “Send by Email” to ensure unique links generated for each voter, rather than a generic link that could be forwarded to people outside the intended voters, or used more than once by the same person:

Send by Email

Choosing “Send by Email” was a key part of achieving the defined aims of online voting.

When choosing “Send by Email” you are invited to submit users from a range of sources and we used the CSV file we had already generated:

Import CSV

You are then able to compose an HTML message to the voter that is sent by SurveyMonkey based off the information from the CSV:

Composition.png

Note the salutation: the use of variables [FirstName] and [LastName] will personalise each email based off the information from the CSV already loaded into SurveyMonkey

Numerous additional variables can be set, some of which we made use of because of our aims included:

  • Changes: Respondents can change their answers on any survey page until they complete the survey (alternatively you can allow no changes at all, right through to changes after it’s been submitted but before the cut off date
  • Anonymous Responses: exclude ALL respondent information (names, email addresses, IP addresses, and custom data) from your survey results (we chose this, but you can collect all of the above information if you wished)
  • Cutoff Date & Time: This was important to ensure timely voting:

Cutoff Date

The end result, when sent, provided a really smart looking HTML email that encouraged staff and students to vote for 2017 Prefect Leaders:

SME Vote Now

Note the personalised salutation, the HTML “Vote Now” button and the footer indicating the URL is unique to the recipient.

When votes are opened you can track in real time the number of votes completed, as well as email opens and partial votes, for example:

Vote Stats

One of the final tweaks I learnt through this process was how to limit or restrict the number of choices a voter could make from a multi-choice question. This was significant as voters were allowed to select up to twenty student names from the long list of candidates. There were some help instructions available, but the key areas to check were in the options of the multi-choice question:

Multi Choice Question

Note that:

  1. For this to work “Require an Answer to This Question” is ticked
  2. You choose “at most” for number of choices if you want voters to be able to select up to but not exceeding a number of candidates
  3. You can customise the error message if a voter chooses more than the allowed number of candidates when voting.

With voting completed, it was easy to export as a PDF the graphs showing the candidates with the most votes and allow the leadership team to analyse the data. Now that we know we can generate personalised, single-use and anonymous voting systems through SurveyMonkey I can anticipate we will use this in other areas as well.

eLearning Through The Lens Of Key Competencies

EdTech SummitIn the last week of Term 2 I had the opportunity to present at the NZ Tech Advance Education Technology Summit hosted at Massey University’s Albany Campus. Key topics and subjects discussed include:

  • Inquiry | Creativity | Collaboration – The role of technology in modern learning
  • Developing teacher understanding and encouraging implementation of collaborative and digital learning methods
  • Integrating and encouraging digital technology adoption in curriculum and classroom
  • The new narrative: IT training and computational thinking
  • Building technology into the curriculum – lessons, challenges and what we’ve learnt along the way
  • Collaboration at the forefront of today’s teaching environment

When preparing what I wanted to share at the 40 minute session I had been given, I decided on using the Key Competencies from the New Zealand Curriculum to explain why some examples of eLearning from four St Andrew’s College teachers had been successful. Additionally, I wanted to use authentic student voice to highlight this – fortunately, having been blogging on this site for over two years now there was plenty of examples I could draw on.

If you are interested in an independent view of my session then you can see this micro blogs from Nathaniel Louwrens here and this brief reflection from Andrew Corney here. You can download a full copy of my slides from the presentation from this link on dropbox.com.

The Key Competencies are at the heart of great teaching and learning in New Zealand and are the bedrock upon which effective eLearning can be built on.

Key Competencies

The Key Competencies from the NZ Curriculum

It’s worth reading over the entire descriptions of learners who demonstrate the 5 Key Competencies but some highlights I pulled out to share at the conference included:

  • Thinking: is about using creative, critical, and metacognitive processes to make sense of information, experiences, and ideas … Intellectual curiosity is at the heart of this competency … [Students] reflect on their own learning, draw on personal knowledge and intuitions, ask questions, and challenge the basis of assumptions and perceptions.
  • Using Language, Symbols and Texts:  Using language, symbols, and texts is about working with and making meaning of the codes in which knowledge is expressed  … Students who are competent users … can interpret and use words, number, images, … and technologies in a range of contexts … They confidently use ICT to access and provide information and to communicate with others
  • Managing Self: This competency is associated with self-motivation, a “can-do” attitude, and with students seeing themselves as capable learners … It is integral to self-assessment.
  • Relating To Others: Students who relate well to others are open to new learning and able to take different roles in different situations … By working effectively together, they can come up with new approaches, ideas, and ways of thinking.
  • Participating & Contributing: This competency is about being actively involved in communities … They may be local, national, or global. This competency includes a capacity … to make connections with others, and to create opportunities for others in the group.

I started the session off by highlighting the fact that often ICT is talked about in terms of risk. This can come from security breaches, budget blow-outs and ICT project cost overruns, not to mention distracted and off-task behaviour when using technology. I then posed the following questions:

Questions.png

I wanted to highlight how some of the best examples of effective eLearning from teachers at St Andrew’s College was firmly rooted in Key Competencies. I chose examples from the following four teachers:

Teachers

Combining OneNote & MineCraft To Create Pick-A-Path Stories:

This example is explained in more detail here and the basic Learning Outcomes are displayed below with the relevant Key Competencies included:

Learning outcomes from this unit:

  • to produce interactive pick-a-path adventure stories
    • KC: Using Languages, Symbols & Text
  • to work collaboratively online to produce an end product
    • KC: Relating To Others
  • to create stories to share online with a wider audience
    • KC: Participating & Contributing

As mentioned above, I wanted to use authentic student voice as much as possible so I included an abbreviated version of the following video so that the audience could hear students articulating their learning and the impact that technology had made:

An insightful quote from the student called Harry was:

The goal was not to just make something pretty in Minecraft, it was actually to improve the quality of your writing … after writing the story, the idea was to look back in Minecraft and see how you could improve the writing you had already completed.

SAMR DivingTo assist teachers at St Andrew’s College with integration of technology into their teaching and learning, we have adopted the SAMR taxonomy that you can see on the left.

This is a really useful way for teachers to conceptualise how technology might assist the learning outcomes for their students as well as provide them some aspirational goals for extended use of technology. Tom Adams, our eLearning Integrator, has recently written in detail about effective use of the SAMR model which is definitely worth reading if you are new to it. During the presentation, I introduced the audience to a relatively new product from Microsoft called Pulse. This enables the audience to provide real time feedback on a session as well as allowing the presenter to push out questions for quick polls. I asked the audience “What level of SAMR do you feel the Minecraft/OneNote example was operating at?” and below is their response:

Pulse SAMR

Using Microsoft Pulse for instant feedback from the audience

Inspiring Creative Writing Through Constructing Digital Worlds:

The next example I shared was again around creative writing, this time from the High School instead of a Year 6 class. The full reflection can be found here, however the high level overview of the task was as follows (with Key Competencies inserted):

Learning Tasks For This Unit:

  • Write a short story of ~600 words with a theme of “conflict”
    • KC: Using Languages, Symbols & Text
  • Students Must produce at least 4 “drafts”
    • KC: Thinking
  • Drafts must be shared with peers for feedback/feed-forward & act on appropriate advice
    • KC: Participating & Contributing

What was different about this activity is that students had to build their digital world before they started their writing and use it as a source of inspiration and planning, not just as a reflective tool for editing. Settings were constructed in Sketchup, Paint, Minecraft and the source engine of the game Counter-Strike. Here is a student Ralph talking about his world which I again shared with the conference audience:

Again, I find the language used by the student here informative, with some of his comments being:

  • I wanted readers to grasp that the bombs had come from the bank itself”
    • Clearly, the reader’s experience is at the forefront of his thinking when he is designing his digital world.
  • He blended his natural enjoyment of the game Counter Strike with his school work and learning – a win/win situation!
  • Ralph talks about adding a backstory to the real events of the London Bombings, demonstrating a wider awareness of global communities
  • “As I was designing the level I was constantly thinking of ways I could make the story more interesting.
    • This was not just technology for the sake of it – it was clearly shaping and informing his understanding of the creative writing task that was the key learning outcome here.
    • This was manifested through his drafting process where he removed a lot of the dialogue to improve the narrative flow and added more descriptive text such as the sound of the gunfire

This impressive learning came on the back of an earlier, easier task where the students in the class had leveraged an existing digital world (Google Earth) rather than having to create their own. Through the lens of the SAMR scale this makes perfect sense – the students build their knowledge and experience of digital toolsets in the lower levels of SAMR and once mastered they can progress to more difficult tasks. Here is a write up of the earlier task where students had to explain the significance of setting in a film, and this is a student talking about their comprehension.

Again, it’s important to pick up on the student’s language – the technology is integrally linked to the learning outcomes, it is not merely there for entertainment or distraction. By requiring students to record their personal reflections in this way, students are using a number of Key Competencies.

Communicate Musical Intention By Composing An Original Piece of Music Inspired By Art:

The final example I shared with the audience came from Level 3 Year 13 Music. On the first day of the conference I had been asked to be part of a Q&A Panel about integrating technology into schools and one question from the audience was essentially around what are real world examples of great technology usage in NCEA subjects. The heart of the question was around the challenge of adapting existing assessments to be technology rich and I answered it by a brief description of this example from Mr Duncan Ferguson our Head of Music.

  • Using AS.91419 (3.4)
    • KC: Using Languages, Symbols & Texts
  • Students are required to reflect on their composition and explain the connection with the art that inspired them
    • KC: Thinking
  • These are largely independent projects that the students need to work on themselves
    • KC: Managing Self

Here is the video of the student reflecting on their learning:

Flipping The Maths Classroom:

I wanted to allow some Q&A at the end of my session so I ran out of time to share this example from Mr Ben Hilliam, so I’ll briefly reference it here. In this example, the key learning outcomes included:

  • Year 9 Maths: solving Linear Equations
    • KC: Using Language, Symbols & Text
  • Students were required to watch the instructional videos and then attempt the practice questions
    • KC: Thinking
  • Students needed to regularly complete check lists indicating their progress
    • KC: Managing Self

Here is an example video made by Mr Hilliam:

What I most liked about this example is that students were not left on their own to just work through it, the teacher is still involved through the process, despite the availability of the instructional videos. The following screenshot is from a OneNote Class Notebook showing how the student has completed their progress reports and the teacher has provided feedback:

Work eg2

I used MS Pulse to ask the audience whether they personally felt that using a “flipped classroom” genuinely created more opportunities for differentiated and personalised learning during class time. Their response was overwhelmingly “yes!”

Flipping The Classroom

An alternative way to show poll results from MS Pulse

I concluded my session with the following thoughts:

Concluding Thoughts

I really enjoyed the opportunity to present at the NZ Tech Advance Education Technology Summit and was fortunate enough to receive some positive feedback from the session:

Guest Post: Mr Dekker’s Journey With OneNote & Minecraft

This is a repost of a blog on the official Microsoft Education blog where Mr Wilj Dekkers, a Year 6 teacher at St Andrew’s College and Microsoft Innovative Educator, recaps the journey of his classroom over the last two years with Microsoft OneNote and Minecraft.

OneNote is central to the pedagogy in my classroom and school. When you walk through the building you can witness the everyday use of the application from Year 4 to Year 8. You will see Active Boards where teachers annotate writing samples in the Content Library for students to use as a reference for their own learning. Students are huddled around their laptops debating which sources of information are most relevant to include in a shared notebook, and staff are reviewing meeting notes shared through a Professional Learning Group’s OneNote.

Preparatory School Inquiry Learning Model

Preparatory School Inquiry Learning Model

St. Andrew’s College uses a custom designed Inquiry Pathway—the core of which is built around helping students develop a collaborative approach to learning. The approach is question-driven, encouraging students to find the answers themselves, coming to their own conclusions. As a teacher, this is exciting; we plan and facilitate but cannot predict the final outcome.

Having planned an inquiry around national identity in the 21st century, I had posed a problem to my class: The Christchurch earthquakes of 2011 had left a long lasting scar on both the economy and identity of the city. Tourism was dwindling, with visitors flying in and quickly moving on to other parts of New Zealand’s South Island. I challenged my students to answer the question, “What does it mean to be a Kiwi in the 21st century?” and also find a way to bring tourists back to our city.

OneNote Minecraft 1

Students formed collaborative groups and created their own shared notebooks. They planned, questioned and researched their Kiwi icons. They interviewed parents and discussed how families from a variety of cultural backgrounds celebrated being “Kiwis” and what being a New Zealander meant to them. All of which was documented in each group’s shared OneNote Notebook.

Students began asking if they could book laptops to work together in our shared learning spaces outside the physical space of the room. They loved having the flexibility to be able to work together around a PC or laptop and then continue collaborating using OneNote at home, completely away from the physical space of the school, in the evenings. Students were so enthralled with the inquiry unit and ability to work together in real-time through OneNote. Parents even began commenting on how they had never seen their students so excited to return from school and get started on their homework.

Part of the inquiry was looking at how we could bring tourists back to Christchurch. This was where Minecraft was introduced to the class. Students brought in devices running the pocket edition and connected to shared realms via the school’s Wi-Fi. As well as working as a team to answer the big inquiry question, members of each group had individually focused on an aspect of Kiwi culture. I asked the students if they could build a theme park with Kiwiana-themed rides that incorporated elements from their inquiries.

Before long, the class was a buzzing hub of self-directed learning. Students were writing presentation speeches from their inquiry notebooks while Minecraft experts built bigger and better Kiwiana rides to showcase their learning. In the evenings, groups continued developing and improving their learning in preparation for the big day.

By the end of the third term of 2014, OneNote became a standard classroom tool. Having seen the benefits, families had started purchasing laptops for their students to use in our class. This again caused a chain reaction. Students with access to their own devices were using OneNote more, which in turn meant that more students began arriving with laptops.

This had to be managed carefully, since having a laptop in Year 6 is not required. I was wary of technology being used as a substitution tool and made sure that in my planning any use of OneNote or any other tools we were using was in ways that enhanced or allowed learning to take place in a way that could not be done without a device.

OneNote Minecraft 2

It was around this time that Sam McNeill, Director of ICT for the college, brought in six Surface Pro 3s to trial, and I was fortunate to be asked to use one in the prep school. Having always been a believer in the creative power of the pen, I was instantly won over by having the best of both worlds at my fingertips—a fully functional Windows tablet with a stylus that allowed me to write down ideas, thoughts and comments directly into my OneNote Notebooks. It did not take long for a few students to begin arriving with their own Surface tablets!

In the final term of the 2014 school year, we focused on our use of narrative; enhancing writing features and broadening our vocabulary. Using both OneNote and Minecraft seemed like a natural fit.

As a class, we read through “The Warlock of Firetop Mountain,” written by Steve Jackson and Ian Livingstone in 1982. This book was one of the first “single-player gamebooks” and was the first of what was to become a successful series of pick-a-path gamebooks called “Fighting Fantasy.”

OneNote Minecraft 3

The students loved it. We discussed modern game worlds, from Fable to World of Warcraft. How could we emulate those fantastic “Fighting Fantasy” stories using the technology at our disposal, and how could the technology enhance the quality of our writing? We wanted our readers to have the same sense of choice and adventure we had experienced reading “Warlock,” while being able to share our writing without needing to produce any form of print media.

“Minecraft brings out the creativity in me. I love remaking my story Minecraft and improving my writing.”
—Mila

Through the insertion of hyperlinks connecting pages, students found an easy way to provide choices for the reader, and as notebooks stored on Onedrive could be easily shared, the audience for their writing expanded quickly. Students were sharing and collaborating on their adventure stories by allowing editing rights to certain classmates deemed to have the relevant skillsets to be seen as official class editors.

The inclusion of Minecraft was thanks to Ms Tam Yuill-Proctor, a Year 10 English teacher in our college. Students in Tam’s creative writing class had used Minecraft and other 3-D authoring tools to create worlds for their stories.

“Using Minecraft made my imagination go wild with thoughts!”
—Kinda

Our Year 6 students took Tam’s idea and expanded upon it by using Minecraft to both plan and develop their writing, as well as to review and revise the content, descriptive phrases and vocabulary. As their Minecraft worlds grew, so did their stories, which were housed in OneNote. In some cases, we had 10-year-old boys who were not big fans of writing producing 5000-word interactive pick-a-path stories. We published a blog entry detailing the OneNote and Minecraft pick-a-path story.

“Minecraft was helpful because it made me notice all the little details in my narrative that were never in my original bubble plan.”
—Padric

By 2015, most teachers in the prep school had embraced OneNote. The superb OneNote Class Notebook app creator was now an important element of Office 365, and students were appreciating the structure of the Collaboration Space, Content Library and their own personal sections.

Teachers were appreciating the organizational simplicity of adding resources and lessons into the Content Library for students to use in their own sections. Within my Year 6 class, multiple students arrived at the beginning of the year armed with Surface Pro 3s.

OneNote sections became collaborative planning spaces for groups designing games and interactive narratives; students naturally made use of the Collaboration Space to form group sections for our prosthetic hand designs for the 3-D printer.

This was also the first year that I started using Minecraft in Math. The students in my group weren’t huge fans of math. I knew they were capable of so much more, but their personal attitude towards the subject was that it was hard; comments at the start of the year were mostly, “I’m not good at math.” My focus was to change their attitudes to that of a growth mindset where they say, “I’m not good at math, yet!” Continue reading

PowerBI Supports StAC’s Pastoral Care Programmes

PowerBI

For the last 12 months we have been actively exploring how Microsoft’s Business Intelligence product called PowerBI could be used at St Andrew’s College. I have blogged about our initial experimentations with this here and that post would be a useful piece of pre-reading to provide context to this post.

This week has seen the culmination of a huge amount of work over the last four months, with Tutors being given access to what is being called the Tutor Quadrant Report. Below is a screencast showing some of the features of this (with identifying details blanked out):

Demonstrating The Tutor Quadrant Report

Initial feedback from Tutors has been very positive as they recognise this new report presents a significant step forward in terms of:

  • Ease of access – using their existing school username/password to access the report on any device with a browser and anywhere (they are not restricted to being on the College campus).
  • The collation of disparate data presented in an easily comprehensible, highly visual format. Previously, to obtain information on attendance, NCEA results, discipline and Fortnightly Notes would have required dozens of clicks, different windows and reports, and even using different platforms (both Synergetic and Sharepoint).
  • Speed – the reports load very quickly in the browser.

It is satisfying to hear this type of feedback given the significant level of investment and effort that has been made in developing this platform from where we were 12 months ago.

AIS.pngFor some understanding of this journey from Crystal Reporting through to PowerBI, the following video is a quick version of a presentation Mr Dave Neilson and I gave at the Association of Independent Schools of New South Wales’ annual ICT Leadership Conference 2016 in Canberra in May. The theme of the conference was Supporting Digital School Improvement and you can download a copy of the slides from this presentation here.

The abbreviated presentation from AIS NSW ICT Leadership Conference 2016

Some of the key points from this presentation include:

  • There are multiple ways you can use Microsoft PowerBI, we have explored two methods of deployment:
    • Manually generating reports in the free PowerBI Desktop App and publishing and storing content in the Azure blob in the cloud (quick and easy, but limited security options)
    • Developing an on-premise data warehouse and using ETL processes to extract data from various sources before loading into a tabular data model and connecting to the cloud via SSAS Gateway Connector. This is also very secure when implemented with row level security.
  • PowerBi was preferred at St Andrew’s College for a number of reasons, including:
    • It’s scaleable – educational pricing for Pro licenses is affordable  (~$4/m per user) and easily managed within the Office365 Licensing Administration area
    • It is easy to access – teachers can use their existing school username/password so there is limited barriers to entry and it is accessible via a browser from any device.
  • Visualisations of data are excellent. The ability to transform what was previously stored in spreadsheets and rows and columns of data into easily comprehensible displays is critical. There is a range of default visualisations as well as third party generated ones.

Next Steps:

time to talk

Time to talk! The power of a visual to highlight a student trending in the wrong direction.

With the release of the Tutor Quadrant Report, planning is already underway for the development of further reports for both teaching staff as well as administrative staff. The migration to PowerBI of an existing Tableau report that our Director of Development used has been completed and this enables her to now access data refreshed daily and drill down using the self-service elements of PowerBI. Pleasingly, she has already identified a number of enhancements she would like to see – this is something we anticipated would occur once the end users started getting more meaningful access to the data.

Additionally, rebuilding a very detailed NCEA report similar to what we explored in the original proof of concept  will be important for academic staff to monitor progress as the year progresses. Ideally, we should see some accelerated development now that the backend infrastructure is in place.

Lastly, there is rapid development happening on the PowerBI platform all the time. One of the most exciting developments is the ability to embed reports into an existing website or portal and even apps, opening up a huge range of possibilities where we could securely share reports like those above with students and parents. For now, that is in the medium to long term planning, as we focus on rapidly deploying further PowerBI reports for the College staff.