Flexible Learning EXperience Program of Research (FLEX PoR)
Photo: Priscilla Du Preez (Unsplash)
What is the FLEX PoR?
The Flexible Learning EXperience Program of Research (FLEX PoR) has been established by Learning Futures to enable research in flexible teaching and learning by providing access to student data held by WSU. With the oversight of Human Ethics Compliance (Chief Investigator, Professor Simon Bedford, HREC H14843) it enables analyses of student success, impact and experience based on the diversity of the modes of delivery of our curriculum.
The PoR functions to expedite and simplify attaining ethics approval for researchers as subprojects are articulated via amendments to the approved ethics application. A mechanism for students to refuse consent for participation is available, a process aligned to our other PoRs START (transition and retention) and TEL (technology-enabled learning).
Current sub-projects approved under the FLEX PoR can be viewed here.
Learning Analytics: Dashboards
Click on the arrow below to see the available data sources
Data on subjects and courses are available from these dashboards (some data may require a separate request via WesternNow)
Learning analytics dashboards: Course level
WSU Profile: Key WSU data, including student demographic data by school. (opens in new window)
Course Demographics: Student demographic data at course level. (opens in new window)
Learning analytics dashboards: Unit level
Enrolment Flux: Enrolment patterns within a teaching session (opens in new window)
Unit Outcomes: Student grade distribution data at a unit level within a teaching session (opens in new window)
SFU Student Feedback on Units (SFU) data: Available to all staff members at a school level. Deans, Deputy Deans, Assoc. Deans Learning & Teaching, DAPs and selected professional staff also have access to data for individual units. (opens in new window)
Unit Success Summary / Subject @ a Glance Provides a full breakdown of student demographics, grade distribution, vUWS and PASS participation at a unit level. De-identified student data allows for further investigation of links between student engagement and outcomes. (opens in new window)
Learning Analytics: Tools to help analyse student behaviour in vUWS (opens in new window)
FLEX Program of Research Frequently Asked Questions
Below is a list of questions about the FLEX Ethics Umbrella.
Click on the arrows to learn more!
Why a Flexible Learning program of research?
There are gaps in our knowledge of the impact of flexible delivery, from student experience, success, additional operational complexities and resource implications. This highlights the need for scholarship and dissemination of findings.
In support of WSU’s Flexible Learning Strategy, a university-wide review of data related to student learning and modes of delivery was undertaken in 2021. The ‘Flexible Learning – HyFlex Review’ recommended:
“that Hyflex@WSU is continued to be investigated as part of a university wide Flexible Learning Strategy, including the provision of additional timetable support to capture student movement between HyFlex delivery modes, evidenced based evaluation of student impact and to undertake further review of requirements and experiences of students and staff.” (Senate Education Committee item 2.3, 14 October 2021)
Under the HyFlex model of learning that is gradually being adopted at WSU, students can choose their own level of on-campus and online learning according to their own preferences. The literature on flexible learning suggests that its effectiveness in terms of student experience and learning outcomes depends greatly on how well learning activities are adapted to this mode of learning.
What subprojects are envisaged?
The FLEX-PoR broad research questions are: What are the relationships between flexible learning, retention, and student success? In what ways and to what extent do flexible learning strategies impact student success?
There are myriad opportunities for research in this relatively new field, with direct application to WSU and higher education generally. In addition to pedagogical effectiveness, the relationship between flexible learning, academic literacy, retention, employability, implications for student mental health and support, and attractiveness of the university as a study destination have yet to be rigorously explored.
Research conducted under the FLEX-PoR will be utilised to better inform and test WSU’s theoretical analysis of its institutional vision, to draw more accurate conclusions concerning its transition, progression and retention initiatives. Consequently, FLEX-PoR subprojects need to demonstrate intended outcomes directly improving learning outcomes and experiences for WSU students.
The FLEX-PoR is open to a range of research questions that are intended to contribute substantive, methodological and theoretical/conceptual knowledge. It is envisaged that most subprojects will be oriented to practice-based, substantive outcomes; however methodological and conceptual investigations are needed and welcome.
The focus of the FLEX-PoR is investigating flexible learning and concepts relevant to student learning and success: retention (e.g., retention for further study, or retained to WSU although change course), engagement, experience, and graduate outcomes.
The HyFlex Review (2021) identified the following themes from WSU students’ and staff responses which can be further investigated:
- Faculty interaction and validation (mattering; proactive best)
- Learning community (belonging)
- Curriculum design and pedagogical interventions) - (active learning design; collaborative learning activities to enhance learning communities and student belonging)
- Non-academic support (e.g., financial)
-
Learning analytics (to detect and action; prediction to guide faculty proactive interaction; early engagement in assessment – therefore curriculum design).
What are some examples of subprojects that could fall under the FLEX PoR?
The PoR has broad questions such as evidencing the impact of flexible learning on student success, retention, progression and success.
For example, a subproject might consider the impact of learning spaces to facilitate student success in HyFlex delivery. See our suggested research questions (https://tinyurl.com/j9rfyhz7).
What data sources are available for FLEX PoR subprojects?
The FLEX-PoR will include the following data sources to conduct the various subprojects. Indicative research questions are included.
Relevant de-identified vUWS analytics data
Examples include: vUWS accesses and vUWS interactions. This data can be used to address the following indicative questions.
- What are the patterns of student interaction with vUWS?
- What can we infer from patterns of student interaction with vUWS?
- How can insights from the description of student interaction with vUWS complement insights from qualitative analysis?
Examples include Google analytics, Panopto analytics, analytics from other packages used by teachers or the digital futures team. This data will be used to address the following indicative questions.
- How can this data be integrated with vUWS data to provide a description of student patterns of behaviour in relation to flexible learning provisions?
- How can this analytics data inform the analysis of student engagement, retention and success?
Student grade data that is required is likely to be historical and current. The justification for accessing historical data is because comparisons between various iterations of vUWS sites are likely to be made and the comparison of student outcomes (grades) is likely to be a focus of interest. The access to current student grades is required because analysis related to the various sub-projects is likely to require ongoing analysis of student learning outcomes (grades). Some indicative questions based on the use of student grades include the following.
- How do flexible arrangements for formative learning activities contribute to student learning outcomes at various stages of a student’s progress through a unit?
- Does student behaviour in flexible learning environments correlate with student learning outcomes (grades)?
- Is student behaviour in flexible learning environments a predictor of student learning outcomes (grades)?
SFU feedback is an important source of data to explore student views on their learning experiences in units. Indicative questions that relate to the use of SFU data include the following.
- How can the interpretation of SFU textual data inform the analysis of student learning experiences in flexible learning environments?
- How can SFU questionnaire data inform the exploration of student learning experiences in flexible environments?
- What are some of the challenges that students encounter in terms of their learning in flexible learning environments?
- What are some of the challenges staff face in teaching in flexible learning environments?
There may be other forms of data such as video or observational data that may be used in sub-projects. Indicative questions include the following.
- How do students engage with curriculum in and across flexible learning environments?
- How do students interact and communicate with their peers in and across flexible learning environments?
Student questionnaires
Student questionnaires that are associated with sub-projects may be designed by researchers interested in exploring a particular area of learning behaviour or experiences. These questionnaires may be text-based or online. Areas of interest might include the following.
- What is the nature of student learning behaviour in and across flexible learning environments?
- What is the student experience of learning in flipped classrooms?
- Which aspects of flexible learning environments can be improved?
Interviews and focus groups
Focus groups and interviews will provide qualitative data that will be used to provide interpretive depth to quantitative findingsVarious interview forms may be used (structured, semi-structured, unstructured) depending on the research aims of the researcher. The n is hard to predict given that the aims of the sub-projects are likely to be significantly different. Some indicative areas of interest that interviews and focus groups might cover are outlined.
- What are some of the challenges that students face in the transition from high school learning environments to a self-directed learning environment?
- In what way do students learn from their peers?
- What role does flexible learning play in student learning?
What criteria are used for subprojects to be accepted into the FLEX PoR?
A subproject can only be submitted to the HREC as an amendment to the FLEX PoR after vetting by the FLEX-PoR research team to determine whether the research and the data requested is appropriate and within scope of the FLEX-PoR. Only subprojects deemed low-risk will be submitted to the Human Ethics Low-Risk Committee.
The FLEX PoR research team will also consider whether the research objectives and intended outcomes are designed to inform improving student learning and experience. Specifically, subprojects under the FLEX-PoR ethics approval will need to demonstrate alignment with the WSU “Sustaining Success 2021-2026” strategic plan.
- Enabler 3. Learning and Teaching
- Enabler 4. Student Experience
- Principle 3.1 Transformation: Deliver transformative education and student experiences through innovative applied curricula, and proactive, customised engagement.
- Principal 4.1 Connectedness: Through enhanced use of technology, align structures, curriculum, research, student & staff experiences to our mission & values to establish partnerships & collaborative projects with communities that build capability & transform regions.
What are the expected impacts of the FLEX PoR and its subprojects?
The outcomes of the FLEX-PoR will inform the design and implementation of targeted strategies to support flexible learning at WSU. They will contribute to a comprehensive understanding of flexible learning experience from the perspectives of staff and students.
Flexible curriculum and teaching practice
Curriculum and teaching include exploration of a range of factors such as timing and choice of learning activities, teaching practices, relationship between discipline and teaching methods, students’ academic skills, personal attributes, academic progression, engagement, demographics, and backgrounds. Suggested considerations include:
- curriculum design, student support, modality, and student choice(s)
- issues of measuring activity, engagement/participation
- Timetabling data (to activity level)
- Zoom data (participation)
- Individual student experience and opinion (difficult).
Findings of research projects will also inform professional development of staff at WSU to, for example, ensure that HyFlex modes of curriculum delivery and assessment are effective and fair. Project members will be provided opportunities to disseminate their findings within WSU (e.g., Research Week or community of practice presentations, course leaders’ forums, online and face-to-face workshops, school-based events, and high impact case studies to guide decision-making at WSU).
Scholarship of Teaching practice
It is anticipated that the FLEX overarching Program of Research and associated subprojects will facilitate WSU academics to engage in scholarship of teaching and disseminate their findings to the broader WSU community and higher education sector. Through engaging in FLEX-PoR subprojects, either as researchers or participants, WSU staff will be able to develop high-quality evaluation of teaching methods and learning practices and identify their relationships with student experience and academic outcomes. Over time, it is envisaged that staff capability in scholarly practice applied to their teaching will increase in depth and rigor; that measuring the impact of any intervention intended to improve students’ learning and experience of university will be routine and normative.
FLEX-PoR research subprojects with the following characteristics will have broader relevance and generalisability:
- Holistic approach to measuring impact of evaluations
- Identify and measure individual factors that impact outcomes for specific interventions
- Longitudinal data collection
- Multi-institutional collaboration and data collection.
What resources are available to support sub-project design?
As an 'ecosystem of research', Western has a number of people and resources to assist researchers.
Baduglang mentoring
Badugulang Fellows are available to support staff to
- Conceptualise and justify a sub-project
- Identify and apply research methods appropriate to the research questions
- data collection and data analysis
- Interpretation and discussion
- Recommendations, limitations and future research
- Review findings and identify future research
- Offer collaboration through a Teaching and Learning group
Suggested research questions
The document FLEX-PoR subproject – Suggested research questions.pdf is available to support development of subprojects that align with WSU priorities.
Literature review of flexible learning
A small-scale literature review prepared by the central learning and teaching unit is available to support the conceptualisation and design of sub-projects (see Flexible Learning Literature Review: Western staff have access). Subproject teams should take into account the Advance HE integrative literature review on Flexible Learning within Higher Education (2016-2021) and consider the implications of the review for their research design, interpretation, and suggested application of results. The review:
- Reports in-depth analysis of 105 Higher Education (HE) research articles published 2016-2021.
- Details research undertaken across the world, using quantitative, qualitative and mixed methods and includes a few conceptual articles.
-
Identifies and summarises flexible learning trends, issues and impact, including specific impact and evidence encompassing:
- Policy and/or practice with evidence of impact on student outcomes (student performance, progression, engagement, satisfaction, skill acquisition and/or self-confidence).
- Impact of emergent technologies
- Adapting and evaluating innovative teaching and assessment practices
- Workforce development and policy review
- Intersections with employment and employability
- Enablers of flexible learning.
FLEX PoR Current Projects
Click on the arrow below to see a description of the projects
School of Health Sciences
Construct validity and internal reliability of an online multiple-choice exam for assessment of learning outcomes among tertiary occupational therapy students. (H15911)
The aims of this study are:
- To investigate the construct validity and internal reliability of data gathered via an online, multiple-choice exam, to measure achievement of learning outcomes among third year occupational therapy students in the subject Occupation and Neurology.
- To identify any test items that are not part of the construct being measured, that are not productive for measurement, or that cannot differentiate performance among students (these items may be considered for removal or adjustment, and further investigation).
- To adjust the target multiple choice exam based on the initial analysis, then readminister the test (to an alternative third year cohort of occupational therapy students) and re-evaluate validity and internal reliability of data gathered post-adjustment.
School of Humanities and Communication Arts
Attitudes and perceptions of WSU staff and students to artificial intelligence (H15601)
The results of an AI survey will provide the university with a comprehensive picture of what all staff and students know about AI, and how they perceive AI as affecting them. (Principal investigator: Raymond Archee)
School of Social Sciences
Learning with the WSU-stride online art therapy student clinic: clinical placements as flexible learning experiences (H15228)
The project builds on a partnership with Stride, a progressive community-based mental health organization which assists carers for people living with major and persistent mental health issues; it emphasizes art therapy at WSU as recovery-oriented with arts-informed pedagogies that demonstrate art therapy as a practice of social justice. (Principal investigator: Sheridan Linnell)
Co-designing dynamic responses to generative AI: Timely scaffolding of an authentic assessment (H15789)
The research will focus on two primary concerns with the implementation of new approaches to generative AI. The research: 1. investigates the role of authentic assessment in the development of approaches to the appropriate incorporation of generative AI tools across the existing subject assessments. 2. investigates the role of a co-design approach in supporting rapid and efficacious adoption of TEL in response to the dynamic impact of generative AI tools. (Principal investigator: Cameron McAuliffe)
School of Computing, Data and Mathematical Sciences
Cross-faculty study exploring project-based learning (H15279)
This research will inform significant curriculum redesign and provide evidence for decisions to strengthen delivery of PBL programs. The study will also contribute to existing knowledge in the teaching and learning community with a focus on flexible project-based learning and identify best practice approaches to implement in curriculum across faculties. (Principal investigator: Marina Belkina)
Uses of Generative AI Tools for Assessments (H15810)
The use of Chat GPT or similar tool will help students learn how to use generative AI tools by studying position descriptions and job applications. Students will also learn that Generative AI tools cannot answer anything asked. Students will learn about the limitations and opportunities provided by Chat GPT or a similar tools. This study will fill in the gaps and will allow researchers to build a draft framework that can be used to guide academics and students when utilising and implementing Generative AI Tools such as ChatGPT for assessments and learning. (Principal Investigator: Ana Hol)
School of Science
Evaluating the student experience of Minecraft Education Edition as a teaching and learning resource in cell biology and physiology (H15429)
With the advent of COVID-19 and its associated restrictions, there has been a rapid rise in the use of digital resources to enhance the student learning experience and thus aid in student retention. In this work we seek to evaluate the student perceptions of using Minecraft Education Edition in medical science higher education. This will lead to improved practice as it will specify how students use such a digital activity and highlight any areas which could be improved for future practice. We foresee this work being useful not only for refining the use of Minecraft Education Edition at Western Sydney University, but to provide an accessible learning activity to medical science education globally. (Principal investigator: Ben Perry)
Design, implementation and evaluation of an authentic final exam for Biochemistry students
Designing flexible human anatomy and physiology practical classes in a post-pandemic environment (H15547)
The student voice will be used to design and deliver a first-year anatomy and physiology practical program that incorporates the student wants and needs to maximise engagement and performance while maintaining flexible study options that students have become accustomed to during and since the pandemic. These flexible study options must also ensure students can meet subject learning outcomes and appropriate levels of pre-requisite knowledge needed for anatomy and physiology subjects at second and third year levels. (Principal investigator: Hayley Green)
School of Nursing and Midwifery
How did online learning affect mature-aged students in Clinical Pharmacology (NATS2008) at Western Sydney University during Covid-19? (H15284)
What is proposed is a pilot study examining how online learning affected my mature-aged students’ retention, engagement and outcomes in Clinical Pharmacology, and whether there is anything on the statistical level that provides a comparison of pre- and during Covid-19 student outcomes. (Principal investigator: Valentina Naumovski)
Improving students’ preparation for OSCE using SimCapture for Skills (H15420)
What is the impact of self-recording and self-reflection learning activities using SimCapture for Skills on nursing students' learning experiences and clinical skills mastery, and does it aid their preparation for the OSCE? We hypothesized that the use of SimCapture for Skills for self-recording and self-reflection will help mitigate the interruptions in students' learning experiences during the semester and clinical placement, leading to improved overall performance in the OSCE. (Principal investigator: Masoud Golkani)
‘Virtual hangouts’: An evaluation and exploration of an online social support strategy. (H15068)
The aim of the project is to explore student experiences of online social support sessions and its effectiveness on the student learning experience during new models of blended online learning. Additionally, to explore the effectiveness of the virtual hangout sessions in supporting first-year student transition into university by integrating literacy support, introduction to university services and subject coordinator assignment support sessions. The research question that will guide the study is “how can online platforms be utilized to provide social and transition support to improve students’ learning experiences and progression through their undergraduate program?” (Principal investigator: Cris Algoso)
Utilising a co-design framework in the development of case studies to circumvent the use of artificial intelligence in assessment (H15670)
Staff collaborate with students utilising their knowledge of AI to codesign assessment case studies that circumvent the use of artificial intelligence during assessment completion and report on the development process. (Principal investigator: Jacqueline Rojo)
Educator perspectives on flexible and ethical approaches to teaching, learning and assessment for nursing students in the era of generative AI. (H15803)
Our research question is: What are the perspectives of educators (national and international) on flexible and ethical teaching, learning and assessment approaches for nursing students in the era of generative AI? (Principle Investigator Lucie Ramjan)
The College
Work Integrated Learning for Online Students (H15191)
The research aims to explore the distinctive needs of online students with respect to their participation in e-WIL activities, via an online questionnaire distributed to students enrolled in Undergraduate Certificates courses at The College between 2020-2022. From internal data, it is known that UG Cert students are highly career driven and have used these courses as a vehicle to transition careers, or to secure promotion in their existing industries. They come to our entirely online courses with prior professional experience, and are predominantly mature aged students aged over 25 years, located across Australia. (Principal investigator: Jack Isherwood)
FLEX PoR Research Outputs
Click on the arrow below to see a description of the projects
The College
Belkina, Marina, Fletcher, Ben, & Kelly, Ben (2023). Cross-faculty staff-students partnership exploring project-based learning. Poster presentation, STARS Conference 2023. https://unistars.org/papers/STARS2023/P17.pdf
FLEX Resources
Participant information statement
Literature review (Link to AdvanceHE)
Research grants
Other research resources
Evidencing your teaching practice
START Program of Research (Transition and retention)
TEL Program of Research (Technology-enabled learning)
Teaching and Curriculum Partnerships research (Partnership pedagogy)
Mobile options: