Exploratory System Testing

This document guides as a way to execute basic exploratory testing of Doubtfire during major API/UI updates. You can duplicate this Markdown file and check off each feature as you go.

Contents

• Unit Administration
  • Creating a new unit
  • Modify existing unit
    • Basic unit details
    • Learning Outcomes
    • Staff
    • Tutorials
    • Students
    • Tasks
    • Task Alignment
    • Group Sets
• User Administration
• Teaching View
  • Feedback
  • Portfolio marking
  • Portfolio marking
• Student View
  • Dashboard
  • Tasks
  • Unit settings
  • ILO Alignment
  • Portfolio Generation

Unit Administration

Creating a new unit

• Create a new unit with unit code and name.

Modify existing unit

WARNING: Be sure to use the unit COS10001 to test the following.

Basic unit details

• Updating a unit. Update code, name, description, start date, end date, active.

Learning Outcomes

• Add a learning outcome.
• Download CSV of ILOs.
• Import CSV of ILOs.
  • Use test_files/COS10001-TestImportOutcomes.csv.
  • Check that TEST_ILO_X have imported.

Staff

• Add a new staff member.
• Delete a staff member.
• Demote a convenor to a tutor.
• Promote a tutor to a convenor.

Tutorials

• Add a new tutorial.
• Delete an existing tutorial.
• Modify an existing tutorial.

Students

• Enrol/withdraw a student.
• Assign a student to a tutorial.
• Remove a student from a tutorial.
• Change a student's tutorial.
• Batch enrol students.
  • Use test_files/COS10001-TestImportEnrolments.csv.
  • You should see 10 TEST_STUDENT_X users enrolled (search for import).
• Batch withdraw students.
  • Use test_files/COS10001-TestImportEnrolments.csv.
  • You should see 10 TEST_STUDENT_X users withdrawn (search for import).

Tasks

• Create a task with basic details.
• Add and remove plagiarism checks to tasks.
• Upload task sheet and resources for a single task.
  • Use test_files/submissions/00_question.pdf and test_files/submissions/2015-08-06-COS10001-acain.zip. It should pass.
  • Use test_files/NotAZip.zip and test_files/NotAPdf.zip for both. It should fail.
• Add and remove task upload requirements.
• Batch upload tasks CSV.
  • Use test_files/COS10001-TestImportTasks.csv
• Batch download tasks CSV.
• Batch upload tasks ZIP.
  • Use test_files/2015-08-06-COS10001-acain.zip
• Batch download tasks ZIP.

Task Alignment

• Add a task/ILO alignment to a task.
• Update an existing task/ILO alignment.
• Delete an existing task/ILO alignment.
• Download CSV of task alignments.
• Upload CSV of task alignments.
  • Use test_files/COS10001-TestImportAlignment.csv.
  • You should see some alignment between Tasks TEST_TASK1/2 and TEST_ILO1/2.

Group Sets

• Add a new group set.
• Edit an existing group set.
  • Change its name.
  • Switch details between staff only/group only.
• Add a new group.
• Edit an existing group.
  • Change its name.
  • Change its tutorial.
• Delete an existing group.
• Add some members to a group.
• Delete some members from a group.
• Upload CSV of groups.
  • Use test_files/COS10001-TestImportGroups.csv.
  • You should see some groups suffixed TEST_GROUP_X with some groups.
• Download CSV of groups.
• Delete a group set.

User Administration

• Upload CSV of users.
  • Use test_files/test_doubtfire_tutors.csv.
  • You should see some groups suffixed TEST_TUTOR_X with some tutors.
• Download CSV of users.
• Edit existing user.
  • Change basic details.
  • Promote and demote system roles.

Teaching View

Run rake db:simulate_signoff to simulate signoff. Run rake submission:generate_pdfs to generate PDF submissions after uploading (requires LaTeX).

Feedback

• Download tasks offline.
• Staff can make comments on upload commented tasks.
• Make feedback on submission.
• Change student task status.

Portfolio marking

Portfolio marking

• Change student task status.
• Change student grade with rationale.

Student View

Use a student from COS10001 (e.g., sign in to student_0).

Dashboard

• Burndown chart displays successfully.
• Target grade changes successfully.

Tasks

• Task description displays successfully.
• File upload successfully completes.
• Submission PDF can be viewed.
• Students can make comments.
• Plagiarism detection report can be viewed.

Unit settings

• Can remove self from all tutorials.
• Can assign self to a new tutorial.

ILO Alignment

• Can create new ILO/Task alignments with description.
• Can modify existing ILO/Task alignments.
• Can delete existing ILO/Task alignments.

Portfolio Generation

• Can run through each step of portfolio generation.
  • Add extra files to portfolio.
  • Ensure some alignments have been made.
  • Don't include all tasks.
• Can successfully view portfolio.
  • Check to see the above have been added after generating the portfolio.