An Integrated Practical Assessment Model for Web Programming Education in Smart Campus Environments

The implementation of a smart campus environment can improve the quality of education through the enhancement of student achievement, participation and motivation to learn. It also encourages integrated assessment methodologies such as displays of student work and practical projects that allow learners to apply theoretical knowledge in real-world scenarios while improving creativity and collaboration abilities. The use of modern digital technology allows higher education institutions to improve the quality of education and to provide more effective, efficient and attractive services to the academic community [1, 2].

Web programming has become a basic part of the teaching of Computer Science and Information Technology [3]. Improvements in information and communication technology have altered teaching approaches and had a great impact on programming education [4]. More recently, advances in artificial intelligence have opened up new avenues for personalized and adaptable learning. Sendeku et al. [5] proposed an AI-enabled adaptive learning framework that integrates cognitive, emotional and cultural learner characteristics to personalize learning experiences and enhance learner engagement. These achievements illustrate the potential of developing technology to promote student-centered and adaptive educational environments.

Project Based Learning (PBL) and student work exhibitions have been widely acknowledged as successful techniques to increase students’ motivation and involvement in programming education. Previous research has shown that the combination of automated assessment with gamification tactics can boost participation and learning motivation as well as student confidence in programming related courses [6]. Despite these benefits, the automated programming assessment systems are still facing the challenges of scalability and integration with complementary assessment approaches [7]. Lubarda et al. [8] observed that first- and second-year students were more inclined towards participating in virtual pair programming activities compared to senior students. Similarly, Ou et al. [9] pointed out the necessity of creating an inclusive digital education ecosystem for preparing future generations for an artificial intelligence-driven society. Furthermore, engineering education is supposed to produce graduates who are not just technically proficient but also ethically responsible professionals [10].

Empirical studies have shown that instructional programming involving practical assignments, programming projects, and student work exhibitions can improve conceptual understanding and practical competence [11]. Considering these findings, the current work designs and assesses an integrated evaluation model for a Basic Web Programming course in a smart campus learning environment.

This study attempts to answer the following research questions:

RQ1: What assessment needs are identified in the Basic Web Programming course? (Context: students’ learning experiences and course assessment activities)

RQ2: How to integrate practical assignments, programming projects, practical examinations and student work exhibitions into a structured assessment model of Basic Web Programming?

RQ3: How do students and visitors of the exhibition perceive the implementation of the integrated assessment model?

The planned output of this project is an integrated assessment model which can support instructors in assessing student learning in Basic Web Programming holistically. The model provides a practical approach to the creation of assessment activities that relate technical competence, conceptual understanding, creativity, cooperation, engagement and problem-solving in a learning environment in a smart campus.

This study utilized a mixed-methods approach within a research and development (R&D) framework to evaluate the effectiveness of integrated assessment tools in a Basic Web Programming course. The research design followed a systematic four-stage process: needs analysis, instrument design, implementation, and evaluation. The mixed-methods approach was chosen to integrate quantitative data (numerical and statistical) with qualitative insights (narrative and descriptive) to provide a more comprehensive and holistic understanding of the research problem.

3.1 Participants and setting

This study was conducted in the Basic Web Programming course offered by the Informatics Engineering Program at a private university in Indonesia. At the beginning of the semester, 89 first-year undergraduate students were enrolled in the course. As part of the course assessment innovation, students were invited to participate in a student work exhibition challenge, in which they presented their web programming projects to a broader audience. The final analytic sample consisted of 61 first-year students who accepted the challenge and completed the required assessment activities.

The participants were selected using a purposive classroom-based sampling approach based on clearly defined inclusion criteria. The inclusion criteria were: (1) being enrolled in the Basic Web Programming course during the semester of implementation, and (2) participating in the assessment activities required for evaluating the proposed assessment model, particularly the student work exhibition challenge. Students who did not complete the full sequence of assessment activities or did not participate in the final exhibition were excluded from the final analysis.

The final sample consisted of 46 male students and 15 female students. All participants were first-year undergraduate students in the Informatics Engineering Program. Therefore, the sample represents students who completed the full assessment sequence and participated in the student work exhibition challenge within the observed Basic Web Programming course context. The findings should be interpreted as context-specific to first-year Informatics Engineering students in this course and institution, rather than as broadly representative of all Information Technology students or all web programming courses.

3.2 Data collection and instruments

Data collection was facilitated through several instruments to capture student assessment outcomes and perceptions of the student work exhibition. The instruments and data consist of:

(1) Assessment Component Records: Assessment records were collected from students who completed the required assessment activities.

(2) Student Satisfaction Surveys: Following the final examination, students were invited to complete a questionnaire designed to measure their perceptions of course quality and the student work exhibition experience. The survey was voluntary, and 46 valid responses were obtained from the final analytic sample of 61 students.

(3) Exhibition Visitor Surveys: Feedback from exhibition visitors was collected through a separate questionnaire employing a 5-point rating scale. Responses were obtained from both onsite and online visitors who attended the exhibition. In total, 735 valid responses were included in the analysis.

(4) Assessment Dimension Framework: The proposed assessment model was informed by six assessment dimensions that were used to guide the design and interpretation of the proposed assessment model: technical skill, conceptual understanding, teamwork, creativity, engagement, and problem-solving. These dimensions were not treated as separate inferential statistical variables in this study; rather, they served as an operational framework for describing the types of learning outcomes supported by practical assignments, programming projects, practical examinations, and the student work exhibition [11]. The operational definitions and examples of evidence for the six assessment dimensions are presented in Table 2.

Table 2. Operational definitions and examples of the six assessment dimensions

In the exhibition context, visitor feedback was collected using a 1–5 rating scale for the student works observed by visitors. A score of 1 indicated very low appreciation, whereas a score of 5 indicated very high appreciation of the work exhibited. Visitors could also provide questions, comments, criticisms, or suggestions for the student work and for the overall exhibition event. Therefore, the visitor rating was used as descriptive feedback on public appreciation of student work, while the six assessment dimensions were used as a framework for interpreting the educational value of the assessment model.

3.3 Survey design and qualitative feedback procedure

The student and visitor questionnaires were designed to capture perceptions of the assessment model and the student work exhibition. The design of the questions was aligned with the purpose of the study, namely, to evaluate and support students’ learning experience in the Basic Web Programming course. The questionnaires used closed-ended rating-scale items and open-ended feedback prompts.

The student questionnaire employed a 1–10 rating scale to determine students’ satisfaction with the quality of the course and the experience of the exhibition. The rating scale was developed to provide a straightforward and familiar answer structure to the students, while allowing variance in perceived pleasure. In addition to rating-scale items, students could also submit written comments regarding their learning experience, the value of practical assignments and programming projects, and their assessment of the student work exhibition. In the visitor questionnaire, visitor assessment of the student works observed during the exhibition was collected using a 1–5 rating system. A score of 1 indicated very low appreciation, whereas a score of 5 indicated very high appreciation. The visitor questionnaire also featured open-ended prompts for questions, comments, critiques or ideas about the student projects and the exhibition event.

Qualitative data were collected via open-ended survey answers, classroom observation notes, peer evaluation information and informal input during the project display. Since the qualitative part of the study was utilized to enhance interpretation and not to perform a comprehensive qualitative investigation, no formal interview methodology or separate interview coding system was employed. Qualitative feedback was evaluated topically to discover reoccurring remarks on involvement, project quality, teamwork, creativity, technical issues and presentation. These themes were then utilized to help with the interpretation of the descriptive survey findings.

Future implementations should establish a more formal interview guide, use systematic qualitative coding techniques, and engage multiple coders for coding agreements to increase repeatability. The current research employed qualitative information as supporting evidence for triangulation and not as distinct qualitative data collection.

3.4 Practical implementation and grading procedure

We assessed the evaluation approach within the normal framework of the Basic Web Programming course exhibition. The grading standards were based on the instructor’s course evaluation criteria. The practical activities were evaluated according to the student’s ability to accomplish the specified programming tasks, to apply the appropriate HTML, CSS and fundamental interaction principles and to overcome technical challenges that arose throughout the learning process. We assessed programming projects based on project completeness, functionality, design quality, innovation, and the student's ability to describe their creation. We conducted practical assessments to test individual comprehension and competency in the application of web programming principles under examination settings. The student work exhibition was an extra evaluation and feedback activity, enabling students to present their projects and get opinions from visitors, peers and instructors.

In this implementation, a formal weighted scoring rubric was not applied independently to each of the six characteristics of the evaluation. Instead, the six dimensions acted as an operational and interpretative framework to express the learning objectives supported by the assessment model. The visitor evaluations were not used as official marks, but as descriptive feedback reflecting public appreciation of student projects. The visitor survey answers were thus used as proof of exhibition reception instead of official performance evaluations.

Rater preparation: The instructor served as the lead academic rater for the course learning goals and evaluation criteria. Visitors were given a basic grading system and encouraged to voice admiration, comments, questions, concerns, or ideas about the student work. However, no official rater training was undertaken for the visits since they were not regular academic raters. Similarly, inter-rater reliability was not determined in this research since the visitor assessments were descriptive feedback rather than formal academic grading.

The findings should be interpreted with this restriction in mind. In future implementations, analytic rubrics with precise explicit weighting of each facet of assessment should be developed; instructors and evaluators should receive formal rater training; and inter-rater reliability should be calculated when multiple raters are used. These modifications would enhance the repeatability, reliability and comparability of the evaluation model across various classes and institutions.

3.5 Course integration and operational workflow

The proposed assessment model was included in the routine of the course Basic Web Programming. The execution of the course was conducted from the introduction of concepts, guided practice, project creation, practical assessment, exhibition preparation, public presentation, and reflection of feedback. In this sequence, evaluation was not only an end-of-course activity, but an activity inside the learning process throughout the semester.

At the beginning of the course, learning objectives, assessment components, project requirements, and exhibition expectations were introduced to students. Participants were informed that their learning performance would be evaluated through practical assignments, programming projects, practical examinations, peer contributions, and participation in the student work exhibition.

During regular learning sessions, fundamental web programming concepts, including site structure, layout, design, and basic interactivity, were introduced. Students then completed practical tasks that required the direct application of these concepts. Throughout the practical activities, the instructor monitored student progress, provided technical guidance, addressed programming difficulties, and delivered formative feedback. These activities generated process-based evidence related to technical skills, engagement, and problem-solving.

Once students had sufficient fundamental competency, they worked on programming projects individually or in groups as planned by course activities. Throughout this phase, students produced web-based products, using the knowledge and skills acquired throughout the course. The teacher helped students to define project scope, monitor project progress, encourage teamwork and assist students with modifying technical or design concerns. Information from peer evaluation was utilized to help comprehend individual contribution and collaboration. The evaluation of individual comprehension and competency in the application of web programming ideas under examination settings was performed via practical exams. These tests complimented the project-based activities to ensure that students were assessed not just via group output or display performance, but also through individual demonstrations of competence.

Towards the conclusion of the term the students prepared their projects for the student work exhibition. During the last phase, the teacher helped students to finish their web projects, create presentation material, defend design choices and answer any queries from visitors. During the exhibition, students showed their work to visitors, peers and instructors. Visitor ratings and open-ended comments were collected through exhibition visitor surveys. The comments collected after the exhibition were utilized as descriptive evidence to reflect on the project quality, presenting abilities, involvement and public appreciation of the students. The operational sequence of the course integration is shown in Table 3.

This workflow shows that the assessment model was embedded throughout the course rather than added only as a final evaluation. The integration of practical tasks, projects, examinations, exhibition, and feedback enabled students to demonstrate learning through both process-based and product-based evidence.

3.6 Data analysis

Data exported from Google Forms was verified for completeness and validity in Microsoft Excel prior to analysis. Only completed voluntary replies to the student survey were included in the study. A student satisfaction survey was completed by 46 of the 61 students in the final analytic sample; survey findings were presented using 46 as the response denominator. The analysis of the visitor survey comprised all visitor replies for a total of 735 valid responses.

Missing data were treated using a complete-case technique. No imputation was used since the analysis was descriptive and only included valid completed answers. Students who did not complete the requisite series of assessments or participate in the project showcase were eliminated from the final analytic sample. Outlier screening was done via range checks based on pre-defined response scales. The answers for student satisfaction were validated using the legitimate scale of 1–10 and visitor satisfaction was validated with the legitimate scale of 1–5. Replies beyond the prescribed range of scales or incomplete replies were not analyzed.

Adjustment for multiple comparisons was not performed since this research used descriptive analysis and did not undertake multiple inferential statistical tests. The findings were consequently viewed as descriptive evidence of the students’ and visitors’ perspectives on the assessment model and project display rather than inferential evidence for generalization to a large population level.

Qualitative data from classroom observation and peer evaluation helped evaluate student participation, individual contribution and creative processes that could not be conveyed by numerical ratings alone. To evaluate the suggested evaluation methodology, data triangulation was achieved by combining quantitative survey findings with qualitative classroom evidence.

The six assessment dimensions were used as an interpretive framework for discussing the educational contribution of the assessment model. They were not analyzed as separate statistical variables because no formal weighted scoring rubric was applied to each dimension in this implementation.

This research was exploratory and descriptive, with the intention of doing a requirements analysis, to build an evaluation model and to gather first input on implementation. Therefore, inferential statistical analysis was not performed. The quantitative data supplied were mostly satisfaction ratings and scores of visitor appreciation that were utilized to reflect impressions of the evaluation model rather than to verify causal effects. Furthermore, the research lacked a randomized control group, pre-test/post-test design, and repeated standardized performance measurements that would provide support to reliable causal inference, effect size calculation, or multivariate modeling. The data were therefore interpreted descriptively and should not be regarded as statistically verified proof of effectiveness.

The development of suitable evaluation tools for Basic Web Programming is vital to promote learning quality and student outcomes from this study. Through a comprehensive requirements analysis, significant assessment needs were identified, suggesting that a comprehensive assessment framework should incorporate should include practical web programming abilities, conceptual knowledge, creativity, collaboration, engagement, and problem-solving. The implementation gave descriptive evidence that the assessment approach was well regarded by the students and exhibition attendees alike. The student work exhibition extended assessment beyond conventional testing by enabling authentic demonstration, feedback exchange, and public engagement.