 Home
Tips
for Creating a Good
Survey
Tips
to Students
Tips
for Tracking Surveys
Protocol
for Surveys
Oral
Critiques, CCEC,
and Advisory Committee
for OEA
MyEvaluations.com
System Information and Instructions
Blackboard
Access
Contact Information |
 |
Office of Educational Assessment (OEA)
MyEvaluations.com System

Information and Instructions on Use of
MyEvaluations.com System Written by Diane Blahun,
OEA,
5-23-04; New info. added as needed by D. Blahun
(last
update: 10-11-07)
The
below
information/instructions are also available in hard copy as a revised
instruction manual that I recently put together. It includes a
table of contents and easy reference to many areas of use on the system.
Please just contact me at
blahun@nso1.uchc.edu
if you haven't received your copy. (10-11-07)
In
April 2004, a new off-site server based on-line evaluation system called
MyEvaluations.com was implemented for the Student Continuity Practice and,
starting with 04/05 AY, for the third year MAX and Inpatient
rotations. Starting in this 07-08AY, the fourth year students are now being
evaluated in their ACE and AIE experiences thru this system as well.
The system allows SCP's associated community based faculty, and Attendings teaching 3rd and 4th year medical students in
their respective specialties, to evaluate their students’ performances
on-line. This has resulted
in more immediate and efficient feedback to the students along with the students’ ability to respond to their
evaluations on-line if they so desire.
Information for Medical Students:
Click
on following areas to bring you to that section:
Acknowledging
Receipt of Your Evaluations
Accessing
Your Signed Evaluations
Information
for Evaluators: i.e.
Course Directors and Section Leaders, Site Directors, Attendings, Residents,
Fellows
Click
on following areas to bring you to that section :
FAQ by Evaluators
Forgot
your Password?
Declining
an Evaluation
55 Minute Warning - At 60 mins. a.) session ends and b.) responses
automatically saved.
No/Yes
Feature at End of Evaluation
3
Options for Evaluator on Completing the Student Evaluation
Voluntary
Evaluations
Reports
Scores on Evaluation
Systematic
View of Student Evaluations
Information
for Specialty's Program Coordinators Individuals
responsible for the evaluation assignments.
Click
on following areas to bring you to that section:
FAQ by Section Program
Coordinators
Options
for Evaluation Assignments
Printing
a Blank Evaluation
User
Roles Defined
User
Information on Attendings (i.e.Evaluators)
Enrolling
an Attending/Evaluator
Enrolling
Medical Students
Process
of Evaluation Assignment
Deleting
or Undoing an Incorrect Evaluation Assignment
Viewing
Evaluation Assignments
Undoing
an Evaluation Submitted by an Evaluator
Special
Notes for Everyone
I.
For Attendings,
Site Directors, and Section Leaders (the Evaluators):
Ø
Once your name has been entered into the MyEvaluations.com database,
the MyEvaluations.com system will automatically e-mail you with your
username and password for access to the system. [If you forget your password, click on
“Forgotten Your Password” button that is located right above the login
box, enter your email address (e.g.jdoe@nso.uchc.edu), and your username/password will
immediately be emailed to
you. If you have more than one username, the system currently sends
the first username and password it locates in system.
Please
contact me (Diane Blahun, blahun@nso1.uchc.edu)
for passwords to any additional usernames and I'll contact off-site
administrator for this information.) Every
effort is currently being made to avoid duplicate entries into this new
system. Attendings already
enrolled via Dr. Ralph Martin’s use of this system for residency
evaluations or via the CMC account (for SCP evaluations), will be shared to
the appropriate area, MAX and/or Inpatient, to avoid issuance of a new
username and password. Since
we are working with such a large database of Attendings, you still may
receive a 2nd
username and password for access to these areas, despite the best efforts to
avoid this from occurring.
And some Section Leaders and Course Directors will
require more than one – e.g. the
Course Director for all of MAX is enrolled as Program Director for the MAX
Account but also is enrolled as a Program Director for the Inpatient Account
since he’s the Inpatient Medicine Section Leader.
In order to provide the correct access rights to Administrators and
Program Directors, they need to be enrolled separately into the correct
account in that capacity and consequently will receive a separate user name
and password in those capacities.
Ø
The
good news is that whenever the program coordinator in your specialty assigns
an Evaluation to your name and to the corresponding students you will be
evaluating, you will again automatically receive an e-mail with your
username and password for access to this evaluation along with a secure
encrypted log-in to the system.
Ø
This
2nd e-mail will instruct you to either Complete
or Decline to
complete an evaluation on your student(s).
If
you
Decline (e.g. the incorrect student has been assigned to you for your
evaluation), you will be asked to explain why you are declining to complete
the evaluation. This information is then forwarded to the program
coordinator of your specialty (who was responsible for the assigning of
these evaluations) and that individual will then look into the issue
explained. (Declining
does NOT delete the assignment from the evaluator's inbox, but simply sends
an email to the administrator letting them know that the doctor is
declining. It is up to the administrator (i.e. the section’s program
coordinator who assigned the evaluations) to then "Delete" the
assignment.)
If you select the Option
Complete, you will be taken directly to the evaluation within the
MyEvaluations.com
system that you need to complete. Alternatively, you always have the option
of logging onto MyEvaluations.com at any time and accessing the
“Evaluation” menu tab located at top and here again you also have the
options of Evaluate or Decline.
And again, if you decline, you will need to explain why and this
information is then forwarded directly to your specialty’s coordinator who
originally assigned the Evaluation to you.
Please
note the following important
information that will help you successfully submit your responses on
the evaluation of your MAX and/or Inpatient Student:
1.
Please read through the entire evaluation and provide
answers to all questions.
2.
After you have provided all your evaluation responses, it
is essential that you
then click on one of options a,
b, or c below. If you close out of your browser and/or the system before
clicking on one of these three options, your student’s evaluation will be
lost.
a). Finished
Final Submission –
Click on this when you are ready to send completed evaluation.
b. Save
& Finish Later
– Click on this if you want to complete the evaluation later.
c). Save
& Send Feedback
– Click on this if you’d like to send your student an interim
evaluation and finish evaluation later.
If you select c.) Save and Send Feedback, your
student will receive the following e-mail message from MyEvaluations.com:
_________________________________________________________________________________________
Dear “Medical Student’s
Name” ,
Please visit MyEvaluations.com to review the
feedback submitted by Dr. “Name of Evalautor”. The report will provide
you with partial feedback on your performance, in order to make improvements
before the final evaluation is submitted at the end of the rotation.
Continuity
Practice - 1st Year Student
Review the feedback report and contact Dr.
“Name of Your Evaluator” directly with your questions.
Thank You
__________________________________________________________________________________________________
3.
You will be prompted to provide a comment
whenever you give a suboptimal rating on a student.
Comments are mandatory for any suboptimal rating – so if you
don’t comment, you
won’t be able to submit the evaluation. Good
ratings do not require your comments – a comment box will be provided
though in case you do wish to enter comments.
Course and Section Leaders are automatically notified by the System of any
suboptimal ratings.
4. While completing an on-line evaluation,
a 55 minute warning will appear signaling that session will expire in 5
minutes. If user hits OK (on warning box)within 5 minutes, the user remains connected to the off-site
server and can continue completing the evaluation. If they don't hit
OK,
their session expires after 60 minutes
however their responses entered on evaluation are automatically
saved. The log-in screen then appears so user can re-access evaluation
by going to their inbox of evaluations. Per Dr. David Melamed: "Note that this has been
tested with Internet Explorer, Netscape and Mozilla. It may not work on all
other browsers and some MAC users may still have issues."
5. Also a feature at
the bottom of the student evaluation allows an evaluator to click on
"No"
or "Yes,
send an immediate notice to the Program Directors". Please use this sparingly
since the Course and Section leaders along with Dr. Koeppen and Dr. Ardolino
all receive this e-mail notification - so it should be used only if truly
necessary. For most instances, we recommend leaving it at the default
of "No".
6.
If you click on options b. or c. above, please do remember to go back into
MyEvaluations.com system and complete the survey later – otherwise your
evaluation will not be submitted.
7. After
you have clicked on one of the above three options, PLEASE WAIT FOR THE
SCREEN TO REFRESH AND RETURN YOU TO THE MENU BEFORE LOGGING OFF.
8.
You will receive an e-mail reminder every
7 days until you complete this
evaluation.
9. Your
student(s) will have the ability to respond within the MyEvaluations.com
system to your evaluation of them, if they so wish – they are all required
to acknowledge receipt of their evaluation.
Once a student acknowledges receipt of your evaluation (optionally
adding their comments as well), their evaluation will appear under your
"Evaluations to Review". By opening up the evaluation, you
will see at very end of each evaluation any comments by the student.
Once you click on acknowledge at end of evaluation, it will drop out of your
Evaluations to Review area.
VOLUNTARY
EVALUATIONS: If an Attending or
Resident or Fellow, etc. that isn’t officially assigned to evaluate a
student’s rotation performance needs to evaluate a student or students, as
long as the Attending/Resident/Fellow, etc. are enrolled in the
MyEvaluations.com system as a user (for Inpatient or MAX accounts), they
have the ability to evaluate by using the “Voluntary Evaluations”
feature. An Administrator
in this system (i.e. the program coordinators for each specialty) can also
enroll such people into their designated account.
An individual processing a voluntary evaluation would do as follows:
1. After logging in, they would click on “Voluntary”
tab at top of menu buttons.
2. Then click on "Attending
of Medical Student". 3. Then a screen will appear asking them to enter
following information : a.
The specific rotation block dates.
b.
Select
the "
Discipline’s 2004-2005 Evaluation for Attendings" from the drop down menu of Evaluation choices. c. Select the “Name
of the Medical Student” they would like to
evaluate.
d. Then press “Next”
and proceed from there to complete the evaluation.
REPORTS
To
access the reporting area , just click on the Report tab at top of
menu buttons of system's main page. Only those in roles of Administrators and Program Directors
have report access.
-
Please
keep in mind that there are a number of reports listed under the Attending
Reports category that are not relevant to our current needs -
some reports here are non-existent for our purposes since we are not
currently having the students evaluate the Attendings on-line via this
system - this is
still being done by the MAX and Inpatient rotation course/preceptor
surveys I set up and post on Blackboard for students to complete.
-
Also, the
Attending reports and the Medical Student Reports
are only areas you
need to access for reporting - all other report areas are for
Residents and Fellows reporting.
-
If you're trying to pull up a report, be sure to enter rotation dates that
are outside the actual rotation block dates - the parameters need to
be inclusive of the rotation dates in order to generate a report - so e.g.
use any old arbitrary dates like 07/01/03 to 09/30/04 and you'll be sure to capture any reports (if
they exist) on what you're looking for.
-
You can narrow down the information generated by
being sure to capture a specific rotation block but not info. on other
rotations (if that is what you need.) – e.g. for completed student
evaluations
on rotation block dates of 7/6
to 7/16/04, enter dates like
7/01/04 to
7/20/04 or 7/05/04 to 7/17/04, etc. – if one set of dates doesn’t work,
then just try dates further outside the rotation date’s actual parameters.
If no reports are generated, then no evaluations have been completed
within that rotation block.
Under
Medical Student Reports:
1. The
Individual
Medical Student Evaluation Report
will pull up all or a specific completed evaluation on an
individual student showing the evaluator's name, the specific or all
evaluations and ratings on each question.
In order to more clearly view or print
the choices of response text on this report, simply Click on Edit
and then Select All.
2. The
Summary
of Medical Student Evaluations Report will
pull up for you all or a specific evaluation completed on as many students
that you select.
Within this electronically generated report,
the
"Attending Average" column provides the average score that the evaluator tends to give based on the evaluations he/she has completed to
date. And
under the "Total" column (last column), the n represents the
number of this specific evaluation completed to date by all Attendings.
So the "Total" represents the Average to date of all
Attendings' ratings on this question in this evaluation.
3. In order to clarify ratings on
a completed individual evaluation report, here are detailed explanations
using the below MAX Ob/Gyn Composite completed evaluation as an example:
I.Attending
Avg:
7.22 (n=23)
80.2%
This represents the average
rating that the evaluator, for this specific question, gave students
on his MAX Ob/Gyn evaluations during that year. N=23 - where 23 is the
number of students Dr. Y evaluated using the MAX Ob/Gyn
Composite evaluation .
II.
Group:
7.00 (n=1)
77.8%
This represents the average
rating that students in this class (including this student X), with
same rotation dates as student X, received on their MAX Ob/Gyn
Comp. Evaluation, for this specific question.
III.
Total
6.92 (n=73)
76.9%
This represents average
rating that all Medical Students in this class received
for this question on this specific evaluation. Here n=73 students.
One
other important note:
In order to pull up the Group and
Total Scores on an individual student's report, you need to select
"All Evaluators" vs. a
specific doctor for parameters. If you select a specific doctor, Group
score will be noted as N/A and Total will be the "Attending
Avg." which makes sense since you're not accessing a group of
students but just this doctor's.
You also can view Group and Total
Averages if using the Summary Report of Med. Students.
|
Individual Medical Student
Evaluations
|
| 05-06 MAX Ob/Gyn COMPOSITE
Evaluation |
|
 |
| UCONN Health Center -
Multidisciplinary Ambulatory Experience (MAX) |
|
|
| Report Date Range: 07/01/2005 -
10/23/2006 |
| Report Date/Time:
10/23/2006 2:12:39 PM |
|
Medical Student: Student X
(MSY - 4)
|
| Competency = Average score on
competency for selected Medical Students |
| Avg = Average score given by
an for each question |
| Group = Average score of all
MSYs represented: MSY-[4] |
| Total = Average score of all
MSYs |
Evaluation Completed:
6/27/2006
Evaluation Period: 4/10/2006 through 5/19/2006
|
| Attending Physician: Dr.
Y |
|
Interpersonal and Communication Skills -
Category Summary (8.00, 88.9%)
| Question: |
Student X |
Attending Avg |
Group |
Total |
Verbal Presentation Skills
Below Expected Level
1. Poor organization; lack of detailed
and/or accurate information.
3. Often lacks appropriate information
and/or organization.
|
At Expected Level
4. Sometimes lacks appropriate
information or presents in a disorganized fashion.
6. Information is pertinent and
presented in a logical manner. Somewhat able to adjust
presentation to visit type. |
Above Expected Level
7. Very well organized pertinent
presentations with excellent details. Adjusts presentation to fit
the case and clinical setting.
9. Outstanding presentation
skills; concise; appropriate. Organized and easy to follow.
Adjusts presentation to the clinical setting. |
Sliding Scale of 1-9 (See Bottom) |
|
8.00
88.9% |
7.22 (n=23)
80.2% |
7.00 (n=1)
77.8% |
6.92 (n=73)
76.9% |
| Question Comments: improved
in morning report |
When
accessing the Summary Group/Medical Student Reports (under Medical Student
Reports), two different types of reports can be generated:
1.
If you select "All Evaluations" then it will give you individual
details. This "Power Report" provides
evaluations in detail on the students selected.
2.
If you select a specific discipline's evaluation, then a summary report will
be generated - this report allows you to review a number of student's
ratings in a more efficient manner and to view the summary of all
comments on each student grouped at end. This summary report is
very beneficial in reviewing all student's evaluations.
The
student names first go horizontally across top of page and also at end of
the ratings their names appear again with acknowledgement by evaluator and
comments if any. On this report
you can do as follows to bring it into an Excel
worksheet:
Edit, Select All, Copy, bring up a blank excel worksheet and Paste this
report there. You can freeze columns by placing cursor in cell below
first student's name and then click on Windows in menu buttons and click on
Freeze Panes.
3.
Ledger of Evaluations report: this
report shows status of all evaluations assigned to be completed on a student
- the evaluator's name, the specific discipline's evaluation and rotation
dates, and if it has been reviewed and acknowledged (signed) by the student
- also, there's a separate list of evaluations assigned but not completed
yet by the student's evaluator.
Term Meanings in Ledger
Report's Status
column
a.
Not Reviewed:
Student has not
opened evaluation completed by his/her evaluator but evaluator has completed
this evaluation - if not completed, the evaluation is listed in block below
student's completed evaluations as pending.
b.
Reviewed/Not Signed:
Student opened their
evaluation but didn't acknowledge receipt of it - didn't click on
Acknowledge Receipt button at very end of survey.
c.
Reviewed/Signed:
Student opened their evaluation and acknowledged receipt of it.
d.
Confidential:
This term is reserved for any
completed evaluations not viewable to the student. Certain MAX Specialty
evaluations completed by Attendings come under this category and are used
by the discipline's Site Director/Section Leaders or other designated
evaluators to create a composite student evaluation and this composite eval. is viewable to
the student.
Completion Date
on Ledger Report: Date evaluator completed the student's evaluation.
Verbal Column:
Yes or No indicates whether Evaluator has met with student to review their evaluation.
Last Date Column
on Ledger Report: Date student reviewed or acknowledged receipt of
their completed evaluation.
4.
How to sort data
found on Ledger Report:
1. Pull up Ledger of Evaluations report.
2. Go under Edit - Select All - and Copy.
3. Pull up a blank excel worksheet and
paste that data onto excel sheet.
4. Delete the first few heading columns
and then:
5. Highlight the sheet (make sure you
highlight the columns and rows of data first) and then click on
Data, Filter, and then AutoFilter.
This will make little grey dropdown boxes appear at top of each column -
if you select an item in any box it will then group those items together.
e.g. Select just Inpatient BTE evaluations and those will only appear on
sheet, etc., etc.
Under
Attending Reports:
1. There is a
Completion
Status report
in which you can select the
Attendings you want or select All - then select the specific Evaluation -
and this report will show you the names of the Attendings, the number of
that specific evaluation they've been assigned and the number still
pending completion. And keep in
mind, all evaluators are receiving an e-mail reminder every 7 days ad
infinitum until they complete the evaluations assigned to them.
2.
The Overdue
Report will prove very useful in identifying the
specific names of that discipline's Attendings and their assigned students
which they haven't completed evaluations on yet.
How
to more systematically view completed student evaluations on this
system:
- Go
under your account, either MAX or Inpatient, go to Medical Student
Reports under Reports tab, click on Summary
of Medical Student Evaluations – either add All students and
select All evaluations, or specify certain students and/or a specific
evaluation. (so e.g. if you
just want to see all completed student evaluations to date under
Inpatient Surgery – add all students and select the Inpatient Surgery
Evaluation.)
- If
you do the above on a designated date once or twice a month, you’ll
recognize any new evaluations the following month by the completed date
noted in upper right corner of each evaluation.
(If you generated a summary report on
9-15-04
and generate the next one on
10-15-04
then it should be apparent what new evals. exist.)
Alternatively,
Step 2 of 6 under
"Summary of MedStud Eval report"
allows you to pull up only evaluations completed after your last
generated report
thru a "Filter Completion Date"
– this should prove very beneficial. I also think
the evaluations are ordered by date completed as well.
I
would also recommend printing out the Ledger
of Evaluation report as a reference tool on a monthly basis –
this will allow you to see what has or hasn’t been completed on
any student. Just use the Find feature (under Edit
on menu bar of your browser) to view specific information more easily and
quickly in this report: e.g. to find any MAX Psych evals. listed, click on
Edit, then Find and enter the phrase MAX Psychiatry -
and you'll be brought to any areas of report with this phrase - and
continue to click on Next, Next, Next, etc. to bring
you to all areas with this phrase - same can be done with a student's
name, an evaluator's name, a specific date, etc.
|
PROGRAM
COORDINATOR INSTRUCTIONS
|
II.
For Program Coordinators of each Specialty
Ø
Each specialty’s leadership is in the process of determining which
Attendings will be designated in each discipline to evaluate on-line the students in their rotation:
i.e. All the Attendings or just the Site Director or both are some
possible scenarios. Your
specialty’s leadership will clearly communicate this information to you
prior to your assignment of the evaluations.
Some evaluations may possibly not be viewable by the students for
certain specialties and others will be depending on the leadership’s
decisions on how to implement the evaluation process.
But there most likely will be at least one on-line evaluation report
viewable by the student (this will either be a composite evaluation or
several Attendings’ evaluations of them.)
In any case, the above will become clearer to all of you as things
progress.
Ø
Prior to the end date of each rotation block within your specialty,
you will need to assign your specialty’s evaluation to the correct
Attendings and Students for that rotation block.
It is important that you do this assignment process just prior to the end date of each rotation block throughout the year.
It is important that you DO NOT assign
an evaluation for a rotation in the future since the Attendings will
automatically and immediately receive an e-mail asking them to complete this
evaluation right after your assignment.
So I would recommend noting in your calendars a date, prior to each
rotation block’s end date, when you will assign the evaluations.
If,
for some reason, it is necessary to assign evaluations in advance, even
though evaluator immediately receives notice of evaluation, the actual
evaluation won't appear in their inbox until the start date for that
rotation.
Unless
essential to assign in advance, it's best to assign
evaluations just prior to rotation's end date. If you do assign
evals. in advance, be sure to notify the evaluators so they won't
prematurely complete the evals. when they hit their inbox on rotation's
start date.
1. Options for Assigning an Evaluation
When you start using this part of the system, you’ll
need to know in advance what
Option your
Section leader will be using in
terms of evaluation assignments to Attendings and the Site Directors.
And I also need this information from
each Section Leader before I can create and publish your surveys.
OPTIONS A, B, and C:
A. The Site Director
only will complete an on-line evaluation of the students.
Details:
The Section's program coordinator will assign the
section's evaluations to the Site Director only and the corresponding
students as each rotation block ends. In this option, individual
Attendings will be given hard copy evaluations to fill out and submit
to the Site Director who will use these in assessing the students in
the on-line evaluation. The program coordinator could, if they wish,
print out a blank on-line evaluation from the MyEvals.com system for these
hard copies.
To print out a hard copy of your rotation survey
(and also edit the hard copy to allow more space for comments), just do as
follows:
1.
Go into MyEvaluations.com and click on Evaluations tab at top.
2. Then click on Edit Evaluation and then on View the
particular evaluation.
3. Then go to File - Save As - and save the document as a word
document (save file in .doc format - make sure to change
extension from .html to .doc - and just click on type as file.txt)
4. Then pull this file up in your MSWord software and you can
edit it from there before printing out.
B. The Attendings and
Site Director will all complete on-line evaluations on the students at their
site and all these evaluation reports will be viewable by their students.
Details: The Section's program coordinator will assign the
Attendings at a site to the Section's on-line evaluation and their
corresponding students as each rotation block ends. I will create
a 2nd evaluation on-line that will be designated as the section's Composite
Evaluation. The program coordinator will assign this composite
evaluation (same text as first one assigned to the Attendings) to the Site
Director only. The Site Director will be reassigned the role of
Administrator (from user/evaluator) by the program coordinator unless he
already is assigned as a Program Director. This will allow him to view the
student evaluation reports by the individual Attendings.
C.
The Attendings and Site Director will all complete on-line
evaluations on the students at their site but only the Site Director's
evaluation report will be viewable by the students.
(Attendings’ evaluations not viewable to
students for this Option.)
Details: The Section's program coordinator will assign the
Attendings at a site to the Section's on-line evaluation and their
corresponding students as each rotation block ends. I will set up this
evaluation to be unviewable to the students. I will create a 2nd evaluation
designated as the Composite for the Site Director to complete and this one
will be viewable to the students. The program coordinator will assign
this composite evaluation to the Site Director and the corresponding
students as each rotation block ends. The Site Director will be
reassigned the role of Administrator by the program coordinator unless he
already is assigned as a Program Director. This will allow him to view student
evaluation reports by the individual Attendings.
2. User Roles Defined
The
three primary roles on this system are: (Underlined
in blue at end of each role are the individuals that are typically
being assigned to these roles here for the Inpatient
and MAX evaluations.)
- User: (default)
Provides the user with basic access to logon and complete evaluations.
Students in this role on the system, are able to view their own
personal evaluation reports done on them. But Attendings can’t view
the completed student evaluation reports after they submit the
evaluation reports on their students.
Mostly Students and the Attendings at the
various rotation Sites.
- Administrator: Provides the user with administrative privileges,
with access to all reports and administrative functions. Section’s Program Coordinators; also
Site Directors needing to view other Attending’s student
evals. in order to create student’s composite on-line evaluation.
- Program
Director:
Provides the user with
Administrator privileges, as above, plus two additional unique features.
(1) Ability to read confidential comments directed to Program Directors.
(2) Access to receive Early-Warning notices on sub-standard evaluation
results. Note: Only a user with
Program Director access can add another user as a Program Director.
Course
Directors and Section Leaders.
Information on your Attendings:
- If you need to verify the
role or e-mail address of an
Attending in MAX or Inpatient, click
on Users
menu tab at top – then on
Add/Edit
Existing Users
– and then to make your list complete, click on ALL in Filter User Type drop down box.
And you can easily edit from here (e.g. to modify an e-mail
address).
- If
you need to Add
an Attending to the system, please
contact me, Diane Blahun, in order to do
this: Below
is purely to show how this process works.
a.) First go
into the MAX or Inpatient account that you need to enroll this user
in. b.) Click on Users
tab. c.) Click on Add/Edit Existing
Users. d.) Click on All for Filter
User Type and determine if user already enrolled in that
account. If user has an * by their level (will appear as follows: Attending*)
then they are already enrolled in your account via the IM residency
system. e.) To add a user, click on User Profile
button in upper left hand corner - then enter text in following fields: Last Name, First
Name, Level Type (select User,
Administrator, or Program Director.) f.) Click on Yes
for Shared only if you want this user to be enrolled in both the
MAX and Inpatient accounts otherwise leave as No
(not shared) - as an Attending, any accounts can then use this
username for assigning evaluations. g.)
Enter their e-mail account name (the
evaluator will receive all e-mail notices from MyEvaluations.com at this
e-mail name along with their username and password to the system.)
h.) Select their Subspecialty from
the dropdown menu, then click on Finished.
-
Below is only for informational purposes so people understand why a user
may have more than one username in the system.
Please contact me, Diane Blahun, to modify or add
users to the system.
How to enroll users in MAX, Inpatient, and CMC accounts on
MyEvaluations.com with consideration to our shared users from database in
Residency area of system:
Attendings
An Attending should be entered only
ONCE into the system as an Attending/(User or Admin).
This username will be used for assigning any evaluations to him/her, be
they medical student or resident evaluations. Entering an evaluator
again into an account with “Attending/(User or
Admin.)” status will create duplicate accounts – i.e. their name will be
listed twice in dropdown menu of Attending names to select from when
assigning evaluations – the coordinator will not know which one to select
for assigning evaluations to.
When presented with a new entry for the
database, one needs to follow these steps: (PLEASE CONTACT ME to do
below, do not follow these steps yourself.)
-
Check on ALL (not All-local) to see
if user exists as shared in residency system with “Attending/(User
or Admin) “ status.
-
Check also all three accounts,
MAX, Inpatient, and CMC, to see if user was enrolled
separately into any of these accounts but not shared. (I can only do
this because of global access to all three accts.)
-
If user exists as Attending/User,
shared thru residency system to our accounts, then we will assign any
medical student evaluations, in any 3 accounts, to this username. This
same username will be used by residency system for assigning
evaluations.
-
If this user needs to view
completed student evaluation reports in an account, then enroll them as
a “Staff/Admininstrator” into the accounts required.
Typically, only section leaders, specialty’s program coordinators, and
evaluators completing composite evals. which require viewing the
specialty’s Attendings evals. to complete the composite, need
Administrator access. Staff/Administrators can not be
shared to other accounts, therefore need to be entered into each
account separately for Admin. access.
-
If an Attending/Administrator
is shared from Residency system, they will not have full access
privileges to the medical student accounts in terms of report viewing.
They need to be entered separately into each account in order to gain
full access rights. And since they are already entered ONCE
(see 1st paragraph above) to the system as an Attending,
it’s important to enter them as a Staff/Administrator NOT
as an Attending/Admin (which would create duplicate usernames) to the
other medical student accounts.
-
If a user does not exist as shared
from the Residency system or is not enrolled in any of the 3 medical
student accounts, then it’s important to enter them as an
Attending/(User or Admin.) into an account with Shared
checked off – this user will then be viewable to our other two accounts
along with the residency area of system – and all will use this username
for assigning evaluations to this evaluator. Enter them as
Attending/Admin. into an account only if they need report access
otherwise enter them as Attending/User. And select the account to enter
them in based on the evaluations you know they’ll be completing – this
will be considered their Main Dept. Other accounts can still use this
username for assigning evaluations since he/she is shared and enrolled
as an Attending. And he/she won’t have access to reports unless they
are an Administrator vs. User in their Main Dept. or entered into other
accounts as a Staff/Administrator.
-
If a user is already enrolled only
in one of the 3 medical student accounts but is not shared, and also is
not enrolled in the residency system, then make that user as shared –
and be sure they are listed as an Attending.
As said previously, please send any
users needing to be enrolled in MyEvaluations.com to me for addition to
the system.
- If an Attending or
Site Director asks you for their username and password, just click on
edit after locating their name as described above, to locate this
information. But again,
PLEASE DO NOT ISSUE PASSWORDS OF ATTENDINGS TO STUDENTS.
Also, it may be best to just direct the
Attending/Site Director to click on “Forgotten Your Password” above
the log-in box.
If they have already accessed the system with their
generic password then they’ve been prompted to change their password
and you won’t have access to their new password in these cases.
- Much effort has been made
to assign all Attendings and Site Directors
to correct roles prior to program coordinators’ use of the
system. The below
information though may be necessary to apply to any Attendings not
correctly assigned as an Administrator.
- BEFORE you start
assigning evaluations, first check the role of the Evaluators you’ll
be assigning to the evaluations to
be sure they have the correct access privileges.
- When Program Coordinators are assigning evaluations
within a MAX
or Inpatient Account and need to increase access privileges for Site Director so they can view other Attendings'evaluations
of a student in order to create the student's composite evaluation,
please contact me, Diane Blahun
(blahun@nso1.uchc.edu.) in order to increase this access.
Please do not modify a user or add a user, instead please contact me to
ensure this is done correctly on the system.
PLEASE DO NOT follow steps a. and b. below, instead contact me,
Diane Blahun, and I'll take care of any modifications or addition of users
to the system. a.
For a local user:
modifying
user to Administrator within an account will allow user to view reports.
b. For shared user:
A shared user is identifiable by having an * in the upper right
corner of
his type (e.g.
Attending*).
If you need this "user" to have Administrator privileges to this account,
add in new with a
Staff/Administrator
role (since they are already enrolled as an Attending/? elsewhere in system) so they will only be able to view
evaluation reports within that Account and will have full Administrator
access rights in this account alone. They will have a separate user
name and password for this account as an Administrator and their
Administrator privileges are restricted to this local account only.
An
evaluator must only be entered into system
ONCE
as an
Attending/"whatever" - and this username is used for
any/all evaluation assignments within system, be they residency evals. or
medical student evals. So, if they need PD or Administrator access to any
of the three medical student accounts, then they need to be entered
separately as a Staff/Administrator or Staff/PD not as an
Attending/"whatever" otherwise their name will show up twice in dropdown
menu of Attendings to select from for their evaluation assignments.
9-12-06:
PD's need to be enrolled as Attending/PD to have access to an
inbox where all evaluations in that account are deposited as they are
completed. If they are enrolled instead as Staff/PD, they'll have
access to EarlyWarning emails and other Admin. functions but not to the PD
inbox of completed evaluations.
3. How to Assign an
Evaluation:
Log in to the system and click on Evaluations tab at top.
- Some of you will have
access to both MAX and Inpatient Accounts, so please log in to the
Account you need for your current assignment needs.
- Click on Assign
Evaluations.
- Click on Schedule
Evaluation Assignments.
- Click on Attending
Assignments.
- Click on Attending of
Medical Students.
- Then Step 1 of
5:
Select Attending Evaluation (there will be a drop
down menu of all the evaluations for the MAX Rotations and likewise
for the Inpatient Rotations – be sure to select the correct
evalaution for your specialty.)
- Step 2 of 5:
Select Evaluation Period:
If the provided drop down boxes match the period and
the start and end dates for the rotation block you are assigning then
you can use those OR you can simply specify the manual date
range in boxes provided – e.g.
enter 7-01-04 to 7-16-04 for a rotation block.
- Step
3 of 5: Select
Attending who will complete this Evaluation.
So, e.g. if Dr. X, Dr. Y, and Dr. Z ALL need to
evaluate Medical Students A, B, and C in this rotation, then Select
Dr.’s X,Y, and Z.
- Step 4 of 5: Select Medical
Students who will be evaluated*:
And
using above example, you would select Med. Students A. B, and C.
*Please
see Enrolling
Medical Students.
Above example would represent a situation where 3
medical students are at same site for their rotation block and have the same
three Attendings assigned to them. For
this same rotation block though you may have just one student (D) at another
site assigned to Dr. G and Dr. H – so you would have to then start at
beginning of Assignment process: Select correct evaluation form, select Drs.
G and Dr. H and then select student
D.
IMPORTANT NOTE: You can’t
just select ALL Attendings for this rotation block regardless of sites and
assign them to all students in this rotation block regardless of
their sites. You need to be sure you are assigning the Attendings to just those
students that they will be evaluating for this particular rotation block.
- If you’ve been
instructed by your Section Leader to use Options B or C in assigning
evaluations,
then you need to be sure the Site Director that you assign to the
evaluation is enrolled as either an Administrator or Program
Director. I have tried to take care of this in the Database
listing of Evaluators that is now in the system. But when you
pull up the Site Director to assign to the Composite Evaluation, first
check to see that his role is either an Administrator or Program
Director by clicking on User tab and viewing his role (referred to as
"Level" in system) by clicking on Add/Edit Existing Users.
- Step 5 of 5: Do you want
the Medical Students to Evaluate the Attendings?
Select “No” – Medical students are evaluating their Attendings in
the on-line Perseus survey system that can be accessed through Blackboard
located in the MAX and Inpatient Experience Umbrella courses – just as
they have been doing the past two years. That hasn’t changed.
*
Enrolling Medical
Students:
Please contact me if you find a medical student is not
listed in MyEvals.com, (I will add that student under
MAIN
account of system which MAX
section coordinators do not have access to and not
under the MAX or Inpatient accounts - it's important that
student is checked off as Shared
in their user profile so
evaluations can be assigned to them within both MAX or Inpatient
accounts. If student is enrolled under
e.g. just the MAX account and even if Shared, the student won't appear under Main account listing of medical
students which can be confusing when trying to determine if a
student is indeed enrolled in system. So please forward student's name to me
for enrollment purposes.
4. How to
print out a hard copy of an Evaluation: 1.
Go into MyEvaluations.com and click on Evaluations tab at top.
2. Then click on Edit Evaluation and then on View the
particular evaluation.
3. Then go to File - Save As - and save the document as a word
document (save file in .doc format - make sure to change
extension from .html to .doc - and just click on type as file.txt)
4. Then pull this file up in your MSWord software and you can
edit it from there before printing out - you can add line breaks to areas
requiring comments to allow more space for evaluator's text. |