Another comp/rhet test

Last night I wrote that there seemed to be a shift in yesterday’s meeting away from cut scores and to a discussion of what our writing work group thought more important.  Well, today Ira Blake, Assistant Vice Chancellor of Academic and Student Affairs, has been waving the “cut score” banner again this morning.  She said that our work groups need to come up with cut scores where we should begin.  

I just asked Ira Blake for a very clear statement about what are task was.  I asked, “so, let me get this straight, the task of our work group is to come up with cut scores.”  Her response, “yes.”  Yes, she did say a lot about us being experts and our imput important and that it was important that we had discussions about what is college ready, but in the end, the task is a cut score.  It will be interesting to see what will happen if our writing work group does not/refuses to come up with a cut score.

So, at today’s meeting of PaSSHE College Ready and Placement Work Group we’re hearing from Kathleen Howley, Assistant Vice Chancellor of Academic and Student Affairs.  At the moment, we’re talking about course numbering. Yes, course numbering.  We were just given a handout showing course equivalencies and course numbers across the State System.  As it turns out, Kutztown is the only campus that has Gen Ed courses–like composition–that begin with a zero (0) (ENG 022, 023, 025, etc.).  According to Howley and Ira Blake (also Assistant Vice Chancellor of Academic and Student Affairs), it  is Board of Governor policy that all introductory courses should be listed as 100 level courses.  Apparently, 0-level courses are supposed to be “remedial” classes.  So, despite the fact that equivalencies/transferability has already been established by a State organization TAOC (Transfer Articulation Oversight Committee), the assumption is being made by legislators and PaSSHE administration that we (KU) are giving college credit for remedial courses.  

This just gets more and more amazing each day.

It’s been an interesting day here in Harrisburg as day one of PaSSHE’s College Ready and Placement Work Group comes to a close.  Interesting because there has been a bit of a shift over the course of the day when it seemed like the sole purpose of this work group was going to be to choose one of the major standardized placement exams–COMPASS, ACCUPLACER, or ASSET (notice all of them are in all-caps)–as the standard for the whole State System.  By the day’s end that imperative was less clear.

The day alternated between whole group sessions led by Vice Chancellor Jim Moran and break out sessions: math, writing, and reading.  The general sessions were not super formal.  Rather, they consisted of Moran making some preliminary comments and report-backs/questions from the break out groups.  Initally Moran say that by the end of our two-days here in Harrisburg, he wanted us to come up with “baseline cut-scores” for each of the areas.  In other words, we were supposed to come up with the scores that would determine when a student would be forced into “remedial” courses.  The primary target was to “identify a standard across the system for college comp and intro to math.  Moran said that this is part of a larger effort–a “two-pronged effort”–to standardize the State’s definition of “college ready” and to create a common set of criteria for college placement.  The other prong is to standardize the entire State’s high school curriculum.  Moran said that PA was one of only five states that does not have a standard curriculum across the state.  

Our discussions were supposed to be guided by “all the research,” or at least the research that we were provided less than a week before today’s meeting.  Most of this research was conducted by ACT and some organizations assosicated with college testing agencies.  In fact, one of the key documents, “Rigor at Risk,” published by the ACT explicitly saw its study as a follow up to the federal government’s 1983 publication, A Nation at Risk.  The report suggests that since the publication of A Nation at Risk, 

almost every state has made significant efforts t o improve its educational system.  Nearly a quarter-century later, in a climate in which U.S. workers are dealing with new forms of technology and facing challenges of a global economy, it is not only reasonable but increasingly urgent to ask: Have we succeeded in fulfilling the goals of A Nation at Risk? (ACT, “Rigor at Risk).  

Of course we might draw attention to the fact that the 1983 study may have contributed to our current problems by narrowly defining curriculum to suit specific educational agendas.  I think it would be useful to revisit John Trimbur’s “Literacy and the Discourse of Crisis” in the midst of this discussion.  

Anyway, at several points in the discussion, Moran suggested that he would prefer one standard placement process across the State System.  However, he stopped short of saying this was necessary.  But, at several points he suggested that any “locally designed assessment” (directed self-placment being one of them) would need to demonstrate how the results could be compared to one of the standardized tests or standard State placement processes.  He said that it would be up to the people responsible at that university to “assess whether or not it would be worth the effort” to demonstrate compatabilty.  This approach seems very much like the State System’s buy-in to the  ”Voluntary System of Accountability,” which I don’t have time to go into here. 

There seems to be some pressure coming from the State Legislature on this score.  Moran told us that “it would not surprise me if there is some move for legislative action on remediation.”  In fact, he is giving testimony before the Republican Caucus tomorrow morning on precisely this topic.  

The good thing about today’s process was the breakout sessions with other faculty across the State System.  One of the most productive aspects of the day was that we talked about our different approaches to placement, different student bodies, and different configurations of composition (some universities have two semesters of comp, others just one).  If anything, I think most members of this group are committed to keeping local control over the placement process.  While no one was opposed to discussing the kind of skills and practices that are necessary for a student to succeed in our first-year composition classes, I remain concerned that the outcome of our work is beyond our control.  For example, we could generate some very good principles and the State System could then turn around and look at the standardized tests that seem to reflect those principles.  I am not suggesting that is what will happen, only one of my concerns.

I’ll have to leave it at that for now.  I’m meeting some of my fellow compers for dinner.  Hopefully, I’ll be back later with an update.

Late morning/lunch work “writing group” was interesting. Lots of discussion at the way placement happens at all 14 State System universities. Some have tests, but a couple institutions do variations of directed self-placement. Other universities do a portfolio system. There seems to be a general agreement in the writing group that it might be possible to lay out some consistencies across the 14 as to what we expect in college level writing, which is DIFFERENT from what you might find in a placement test. For example, flexibility in responding to different audiences; writing in different genres; incorporating research.

Yet, there is a wide range in the preparation of students across the State System schools. Jim Moran in clear that some universities WILL HAVE TO change the way they do placement…although he is not being specific as to which universities. Everything, however, points to directed self-placement as a “problem” that is not assessable in a way that will be consistent across all 14.

There seems to be a general “sense” at the table that we can distinguish between what we expect in college-level writing and what are some of the barriers students face (at least that’s how I am trying to argue the case). What comes up consistently is the lack of funding from the the State System to support best practices–such as required portfolios from all new students, or even the kind of directed self-placement we do at Kutztown.  

Moran seems to be genuinely invested in the process, but is non-committal to guarantee funding to support best practices. 

Just moments ago, we had a pretty heated debate over the question of “remediation” and what kind of courses we are talking about.

Hey all.  So, guess where I am.  Harrisburg.  I just checked into a Days Inn at around 11:30pm on Monday.  Tomorrow will begin what is being billed as a “Work Group” to determine a common definition of “college ready” and to “standardize” placement  in “remedial” courses. Presumably the outcomes of this group will contribute to a standard for Math and Writing across the State System.  

Now, anyone who knows me and/or knows our program at KU might question what it is that I am doing here.  Well, as the Coordinator of Composition I was asked to represent KU for the “writing” work group.  To be honest, I don’t know exactly what to expect.  The initial request was fairly vague.  However, a couple of days ago, we got another  email laying out the agenda a little more.  That email came with several attachments (which I will post tomorrow).  

Since I believe in working in public where we can all see what’s going on and contribute to the conversation, I am posting the email I received in it’s entirety.  I wil also be posting updates to this blog to let you know what seems to be the general thrust of the meeting.  The one article we were  asked to read before our meeting tomorrow is a policy brief called “It’s Not About the Cut Score: Redefining Placement Assessment Policyto Improve Student Success” authored by Michael Lawrence Collins for a Boston policy institute called Jobs for the Future. 

So, in the meantime, here’s the email I received on May 6th:

Colleagues: 

Thank you for your willingness to come to Harrisburg to develop a more consistent model for determining the standards for “college ready” and placement across PASSHE.  We have attached a number of documents to help shape the discussion and would request that you review the paper titled, “It’s Not About the Cut Score” prior to the meeting.

Let me first provide you with some context for our discussions, then provide some background for the attachments and finally talk about the details regarding arrangements and compensation. 

Context:

The primary goal is to achieve consistency in the definition of “college-ready” across the System.  Right now the standards vary considerably from university to university. The “Achieve the Dream” initiative at community colleges has focused on this effort and Pennsylvania is participating in that effort. We believe that a common standard, not necessarily a common test, will, taken in context, be one of the factors that will serve to improve the quality of the preK-16 educational system across the Commonwealth.

One may ask: “Why now?”  We believe that we have the support of the current administration and PDE to move in this direction; community colleges are receptive to us taking the lead and are willing to join in on the effort at the appropriate time. 

Concurrent with this effort is an attempt to identify for the System a high school curriculum required for regular admission (e.g., four (4) years English; three (3) years Math including Algebra II; three (3) years Science, etc).  A set of common placement standards for reading and mathematics helps set the expectation for such a curriculum.

During the System-level deliberations related to the standards for concurrent enrollment programs, the CAOs identified a set of standards that students should meet to be identified as “college-ready.” Also, Middle States’ teams have connected placement standards with measures of student learning outcomes in assessing general education programs and inquired about the consistency across System universities. 

Moreover, as part of the transfer and articulation legislation, standards for transfer of foundation courses were established. However, in some cases courses listed in the System are identified as remedial courses, which should not transfer. Currently, legislative hearings on remediation are taking place and the concept of consistency has been raised. Several states have moved forward with creating standards, either at the state or System level (e.g., New Jersey Community Colleges just recently agreed on common standards).

The interest in the Keystone Examination (formerly known as graduation competency assessments – exit exams from high school) has raised the ante in all of the aforementioned discussions. Local assessments within this context are acceptable only if the local district demonstrates comparability to the basic standard.

As the Office of the Chancellor has prepared the data for these hearings, it is increasingly difficult to explain the variation among our universities in the number of students required to take remedial or developmental courses.

The advent of the PIMS project (Pennsylvania Information Management System) and the connection of the higher education databases to the preK-12 databases (made possible through the use of the PA Secure ID effort) enable significant opportunities to provide detailed feedback to high schools on the success of students and nature of the curriculum. Consistency in standards allows for greater power of analysis to provide better feedback for improvements and curriculum revisions.

We also recognize that setting a “cut score” will not be sufficient and revisions will be required over the next several years as we are able to research the success of students. The ability to track students through the high school, community college and PASSHE will enable us to have an excellent database to make subsequent revisions as necessary.

A few years ago there was considerable discussion about whether four-year institutions should be in the business of remediation. We believe there is clear recognition that in Pennsylvania, with limited access to community colleges and given our mission as Pennsylvania’s public universities, the PASSHE recognizes that we will be involved in some form of developmental education to provide students with higher education opportunities, and that we should have in place better assessments and support for students that have potential.

We believe that now is the time for PASSHE to take a leadership role in the Commonwealth to set standards to improve the education of all students. Placement testing is but one aspect to this larger effort but is important in helping set the context of expectation.

Note that this does NOT mean that the admission standards across the universities are to be common or that we intend for universities to become more or less selective. Those decisions are governed by the universities themselves and by other factors. We are also looking at how to revise the accountability and performance funding measures to better reflect the access and quality mission of PASSHE and may need to consider how any change in the placement process affects those key measures.

Resources:

An excellent paper to read is, “It’s Not About the Cut Score” put out by the Achieve the Dream initiative.

We have attached material that details the System level reports from universities about the number of students taking “remedial” courses. We also attached a preliminary paper that provides a summary analysis of some of this data.  In addition, included are some summary data of college and university standards we collected a few years ago (and may require updating).

ACT has published several major studies focusing on the readiness of students based on performance on the ACT. “Readiness” is defined as the likelihood of receiving a C or better in the first college course.  Note that although several states are using the ACT as a placement exam (e.g., Arkansas), most researchers agree that the SAT should not be similarly used and should be used only as a possible screening tool to determine who should take a placement test.  We have included material from ACT.

Note that the link to the foundation courses that are approved for transfer is www.patrac.org

Details:

We are asking that you make your own hotel and travel arrangements. Attached is a list of hotels in the area with links to their website so that you can view their facilities when making reservations. Reimbursement and compensation will be through your own university. Travel and meals must fit within the standard PASSHE travel guidelines. To assure that your “take home” compensation is approximately $500/day, we have set aside $1,700 gross compensation for each of you. 

NOTE:  You will receive two additional e-mails with the reference material.

There are just three days left in the semester and we’re wrapping things up. Like most of my colleagues, I am deep in grading mode. However, I thought I would take a few minutes this morning (before I head into campus and while my son is sleeping) to post.

This past academic year has been pretty incredible for our little composition program.  We have one new class on the books, ENG 316 Rhetoric,  Democracy, Advocacy, which will be offered in spring 2010 for the first time.  We also have two classes heading for college and university curriculum committees after passing our department unanimously: Women, Writing, Rhetoric and Issues in Composition and Rhetoric Studies.  A very productive year for course development and another step toward rounding out a solid concentration in Composition, Rhetoric, and Literacy Studies at KU. 

This past year we also completed two successful tenure-track faculty searches.  In the fall, we will welcome Mysti Rudd from Lamar State College-Port Arthur (IUP PhD candidate) in Texas and Moe Folk from Michigan Tech.   Over the summer I am going to ask Mysti and Moe to introduces themselves to you, but for now let me just say that both of these folks promise to contribute to our program in exciting ways.  As I have suggested before on this blog, our program has at its core an ethic of “conversation.”  That is, we are interested in a diversity of approaches at our composition table that can contibute to a lively conversation over the teaching of writing, literacy in the 21st Century, and all things composition and rhetoric.  Many of us got into this field because of its lively discussion over the purpose and nature of writing, rhetoric, and literacy…so, it only makes sense that we would want to use that energy, that commitment to discussion as the model of our program.  I am sure that Mysti and Moe will both expand and deepen our conversations. 

This past spring saw another successful Composition Conference for student writers.  This 5th annual conference was expanded to include student writers from all levels of composition courses, which exceeded our expectations.  Despite a very miserable weather day, attendance at this year’s conference was the best yet.  Our keynote speaker, Steve Parks from Syracuse University, gave an engaging talk entitled “Once I was a Washing Machine: Worker/Writer Alliances at the Edge of the Economic Abyss” (see the pics below).  His talk was both well attended and sparked conversations that echoed through our conversations for weeks. 

Over the course of this summer we will be planning for what promises to be an exciting new academic year.  We will be hiring an additional tenure-track faculty member in Multicultural/Multiethnic Rhetorics; formally submitting our concentration for department approval; expanding our course offerings; deepening our use of new media; and continuing conversations in our weekly meetings and reading groups.  Toward the end of this semester, we began some interesting and exciting conversations with our fellow rhetoricians in the Speech Department (soon to be Communications Studies).  Frankly, the promise of reuniting rhetoric just gets me all happy (yes, I am a rhetoric geek). In short, I think we are in great shape…or, given that today is Obama’s 100th day in office, maybe I should say: “the state of our program is strong!”  :-)

The English department held its fifth annual Kutztown University Composition Conference on April 3 2009. Our conference theme, “Writers @ Work,” represented our effort to showcase the myriad means we use to compose, as well as the genuine toil required to create. Over 300 students attended the conference.

This year, the KUCC was open to student writers from across all levels of composition courses. More than fifty students enrolled in first year composition, Advanced Composition and Teaching Writing during the 2008-2009 academic year presented original academic works at the conference.

Also new at the 2009 KUCC was our “technology room,” allowing students to present multimodal compositions. Presentations here included a short film; PowerPoint displays; the projection of compositions via document cameras (in order to display their visual elements); and a paper on protest songs culminating in the performance of an original piece of music.

Students in Dr. Chernekoff’s Teaching Writing Course created an impressive poster session, adding a new visual dimension to the day. We also sold copies of the cookbook, A Semester of Seasonings. This text was composed by members of Dr. Chernekoff’s Advanced Composition Course and reimagined by Dr. O’Brien’s Desktop Publishing class. Sales of the text benfit the foodbank of Friend, Inc in Kutztown.

The Keynote Speaker, Prof. Stephen Parks of Syracuse University, spoke to a large and enthusiastic crowd in Alumni Auditorium. His talk, “Once I Was A Washing Machine: Worker / Writer Alliances at the Edge of the Economic Abyss” explored many of the obstacles inherent in pursuing a higher education while working. His account of worker-writer alliances made among his working class Syracuse students was both moving and inspiring.

We should be very proud of our students and campus community! Read more about the event at the Composition Program’s blog: http://kucomprhet.wordpress.com/blog/

Pictures from the conference can be found at: <http://kucomprhet.wordpress.com/2009/04/04/photos-from-kucc-2009/>
My thanks to the English Department Faculty, department secretary Annette Christman, Department Chair Dr. Janice Chernekoff, and the KUCC Committee for making the day a success for our student-writers!

Best,

Amy Lynch-Biniek, KUCC Chair

In addition to all the vlogging we did and photos we took, we did our first experiment in podcasting for the KU Composition Conference.  Three students from my Advanced Composition class–Tim Crane, Katrina Albert, and Renee Franklin–agreed to having their panel recorded for a podcast.  A huge thanks goes out to them for their willingness to try this out.  

I just finished loading up the audio (with very minimal editing) and it sounds good!  If you’d like to check it out, click on the radio icon above.  A QuickTime (or other audio program) should start up and play the file.  If you want a little context for the panel, check out the paper assignment that provided the prompt for Tim, Katrina, and Renee’s paper.  Or, check out the Ramage-tagged posts on our class blog.