Showing posts with label #altmetrics. Show all posts
Showing posts with label #altmetrics. Show all posts

Friday, June 20, 2014

The Billionaires, Part 1: Elon Musk

Elon Musk did not need a journal to publicize his Hyperloop paper. [Hyperloop Alpha] No journal can create the kind of buzz he creates on his own. He did not need the validation of peer review; he had the credibility of his research teams that already revolutionized travel on earth and to space. He did not need the prestige of a journal's brand; he is his own brand.

Any number of journals would have published this paper by this author. They might even have expedited their review process. Yet, journals could hardly have done better than the public-review process that actually took place. Within days, experts from different disciplines had posted several insightful critiques. By now, there are too many to list. A journal would have insisted that the paper include author(s) and affiliations, a publication date (Aug. 12th, 2013), a bibliography... but those are irrelevant details to someone on a mission to change the world.

Does the Hyperloop paper even qualify as a scholarly paper? Or, is it an engineering-based political pamphlet written to undermine California's high-speed rail project? As a data point for scholarly communication, the Hyperloop paper may be an extreme outlier, but it holds some valuable lessons for the scholarly-communication community.

The gate-keeping role of journals is permanently over.

Neither researchers nor journalists rely on scholarly editors to dismiss research on their behalf.

In many disciplines, day-to-day research relies more on the grey literature (preprints, technical reports, even blogs and mailing lists) than on journal articles. In other words, researchers commit considerable time to refereeing one another, but they largely ignore each other's gate keeping. When it matters, they prefer immediacy over gate keeping and their own gate keeping over someone else's.

The same is true for journalists. If the story is interesting, it does not matter whether it comes from an established journal or the press release of a venture capitalist. Many journalists balance their reports with comments from neutral or adversarial experts. This practice may satisfy a journalistic concept of objectivity, but giving questionable research "equal treatment" may elevate it to a level it does not deserve.

Public review can be fast and effective. 

The web-based debate on Hyperloop remained remarkably professional and civil. Topics that attract trolls and conspiracy theorists may benefit from a more controlled discussion environment, but the public forum worked well for Hyperloop. The many critiques provide skeptical, but largely constructive, feedback that bold new ideas need.

Speculative papers that spark the imagination do not live by the stodgy rules of peer review.

The Hyperloop paper would be a success if its only accomplishment is inspiring a handful of young engineers to research radically different modes of mass transportation. Unfortunately, publishing speculative, incomplete, sloppy, or bad research may cause real harm. The imagined link between vaccines and autism (published in a peer-reviewed journal and later retracted) serves as an unhappy reminder of the latter.

Not all good research belongs in the scholarly record.

This episode points to an interactive future of scholarly communication. After the current public discussion, Hyperloop may gain acceptance, and engineering journals may publish many papers about it. Alternatively, the idea may die a quiet death, perhaps documented by one or more historical review papers (or books).

The ideal research paper solves a significant problem with inspiration (creative bold ideas) and perspiration (proper methodology, reproducibility, accuracy). Before that ideal is in sight, researchers travel long winding roads with many detours and dead ends. Most papers are small incremental steps along that road. A select few represent milestone research.

The de-facto system to identify milestone research is journal prestige. No journal could survive if it advertised itself as a place for routine research. Instead, the number of journals has exploded, and each journal claims high prestige for the narrowest of specializations. All of these journals treat all submissions as if they are milestone research and apply the same costly and inefficient refereeing processes across the board.

The cost of scholarly communication is more than the sum of subscriptions and page charges. While refereeing can be a valuable experience, there is a point of diminishing returns. Moreover, overwhelmed scholars are more likely to conduct only cursory reviews after ignoring the requests for extended periods. The expectation that all research deserves to be refereed has reduced the quality of the refereeing process, introduced inordinate delays, increased the number of journals, and indirectly increased the pressure to publish.

Papers should earn the privilege to be refereed. By channeling informal scholarly communication to social-network platforms, research can gain some scholarly weight based on community feedback and usage-based metrics. Such social networks, perhaps run by scholarly societies, would provide a forum for lively debate, and they could act as submission and screening systems for refereed journals. By restricting refereed journals to milestone research supported and validated by a significant fraction of the profession, we would need far fewer, less specialized journals.

A two-tier system would provide the immediacy and openness researchers crave, while reserving the highest level of scrutiny to research that has already shown significant promise.

Wednesday, January 1, 2014

Market Capitalism and Open Access

Is it feasible to create a self-regulating market for Open Access (OA) journals where competition for money is aligned with the quest for scholarly excellence?

Many proponents of the subscription model argue that a competitive market provides the best assurance for quality. This ignores that the relationship between a strong subscription base and scholarly excellence is tenuous at best. What if we created a market that rewards journals when a university makes its most tangible commitment to scholarly excellence?

While role of journals in actual scholarly communication has diminished, their role in academic career advancement remains as strong than ever. [Paul Krugman: The Facebooking of Economics] The scholarly-journal infrastructure streamlines the screening, comparing, and short-listing of candidates. It enables the gathering of quantitative evidence in support of the hiring decision. Without journals, the work load of search committees would skyrocket. If scholarly journals are the headhunters of the academic-job market, let us compensate them as such.

There are many ways to structure such compensation, but we only need one example to clarify the concept. Consider the following scenario:

  • The new hire submitted a bibliography of 100 papers.
  • The search committee selected 10 of those papers to argue the case in favor of the appointment. This subset consists of 6 papers in subscription journals, 3 papers in the OA journal Theoretical Approaches to Theory (TAT), and 1 paper in the OA journal Practical Applications of Practice (PAP).
  • The university's journal budget is 1% of its budget for faculty salaries. (In reality, that percentage would be much lower.)

Divide the new faculty member's share of the journal budget, 1% of his or her salary, into three portions:

  • (6/10) x 1% = 0.6% of salary to subscription journals,
  • (3/10) x 1% = 0.3% of salary to the journal TAT, and
  • (1/10) x 1% = 0.1% of salary to the journal PAP.

The first portion (0.6%) remains in the journal budget to pay for subscriptions. The second (0.3%) and third (0.1%) portion are, respectively, awarded yearly to the OA journals TAT and PAP. The university adjusts the reward formula every time a promotion committee determines a new list of best papers.

To move beyond a voluntary system, universities should give headhunting rewards only to those journals with whom they have a contractual relationship. Some Gold OA journals are already pursuing institutional-membership deals that eliminate or reduce author page charges (APCs). [BioMed Central] [PeerJ][SpringerOpen] Such memberships are a form of discounting for quantity. Instead, we propose a pay-for-performance contract that eliminates APCs in exchange for headhunting rewards. Before signing such a contract, a university would conduct a due-diligence investigation into the journal. It would assess the publisher's reputation, the journal's editorial board, its refereeing, editing, formatting, and archiving standards, its OA licensing practices, and its level of participation in various abstracting-and-indexing and content-mining services. This step would all but eliminate predatory journals.

Every headhunting reward would enhance the prestige (and the bottom line) of a journal. A reward citing a paper would be a significant recognition of that paper. Such citations might be even more valuable than citations in other papers, thereby creating a strong incentive for institutions to participate in the headhunting system. Nonparticipating institutions would miss out on publicly recognizing the work of their faculty, and their faculty would have to pay APCs. There is no Open Access free ride.

Headhunting rewards create little to no extra work for search committees. Academic libraries are more than capable to perform due diligence, to negotiate the contracts, and to administer the rewards. Our scenario assumed a base percentage of 1%. The actual percentage would be negotiated between universities and publishers. With rewards proportional to salaries, there is a built-in adjustment for inflation, for financial differences between institutions and countries, and for differences in the sizes of various scholarly disciplines.

Scholars retain the right to publish in the venue of their choice. The business models of journals are used when distributing rewards, but this occurs well after the search process has concluded. The headhunting rewards gradually reduce the subscription budget in proportion to the number of papers published in OA journals by the university's faculty. A scholar who wishes to support a brand-new journal should not pay APCs, but lobby his or her university to negotiate a performance-based headhunting contract.

The essence of this proposal is the performance-based contract that exchanges APCs for headhunting rewards. All other details are up for discussion. Every university would be free to develop its own specific performance criteria and reward structures. Over time, we would probably want to converge towards a standard contract.

Headhunting contracts create a competitive market for OA journals. In this market, the distributed and collective wisdom of search/promotion committees defines scholarly excellence and provides the monetary rewards to journals. As a side benefit, this free-market system creates a professionally managed open infrastructure for the scholarly archive.

Wednesday, October 9, 2013

Where the Puck won't be

“I skate to where the puck is going to be, not where it has been.”

The academic library has, by default, tied its destiny to a service with no realistic prospects of long-term survival. It has become a systems integrator that stitches together outsourced components into a digital recreation of a paper-based library. This horseless carriage provides the same commodity service to an undergraduate student majoring in chemistry, a graduate student in economics, and a professor of literature. Because it overwhelms the library's budget, organizational structure, and decision-making processes, this expensive and inefficient service hampers innovation in areas that are the library's best hope for survival.

A paper-based library gradually builds a collection of ever-increasing value, and its overhead builds permanent infrastructure. Its digital recreation never builds lasting value. It is a maintenance service, and its overhead is pure inefficiency. This overhead, duplicated at thousands of universities, starts with the costs of preparing for and conducting near-futile site-license negotiations. To shave off a point here and there, the library spends countless staff hours on usage surveys, faculty discussions, consortium meetings, and negotiations with publishers and their middlemen. But the game is rigged. If 15% of a campus wants Journal A, 15% competing Journal B, 10% wants both A and B, and the rest wants neither, the library is effectively forced to rent both A and B for 100% of the campus. This is why scholarly publishers were able to raise prices at super-inflationary rates during a time when all other publishers faced catastrophic disruption. After conducting expensive negotiations, after paying inflated prices, the library must still pay for, build, and maintain the platform that protects publishers' interests by keeping unwanted users out.

Many academics and librarians hope that Open Access efforts will provide an exit from this unsustainable path. If successful, Green Open Access will lead to price reductions and journal cancellations. Gold Open Access seeks to replace site licenses with author page charges. Either strategy reduces the efficiency of library-mediated digital lending by spreading its fixed overhead costs over fewer and/or less expensive journals. New business models for journals, alternative metrics that give scholarly credibility to unbundled works, and any other innovation that competes with site licenses will reduce efficiency even further. All of these factors hasten the demise of an unsustainable service that is already collapsing under its own weight.

Traditionally, a library adapts in response to changing user behavior, attitude, and opinion. However, the Wayne Gretzky quote became a cliché for a reason. When trends have become obvious and users have moved on, it is too late for strategic restructuring.

At the other extreme, an angel investor bets on someone with a compelling idea, accepts the risk of failure, and is prepared to move on to the next player who knows where the puck will be. The library does not have that luxury. It is an institution, not a venture.

The library must maintain sufficient institutional stability to ensure its archival mission. While Open Access is a given, the service portfolio of the future library is far from settled. We must create budgetary and organizational space for new services. We may not know where precisely the puck will be, but we can still move the team out of a field where there is no game to be played.

When canceling site-licensed journals today, the only legally available alternatives are individual subscriptions, pay per view, and self-archived versions of individual papers. This stands in stark contrast with the digital-entertainment universe, where there is a competitive market for providers of personal digital libraries. Services like Apple ITunes, Google Play, Amazon Kindle and Prime, Netflix, Pandora, Spotify, etc. compete on the basis of price, content, usability, convenience, and features. There are many scholarly-communication organizations that could launch analogous services. Within months, Thomson Reuters, EBSCO, publisher alliances, scholarly societies, and even some research libraries could provide a wide selection of options. This will never happen without starving publishers of site-license revenue. Instead of subsidizing publishers, subsidize students and faculty. They are quite capable to choose for themselves what information services they need. After a messy, but short, transition, a competitive market will blossom.

The only thing more terrifying than phasing out a core service is the prospect of outside forces triggering a sudden disruption. Libraries have the choice to disrupt or to be disrupted, to organize their own restructuring or to be restructured by a crisis manager. This is the perfect time to redirect resources away from digital-lending overhead and towards building a scalable, robust, and permanent infrastructure of open scholarly information (refereed papers, technical reports, lab reports, and supporting data). Björn Brembs wants to go even further; he wants libraries to take over all of scholarly communication.

We do not have to wait for Open Access to work its disruptive magic, which may or may not happen at some undetermined time. By forcing the disruption, the rationale for Green Open Access becomes much more straightforward: It creates a permanent public archive of culturally important content that is now controlled by private companies. As a public option to the publishers' walled garden, it may help keep prices in check. That role is much less important, however, when prices are set in a truly competitive market.

Publishers do not think Green Open Access has the power disrupt. They believe they can compensate lower revenue from Gold Open Access by increasing the number of papers they publish. Should site licenses be disrupted anyway, publishers stand ready to compete with libraries.

Publishers are well prepared for any scenario.

Is your library?

Tuesday, August 6, 2013

The Empire Strikes Back

Publishers may soon compete with libraries. The business case for enticing users away from library-managed portals is simple, compelling, and growing. As funding agencies and universities enact Open Access (OA) mandates and publishers transition their journals from the site-license model to the Gold OA model, libraries will cease to be the spigots through which money streams from universities to publishers. In the Gold-OA world, the publishers' core business is developing relationships with scholars, not librarians. For publishers, it makes perfect sense to cater to scholars both as authors and readers.


Current direct-to-scholar portals provided by publishers do not live up to their potential. Each portal is limited to content from just one publisher. Without interoperability, each publisher portal is an island. Only scholars covered by a site license can afford to use them, and those scholars have access to a gateway for all site-licensed content irrespective of publisher: their library web site. In spite of these near-fatal flaws, publishers invest heavily in their direct-to-scholar portals.


These portals are opportunities for future growth. The model is well established: Thomson Reuters' Westlaw is the de-facto standard for legal research in the US, and it is able to command premium pricing for structured public-domain information. It may take a long time for scholarly publishers to duplicate Westlaw's success. Yet, even without access fees, publishers might be able to unlock significant marketing and business-intelligence value from their systems. Knowledge from managing the publishing process combined with usage data from their portals will give publishers unprecedented insight into every aspect of scholars' professional lives in education, research, and development.


For publishers, the transition to Gold OA is rather tricky. They hope to maintain their current level of revenue while replacing the income stream from site licenses with an equivalent income stream from author page charges. This goal, implausible just a few years ago, now seems realistically within their grasp. The outcome remains far from certain, and publishers are hedging their bets by fighting Green OA and lobbying hard for embargo periods. As long as site-license revenue is their main source of revenue, publishers cannot afford to compete with libraries and journal aggregators, their current customers and partners. This calculation will change when Gold OA reaches a certain critical point. This is the context of proposals like CHORUS, an attempt to take over Green OA, and Elsevier's acquisition of Mendeley, a brilliant social-network interface for scholarly content.


Publishers, indexing services, journal aggregators, startups, some nonprofit organizations, and library-system vendors all have expertise to produce compelling post-OA services. However, publishers only need to protect their Gold OA income, and any new revenue streams are just icing on the cake. All others need a reasonable expectation of new revenue to develop new services. This sets the stage for a significant consolidation of the scholarly-communication industry into the hands of publishers.


As soon as the Gold OA shock hits, academic libraries must be ready to engage publishers as competitors. When site licenses disappear, there is no more journal-collection development, and digital lending of journals disappears as a core service. This is a time that requires major strategic decisions from leaders in academia. With its recently released new mission statement, the Harvard Library seems to pave the way: “The Harvard Library advances scholarship and teaching by committing itself to the creation, application, preservation and dissemination of knowledge.” The future of the academic library will be implemented on these pillars. While the revised mission statement necessarily lacks specifics, it is crystal-clear in what it omits: collection development.

Monday, April 22, 2013

The Sibyl of Cumae


“The seventh was of Cumae, by name Amalthaea, who is termed by some Herophile, or Demophile and they say that she brought nine books to the king Tarquinius Priscus, and asked for them three hundred philippics, and that the king refused so great a price, and derided the madness of the woman; that she, in the sight of the king, burnt three of the books, and demanded the same price for those which were left; that Tarquinius much more considered the woman to be mad; and that when she again, having burnt three other books, persisted in asking the same price, the king was moved, and bought the remaining books for the three hundred pieces of gold: and the number of these books was afterwards increased, after the rebuilding of the Capitol; because they were collected from all cities of Italy and Greece, and especially from those of Erythraea, and were brought to Rome, under the name of whatever Sibyl they were.”
The myth of the Sibyl of Cumae from: The Divine Institutes, by Lactantius (b. ca. A.D. 250), Book I, Chapter VI.

Publishers select, prepare, market, and disseminate information. They developed their selection processes at a time when it was expensive to prepare and disseminate information. As these costs decreased, they could publish more and be less selective. However, the selection process endows information with gravitas, a valuable commodity for marketing. Today's publishers must balance two conflicting interests: increase revenue by publishing as much as possible vs. increase profit margins by selectively publishing high-value information. Scholarly publishers found a way to do both.

Where the Sibyl of Cumae burned some books to increase the value of the remaining books, a scholarly journal rejects a certain number of papers for each paper it publishes. Many of the rejected papers may be interesting, but they do not fit the journal's mission. For the publisher, this is an opportunity to spawn new journals in the wake of its successful journals. Such portfolios of journals are less selective than their individual journals. Of course, if one considers the scholarly publishing industry at the macro level, the notion of selectivity virtually vanishes. Papers are submitted and re-submitted until an outlet is found.

The Sibyls of Scholarly Publishing perform an elaborate dance with pyrotechnic effects that give the illusion they burn papers. In fact, each Sibyl takes in new and rejected papers, packages some of them in a journal, and pretends to burn the rest before handing them off to her sisters. Each Sibyl maximizes the price in her respective corner of the universe. Academia repeatedly acts like King Tarquinius, who thinks the woman mad and pays the price she demands.

It may take years and several turnovers of the editorial board before an established journal that covers a large domain accepts papers in an emerging field. This has created a seemingly insatiable demand for new highly specialized journals. Each successful journal serves its publisher by raising revenue, its editorial-board members by raising their research prestige, and its authors by providing an avenue for dissemination of material without a natural home in existing journals. Many of these journals cater to such a small cadre of specialists that they subvert the single largest scholarly benefit of the refereeing process: a critical reading by someone with a different point of view and background. Even when run with the best of intentions, these narrow journals are echo chambers for group think. Emerging fields need some breathing room, particularly in the early developmental stages, but they should not be immune from outside criticism. Do these journals really serve the cause of good scholarship? Are they worth the super-inflationary cost increases, which they help create?

Open Access may not reduce the cost of scholarly communication as originally hoped. A large-scale conversion to Gold Open Access would shift the costs from universities to governments. Once university administrations no longer feel the budgetary pain and the costs are baked into government budgets, publishers would be free to continue the super-inflationary trajectory. There would not be any market forces that limit the introduction of new journals, the growth of existing journals, or the price charged per paper published. The access problem would be resolved by hiding, compounding, and postponing the cost problem. In the end, the scholarly-communication market would remain as dysfunctional as ever.

Technology has eroded the foundation of the current scholarly-communication system. It assumes that there is a scarcity of dissemination, and it uses that scarcity for the purpose of gatekeeping. In fact, dissemination is abundant and nearly free. The scarcity and associated gatekeeping are marketing illusions.

The reluctance to change is understandable. A scholarly-communication system is a delicate balancing act. It must be fair, but critical. It must discourage poor research, yet be supportive of new ideas, including ideas that challenge established views. Because scholarly communication is tied to research assessment, any changes to the system must gain wide institutional acceptance.

Ultimately, we have little choice but to accept today's reality. Anyone has the power to disseminate any information, regardless of quality. No one has the power to be a gatekeeper. At most, editorial boards have the power of influence in their respective communities; they can highlight important achievements and developments. But even this power to influence may soon be challenged by crowd-sourced quality labels of alternative metrics. (Perhaps not.)

We should be elated about the recent successes of the Open Access movement. We should also recognize that Open Access is not an end point. It is only the first step in the reinvention of scholarly communication.

Tuesday, March 26, 2013

Open Access Politics

The Open Access (OA) movement is gaining some high-level political traction.

The White House Open Access memorandum enacts a national Green OA mandate: Most US funding agencies are directed to set up OA repositories for the research they fund. This Green OA strategy contrasts with the Gold OA strategy proposed by the Finch report in the UK. The latter all but guarantees that established publishers will retain their revenue stream if they switch their business model from site licenses to Author Page Charges (APCs).

The White House memorandum is likely to have the greatest impact. As its consequences ripple through the system, the number and size of Green OA repositories is likely to grow substantially over the next few years. Large-scale validation of altmetrics and the development of new business models may lead to the emergence of new forms of scholarly communication. Green OA archivangelist Stevan Harnad hypothesizes a ten-step scenario of changes.

There are also reasons for concern. As this new phase of the OA movement unfolds on the national political stage, all sides will use their influence and try to re-shape the initial policies to further their respective agendas. The outcome of this political game is far from certain. Worse, the outcome may not be settled for years, as these kind of policies are easily reversed without significant voter backlash.

At its core, OA is about an industry changing because of (not-so-)new technology and its accompanying shift in attitudes and values. In such cases, we expect established players to resist innovation by (ab)using politics and litigation. The entertainment industry lobbied and litigated against VCRs, DVRs, every Internet service ever launched, and now even antennas. In the dysfunctional scholarly-communication market, on the other hand, it is the innovators who resort to politics.

To understand why, suppose university libraries were funded by user-paid memberships and/or service fees. In this scenario, libraries and publishers encountered the same paper-to-digital transition costs. When library prices sky rocketed, students and faculty created underground exchanges of scholarly information. They cancelled their library memberships and/or stopped using their services. The publishers' revenue streams collapsed. Only the most successful journals survived, and even they suffered. Publishing a paper became increasingly difficult because of a lack of journals. This created an opening for experiments in scholarly publishing. This bottoms-up free-market transition would have been chaotic, painful, and forgotten by now.

We do not need to convert our libraries and research institutions into free-market enterprises. We do not need to abandon the fundamental principles on which these institutions are built. On the contrary, we must return to those principles and apply them in a new technological reality. Rebuilding the foundations of institutions is hard under the best of circumstances. When users are shielded from the external incentives/hardships of the free market, it is near impossible to disrupt, and continuity remains an option far beyond reason.

Green OA is an indirect approach to achieve fundamental change. It asks scholars to accept a little inconvenience for the sake of the larger principle. It asks them to deposit their papers into OA repositories and provide free access to publicly-funded research. It is hoped that this will gradually change the journal ecosystem and build pressure to innovate. It took dedicated developers, activists, advocates, and academic leaders over twenty years to promote this modest goal and create a movement that, finally, seems to have achieved critical mass. A growing number of universities have enacted OA mandates. These pioneers led the way, but only a government mandate can achieve the scale required to change the market. Enter politics.

Scholars, the creators and consumers of this market, should be able to dictate their terms. Yet, they are beholden to the establishment journals (and their publishers), which are the fountain of academic prestige. The SCOAP3 initiative for High Energy Physics journals shows how scholars are willing to go to unprecedented lengths to protect their journals.

Market-dominating scholarly publishers are paralyzed. They cannot abandon their only source of significant revenue (site licenses) on a hunch that another business model may work out better in the long term. In the mean time, they promote an impossible-to-defend hybrid Gold OA scheme, and they miss an opportunity to create value from author/reader networks (an opportunity recognized by upstart innovators). This business paralysis translates into a lobbying effort to protect the status quo for as long as feasible.

Academic libraries, which enthusiastically supported and developed Green OA, now enter this political arena in a weak position. The White House memorandum all but ignores them. Before complacency sets in, there is precious little time to argue a compelling case for independent institutional or individual repositories preserved in a long-term archive. After all, government-run repositories may disappear at any time for a variety of reasons.

The Gold OA approach of the Finch report is conceptually simpler. Neither scholars nor publishers are inconvenienced, let alone disrupted. It underwrites the survival of favored journals as Gold OA entities. It preempts real innovation. Without a mechanism in place to limit APCs, it's good to be a scholarly publisher in the UK. For now.

Wednesday, February 13, 2013

Crowd Sourcing Gun Control

Background checks deter only those with prior offenses. For more comprehensive gun-violence prevention, we need systems that help law enforcement focus on high-risk individuals before their first offense. Such prevention systems must operate within important legal and political constraints: they must be compatible with the second amendment, they must be relatively effortless for the vast majority of low-risk gun buyers/owners, and they must respect the privacy of all citizens.


Graph theory makes it possible to extract strong information from a large set of weak relationships. It is the foundation of companies like Google and Facebook. It is the basis for alternative metrics that assess the quality of scholarly papers. Graph theory also applies to gun control. As individuals, we absorb all kinds of information about others and decide to like or dislike, befriend or avoid, trust or distrust them. These individual assessments are rather unreliable, but they become a powerful resource when connected with one another in a graph. For gun control, imagine a system in which gun owners recommend one another. This creates a graph on which to unleash the power of graph theory.

Consider a concrete example (no graph-theory knowledge required):

  1. Every gun buyer/owner registers three Qualified Recommenders (QRs). Without assuming any legal liability, QRs state that the gun buyer/owner is not presently a danger to himself/herself or to society and that they will withdraw as QR if their opinion changes or if they should lose contact with the gun owner.
  2. Most legal gun owners may act as a QR. However, law enforcement may revoke anyone's QR status at any time for any reason. Such action prevents this person from submitting new recommendations, and it voids his/her existing recommendations. Revoking the QR status carries no other consequences. One's own QR status does not affect one's right to own guns.
  3. A gun buyer who is unable to obtain three QRs is subject to a background investigation that may include interviews with family, friends, and neighbors.
  4. A gun owner may lose recommendations because (1) QRs may withdraw their recommendation, (2) QRs may die, or (3) QRs may lose their QR status. A gun owner who does not maintain three QRs is subject to increased scrutiny.
Maintaining three QRs is relatively effortless for low-risk gun owners, who tend to have strong ties to their communities. If they should become high risk (through mental illness, for example), their QRs are likely to withdraw their recommendations, thereby creating an early warning.

The impact on high-risk gun owners is more substantial. Very few law-abiding gun owners would be willing to sponsor someone they consider dangerous because of mental health, behavioral issues, or criminal connections. Convicted criminals cannot be QRs, because they cannot be legal gun owners. This reduces the pool of available QRs for their non-convicted associates. Law enforcement can reduce that pool even further: when they arrest someone, they could revoke the QR status of the arrestee and of his/her QRs (under the theory that these QRs are unreliable).

Consider a few scenarios.

Scenario 1. Joe is a gun owner. His QRs are his wife (Mary) and two friends (John and Pete).

Scenario 1a. Joe develops a mental-health problem and is in therapy. Mary convinces Joe to dispose of the guns. Mary withdraws her recommendation and, perhaps, approaches John and Pete to withdraw theirs. There are no legal proceedings of any kind.

Scenario 1b. Joe develops a mental-health problem, refuses therapy, and develops violent tendencies. The QRs and the police develop a plan to withdraw their recommendations and, simultaneously, to impound Joe's weapons. After the emergency intervention, Joe's fitness to own guns is evaluated.

Scenario 1c. Joe is arrested under suspicion of committing a violent crime.

Upon his arrest, Joe's QR status is revoked immediately. Joe's gun rights depend on the resolution of the criminal case against him. Mary, John, and Pete are not legally liable for failing to intervene in time, but their QR status is revoked.

Mary, John, and Pete remain legal gun owners. If they acted as each other's QRs, they have to find replacement QRs. For most gun owners, these circumstances are an extremely rare occurrence, and replacing QRs is a low hurdle. For criminal gangs, every arrest eliminates QRs from their environment and increases their difficulty of replacing QRs.

Scenario 2. Bill sells his recommendations. As soon as he is identified as a shady operator, the police subjects his network to heightened scrutiny. With the first arrest in Bill's network, he loses his QR status, and his recommendations are voided. As Bill's clients find replacement QRs, they leave useful network trails.

Scenario 3. Mary, a law-abiding citizen living in a gang-infested neighborhood, wants a gun for protection. Some of her relatives and friends have arrest records, and she cannot find three QRs. She is a high-risk gun buyer because of the circumstances of her life: her gun is at much higher risk to be stolen and/or misused. She is able to buy a gun after passing an in-depth background investigation.

Scenario 4. Bob is a criminal and does not care about gun laws. Because his guns are illegal, he faces a much harsher sentence if arrested and convicted.

Bob's guns are most likely stolen or obtained from sources that claim their guns were stolen or lost. If one of his guns is traced back to Mary, her QR status is revoked immediately. If Mary is an innocent bystander, losing her QR status is no big deal. If she is a member of a network that traffics guns illegally, this incident reduces the pool of available QRs.

Other Scenarios. The QR system implements a form of social control that occurs organically in small communities where everyone knows their neighbors (a rarity nowadays). The process of finding QRs provides opportunities for a community to intervene in a non-confrontational manner and to help prospective gun buyers make a realistic assessment of their own risk profile.

The QR system shows that gun-violence prevention does not require storing detailed personal information. It shows that an alert and involved community does not need to become a society of snoops that report every eccentricity to the police. Yet, the QR system is just one example. Graph theory provides a lot of flexibility to respond to legal and political concerns.

I call on the graph-theory community to contribute to the gun-control effort. It is up to you. Criticize. Amend. Propose. Do something. Anything. Save lives.

Monday, January 14, 2013

MOOCs Teach OA a Lesson

Just four years ago, Massive Open Online Courses (MOOCs) were tentative experiments promoted by a handful of professors. (Wikipedia, New York Times, Chronicle of Higher Education) Today, universities across the world are rushing in, and millions of students are enrolling. Contrast this with the Open Access movement (OA). More than twenty years after the introduction of the hep-th database (which became arXiv), OA remains a struggle. There have been significant OA advances, but universal open access to the scholarly literature remains a distant promise, probably requiring many more years.

Why did OA never reach the kind of momentum MOOCs seem to have?

Because successful MOOCs serve many thousands of students, their per-student costs are extremely low when compared to traditional teaching. Yet, the cost of producing a series of high-quality large-scale interactive multimedia events is significant. Compared with MOOCs, the start-up cost of OA is almost negligible. After an institutional repository is set up, the only barrier to OA is a few key strokes per scholarly paper.

Why were academic leaders so concerned about the minimal costs of OA? Why are they not concerned about the far more significant costs of MOOCs?

MOOCs have the potential of disrupting thousands of teaching positions. MOOCs are a threat to admissions offices and a system of university reputations based on rejection rates. On the other hand, universal OA would primarily disrupt libraries, publishers, and their middlemen, not academics. Yet, academic leaders are enamored with MOOCs, and they treat OA like a chore for which there is always some excuse to postpone. If MOOCs really prove to be as disruptive as hoped or feared, they figure it is preferable to be on the side of the disrupters.

Why do academic leaders not make the same calculation with respect to OA? Why do they fear the potential of OA-caused disruption? Why do they embrace the potential of MOOCs-caused disruption?

In my search for answers, I arrived at four tentative conjectures.

Conjecture 1. MOOCs are in their infancy. The wave of initial excitement will pass, and the hard MOOC work lies ahead. OA is further along in its evolution. Passed its own wave of initial excitement, OA is now in the slow process of building its infrastructure. Some form of OA will soon emerge as the inevitable path.

This conjecture provides cover to continue on the current path.

Conjecture 2. With MOOCs, first movers have a clear advantage. They have the most time to develop the know-how for producing successful MOOCs. With little competition, they can afford to make mistakes and learn from them. With OA, first movers provide a service to those on the sidelines and get little in return. (This perverse incentive explains, in part, the need for OA mandates.)

This begs for initiatives that reward scholars who make their works OA.

Conjecture 3. With MOOCs, faculty control their work, and they do what they do best: they innovate an area in which they are experts. OA feels like an external imposition. To add insult to injury, some repository managers have turned simple light-weight OA repositories into a bureaucratic mess with useless policies that turn faculty off. And it is not just repository policies. Scholars are increasingly awash in conflicting and confusing OA-related policies from funding agencies, publishers, universities, and libraries. Discussions about OA mandates do not help the cause either. It is irrelevant that OA mandates require very little effort when enacted; the discussion itself is a turn-off.

This is an argument to reduce the heavy-handedness of current OA approaches. Eliminate the bureaucracy, and replace institutional repositories with self-managed individual repositories. These may not eliminate all institutional policies, but they give scholars a greater degree of control and flexibility. Individual repositories are also portable when scholars move from one institution to the next. There are at least two options that make it easy for scholars to manage their own individual repository: academia.edu and myopenarchive.org. ORCID, the recently launched initiative to manage the identities of scholars, could also evolve into a system of individual repositories.

Conjecture 4. OA is not sufficiently disruptive. Hoping to minimize resistance to OA, OA advocates tend to underemphasize the disruptiveness of OA. Gold and Green OA leave the scholarly-communication system essentially intact. When presented in a minimalist frame, they are minor tweaks that provide open access, shift costs, and bend the cost curve. Such modest, even boring, goals do not capture the imagination of the most effective advocates for change, advocates who have the ears of and who are courted by academic leaders: venture capitalists. This is a constituency that seeks out projects that change the world.

This conjecture is an argument to pursue disruptive OA. What if OA completely erased the cost of all scholarly communication? That would reduce the cost of education and/or research by at least as much as some of the most disruptive MOOC scenarios.

PeerJ falls in the category of disruptive OA. PeerJ is a new model for open-access journals with peer review. PeerJ charges authors a one-time $99 membership fee and eliminates the per-paper publication charges of Gold OA journals.

One could, of course, dispose of journals altogether. Combine individual repositories with open evaluation and alternative metrics. The field of altmetrics has developed various impact measures based on usage statistics of individual papers. This fine-grained analysis is far superior to the rather coarse and often misleading Journal Impact Factor. To succeed, open evaluation and altmetrics must win over the entrenched interests that control academia's prestige machine.

Perhaps, none of these conjectures fully explain differing attitudes towards MOOCs and OA. Perhaps, it is a combination of all four. Perhaps, there are other factors at play. If so, what are they, and how should those factors influence our approach to OA?

Monday, November 5, 2012

Hitler, Mother Teresa, and Coke


Publishers are manipulative capitalists who extort academia by holding hostage the research papers they stole from helpless scholars on a mission to save the world. This Hitler vs. Mother Teresa narrative is widespread in academic circles. Some versions are nearly as shrill as this one. Others are toned-down and carry scholarly authority. All versions are just plain wrong.

Scholarly publishers do what is expected of them: they offer a service and maximize their profit. Prices are set by a free market, where consumers make cost-benefit evaluations and decide to buy or not. If journal prices keep rising at exorbitant rates, assess why publishers have the power to dictate prices, and fix what is wrong. Do not blame the bee for the sting; it is what bees do.

Scholars submit their manuscripts to journals to expose and validate their work. They are referees because they benefit from the peer-review system or hope to benefit eventually. When they become editor of a journal, scholars advance up the prestige ladder in proportion to the reputation of the journal. Every step of the publishing process rewards scholars in the currency of academic prestige, the foundation of a portfolio that leads to academic appointments.

If journals were only about the dissemination of information, they would not survive current market conditions. There are free resources (not all legal) to obtain scholarly papers: from open-access repositories, from colleagues by e-mail, or from Twitter-enabled exchanges. There are free resources to disseminate research: blogs, web sites, or self-published e-books. None of these alternatives to acquire or disseminate research have affected the scholarly-information market. Scholarly journals are expensive not because they disseminate information, but because they disseminate prestige.

Authors and editors benefit from a journal's prestige, and the survival of “their journal” is important to their field's prestige and, by implication, their own. They never personally face the cost-benefit question (Is a journal's prestige worth its price?), but they influence their organization's subscription decisions. In faculty discussions, the issue of access often serves as a proxy for prestige. For authors and editors, the university canceling “their journal” is outright institutional rejection. To a certain extent, journal subscriptions are a means to divvy up prestige. This inherently dysfunctional market is further distorted by site licenses. (See a previous blog post.)

There are no Hitlers. There are no Mothers Teresa. There are just individuals and organizations looking out for their self-interest in a market complicated by historical baggage (site licenses modeled after paper-journal subscriptions) and competing interests (access, prestige, cost, profit). Academic leaders are concerned about the cost of scholarly communication, but they are equally reluctant to undermine the established system for assessing and rewarding excellence in scholarship.

Scholarly publishers create value by attaching prestige to (what has become) a commodity service. This is not unlike Coca Cola, which ties its commodity products to various nostalgic sentiments. Where Coca Cola invested in mass-marketing campaigns, publishers invested in relationships with academia. They developed the capability of identifying emerging disciplines ready for new journals. They learned how to select editors. They learned how to acquire and disseminate academic prestige. They achieved the power to set prices by seamlessly attaching their prestige infrastructure to the academic enterprise. However, just like team spirit, family togetherness, and the desire for world peace would survive the loss of sugary flavored water, the pursuit of  prestige will survive new dissemination methods for scholarly communication.

From a free-market perspective, Gold Open Access journals seem to have the right structure. When authors pay to be published, they weigh the prestige of the journal against its price. Yet, there is a problem. To survive, a Gold journal only needs a relatively small base of paying authors. It does not need subscribers. It does not need a high impact factor. This presents an opening for opportunists to create vanity platforms. To counter this, universities could prohibit the use of institutional funds to pay for publication in low-impact journals. Unfortunately, this would also increase the difficulty of launching legitimate new Gold journals, decrease competition, and increase prices.

Scholars who grew up with the web will, eventually, question the paper-era structure of all journals. The burgeoning field of alternative metrics uses graph theory to produce article-level quantitative assessments based on correlated web usage. Altmetrics will first complement, then compete with, and ultimately replace the journal impact factor. When articles are assessed based on their own metrics, bundling articles into a journal loses much of its significance. Today, respected academics will not accept a blog post, a self-published e-book (long or short form), or a web site as a valid method to establish academic credibility, let alone prestige. This skepticism is justified, dismissiveness is not.

The journal impact factor exerts its influence through an infrastructure of editorial boards and related organizations that took decades to develop. To achieve that kind of institutional impact, altmetrics need their own social constructs. It may take considerable time and effort to develop these constructs and to have them institutionally accepted. But if it succeeds, such a prestige infrastructure could herald a new era of scholarly communication based on personal dissemination methods.