Output criteria

Standardised eligibility criteria are used to ensure consistency in research outputs assessment, and eligibility for external reporting.

The following information is derived from the Excellence in Research for Australia (ERA) 2018 specifications and guides the verification of research outputs for the internal Research Outputs Collection (ROC). For further advice on output eligibility please contact the Research Outputs team.

The Division of Library Services can also provide support in locating appropriate outlets in which to publish your research, see the "Where to Publish" guide for more information.

If you have had an output excluded, you can refer to the Output exclusion guidelines for further information on why your output was excluded and how to lodge an appeal if relevant.

Generic criteria

  • Definition of research

    All submissions must meet the definition of research, as outlined in the specifications:

    ERA defines research as the creation of new knowledge and/or the use of existing knowledge in a new and creative way to generate new concepts, methodologies, inventions and understandings. This could include the synthesis and analysis of previous research to the extent that it is new and creative.

    This definition of research is consistent with a broad notion of research and experimental development comprising “creative and systematic work undertaken in order to increase the stock of knowledge – including knowledge of humankind, culture and society – and to devise new applications of available knowledge”1 as defined in the ARC funding rules.

    Key characteristics are:

    • Substantial scholarly activity, as evidenced by discussion of the relevant literature, an awareness of the history and antecedents of work described, and provided in a format which allows a reader to trace sources of the work, including through citations and footnotes
    • Originality (ie., not a compilation of existing works)
    • Veracity/validity through a peer review process or the quality control processes of a commercial publisher
    • Increasing the stock of knowledge; and
    • Being in a form that enables the dissemination of knowledge

    In general, the above means that it must be a traditional scholarly publication, and would normally include a reference list, footnotes or in-text references. It should be original and innovative (not a summary of other works) and engage with the topic in some depth (not a simple overview). It should have investigation as a chief characteristic.

  • Count each publication once only

    Often research publications are published in more than one format - for example, a conference paper may subsequently be published in the following year as a journal article or book chapter. Please note that, for ROC purposes, the same publication may only be counted once, in one format. It is, however, legitimate to have alternative versions of an output on CRO as ‘Also published as’ items.

  • Author affiliation

    We can claim any author identified as affiliated with Charles Sturt University on the publication itself, including academic staff, adjuncts, HDR candidates, general staff, and visiting scholars. Evidence for affiliation is normally an explicit acknowledgement of Charles Sturt University (or its entities) on the byline, or in the contributor information page/s

    See the author affiliations page for more specific information.

  • Peer review

    An acceptable peer review process is one that involves impartial and independent assessment or review of the research publication in its entirety before publication. This must be conducted by qualified experts, who are independent of the author.

    Note that a statement from an author that a publication was peer reviewed is not acceptable. The existence of an advisory board is also not sufficient evidence that all relevant publications were assessed by its members.

    Peer review is required for:

    Journal articles

    This is often demonstrated by the appearance of the peer review icon against the journal on an Ulrichs search, or by the listing of the journal on the ERA 2018 journal list. In the absence of these indicators, we can also accept:

    • a statement in the journal or from the journal editor which shows that contributions are peer reviewed, or
    • a copy of a reviewer’s assessment relating to the article itself.

    Please note that a reviewer’s assessment needs to confirm that the article was subject to full assessment/review – ie, more than just proofing or editing.

    Conference papers

    The most common evidence is an explicit statement from the conference proceedings or in the preamble which shows that contributions are peer reviewed; however, we can also accept a copy of:

    • a reviewer’s assessment relating to the conference paper itself (this needs to confirm that the article was subject to full assessment/review – ie, more than just proofing or editing), or
    • an explicit peer review statement in the call for papers or conference website.

    Note that the statement needs to confirm the peer review process on the full paper – ie, not just on the abstract or poster presentation.

    Books and book chapters

    Evidence of peer review is now required for any books or book chapters which are not published by a commercial publisher. Acceptable evidence includes:

    • a statement in the book which shows that contributions are peer reviewed and, in the case of book chapters, indicating which chapters are peer reviewed (if this does not apply to the entire book)
    • a statement or acknowledgement from the publisher or editor confirming peer review
    • a copy of a reviewer’s assessment relating to the book or chapter. Please note that a reviewer’s assessment needs to confirm that the article was subject to full assessment/review – ie, more than just proofing or editing.
  • Commercial publishers - books and chapters

    For books and book chapters, the concept of a commercial publisher is used as a surrogate test of quality in place of a peer review requirement. A commercial publisher is defined as an entity for which the core business is publishing books and distributing them for sale.

    ‘Publication’ is more than the production of a book. It needs to include quality control such as peer review or equivalent in-house quality control through processes such as expert assessment or review, as well as editing, copy-editing, design, and conversion of the work to an appropriate format.

    If publishing is not the core business of an organisation, but there is a distinct organisational entity devoted to commercial publication and its publications are not completely paid for or subsidised by the parent organisation or a third party, the publisher is acceptable as a commercial publisher. University presses are also regarded as commercial publishers, provided that they have responsibility for the distribution of the publication, in addition to its printing.

    Note that in order to be considered a commercial publisher for these purposes, companies must generally demonstrate a degree of editorial responsibility and financial risk in choosing to publish, as well as be responsible for the entire publishing process (including printing and distribution). For this reason, 'vanity presses', as well as companies specialising primarily in the publication of theses are NOT considered to meet the 'commercial publisher' criteria.

    Evidence of commercial publisher status is generally available on the web pages of publishing companies.

    See also section on 'Peer Review'.

  • Year of publication

    All publications included for ROC must be claimed in the appropriate year.

    The year of publication must be verifiable, and stated as the year of publication within or on the work being claimed. 'Published' in this context is the date the publication was released to its intended audience. Publications which are published as ‘advance’ or ‘in press online’ may be reported either in the year that they were published online or the year of final publication – but they can be claimed only once.

    Letters from authors, editors, etc stating that a research publication was published in a certain year, even though that year is not stated within or on the work as the year of publication, are not acceptable evidence of the year of publication.

    There are two exceptions:

    • For journal articles and/or conference publications that are produced on CD-ROM or are web-based, and do not contain a date published within or on the work being claimed, a letter from a journal editor or conference organiser verifying the published date may be accepted
    • The date a conference was held may be acceptable evidence of the year of publication.

    The year of publication is normally the latest of the year indicated as published, printed, or the year of copyright.

Category specific criteria

  • Books

    Eligibility requirements

    The book must meet the definition of research.

    In addition the book must:

    • have an ISBN (International Standard Book Number)
    • be a major work of scholarship
    • be offered for sale in any form of:
      − hard copies, bound
      − CD-ROMs, packaged
      − e-books, on subscription or fee basis
    • have been entirely written by a single or co-authors ( - i.e., not an edited book. Chapters within edited books should be claimed as chapters.)
    • have at least one author affiliated with CSU (see 'Author affiliation')
    • have been published by a commercial publisher (see 'Commercial publishers - books and chapters') OR, if not published by a commercial publisher, must have been peer reviewed (see 'Peer review')*

    Evidence required

    Unless all of the above requirements can be established from the URLs/web pages supplied in the appropriate fields in the submission form, or via accompanying PDFs, we may require scans or hard copy of some/all of the following:

    • Title page
    • Contents
    • Preface and introduction
    • Contributor information page/s or other evidence of CSU affiliation
    • Pages showing all bibliographic information (ISBN, title, author(s), publisher, all dates referring to copyright, publication, printing, distribution)
    • Evidence supporting commercial publisher status
    • Evidence of independent, impartial peer review of the work in its entirety before publication (see ‘Peer review’)

    Many of the books published by professional bodies do not report original research findings but report the results of evaluations, or repackage existing information for the benefit of professionals and practitioners. It is important that these outputs are assessed very carefully against the definition of research to ensure we include only those books which report research activities.

    Eligibility examples

    The types of ‘Book’ research output likely to meet the eligibility criteria are:

    • critical scholarly texts
    • new interpretations of historical events
    • new ideas or perspectives based on established research findings.

    The types of books unlikely to meet the criteria include:

    • textbooks
    • anthologies
    • edited books
    • creative works (eg. novels)
    • translations (unless they have a major demonstrable research component)
    • revisions or new editions
    • manuals and handbooks
    • theses (PhD, Masters and Honours)

    If a book is only available online, and/or not offered for sale or published commercially, institutions can only report the book if it has been through an acceptable peer review process and otherwise meets the relevant eligibility criteria.

  • Chapters

    Eligibility requirements

    The chapter must meet the definition of research.

    In addition the book itself must:

    • consist substantially of new material
    • be in an edited compilation in which the material is subject to editorial scrutiny
    • have an ISBN (International Standard Book Number)
    • be a chapter in a book that is offered for sale in any of the forms of:
      − hard copies, bound
      − CD-ROMs, packaged
      − e-books, on subscription or fee basis
    • have at least one author affiliated with CSU (see 'Author affiliation')
    • have been published by a commercial publisher (see 'Commercial publishers - books and chapters') OR if not published by a commercial publisher, must have been peer reviewed (see ‘Peer review’)

    Evidence required

    Unless all of the above requirements can be established from the URLs/web pages supplied in the appropriate fields in the submission form, or via accompanying PDFs, we may require scans or hard copy of some/all of the following:

    • A copy of the published chapter
    • Title page
    • Contents
    • Preface and introduction
    • Contributor information page/s or other evidence of CSU affiliation
    • Pages showing all bibliographic information (ISBN, title, author(s), publisher, all dates referring to copyright, publication, printing, distribution)
    • Evidence supporting commercial publisher status
    • Evidence of independent, impartial peer review of the work in its entirety before publication (see ‘Peer review’)

    Note: If it is a new chapter in revised edition, include also contents of previous edition if preface does not indicate that chapter is new.

    Eligibility examples

    A book chapter may be included if it has been published previously, as long as it constitutes substantial new knowledge and constitutes original research.

    The types of book chapters likely to meet the criteria include:

    • A scholarly introduction of chapter length to an edited volume, where the content of the introduction reports research and makes a substantial contribution to a defined area of knowledge.
    • A critical scholarly text of chapter length
    • Critical reviews of current research

    The types of book chapters unlikely to meet ROC criteria include:

    • chapters in textbooks
    • entries in reference books
    • anthologies
    • revisions of chapters in edited books
    • forewords
    • brief introductions
    • brief editorials
    • appendices
    • literary or creative pieces such as collections of short stories; and
    • translations (unless they have a major demonstrable original research component)

    If a book chapter is only available online, and/or not offered for sale or published commercially, institutions can only report the book if it has been through an acceptable peer review process and otherwise meets the relevant eligibility criteria.

  • Journal articles

    Eligibility requirements

    The article must meet the definition of research.

    In addition the article must:

    • be published in a scholarly journal
    • have been peer reviewed (see 'Peer review')
    • have an ISSN (International Standard Serial Number). (Note: Some journals may be regularly published as separate volumes with an ISBN rather than an ISSN. Provided that the publication is clearly identified as an edition of a journal, and not a book, articles in such publications may be eligible if they meet all other criteria)
    • If an ISSN does not appear in the journal, then there should be either a) external evidence (such as an ISSN being cited in an extract from an authoritative journal listing, such as Thomson-Reuters or Scopus), or b) evidence that the journal is classified as 'refereed' in the Ulrich's Knowledgebase
    • have at least one author affiliated with CSU (see 'Author affiliation')

    Evidence required

    Unless all of the above requirements can be established from the URLs/web pages supplied in the appropriate fields in the submission form, or via accompanying PDFs, we may require scans or hard copy of some/all of the following:

    • a copy of the published article
    • Pages showing all bibliographic information (journal title, dates where not provided in the article or offprint)
    • Proof of peer review (see 'Peer review')
    • Evidence of CSU affiliation (see 'Author affiliation')

    Eligibility examples

    The types of ‘Journal Article’ research output likely to meet the eligibility criteria are:

    • commentaries and communications of original research
    • research notes
    • critical scholarly texts that appear in article form
    • articles reviewing multiple works or an entire FoR
    • invited papers in journals
    • articles in journals targeted to both scholars and professionals
    • articles in a standalone series.

    The types of journal articles that are unlikely to meet ROC criteria include:

    • letters to the editor
    • case studies
    • articles designed to inform practitioners on existing knowledge in a professional field
    • articles in newspapers and popular magazines
    • editorials
    • book reviews
    • brief commentaries and communications of original research
    • reviews of art exhibitions, concerts, theatre productions
  • Conference papers

    The paper must meet the definition of research.

    In addition the paper must:

    • be published in full. Publication of the abstract only is not sufficient. 'Publication' may be in a number of different formats, e.g. a volume of proceedings, a special edition of a journal, a normal issue of a journal, a book or a monograph, CD-ROM or conference or organisational web site
    • be peer reviewed in full (see 'Peer review')
    • be presented at a conference, workshop or seminar of national or international significance
    • have at least one author affiliated with CSU (see 'Author affiliation')

    Evidence required

    Unless all of the above requirements can be established from the URLs/web pages supplied in the appropriate fields in the submission form, or via accompanying PDFs, we may require scans or hard copy of some/all of the following:

    • From published proceedings: full published paper; Title page, Contents, bibliographic page/s showing ISBN, title, editor, authors, publisher, dates
    • Conference program indicating time and date of presentation
    • Proof of national or international significance
    • Proof of peer review
    • Evidence of CSU affiliation

    Eligibility examples

    The types of conference papers that are unlikely to meet ROC criteria include:

    • papers that appear only in a volume handed out to conference participants.
    • Keynote addresses
    • Plenary addresses
    • Poster presentations (unless a fully refereed conference paper is also submitted and published for the conference)
    • Abstracts of conference publications
  • Creative works

    Eligibility criteria relating to creative works can be found here.

  • Research reports

    Eligibility criteria relating to research reports can be found here.