Systematic Bulk Downloading of Articles from PubMed Central (PMC)

In this era of artificial intelligence (AI) and machine learning (ML), there is increased interest in accessing large numbers of full-text articles to train deep learning models and/or evaluate their performance. The U. S. National Library of Medicine (NLM)’s PubMed Central (PMC) full-text article repository is a popular choice with AI/ML researchers who are often looking for a free, openly accessible source of the scholarly biomedical literature. For a recent example of research carried out using the PMC Open Access Subset, see PMID: 37094464:

Although the NLM is generally accommodating of researchers using and even building upon all the tools and resources that it develops and supports, there is an expectation on the part of NLM that researchers will work within their rules and restrictions. Anyone interested in “automated retrieval of articles in machine-readable formats in PubMed Central (PMC)” is encouraged to explore the “several large datasets of journal articles and other scientific publications made available for retrieval under license terms that generally allow for more liberal redistribution and reuse than a traditional copyrighted work (e.g., Creative Commons licenses)”. However, there are “Restrictions on the Systematic Downloading of Articles”– see https://www.ncbi.nlm.nih.gov/pmc/tools/textmining/

When researchers try to bulk download a large amount of content via the regular PMC web interface on their own, PMC’s systems notice the increased activity and block the IP range(s) responsible as this is in violation of the terms of the PMC Copyright Notice which states that “Systematic downloading of batches of articles from the main PMC web site, in any way, is prohibited because of copyright restrictions.”

From: https://www.ncbi.nlm.nih.gov/pmc/about/copyright/:

PMC makes certain subsets of articles (i.e., the PMC Article Datasets) accessible through auxiliary services that may be used for automated retrieval and downloading. These are:

These services are the only services that may be used for this purpose. Do not use any other automated processes for downloading articles, even if you are only retrieving articles from the PMC Article Datasets (including the PMC Open Access Subset).

Questions? Be sure to Ask Us at the MSK Library!

NEW EndNote Web for EndNote 21 Users

Now that EndNote 21 is available at MSK, users may wish to take advantage of the new EndNote Web tool which is included as part of MSK’s institutional license for the EndNote 21 desktop version. The most important takeaway to remember about the new EndNote Web is that it is NOT in any way intended to be used “on its own” as a substitute for the EndNote 21 desktop version. Rather it is intended to add flexibility to the EndNote 21 desktop user experience by making it possible for users to access their EndNote library from anywhere.

As per Clarivate’s marketing:

“With EndNote you can access your research anytime, anywhere online. Move seamlessly between online and the desktop and iPad applications in the cloud.

Say hello to the brand-new EndNote Web, available only to EndNote 21 customers for three years from activation date. Securely sync your entire library including PDF’s, notes, and annotations across all your devices.”

EndNote Web has been redesigned from the ground up” 

What this means in practical terms is that EndNote Web on its own no longer functions as a complete citation manager but is basically a cloud storage solution for the EndNote 21 desktop tool. Users are expected – for the most part – to make their references available in EndNote Web by syncing from the desktop tool. That said, references can also be imported into EndNote Web from a file or created manually, added to a group, exported, or deleted.

Furthermore, an EndNote library can now be shared with up to 1,000 colleagues. However, the actual sharing action needs to be carried out in the desktop version of EndNote (by going to File > Share, and then adding the email addresses of colleagues who will be given access). Individuals can be assigned either “Read Only” or “Read-Write” privileges, giving the EndNote desktop library account owner the ability to decide who can simply access the references versus who can make changes to their EndNote Web shared library.

Also, when working on writing up their research, users now can insert their EndNote references into more word processing software options: Microsoft Word™, Apple Pages™ and Google Docs™. Cite While You Write (CWYW) plug-ins/add-ons are available for download, for example – see: EndNote: Google Docs CWYW (clarivate.com). (Tip: If you have the EndNote 21 tab installed in MS Word, you can go to Preferences > Application tab to specify if you wish for MS Word to draw from your desktop EndNote library, from your new EndNote Web library, or from your EndNote Online Classic library.)

NEW EndNote Web is completely different than EndNote Online Classic

Because the vendor realizes that EndNote Web and EndNote Online Classic are quite different tools, Clarivate will continue to make both tools available. Users who already have an EndNote Online Classic account may log into EndNote Web using the same online credentials if they want  their online references from the classic tool to be available in the new online tool. However, they are also welcome to sign-up for a brand new account.

The reason why Endnote Online Classic is so different than the new EndNote Web is that it was developed with a completely different purpose in mind, many years ago. Back then, it was described by the company as “the online counterpart to our popular desktop reference management and bibliography creation software” that was available as a free basic version (i.e. with much less functionality than the desktop version). From the vendor’s handout:

“Whether you use EndNote online through Web of Science™, with EndNote desktop, or on its own – you reduce the time you spend searching, updating, and cleaning your research and formatting documents. Depending on how you access EndNote online, you may see different features and options. > ENDNOTE BASIC If you only have access to EndNote online, and not EndNote desktop, you are considered a basic user. While your feature set is limited compared to those using EndNote online in addition to the desktop, it’s still perfect for the new-to-research and writing student.”

For years, EndNote Online Classic served as an introductory student gateway to more sophisticated citation management tools, as well as a vehicle for sharing references between colleagues. Currently, the classic online version can still be used independently as a basic tool for capturing and managing references (that even allows for online searching of tools like PubMed for harvesting new citations) but it likely will not be further developed by the vendor. 

EndNote Online Classic User Guides:

https://clarivate.libguides.com/ld.php?content_id=64075557

https://endnote.com/wp-content/uploads/m/pdf/en-online-qrc.pdf

https://endnote.com/product-details/compare-current-versions

Questions? Be sure to Ask Us at the MSK Library!

Evidence Based Point of Care/Clinical Decision Support Resources

The MSK Library has subscriptions to a number of resources that are often referred to as evidence based point of care tools or clinical decision support resources. A hallmark of these tools is that they often include succinct clinical information summaries accompanied by some strength of evidence rating or quality assessment and/or may offer links to evidence-based recommendations and guidelines. Some tools give users the opportunity to earn CME points and credits for spending time using the resource, while others provide separate content prepared specifically for clinicians while also offering versions intended for patients.

Included in the library’s Databases A-Z list, for example, are:
(click on name to access the resource) 

Note: To use these resources via the MSK Library’s subscription, you are not required to register for your own personal account – you can just use MSK’s institutional OpenAthens sign-on to gain access.

However, if you are interested in earning CME points and credits (in the tools that offer this option), you will need to register for a personal account after gaining access to the tool via MSK’s subscription.

Some tools also have a mobile app that you can download after you register for a personal account. If you experience any download issues or are prompted for MSK-specific subscription information that you do not have, please reach out to the MSK Library using our Ask Us form to obtain any needed subscription details from the library’s Content Team.