Support : Dialog Search Aids : Successful Searching : REMOVE DUPLICATES

REMOVE DUPLICATES

REMOVE DUPLICATES is the most frequently used duplicate detection command. The RD command creates a set of unique records, in which only one record from each set of duplicate citations is retained. The format for the command is

RD Sn

RD entered without a set number defaults to the last set created.

When duplicate records are identified, records are chosen for retention based on the order in which the files were entered in the BEGIN command. For example, if the command BEGIN 154,72 is entered, records from File 154, MEDLINE^® are given priority over records from File 72, EMBASE^®. You can change this order of priority with the SET FILES command.

The records in the RD set are in accession number order. Since the SORT command only works with publication year (PY) and publication date (PD) in OneSearch, you can use the IDENTIFY DUPLICATES (ID) command to obtain a set that is approximately sorted by title (initial articles are ignored). Simply use the ID command with the set that resulted from the RD command, as shown in the second group of records in the following example.

Duplicates can be removed from a single file, as well as from multiple files. You can also use the RD command with the FROM option to remove duplicates FROM particular files (e.g., RD S3 FROM 6,8).

Records in a set created with the RD command can be used in later search statements.

Note: If you apply the RD command to a search that includes one or more files that do not offer duplicate detection, a system message notifies you of that fact. The system then processes the remaining files that do offer duplicate detection. All records from the unsupported
file(s) are retained in the RD set. Enter the HELP DUP command online to display a list of files that do not offer duplicate detection.

• To REMOVE DUPLICATES from a search done in OneSearch, using ID to SORT by title:

?show files
[File 154] MEDLINE(R) 1990-2008/Mar 12
(c) format only 2008 Dialog. All rights reserved.
[File 72] EMBASE 1993-2008/Mar 13 
(c) 2008 Elsevier B.V. All rights reserved.

?ds
Set     Items   Description
S1       5312   S ASPIRIN AND DIABET?
S2       1782   S S1/ENG,2006:2008

?rd s2
Processing
S3       1527   RD S2  (UNIQUE ITEMS)

?type s3/6/1-3
 3/6/1 (Item 1 from file: 154) 

26167945   PMID: 18334241 
Chronic kidney disease risk reduction in a Hispanic 
population through pharmacist-based disease-state 
management. 

Apr 2008 

3/6/2 (Item 2 from file: 154) 

26162441   PMID: 18332580 
A case of nonarteritic anterior ischemic optic neuropathy 
with hypertension, diabetes mellitus, hyperlipidemia and 
severe stenosis of the internal carotid artery. 

Jan 2008 

 3/6/3 (Item 3 from file: 154)  

26156835   PMID: 18085336 
Assessment of the risk factors for colonic diverticular 
hemorrhage. 

Jan 2008 

?id s3
S4       1527   ID S3  (IN DUPLICATE ORDER)

?t s4/6/1-4
 4/6/1 (Item 1 from file: 72) 

0082224833     EMBASE No: 2008020197 
  ABCD position statement on lipid modifying drug therapy 
in diabetes 

 Publication Date: November 1, 2007 

 4/6/2 (Item 2 from file: 72) 

0081515978     EMBASE No: 2006579505 
  Abciximab and fatal pulmonary hemorrhage 

 Publication Date: November 1, 2006 

 4/6/3 (Item 3 from file: 72) 

0081992214     EMBASE No: 2007428540 
  Abciximab in primary coronary stenting of ST-elevation 
myocardial infarction: A European meta-analysis on 
individual patients' data with long-term follow-up 

 Publication Date: February 1, 2007 

 4/6/4 (Item 4 from file: 72) 

0081501365     EMBASE No: 2006564809 
  ABCss: B is for blood pressure 

 Publication Date: November 1, 2006

top