HAMR: Human/Authority Metadata Reconciliation - Revision history

Ryscher at 20:29, 9 March 2012

2012-03-09T20:29:10Z

2011-06-03T20:21:35Z

2011-02-17T04:24:42Z

2011-02-07T22:05:40Z

‎UI Example (example)

2011-02-07T22:05:22Z

‎Static UI Example

2011-02-07T21:33:24Z

‎Draft Matching Algorithm

2011-02-07T21:30:44Z

‎Draft Matching Algorithm

2011-02-07T21:27:19Z

‎Draft Matching Algorithm

2011-02-07T21:22:02Z

2011-02-07T21:19:03Z

‎Draft Matching Algorithm

@@ Line 1: / Line 1: @@
 [[HAMR: Human/Authority Metadata Reconciliation]]
-Sean Chen, Tim Donohue, Joshua Gomez, Ranti Junus, Ryan Scherle
+Initial design/prototype by: Sean Chen, Tim Donohue, Joshua Gomez, Ranti Junus, Ryan Scherle
 A tool for a curator to determine whether the various fields of a metadata record are correct. Takes a metadata record, locates any identifiers (e.g., DOI, PMID). Retrieves a copy of the metadata record from an authoritative source (e.g., CrossRef, PubMed). Displays a human-readable page that compares fields in the initial record with fields in the authoritative record. Each field is color-coded based on how well it matches, so the curator can quickly identify discrepancies.

@@ Line 5: / Line 5: @@
 A tool for a curator to determine whether the various fields of a metadata record are correct. Takes a metadata record, locates any identifiers (e.g., DOI, PMID). Retrieves a copy of the metadata record from an authoritative source (e.g., CrossRef, PubMed). Displays a human-readable page that compares fields in the initial record with fields in the authoritative record. Each field is color-coded based on how well it matches, so the curator can quickly identify discrepancies.
-Narrowing the focus for today:
+Narrowing the focus for an initial usable version:
 * Dublin core (maybe qualified)
 * framework that allows multiple authority sources
@@ Line 114: / Line 118: @@
 </hamr>
 </pre>
 == Need to do ==

@@ Line 18: / Line 18: @@
 *** Mapping happens here: See [https://wiki.duraspace.org/display/DSPACE/PubMedPrefill-pmid+dim.xsl pmid-to-dim.xsl] for a sample XSLT crosswalk to translate PubMed format to a qualified dublin core (internal DSpace metadata format)
 ** More examples of querying PubMed: http://www.my-whiteboard.com/how-to-automate-pubmed-search-using-perl-php-or-java/
 * CrossRef
 ** simply send the DOI to crossref, and get JSON/XML back

@@ Line 114: / Line 114: @@
 </pre>
-== UI Example (example) ==
+== UI Example (static) ==
 http://dl.dropbox.com/u/9074989/code4lib/unverified.html

@@ Line 114: / Line 114: @@
 </pre>
-== Static UI Example ==
+== UI Example (example) ==
 http://dl.dropbox.com/u/9074989/code4lib/unverified.html

@@ Line 42: / Line 42: @@
 <pre>
 function compareRecords(localDubCore, authDubCore)
      for each element-type:
          loc = array of local values
@@ Line 49: / Line 50: @@
          // 0    value="Benson, Arnold", match="", strength=""
          // 1    value="Terrence, D.", match="a2[3]", strength="100%"
-         compareElements(loc, auth)
+         elementMatches = compareElements(loc, auth)

@@ Line 67: / Line 67: @@
             if strength > loc element's current strength value
                 overwrite loc element's strength and match values
-     //this second loop routine pulls out the strongest matches
+     //this second set of non-nested loops pull out the strongest matches
      for each item in auth
          //x = some arbitrary barrier for a decent enough match
-         if element strength > x AND if matching element is still in the a1 list
+         if element strength > x AND if matching element is still in the loc list
              pop each element and add their values to output array
+    for each item in loc
+        if element strength > x AND if matching element is still in the auth list
 </pre>

@@ Line 54: / Line 54: @@
 function compareElements(loc, auth)
      output = []
      for each element in loc
          for each element in auth
              strength = string distance between the two elements
              if strength = 100
-                 //pop each element and add their values to output array
+                 //if match is perfect go ahead pop each element and add their values to output array
                  //output array is also list of dictionaries
                  //0    loc="Hector", auth="Hector", strength="100"
                  //1    loc="Albert", auth="Alberto", strength="90"
 </pre>
 == Output Spec ==