The pitch - "Creating a toolkit/process for collaborative, grassroots self-archiving of significant, small BC websites using DIY tools"

The problem - Small site approaches us; we have developed a collection of resources of signifigance to people doing aboriginal law in BC. Our lead person is retiring. We will not be running the service any longer, have no more budget, but we would like the files on our small website to remain available?

Possible Solutions
- leave the site where it is. Pros - urls work, already indexed and known. Cons - cost to maintain server & domain name.
- rely on the internet archive. Pros - no cost Cons - the default wayback machine provides inconsistent coverage and may not have archived the whole site. Not found at original URL.

So....

Is there a case for self-service archiving of small but significant websites in BC?

archive team
central tracker of requests, distributed harvesting

Watershed questions
is the internal structure important
yes - harvesting
no - publishing / zipping contents

wget with warc

WAIL Web Archiving Integration Layer
- creation tool is a chrome plugin

archiveit

index warc files
andy jackson, british library has mandate to archive the web

http://www.digitalpreservation.gov/personalarchiving/

lockss box - distributed file storage
sfu working on locksamatic
can be web proxy

Links & Resources

http://www.archiveteam.org/index.php?title=The_WARC_Ecosystem
http://netpreserve.org/web-archiving/tools-and-software
https://archive-it.org/

Creating a toolkit/process for collaborative, grassroots archiving of significant, small BC websites using DIY tools

2013-11-28T22:37:17Z

ScottLeslie: Created page with "The pitch - "Creating a toolkit/process for collaborative, grassroots self-archiving of significant, small BC websites using DIY tools" The problem - Small site approaches us; w..."

BC

2013-11-28T22:35:29Z

ScottLeslie:

Welcome to code4lib BC!

Begun in Summer 2013, this chapter aims to create connections and professional development opportunities for folks from British Columbia and surrounding areas.

== '''First Annual Code4lib BC Event''' ==

'''When''': November 28 and 29, 2013

'''Where''': SFU Harbour Centre, Vancouver, BC [http://goo.gl/maps/iyC0j map]

'''Cost''': $20

'''Accommodations''': Info coming soon.

'''Register here''': https://code4libbc2013.eventbrite.ca/ 2013-11-21: We are full at 80 people but the waitlist is open.

'''What''': It’s a 2 day unconference! A participant-driven meeting featuring lightning talks in the mornings, hackfest in the afternoons, with coffee, tea and snacks provided. Lightning talks are brief presentations which are typically 5-10 minutes in length (15 minutes is the maximum) on topics related to library technologies: current projects, tips and tricks, or hacks in the works. Hackfest is an opportunity to bring participants together in an ad hoc fashion for a short, yet sustained period of problem solving, software development and fun. In advance of the event, we will gather project ideas in a form available through our wiki and registration pages. Each afternoon the code4libBC participants will review and discuss the proposals, break into groups, and work on some of the projects.

'''Who''': A diverse and open community of library developers and non-developers engaging in effective, collaborative problem-solving through technology.Anyone from the library community who is interested in library technologies are welcome to join and participate, regardless of their department or background: systems and IT, public services, circulation, cataloguing and technical services, archives, digitization and preservation. All are welcome to help set the agenda, define the outcomes and develop the deliverables!

'''Why''': Why not? code4libBC is a group of dynamic library technology practitioners throughout the province who want to build new relationships as much as develop new software solutions to problems.

'''Tag d'hash''': #c4lbc

If you’re ready to get your hands dirty with library technology practitioners, join us!

As a Code4Lib event, we adhere to the Code4Lib Code of Conduct, which seeks to provide a welcoming, harassment-free environment. Please see the [http://bit.ly/coc4lib Code of Conduct] for further details.

Our first annual code4libBC event could not have been made possible without the generous financial support of:

* BCCATS (British Columbia Cataloguing and Technical Services Interest Group)
* BC Electronic Library Network
* BC Libraries Cooperative
* Kwantlen Polytechnic University
* Simon Fraser University
* University of Victoria

And special thanks to the BC Libraries Cooperative for assisting the organizing group with administrative duties.

Feel free to email Paul Joseph (code4libBC Chair) at paul.joseph@ubc.ca with questions or comments.

'''Lightning Talk Proposals and Hackfest/Breakout Suggestions''': Submit them [https://docs.google.com/forms/d/1NVEGsJZvqNLyqxATdYvNonGuPmlDAFOJn-R2vGpIvWg/viewform here].

=== Schedule ===

==== Thursday ====
{|
| 9:00 || Welcome & Announcements
|-
| || Lightning Talks
* Paul Joseph - Opening Talk
* Linda Woodcock - RDA: 10 Things
* Mark Jordan - Linked Data in SFU's Editorial Cartoons Collection
* Marcus Emmanuel Barnes - [http://www.slideshare.net/MarcusBarnes/code4-lib-bc-2013-lightening-talk SFU Library's METS-Bagger Tool]
* Misty De Meo - Archivematica Format Policy Registry (FPR)
* Cynthia Ng - [http://t.co/vIHCuuGExZ Shifting Perspectives: From Disability Accommodation to Universal Design]
* Stefan Khan-Kernahan - Course Reserves at UBC
* May Chan - [http://ow.ly/rhk3L Hackfests for the Uninitiated]
|-
| 10:30 || Coffee break
|-
| 10:45 || Schedule Jam
|-
| 11:00 || Breakout Sessions
* Connecting Public Services and Library Data (NE side of room) with Janis
* Collaborative Grassroots Archiving with Scott (NW side of room)
* Omeka Plugin with John and Jon (South Central side of room)
* accessibility https://docs.google.com/document/d/13zM-Q84eYJqvfLdYWU8PkAf_z8RbeJC_iskPB5QlSo8/edit
* Learn more about UBC'c Reserves Project
* How to build in accessibility
|-
| 1 Hour || Lunch (On Your Own) [http://eg2013.sitka.bclibraries.ca/social-events/#thursday-lunch Suggestions]
|-
| 3:15 || Break
|-
| 3:30 || Breakout Reports
|-
| 5:00 || Social
|}

==== Friday ====
{|
| 9:00 || Announcements
|-
| || Lightning Talks
* Mark Jordan - DOCR/SMD
* Peter Tyrrell - Parsing PDF into Various Formats
* John Durno - Uploading to Internet Archive via API
* Colleen Bell - Integrating ERM & Libguides Content
* James MacGregor - PKP Article Level Metrics with OJS and OMP
* Jonathan Schatz - The Story of BC Libraries' IT Environments
* Sarah Sutherland - RFP Evaluation Process
* Calvin Mah / Todd Holbrook - SFU Library - Hours Database
|-
| 10:30 || Coffee break
|-
| 11:00 || Breakout Sessions
* New bibliographic environment with May and Mark
* Engaging digital asset viewer
* library hours tool & api
* UBC IT Reorg by Paul
* Learn more about Archivematica
|-
| 1 Hour || Lunch (On Your Own) [http://eg2013.sitka.bclibraries.ca/social-events/#thursday-lunch Suggestions]
|-
| 3:15 || Break
|-
| 3:30 || Breakout Reports
|-
| 4:00 || End of Day
|}

=== '''Lightning Talk Proposals''' ===

John Durno, University of Victoria
* Filling up the Internet Archive using their S3-like API. UVic recently uploaded 750G of old newspapers and metadata (over 15,000 issues) to the IA via their API, based on Amazon's S3, by way of a simple python script making use of the boto library and a wrapper supplied by one of the IA developers. The API proved surprisingly robust, and I'd like to spread the word.

Peter Tyrrell, Andornot
* Setting up Apache Solr to index and search over multiple source types: database and fielded data, Excel/CSV, scanned mags and newspapers, PDFs, word processor documents, websites, geolocations, etc. Focus will be on schema and DataImportHandler considerations, plus amusing anecdotes as time allows.
* Another option would be: scripts that parse a PDF into a TIF, JPG, TXT, and positional XML per page via djvulibre and imagemagick libraries. Make 'em ready for indexing and flexible display.
* I could maybe go over how to (and how NOT to) represent and display hierarchical (cough, archival) data in an Apache Solr index. Mostly this would be a juicy rant about how just how ruddy difficult I found it.

Stefan Khan-Kernahan, The University of British Columbia
* UBC is launching an in-house product for managing course reserves that helps streamline workflows between faculty & library, within library staff (e.g copyright control etc.), and library & student, which I'd like to present on, the content of which would be on completed modules to date and learning lessons for others

Marcus Emmanuel Barnes, Simon Fraser University
* Normalizing existing digitized content into standardized packages for robust long-term management. A report on SFU Library's METS-Bagger tool, with a discussion of the benefits, design principles used for the packaging specification, and potential next steps.

Colleen Bell, University of the Fraser Valley
* I've been using PHP, JSON, and Libguides widgets to integrate Libguides content into our ERM and ERM content into our Libguides. This is particularly useful for libraries using SFU's researcher suite, but could provide ideas for anyone, since the code generated by the PHP can be displayed in any web page.

Mark Jordan, Simon Fraser University
* Libraries are realizing the potential for both exposing their locally managed content as Linked Data and for consuming Linked Data. One of the types of local data that offers a lot of promise for leveraging Linked Data's capabilities is the controlled subject terms applied to local digital collections. I would like to demonstrate how I've enriched SFU's Editorial Cartoons Collection's descriptive metadata with URIs from http://id.loc.gov, paying particular attention to those from the Thesaurus for Graphic Material.
* Explanation and demo of docr/smd, a distributed Optical Character Recognition platform designed to use smartphones and tablets to do the OCR.

May Chan, Burnaby Public Library
* Hackfests for the Uninitiated. For all sorts of reasons, hackfests can be intimidating to first-timers and especially to those who have little or no programming ability. To encourage those new to this form of collaborative learning, my LT will relate key a-ha! moments from my first hackfest experience, especially some difficult truths learned.
* The Code4Lib Conference Gender and Minority Scholarships. One of the ways Code4Lib supports gender and cultural diversity is to offer conference scholarships to women, transgendered persons and persons of ethnic or aboriginal descent. As a way to encourage potential BC applicants, this LT will give some nuanced background on the scholarship program and application process.

Calvin Mah / Todd Holbrook, SFU Library
* SFU Library - Hours Database. The Library Hours Database developed by Todd Holbrook at SFU Library is a tool for managing library hours. The SFU Library hours page is generated by this database: http://www.lib.sfu.ca/about/hours

Sarah Sutherland, Canadian Legal Information Institute
* I would like to discuss the process involved in evaluating the responses to requests for proposals for technology projects. There are often several very good submissions once the basic requirements are met, and at that point it becomes more about the style of the vendor and what kind of project it is. We recently went through this process, so I will use some anonymized examples from our process to illustrate my talk.

Cynthia Ng, CILS @ Langara College
* Shifting Perspectives: From Disability Accommodation to Universal Design 
Too often we design for the "average" user and then tack on accommodations for those with disabilities, but there is no "average" user to speak of, and we all use "assistive" technology. With this presentation, I hope to help shift the way we think about library services and their delivery.

Linda Woodcock, Kwantlen Polytechnic University
* RDA : 10 Things. Walks through an RDA record focusing on new data elements and changes from AACR2. Will talk about benefits to user and possibilities for the future use of new data.

Jonathan Schatz, BC Libraries Cooperative
* This summer a colleague and I toured three library federations BC as "field librarians". These treks were part of a unique project to survey the IT environments of the Co-op's member libraries. In addition to sharing the data with the libraries as actionable status reports, we are developing an app to track all this member data for our support team, allowing for a high-level snapshot of Sitka libraries. I want to tell a quick story about what sorts of configurations and solutions we saw out there, what seem to work, what to avoid and perhaps some DIY tips for technology management for libraries with fewer resources.

James MacGregor, Simon Fraser University Library
* Public Knowledge Project has been working with PLOS to implement article level metrics within OJS and OMP. We are past the initial development stage, with a number of implementations live in production environments. We will discuss the available toolset, and future plans for it.

Misty De Meo, Artefactual Systems
* Archivematica Format Policy Registry (FPR) 
Archivematica is an open-source digital preservation platform. 
Starting with version 1.0, Archivematica has made much of the standard behaviour of Archivematica configurable. The FPR provides a database of the recognized formats in Archivematica along with the rules used to control how files are identified, how metadata is extracted, and how files are normalized, all of which is customizable by users without changing the Archivematica source code. This lightning talk would go over the FPR and what it enables in Archivematica, as well as the open-source FPR administrator app.
* FITS performance optimizations 
Archivematica has begun work on performance improvements to reduce the performance overhead of the FITS file identification tool in digital preservation workflows. This lightning talk would go over the major performance bottlenecks discovered and discuss the ways in which Archivematica is working to improve them.

=== '''Hackfest/Breakout Suggestions''' ===

Requests, but facilitator needed:
* Want to put us where the user is - discuss
* quick github demo: possibly adding yourself as a supporter of Code of Conduct
* collaboratively improve an open source project's crappy documentation
* learn more about archivematica
* want to hear about UBC Reserves

John Durno, University of Victoria
* Develop an Omeka module that uses the Internet Archive to host video and audio content, essentially using Omeka as the front end user interface while taking advantage of the IA's media delivery/streaming capabilities. I envision two components: content and metadata would be uploaded via Omeka's admin interface. The IA's media player would be embedded in the public interface for content delivery.

Stefan Khan-Kernahan, The University of British Columbia
* Building a more engaging digital asset viewer than what is provided by ContentDM/competitors. Details: current digital asset presentation (e.g Content DM), whilst providing all the ""necessary"" information for the user (image + metadata etc.) simply lack in user engagement. If universities are expecting to build interest in these collections among current/future students, they need to cater for a more involved experience. I am proposing an image viewer for digital assets that allows tagging/hotspot that trigger supplementary information beyond metadata (e.g. video explanations of areas on maps, how they came to be etc)

Karen J. Nelson, Capilano Unversity Library
* Could we have a quickie: 1. FRBR explanation. 2. ditto data exchange. 3. ditto linked data. 4. bibframe. 5. WEMI language

Jonathan Jacobsen, Andornot
* I'm working on a virtual exhibit project using Omeka right now, so I second the idea of an Omeka breakout session. Would love to connect with some other Omeka users/developers. In particular, to discuss the Solr plug-in.

Scott Leslie, BC Libraries Cooperative
* [[Creating a toolkit/process for collaborative, grassroots archiving of significant, small BC websites using DIY tools]]

May Chan, Burnaby Public Library, and Mark Jordan, Simon Fraser University
* New bibliographic environment. This breakout session will provide opportunities for us to explore new and emerging models for bibliographic data, such as FRBR, the DCMI Abstract Model, and BIBFRAME with the context of the Resource Description Framework (RDF) and Linked Data. This breakout will take the approach of self-directed learning in a collaborative environment (i.e. there will be no expert talking heads). In the first hour, we will individually review some [http://ow.ly/rb9jo suggested background material]. As we work through the material, we will record topics of interest and questions [http://ow.ly/rb9ql here]. Feel free to add other suggested resources and related topics/questions at any time. In the second hour, based on things learned and topics/questions generated in Hour 1, we will assemble into groups of 2 or 3 and develop a 10-minute 'overview' of one topic/question to explore further. We can sign up for them once we collectively finalize the topics. In the last hour, we will present our overviews to the larger group.

Janis McKenzie, Simon Fraser University
* What do we really know about library use and what can we do with this information? The general idea of this breakout session is to connect those who made decisions about public services (and want to make more informed public service decisions) and those who have access to data on how library resources of all types are being used. The expected outcome would be to work towards identifying the types of activities that reflect how libraries are used today, with a focus on the impact of new, emerging, and future library services.