Re: [CODE4LIB] Data Lifecycle Tracking & Documentation Tools

[davesgonechina]

Hi John,

Good question - we're taking in XLS, CSV, JSON, XML, and on a bad day PDF
of varying file sizes, each requiring different transformation and audit
strategies, on both regular and irregular schedules. New batches often
feature schema changes requiring modification to ingest procedures, which
we're trying to automate as much as possible but obviously require a human
chaperone.

Mediawiki is our default choice at the moment, but then I would still be
looking for a good workflow management model for the structure of the wiki,
especially since in my experience wikis are often a graveyard for the best
intentions.

Dave




On Tue, Mar 10, 2015 at 8:10 PM, Scancella, John  wrote:

> Dave,
>
> How are you getting the metadata streams? Are they actual stream objects,
> or files, or database dumps, etc?
>
> As for the tools, I have used a number of the ones you listed below. I
> personally prefer JIRA (and it is free for non-profit). If you are ok if
> editing in wiki syntax I would recommend mediaWiki (it is what powers
> Wikipedia). You could also take a look at continuous deployment
> technologies like Virtual Machines (virtualbox), linux containers (docker),
> and rapid deployment tools (ansible, salt). Of course if you are doing lots
> of code changes you will want to test all of this continually (Jenkins).
>
> John Scancella
> Library of Congress, OSI
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> davesgonechina
> Sent: Tuesday, March 10, 2015 6:05 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: [CODE4LIB] Data Lifecycle Tracking & Documentation Tools
>
> Hi all,
>
> One of my projects involves harvesting, cleaning and transforming steady
> streams of metadata from numerous publishers. It's an infinite loop but
> every cycle can be a little bit or significantly different. Many issue
> tracking tools are designed for a linear progression that ends in
> deployment, not a circular workflow, and I've not hit upon a tool or use
> strategy that really fits.
>
> The best illustration I've found so far of the type of workflow I'm
> talking about is the DCC Curation Lifecycle Model <
> http://www.dcc.ac.uk/sites/default/files/documents/publications/DCCLifecycle.pdf
> >
> .
>
> Here are some things I've tried or thought about trying:
>
>- Git comments
>- Github Issues
>- MySQL comments
>- Bash script logs
>- JIRA
>- Trac
>- Trello
>- Wiki
>- Unfuddle
>- Redmine
>- Zendesk
>- Request Tracker
>- Basecamp
>- Asana
>
> Thoughts?
>
> Dave
>

Re: [CODE4LIB] Drupal code club

[Riley-Huff, Debra]

Count me in as well!

*Debra Riley-Huff*

Head of Web Services and Associate Professor

The University of Mississippi Libraries

J.D. Williams Library

P.O. Box 1848

University, MS 38677-1848

U.S.A.

1-662-915-7353

riley...@olemiss.edu | libraries.olemiss.edu

On Tue, Mar 10, 2015 at 10:48 AM, Sean Q Hendricks 
wrote:

> I'd be interested as well.
>
> Sean Hendricks
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> Brown, Bryan
> Sent: Wednesday, March 04, 2015 6:31 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: [CODE4LIB] Drupal code club
>
> With the overwhelming response to the recent post about a Python/PyMARC
> code club on the Code4Lib list, I was wondering if anyone would be
> interested in something similar for Drupal. As a Drupal user and a wannabe
> module developer, I'm finding that reading other people's modules
> (especially core) is one of the best ways to really understand what's going
> on under the hood. Much like Python, Drupal has its own unique idioms and
> ways of looking at problems, and reading modules helps one get into this
> mindset.
>
> If anyone else is interested in this, please let me know either through a
> reply to this thread or a direct email (bjbr...@fsu.edu). If there is
> sufficient interest, I'll try to set up something similar to what the
> Python/PyMARC crowd is doing.
>
> - Bryan Brown
>

[CODE4LIB] SAVE THE DATE for Digital Preservation Management Workshop and Call for Applications

[Kari R Smith]

-- Please excuse cross-posting and forward this announcement to colleagues and 
other lists as appropriate --

Digital Preservation Management
Are you responsible for digital preservation at your organization?  Are you 
interested in learning the standards, resources, policies, and work flows 
integral to a successful program?  Do you want to join a cohort of similar 
professionals as you develop your skills and organizational readiness?  Come 
learn how to implement short-term strategies for long-term problems.

We are happy to announce that the five-day Digital Preservation Management 
Workshop directed by Nancy Y. McGovern is taking place this June 14 - 19, 2015 
at Tufts University in Medford, Massachusetts near to Cambridge and Boston.  
Tuition fee for the week is $1,200.00 and includes four lunches and a group 
dinner.  Information 
Website   The 
application system will open on March 16 at 9:00 ET.  No fees are due at time 
of application.

Workshop Goals
Promote Practical and Responsible Stewardship of Digital Assets.  The goals of 
the workshop are to foster critical thinking in a technological realm and 
provide the means for exercising practical and responsible stewardship of 
digital assets in an age of technological uncertainty. The workshop sessions 
are geared towards making a digital preservation program doable for any 
organization and all of the sessions include as many relevant examples as we 
can fit.  The workshop focuses on the decision points involved in responding to 
ongoing technological changes while managing digital content across the life 
cycle.

Workshop Audience
The workshop series is intended for managers who are or will be responsible for 
digital preservation programs in libraries, archives, and other cultural 
institutions.

Faculty for June 2015
The faculty for the workshop will include Dr. Nancy Y. McGovern, Kari R. Smith, 
Courtney Mumma, and Brad Westbrook. Link 
here for information 
about each instructor.  We are very pleased that our keynote speaker will be 
Dr. Katherine Skinner, Executive Director of the Educopia Institute.

Workshop Content
The workshop includes interactive presentations, group discussions, exercises, 
individual assignments, and a keynote presentation by an international expert 
in digital preservation. Workshop attendees explore the range of components 
needed to develop an effective digital preservation program. Workshop materials 
include action plans for organizations to complete when participants return to 
their institutions. Action plans result in organization-specific plans that 
incorporate technical, financial, organizational, and policy aspects 
encompassing the full life cycle of digital objects. The workshop focuses on 
strategies for organizations to implement now, while research and development 
goes forward in creating longer-term solutions that can be incorporated into 
the program framework.

As a prerequisite for the workshop, we ask participants to work through the 
Digital Preservation Management Tutorial - a free resource for anyone 
interested in learning the foundations for digital preservation and as a 
starting point for advanced discussions.  The tutorial is online at:  
www.workshop.org.

Please let us know if you have questions about the workshop.
dpmw-managem...@mit.edu

Your Digital Preservation Management Workshop Team and
Director, Nancy Y. McGovern

[CODE4LIB] Internet Archive API

[Karlsen, Jeffrey]

I'm wondering if anyone out there has much experience working with the Internet 
Archive JSON API.

It appears to me that if my items at archive.org have reliable key/value 
metadata, I should be able to e.g. populate a web page with links, thumbnails 
etc. to, say, issues of a newspaper from a given year or month. But I have 
really not found any such examples in the wild and my searching has not turned 
up any info on using it outside of their own page:
https://archive.org/help/json.php

If anyone can help with links, examples etc., I'd really appreciate it.

--
Jeff Karlsen
Librarian & Library Dept Chair
Sacramento City College
(916) 558-2583
www.scc.losrios.edu/library

[CODE4LIB] Library CMS

[Kun Lin]

Hi

I just want to check is there anyone using concrete5 as their CMS? How
does it performs?

 

Thanks

Kun Lin 

[CODE4LIB] Library Juice Academy courses offered in March and April

[Rory Litwin]

Library Juice Academy courses offered in March and April


Most of these classes are four weeks in length, with a price of $175.

We accept registrations through the first week of class.

Classes are taught asynchronously, so participants can do the work as their
schedules allow.

Details on these courses are at http://libraryjuiceacademy.com/courses.php

Share as appropriate, and apologies for cross-posting.


April

Metadata Design
Grace Agnew

Evaluating Service Quality and Patron Satisfaction
Jennifer Sweeney

Do-It-Yourself Usability Testing
Rebecca Blakiston

Planning and Leading Productive Meetings
Deborah Schmidle

Digital Scholarship: New Metrics, New Modes
Marcus Banks

Game-Based Learning in Library Instruction
Scott Rice

Library Makerspaces: From Dream to Reality
Melissa Robinson

Introduction to the Semantic Web
Robert Chavez

Beginning Programming in Python, Part I
Tony Castelletto

Wikipedia: Library Initiatives and Expert Editing
Megan Wacha

Threshold Concepts in the Information Literacy Classroom: Translating the
ACRL Framework for Information Literacy into Our Teaching Practices
Andrea Baer


May

Introduction to Project Management
Robin Hastings

Metadata Implementation
Grace Agnew

Easy Patron Surveys
Jennifer Sweeney

Assessing and Improving Your Library's Social Media Presence
Julia Skinner

Research Data Management
Jillian Wallis

PHP and APIs
Caleb Tucker-Raymond

Strategic Planning: Setting Directions for the Future
Deborah Schmidle

Trends in Library Automation
Mandy Henk

The Sustainability Movement on Campus: Forming a Library Action Plan for
Engagement
Madeleine Charney

Beginning Programming in Python, Part II
Tony Castelletto

RDFa1.1 (RDFa and RDFa Lite) and RSS
Robert Chavez

Visual Analytics with D3.js
Olga Buchel

Information Literacy, Composition Studies and Higher Order Thinking
Andrea Baer


While academic programs focus on conceptual understanding of foundations,
we focus on the kinds of skills that library schools generally expect
librarians to learn on-the-job, but which usually turn out to require
additional study. These workshops earn Continuing Education Units, and are
intended as professional development activities. Workshops are taught
asynchronously, so you can participate as your own schedule allows.


Library Juice Academy
P.O. Box 188784
Sacramento, CA 95818
Tel. 218-260-6115
Fax 916-415-5446

inquir...@libraryjuiceacademy.com
http://libraryjuiceacademy.com/

Testimonials:
http://libraryjuiceacademy.com/testimonial.php

Twitter:
http://twitter.com/libjuiceacademy

Check out our jingle:
http://libraryjuiceacademy.com/news/?p=139

Re: [CODE4LIB] Drupal code club

[Sean Q Hendricks]

I'd be interested as well.

Sean Hendricks

-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Brown, 
Bryan
Sent: Wednesday, March 04, 2015 6:31 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: [CODE4LIB] Drupal code club

With the overwhelming response to the recent post about a Python/PyMARC code 
club on the Code4Lib list, I was wondering if anyone would be interested in 
something similar for Drupal. As a Drupal user and a wannabe module developer, 
I'm finding that reading other people's modules (especially core) is one of the 
best ways to really understand what's going on under the hood. Much like 
Python, Drupal has its own unique idioms and ways of looking at problems, and 
reading modules helps one get into this mindset.

If anyone else is interested in this, please let me know either through a reply 
to this thread or a direct email (bjbr...@fsu.edu). If there is sufficient 
interest, I'll try to set up something similar to what the Python/PyMARC crowd 
is doing.

- Bryan Brown

Re: [CODE4LIB] Data Lifecycle Tracking & Documentation Tools

[Scancella, John]

Dave,

How are you getting the metadata streams? Are they actual stream objects, or 
files, or database dumps, etc?

As for the tools, I have used a number of the ones you listed below. I 
personally prefer JIRA (and it is free for non-profit). If you are ok if 
editing in wiki syntax I would recommend mediaWiki (it is what powers 
Wikipedia). You could also take a look at continuous deployment technologies 
like Virtual Machines (virtualbox), linux containers (docker), and rapid 
deployment tools (ansible, salt). Of course if you are doing lots of code 
changes you will want to test all of this continually (Jenkins).

John Scancella
Library of Congress, OSI  

-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of 
davesgonechina
Sent: Tuesday, March 10, 2015 6:05 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: [CODE4LIB] Data Lifecycle Tracking & Documentation Tools

Hi all,

One of my projects involves harvesting, cleaning and transforming steady 
streams of metadata from numerous publishers. It's an infinite loop but every 
cycle can be a little bit or significantly different. Many issue tracking tools 
are designed for a linear progression that ends in deployment, not a circular 
workflow, and I've not hit upon a tool or use strategy that really fits.

The best illustration I've found so far of the type of workflow I'm talking 
about is the DCC Curation Lifecycle Model 

.

Here are some things I've tried or thought about trying:

   - Git comments
   - Github Issues
   - MySQL comments
   - Bash script logs
   - JIRA
   - Trac
   - Trello
   - Wiki
   - Unfuddle
   - Redmine
   - Zendesk
   - Request Tracker
   - Basecamp
   - Asana

Thoughts?

Dave

[CODE4LIB] Data Lifecycle Tracking & Documentation Tools

[davesgonechina]

Hi all,

One of my projects involves harvesting, cleaning and transforming steady
streams of metadata from numerous publishers. It's an infinite loop but
every cycle can be a little bit or significantly different. Many issue
tracking tools are designed for a linear progression that ends in
deployment, not a circular workflow, and I've not hit upon a tool or use
strategy that really fits.

The best illustration I've found so far of the type of workflow I'm talking
about is the DCC Curation Lifecycle Model

.

Here are some things I've tried or thought about trying:

   - Git comments
   - Github Issues
   - MySQL comments
   - Bash script logs
   - JIRA
   - Trac
   - Trello
   - Wiki
   - Unfuddle
   - Redmine
   - Zendesk
   - Request Tracker
   - Basecamp
   - Asana

Thoughts?

Dave