May 30, 2018

Time/Place

This meeting is a hybrid teleconference and IRC chat. Anyone is welcome to join. Here is the info:

• Time: 1:00pm Eastern Daylight Time US (UTC-4)
• Dial-in Number: (641) 715-3570
  • Participant Code: 304589#
  • International numbers: Conference Call Information
  • Web Access: https://www.freeconferencecallhd.com/wp-content/themes/responsive/flashphone/flash-phone.php
• IRC:
  • Join the #islandora chat room via Freenode Web IRC (enter a unique nick)
  • Or point your IRC client to #islandora on irc.freenode.net

Attendees

• Paul Pound
• Seth Shaw
• Jared Whiklo
• Andrija Sagic
• Yamil Suarez
• Jonathan Green
• Natkeeran
• Minnie Rangel
• Dieago Pino

Agenda

1. https://github.com/Islandora-CLAW/islandora/pull/86 is green
2. https://github.com/dannylamb/islandora/tree/flysystem It works... but needs work.
3. https://github.com/Islandora-CLAW/Crayfish/pull/46 needs CENTOS testers.
   1. http://symfony.com/blog/the-end-of-silex :(
   2. The end of PHP 5 support in Symfony
4. ... (feel free to add agenda items)

Minutes

drupal-project composer lock issue and the major PR - https://github.com/Islandora-CLAW/islandora/pull/86 is green

Danny - We were not originally using composer lock file in the drupal-project fork. This caused some issues. This issue has been resolved. This will save memory and make the deployment faster. This major PR is ready for merging.

flysystem Integration, Fedora Adaptor - https://github.com/dannylamb/islandora/tree/flysystem

"Flysystem is a filesystem abstraction which allows you to easily swap out a local filesystem for a remote one." Drupal provides support to use flysystem to manage Drupal files. Danny has extended that to support putting drupal files into Fedora: https://github.com/dannylamb/islandora/tree/flysystem/src/Flysystem. This PR allows for file fields to be configured to be stored in Fedora. Drupal will act like a proxy for these files. There are some clean up that is needed in Alpaca and other modules due to this work.

This integration allows various file systems including S3 to be used as filesystem for Drupal.It addresses the issue of storage duplication.

Jared - Are we moving from async to sync indexing in Fedora?

Danny - Yes, if we put files in Fedora. Previously we put files in the Drupal filesystem synchronously and then pushed out to Fedora asynchronously. Using flysystem means we will be writing those binaries directly to Fedora.

Seth - Flysystem allows for files to be mirrored in multiple storage systems. Also, there is issue with Cantaloupe, where it expects to work with Drupal file system.

Danny - Can Cantaloupe be configured to point to http resolves?

Seth - Yes, possibly.

Jared - Following are some immediate concerns. 1) Where do we configure/define the file system? 2) Would it be possible to allow Fedora to store files externally (i.e disc)? Do we need Gemini?

Danny - Yes, we still need Gemini to do look up. The filesystem can be configured in the form fields. Currently there is no option for the user to choose the file system on ingest. My design choices takes the Fedora external file/link use case into consideration. When the file gets create, instructions can be passed onto Fedora. Fedora can act as a proxy.

Jared - I want to make sure Fedora has all the information. In the long term, we may be able to restore Drupal from Fedora. At the same I don't want to manage the derivatives/files inside Fedora! . Diego - flysystem only provides the streamwrappers and the back functionality, but we still need to tell Drupal, this form uploads to that streamwrapper right?

Seth - Yes.

Danny - MIME info is not available in the Flysystem level. Thus, currently when we create the files in Fedora, they are simple binary files. We will need to develop a MIME type guesser using tools such as FITS to determine the MIME type and other information before pushing to Fedora.

Danny - Also, the following modules work with flysystem: entity_browser and file_browser.

Gemini Schema changes for CENTOS, Symfony/Console, Support Matrix - https://github.com/Islandora-CLAW/Crayfish/pull/46 needs CENTOS testers.

Dieago - This PR address the issue related to primary key max size issue. It converts the URIs used for primary keys into hash and uses the hash as the primary keys. It also installs Symfony/Console. This allows you to use the DoctrineMigrations to modify and manage modifications to database schemas.

Danny - Would it auto generate migrations?

Dieago - In Sympohy4, it will generate auto generate migrations. It has a robust system to generate and apply schema updates. I've created using Symphony and brought it into silex! https://github.com/Islandora-CLAW/Crayfish/pull/46/files#diff-fa3aef35b9f8037b887c6c3a21b734d0

Dieago - In Symphony 4, you can deploy the application in different environment by setting variables.

Support Matrix

Jared - Smithsonian and others need to provide feedback with respect to PHP5. We need to create a support matrix to clarify the ecosystem we plan to support.

Diego - We can consider using Docker containers to support some environments. I've used Docker image with Alpine base that helps to lower the barrier to implementation.

Jared - There are barriers to use docker. We should not make it a requirement.

Danny - Adam's policy is the most conservative and restrictive. ISLE project may provide for Docker deployment. However, we must provide bare-metal deployments.

Yamil - Our claw playbook works on Php 7 in CentOS.

Danny - Yes, we need to establish a clear support matrix and stick to it.