Openverse Monthly Priorities Meeting 2024-04-03

OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. contributors will host a community meeting to discuss priorities for April at 1500 UTC on April 3rd, 2024.

A sync video chat link will be provided in the #openverse channel of the Making WordPress Chat. We hope to see you there!

You can read the ongoing notes document for these meetings here.

#openverse-priorities, #priorities

Community Meeting Recap (2024-03-25)

[Meeting start]

We had 1 item on our agenda:

What’s the plan for launching additional search views? Can we this week? Should we draft a make post; do we need a rollback plan (in case the APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. changes caused trouble in prod, for example)?

There is still work to be done before launching the project, specifically:

  1. Use search query parameters for additional search views in the API #3887
  2. Add SEO properties to the collection pages #3917 (needs discussion)

After completing the issues, we can discuss the details of the launch.

[Meeting end]

#openverse-weekly-community-meeting

A week in Openverse: 2024-03-18 – 2024-03-25

openverse

Merged PRs

  • #3956: Publish changelog for catalog-2024.03.22.17.45.11
  • #3954: Add debug logs to renovate
  • #3953: Bump jwcrypto from 1.5.4 to 1.5.6 in /api
  • #3952: Update pinia and vue-demi
  • #3951: Adds locale to the locale kebab-case warnings
  • #3950: Link to OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. in Documentation site root
  • #3942: Fix the skip-to-content link reloading the results
  • #3933: Publish changelog for frontend-2024.03.18.15.51.41
  • #3932: Publish changelog for api-2024.03.18.15.51.25
  • #3931: Fix audio alt files missing bit rate
  • #3928: Use DAG_DEFAULT_ARGS for all DAGs
  • #3850: Centralise frontend error reporting (and suppress unactionable Sentry errors)
  • #3836: Add accesstoken and ThrottledApplication to admin panel
  • #3835: Use the `VMediaCollection` for search and collection results
  • #3808: Cleanup tag display for long lists of tags
  • #3760: Implementation Plan: Content moderation metrics

Closed issues

  • #3940: Using "skip to content" button on search results page clears result counts (staging only)
  • #3939: Unmet `pinia` peer dependency (version issue)
  • #3938: Kebab-cased translation key warning when running `just p frontend i18n`
  • #3930: KeyError: "Got KeyError when attempting to get a value for field `bit_rate` on serializer `AudioAltFileSeri…
  • #3884: Search results are not updated when filters are unchecked but the search term is the same
  • #3830: Navigating between additional search views and single result pages and back does not update the single image
  • #3821: Clean up APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. URLURL A specific web address of a website or web page on the Internet, such as a website’s URL www.wordpress.org environment variables
  • #3803: Not all DAGs have `DAG_DEFAULT_ARGS` applied
  • #3711: Add access token and throttled application models to Django admin
  • #3576: Returning to results from the new content views does not load previously-loaded pages
  • #3468: Avoid `AxiosError` when requesting bad image links
  • #2589: Cleanup tag display with long lists of tags
  • #1970: Implementation Plan: Moderation queue metrification
  • #1163: Update the Priority custom fieldCustom Field Custom Field, also referred to as post meta, is a feature in WordPress. It allows users to add additional information when writing a post, eg contributors’ names, auth. WordPress stores this information as metadata. Users can display this meta data by using template tags in their WordPress themes. when the issue priority label changes
  • #1126: Implementation Plan: Rekognition Data Evaluation
  • #1459: Surface materialized views in view names
  • #1473: Investigate Data Refreshes blocking during popularity steps
  • #1662: Catalog database/ingestion overhaul
  • #1667: No descriptions for audio files
  • #744: Add Rawpixel to authority data as `CURATED`
  • #1765: Come up with a solution for consuming crawler events (original #457)
  • #1791: Scrape CC REL data to identify CC-licensed images (original #182)
  • #1790: Feed new images to the crawler (original #456)

openverse-infrastructure

Merged PRs

  • #828: Bump catalog airflow version to rel-2024.03.22.17.45.11
  • #827: Update Nuxt HTTPHTTP HTTP is an acronym for Hyper Text Transfer Protocol. HTTP is the underlying protocol used by the World Wide Web and this protocol defines how messages are formatted and transmitted, and what actions Web servers and browsers should take in response to various commands. 5xx responses runbook link
  • #826: Restrict SSHSSH Secure SHell - a protocol for securely connecting to a remote system in addition to or in place of a password. ingress on all non-bastion services to within the VPC
  • #825: Remove sudo calls from ingestion server init
  • #824: Remove API environment variables that are no longer used
  • #819: Remove Airflow email settings

Closed issues

  • #789: Drop SSH ingress from outside of the VPC on all EC2 instances (except the SSH bastion)
  • #548: Remove unnecessary calls to `sudo` from ingestion server user-data script
  • #258: Remove Airflow SMTP settings

#openverse, #week-in-openverse

Community Meeting Recap (2024-03-18)

[Meeting start]

We had 1 item on our agenda:

When should we add ccMixter to the Django Admin content provider list? And should we make a public announcement about their addition?

We decided to keep this item on the Agenda for the next week, and clarify some problems with it in the mean time:

  1. The preview URLs don’t work on the frontend, so the users cannot play them. @aetherunbound offered to contact ccMixter to clarify if we are using their APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. correctly, and how we can fix the preview URLs.
  2. The API returns 500 due to the AudioAltFile serializer.

[Meeting end]

#openverse-weekly-community-meeting

A week in Openverse: 2024-03-11 – 2024-03-18

openverse

Merged PRs

  • #3929: Remove unused APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. variables from environment template
  • #3915: Remove leftover files from catalog
  • #3911: Publish changelog for api-2024.03.13.17.10.22
  • #3909: Freesound: handle space in creator name when making URLURL A specific web address of a website or web page on the Internet, such as a website’s URL www.wordpress.org
  • #3907: ccMixter: Handle spaces in URLs
  • #3905: ccMixter: Handle bad numbers with a decimal point
  • #3903: ES healthcheck: skip message composition task when cluster is green
  • #3899: Enable Users and Groups in the Django Admin UIUI UI is an acronym for User Interface - the layout of the page the user interacts with. Think ‘how are they doing that’ and less about what they are doing.
  • #3898: Publish changelog for api-2024.03.11.15.26.16
  • #3897: Publish changelog for frontend-2024.03.11.15.25.54
  • #3892: Correct `ADDITIONAL_DOMAINS` to `ALTERNATIVE_DOMAINS`
  • #3890: Add point_alias DAG and add alias params to create_new_es_index DAGs
  • #3874: Recover from updated build_param in Phylopic DAG
  • #3868: Update the Additional search views IP
  • #3848: Implementation plan: Catalog Data Cleaning
  • #3780: Add source links to creator pages

Closed issues

  • #3908: Freesound: Space present in URL
  • #3906: ccMixter: Space present in URL
  • #3902: Elasticsearch cluster health check fails to notify
  • #3901: ccMixter DAG ingestion processing error
  • #3820: Phylopic ingestion may fail if `build` changes during processing
  • #3791: Unable to visit creator page if creator name has `/` in it
  • #3633: Establish preliminary Django admin access control for content moderator users
  • #3496: Link to source on creator view
  • #3493: Make a DAG for pointing ES aliases
  • #1369: Bubble up original exception when retries have exceeded
  • #1557: Audit `tags` field for images

openverse-infrastructure

Merged PRs

  • #823: Add provider and collaborator contact information

#openverse, #week-in-openverse

Community Meeting Recap (2024-03-11)

[Meeting start]

This meeting didn’t have any agenda items. We did however discuss and confirm that we should always create GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ issues for necessary project documents (implementation and project plans, for example).

[Meeting end]

#openverse-weekly-community-meeting

A week in Openverse: 2024-03-04 – 2024-03-11

openverse

Merged PRs

  • #3888: Extend timeout on iNaturalist table loads
  • #3882: Publish changelog for ingestion_server-2024.03.06.16.40.36
  • #3881: Publish changelog for catalog-2024.03.06.16.40.36
  • #3880: Fix flaky content report form test
  • #3879: Fix prettier errors
  • #3878: Update documentation for how to perform rollbacks
  • #3873: Publish changelog for frontend-2024.03.04.15.15.07
  • #3872: Publish changelog for api-2024.03.04.15.15.13
  • #3871: Fix Vale by passing files to process instead of a glob to ignore
  • #3867: Fix pr_ping typo
  • #3866: Use query parameters for additional search views in Nuxt
  • #3862: Update dependency prettier-pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party-tailwindcss to v0.5.11
  • #3857: Update docker.io/nginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. Docker tag to v1.25.4
  • #3853: Update dependency apacheApache Apache is the most widely used web server software. Developed and maintained by Apache Software Foundation. Apache is an Open Source software available for free.-airflow to v2.8.2 [SECURITY]
  • #3852: Add copyright disclaimer text
  • #3846: Various iNaturalist updates
  • #3845: Preemptively fail unparsable/unusable Europeana URLs
  • #3831: Combine related media component using `VMediaCollection.vue`
  • #3822: Introduce and use new APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. domain environment variables
  • #3796: Update recent searches to match updated mockups

Closed issues

  • #3864: Replace Additional search views path parameters with query parameters
  • #3832: Related audio does not send `relatedTo` prop in analytics
  • #3764: Vale sometimes fails to run, complaining of non-existent files
  • #3761: `create_proportional_by_source_staging_index` DAG does not base proportions off source index
  • #3631: Update Catalog of Life data source url for iNaturalist DAG
  • #3194: Recent searches popover improvement
  • #2807: Add copy explaining photography containing copyrighted works
  • #2784: Europeana data ingester can return `None` in URLURL A specific web address of a website or web page on the Internet, such as a website’s URL www.wordpress.org
  • #2020: Flaky test: `content-report-form` `focused-close-button`
  • #1541: Create runbook for handling reported media

openverse-infrastructure

Merged PRs

  • #822: Add Sara's new gpg key
  • #820: Add airflow.openverse.org to Cf access
  • #818: Bump ingestion server to rel-2024.03.06.16.40.36
  • #817: Bump catalog to rel-2024.03.06.16.40.36
  • #816: Try increasing frontend grace period to 3 seconds
  • #814: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.

Closed issues

  • #811: Failed staging-frontend deployment
  • #773: Add `airflow.openverse.org` to Cloudflare access

#openverse, #week-in-openverse

A week in Openverse: 2024-02-26 – 2024-03-04

openverse

Merged PRs

  • #3861: Update dependency fakeredis to v2.21.1
  • #3859: Update dependency @playwright/test to v1.42.0
  • #3858: Update workflows
  • #3856: Update dependency pook to v1.4.3
  • #3855: Update dependency elasticsearch to v8.12.1
  • #3854: Update Node.js to v18.19.1
  • #3851: Use GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ script to handle JSONJSON JSON, or JavaScript Object Notation, is a minimal, readable format for structuring data. It is used primarily to transmit data between a server and web application, as an alternative to XML. escaping in SlackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. message
  • #3849: Remove references to api-dev
  • #3839: Publish changelog for ingestion_server-2024.02.28.18.32.08
  • #3838: Publish changelog for api-2024.02.28.16.32.28
  • #3837: Rename verbose plural "mature" to "sensitive" in APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. admin
  • #3834: Add Free Music Archive to external sources in the frontend
  • #3829: Publish changelog for frontend-2024.02.26.18.58.35
  • #3828: Make User-Agent a default headerHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes.
  • #3826: Extend Europeana timeout
  • #3811: Turn analytics composable into a pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party
  • #3810: Use infrequent access when uploading provider TSVs
  • #3786: Add a documentation page describing the different parts of the OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. stack
  • #3769: `mature` -> `sensitive` code changes for the API
  • #3763: Add proportional staging index dag
  • #3719: Implementation Plan: Bulk moderation actions
  • #3528: Replaced `get_token_info` calls with the `request.auth.application`
  • #3444: Add API schema tests using schemathesis

Closed issues

  • #3781: `Send Slack message` CI step failure
  • #3723: `mature` -> `sensitive` code changes for the API
  • #3514: Remove unnecessary `get_token_info`
  • #3488: Create a DAG for creating es indices proportional by provider
  • #3446: Use property-based testing for the API
  • #3201: Add a documentation page describing the different parts of our stack
  • #2486: Add Free Music Archive to the "External Sources" frontend feature
  • #1967: Implementation Plan: Bulk moderation actions
  • #1362: Include UA string on every request made by the DelayedRequester
  • #1787: Archive TSVs saved on S3 at lower (cheaper) access level (original #376)

openverse-infrastructure

Merged PRs

  • #812: 🔄 synced file(s) with WordPress/openverse
  • #810: Remove unnecessary `register_with_target_group`
  • #809: Bump ingestion server version
  • #808: Add openverse-catalog bucket lifecycle rule
  • #805: Add new API domain environment variables
  • #804: Extract load balancer listener management out of generic service modules

Closed issues

  • #772: Remove register_with_target_group option from ec2-service to simplify the module
  • #771: Extract security group configuration out of `generic/service` and `generic/ec2-service` into new security group module
  • #770: Extract load balancer rule and cloudflare domain provisioning out of `generic/service` and `generic/ec2-service`

#openverse, #week-in-openverse

Openverse Monthly Priorities Meeting 2024-03-06

OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. contributors will host a community meeting to discuss priorities for March at 1700 UTC on March 6th, 2024.

A sync video chat link will be provided in the #openverse channel of the Making WordPress Chat. We hope to see you there!

You can read the ongoing notes document for these meetings here.

#openverse-priorities, #priorities

Community Meeting Recap (2024-02-26)

[Meeting start]

Agenda

[Meeting end]

#openverse-weekly-community-meeting