A week in Openverse: 2024-03-18 – 2024-03-25

openverse

Merged PRs

  • #3956: Publish changelog for catalog-2024.03.22.17.45.11
  • #3954: Add debug logs to renovate
  • #3953: Bump jwcrypto from 1.5.4 to 1.5.6 in /api
  • #3952: Update pinia and vue-demi
  • #3951: Adds locale to the locale kebab-case warnings
  • #3950: Link to OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. in Documentation site root
  • #3942: Fix the skip-to-content link reloading the results
  • #3933: Publish changelog for frontend-2024.03.18.15.51.41
  • #3932: Publish changelog for api-2024.03.18.15.51.25
  • #3931: Fix audio alt files missing bit rate
  • #3928: Use DAG_DEFAULT_ARGS for all DAGs
  • #3850: Centralise frontend error reporting (and suppress unactionable Sentry errors)
  • #3836: Add accesstoken and ThrottledApplication to admin panel
  • #3835: Use the `VMediaCollection` for search and collection results
  • #3808: Cleanup tag display for long lists of tags
  • #3760: Implementation Plan: Content moderation metrics

Closed issues

  • #3940: Using "skip to content" button on search results page clears result counts (staging only)
  • #3939: Unmet `pinia` peer dependency (version issue)
  • #3938: Kebab-cased translation key warning when running `just p frontend i18n`
  • #3930: KeyError: "Got KeyError when attempting to get a value for field `bit_rate` on serializer `AudioAltFileSeri…
  • #3884: Search results are not updated when filters are unchecked but the search term is the same
  • #3830: Navigating between additional search views and single result pages and back does not update the single image
  • #3821: Clean up APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. URLURL A specific web address of a website or web page on the Internet, such as a website’s URL www.wordpress.org environment variables
  • #3803: Not all DAGs have `DAG_DEFAULT_ARGS` applied
  • #3711: Add access token and throttled application models to Django admin
  • #3576: Returning to results from the new content views does not load previously-loaded pages
  • #3468: Avoid `AxiosError` when requesting bad image links
  • #2589: Cleanup tag display with long lists of tags
  • #1970: Implementation Plan: Moderation queue metrification
  • #1163: Update the Priority custom fieldCustom Field Custom Field, also referred to as post meta, is a feature in WordPress. It allows users to add additional information when writing a post, eg contributors’ names, auth. WordPress stores this information as metadata. Users can display this meta data by using template tags in their WordPress themes. when the issue priority label changes
  • #1126: Implementation Plan: Rekognition Data Evaluation
  • #1459: Surface materialized views in view names
  • #1473: Investigate Data Refreshes blocking during popularity steps
  • #1662: Catalog database/ingestion overhaul
  • #1667: No descriptions for audio files
  • #744: Add Rawpixel to authority data as `CURATED`
  • #1765: Come up with a solution for consuming crawler events (original #457)
  • #1791: Scrape CC REL data to identify CC-licensed images (original #182)
  • #1790: Feed new images to the crawler (original #456)

openverse-infrastructure

Merged PRs

  • #828: Bump catalog airflow version to rel-2024.03.22.17.45.11
  • #827: Update Nuxt HTTPHTTP HTTP is an acronym for Hyper Text Transfer Protocol. HTTP is the underlying protocol used by the World Wide Web and this protocol defines how messages are formatted and transmitted, and what actions Web servers and browsers should take in response to various commands. 5xx responses runbook link
  • #826: Restrict SSHSSH Secure SHell - a protocol for securely connecting to a remote system in addition to or in place of a password. ingress on all non-bastion services to within the VPC
  • #825: Remove sudo calls from ingestion server init
  • #824: Remove API environment variables that are no longer used
  • #819: Remove Airflow email settings

Closed issues

  • #789: Drop SSH ingress from outside of the VPC on all EC2 instances (except the SSH bastion)
  • #548: Remove unnecessary calls to `sudo` from ingestion server user-data script
  • #258: Remove Airflow SMTP settings

#openverse, #week-in-openverse

A week in Openverse: 2024-03-11 – 2024-03-18

openverse

Merged PRs

  • #3929: Remove unused APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. variables from environment template
  • #3915: Remove leftover files from catalog
  • #3911: Publish changelog for api-2024.03.13.17.10.22
  • #3909: Freesound: handle space in creator name when making URLURL A specific web address of a website or web page on the Internet, such as a website’s URL www.wordpress.org
  • #3907: ccMixter: Handle spaces in URLs
  • #3905: ccMixter: Handle bad numbers with a decimal point
  • #3903: ES healthcheck: skip message composition task when cluster is green
  • #3899: Enable Users and Groups in the Django Admin UIUI UI is an acronym for User Interface - the layout of the page the user interacts with. Think ‘how are they doing that’ and less about what they are doing.
  • #3898: Publish changelog for api-2024.03.11.15.26.16
  • #3897: Publish changelog for frontend-2024.03.11.15.25.54
  • #3892: Correct `ADDITIONAL_DOMAINS` to `ALTERNATIVE_DOMAINS`
  • #3890: Add point_alias DAG and add alias params to create_new_es_index DAGs
  • #3874: Recover from updated build_param in Phylopic DAG
  • #3868: Update the Additional search views IP
  • #3848: Implementation plan: Catalog Data Cleaning
  • #3780: Add source links to creator pages

Closed issues

  • #3908: Freesound: Space present in URL
  • #3906: ccMixter: Space present in URL
  • #3902: Elasticsearch cluster health check fails to notify
  • #3901: ccMixter DAG ingestion processing error
  • #3820: Phylopic ingestion may fail if `build` changes during processing
  • #3791: Unable to visit creator page if creator name has `/` in it
  • #3633: Establish preliminary Django admin access control for content moderator users
  • #3496: Link to source on creator view
  • #3493: Make a DAG for pointing ES aliases
  • #1369: Bubble up original exception when retries have exceeded
  • #1557: Audit `tags` field for images

openverse-infrastructure

Merged PRs

  • #823: Add provider and collaborator contact information

#openverse, #week-in-openverse

A week in Openverse: 2024-03-04 – 2024-03-11

openverse

Merged PRs

  • #3888: Extend timeout on iNaturalist table loads
  • #3882: Publish changelog for ingestion_server-2024.03.06.16.40.36
  • #3881: Publish changelog for catalog-2024.03.06.16.40.36
  • #3880: Fix flaky content report form test
  • #3879: Fix prettier errors
  • #3878: Update documentation for how to perform rollbacks
  • #3873: Publish changelog for frontend-2024.03.04.15.15.07
  • #3872: Publish changelog for api-2024.03.04.15.15.13
  • #3871: Fix Vale by passing files to process instead of a glob to ignore
  • #3867: Fix pr_ping typo
  • #3866: Use query parameters for additional search views in Nuxt
  • #3862: Update dependency prettier-pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party-tailwindcss to v0.5.11
  • #3857: Update docker.io/nginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. Docker tag to v1.25.4
  • #3853: Update dependency apacheApache Apache is the most widely used web server software. Developed and maintained by Apache Software Foundation. Apache is an Open Source software available for free.-airflow to v2.8.2 [SECURITY]
  • #3852: Add copyright disclaimer text
  • #3846: Various iNaturalist updates
  • #3845: Preemptively fail unparsable/unusable Europeana URLs
  • #3831: Combine related media component using `VMediaCollection.vue`
  • #3822: Introduce and use new APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. domain environment variables
  • #3796: Update recent searches to match updated mockups

Closed issues

  • #3864: Replace Additional search views path parameters with query parameters
  • #3832: Related audio does not send `relatedTo` prop in analytics
  • #3764: Vale sometimes fails to run, complaining of non-existent files
  • #3761: `create_proportional_by_source_staging_index` DAG does not base proportions off source index
  • #3631: Update Catalog of Life data source url for iNaturalist DAG
  • #3194: Recent searches popover improvement
  • #2807: Add copy explaining photography containing copyrighted works
  • #2784: Europeana data ingester can return `None` in URLURL A specific web address of a website or web page on the Internet, such as a website’s URL www.wordpress.org
  • #2020: Flaky test: `content-report-form` `focused-close-button`
  • #1541: Create runbook for handling reported media

openverse-infrastructure

Merged PRs

  • #822: Add Sara's new gpg key
  • #820: Add airflow.openverse.org to Cf access
  • #818: Bump ingestion server to rel-2024.03.06.16.40.36
  • #817: Bump catalog to rel-2024.03.06.16.40.36
  • #816: Try increasing frontend grace period to 3 seconds
  • #814: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.

Closed issues

  • #811: Failed staging-frontend deployment
  • #773: Add `airflow.openverse.org` to Cloudflare access

#openverse, #week-in-openverse

A week in Openverse: 2024-02-26 – 2024-03-04

openverse

Merged PRs

  • #3861: Update dependency fakeredis to v2.21.1
  • #3859: Update dependency @playwright/test to v1.42.0
  • #3858: Update workflows
  • #3856: Update dependency pook to v1.4.3
  • #3855: Update dependency elasticsearch to v8.12.1
  • #3854: Update Node.js to v18.19.1
  • #3851: Use GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ script to handle JSONJSON JSON, or JavaScript Object Notation, is a minimal, readable format for structuring data. It is used primarily to transmit data between a server and web application, as an alternative to XML. escaping in SlackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. message
  • #3849: Remove references to api-dev
  • #3839: Publish changelog for ingestion_server-2024.02.28.18.32.08
  • #3838: Publish changelog for api-2024.02.28.16.32.28
  • #3837: Rename verbose plural "mature" to "sensitive" in APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. admin
  • #3834: Add Free Music Archive to external sources in the frontend
  • #3829: Publish changelog for frontend-2024.02.26.18.58.35
  • #3828: Make User-Agent a default headerHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes.
  • #3826: Extend Europeana timeout
  • #3811: Turn analytics composable into a pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party
  • #3810: Use infrequent access when uploading provider TSVs
  • #3786: Add a documentation page describing the different parts of the OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. stack
  • #3769: `mature` -> `sensitive` code changes for the API
  • #3763: Add proportional staging index dag
  • #3719: Implementation Plan: Bulk moderation actions
  • #3528: Replaced `get_token_info` calls with the `request.auth.application`
  • #3444: Add API schema tests using schemathesis

Closed issues

  • #3781: `Send Slack message` CI step failure
  • #3723: `mature` -> `sensitive` code changes for the API
  • #3514: Remove unnecessary `get_token_info`
  • #3488: Create a DAG for creating es indices proportional by provider
  • #3446: Use property-based testing for the API
  • #3201: Add a documentation page describing the different parts of our stack
  • #2486: Add Free Music Archive to the "External Sources" frontend feature
  • #1967: Implementation Plan: Bulk moderation actions
  • #1362: Include UA string on every request made by the DelayedRequester
  • #1787: Archive TSVs saved on S3 at lower (cheaper) access level (original #376)

openverse-infrastructure

Merged PRs

  • #812: 🔄 synced file(s) with WordPress/openverse
  • #810: Remove unnecessary `register_with_target_group`
  • #809: Bump ingestion server version
  • #808: Add openverse-catalog bucket lifecycle rule
  • #805: Add new API domain environment variables
  • #804: Extract load balancer listener management out of generic service modules

Closed issues

  • #772: Remove register_with_target_group option from ec2-service to simplify the module
  • #771: Extract security group configuration out of `generic/service` and `generic/ec2-service` into new security group module
  • #770: Extract load balancer rule and cloudflare domain provisioning out of `generic/service` and `generic/ec2-service`

#openverse, #week-in-openverse

A week in Openverse: 2024-02-19 – 2024-02-26

openverse

Merged PRs

  • #3824: Enable at-any-time security updates from Renovate
  • #3819: Bump cryptography from 42.0.2 to 42.0.4 in /automations/python
  • #3818: Bump cryptography from 42.0.2 to 42.0.4 in /api
  • #3812: Publish changelog for api-2024.02.20.22.54.08
  • #3809: Publish changelog for frontend-2024.02.19.15.45.00
  • #3805: Fix airflow connections
  • #3804: Use correct `BASE_URL` for the APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. by default
  • #3802: Expose search time headers to the browser
  • #3801: Update actions running on deprecated Node v16
  • #3794: Fix sketchfab loading state error

Closed issues

  • #3777: Expose CORS headers in Django app required for the search time event
  • #3746: OperationalError: [Errno -2] Name or service not known
  • #3729: Image skeleton keeps rendering on page for 3D model images
  • #2689: Link to reported media URLURL A specific web address of a website or web page on the Internet, such as a website’s URL www.wordpress.org in API Admin is incorrect
  • #1240: Merge API documentation into main docs site
  • #551: Use the image size information provided by the API instead of making head requests

openverse-infrastructure

Merged PRs

  • #806: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
  • #803: 🔄 synced file(s) with WordPress/openverse
  • #802: Extract Cloudflare domains and redirects from next environment root modules

Closed issues

  • #796: Do away with `api-dev` and the `search*.openverse.engineering` domains from Cloudflare

#openverse, #week-in-openverse

A week in Openverse: 2024-02-12 – 2024-02-19

openverse

Merged PRs

  • #3806: Bump cryptography from 42.0.0 to 42.0.2 in /automations/python
  • #3800: Remove the repository specific code of conduct.
  • #3799: Prevent creation of `.md-e` files in the docs
  • #3792: Publish changelog for api-2024.02.13.05.45.50
  • #3790: Publish changelog for frontend-2024.02.12.23.34.43
  • #3789: Fix newline at end of folded env variable string and prevent confusing skips of the changelog PRs
  • #3788: Fix release tag formatting
  • #3787: Add Ralph Rinzler Folklife Archives and Collections to Smithsonian subproviders
  • #3784: feat: Updated Dockerfile to Use Specific Version of audiowaveform Image
  • #3774: Update NYPL DAG to use APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. v2
  • #3771: Remove `edited` type from PR automation init review trigger, enable concurrency
  • #3768: Change outdated links in about page for codebase and project board to current links
  • #3755: Separate release drafting from publishing
  • #3749: Add links to additional views to sources table
  • #3748: Add Elasticsearch cluster health monitor DAGs
  • #3682: Add check to skip toggling CloudWatch alarms
  • #3544: Refactor integration tests to have no side-effects

Closed issues

  • #3782: Pin version of `audiowaveform` image in API `Dockerfile`
  • #3770: Some PRs are not moved from Approved to Merged after they are merged
  • #3757: About page has outdated links for codebase and the GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ project board
  • #3747: Airflow DAG to monitor Elasticsearch cluster health
  • #3578: Sources page should link to new source view
  • #3492: Set up staging ingestion server connection in Airflow
  • #2747: Change NYPL DAG to use the API v2
  • #2264: Change release process to facilitate release notes previews

openverse-infrastructure

Merged PRs

  • #801: Fix ansible inventories listing recipe
  • #800: Add ssh-ed25519 key for zackkrida to globally_authorized_keys
  • #799: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
  • #793: Move Cloudflare Access into new `cloudflare` root module; rename `org` to `github`

Closed issues

  • #769: Rename the org root module to github
  • #768: Move `access` module into new `cloudflare` root module

#openverse, #week-in-openverse

A week in Openverse: 2024-02-05 – 2024-02-12

openverse

Merged PRs

  • #3779: Revert Add SEARCH_RESPONSE_TIME analytics event to searches (#3632)
  • #3773: Prevent running certain workflows on forks
  • #3767: Fixed Typo in Frontend Icons.md file
  • #3765: Publish changelog for ingestion_server-2024.02.07.18.41.16
  • #3762: Remove codeowners validator from pre-commit
  • #3759: Fix flaky Playwright tests
  • #3756: Fix incorrect key `pass_filesnames`
  • #3754: Bump cryptography from 41.0.6 to 42.0.0 in /automations/python
  • #3752: Publish changelog for api-2024.02.05.20.34.01
  • #3751: Publish changelog for frontend-2024.02.05.18.10.41
  • #3738: Update dependency @playwright/test to v1.41.2
  • #3737: Update @openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org./eslint-pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party
  • #3734: Update dependency @types/node to v18.19.14
  • #3733: Replace dependency npm-run-all with npm-run-all2 ^6.1.2 (edited by @obulat)
  • #3726: Raise an exception if any indexer workers fail their health check
  • #3632: Add SEARCH_RESPONSE_TIME analytics event to searches
  • #3407: Add source and provider definition tooltips

Closed issues

  • #3775: `SEARCH_TIME_EVENT` is unusable due to plausible and CORS limitations
  • #3766: Small Typo Correction Documentation File
  • #3744: TypeError: 'NoneType' object is not subscriptable
  • #3714: `visual-regression/v-headerHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes.-internal.spec.ts:36:11 › VHeaderInternal › screen at breakpoint xs with width 340 › mobile-header-internal-modal-ltr` is flaky
  • #3713: `visual-regression/v-filterFilter Filters are one of the two types of Hooks https://codex.wordpress.org/Plugin_API/Hooks. They provide a way for functions to modify data of other functions. They are the counterpart to Actions. Unlike Actions, filters are meant to work in an isolated manner, and should never have side effects such as affecting global variables and output.-button.spec.ts:82:11 › VFilterButton › screen at breakpoint xl with width 1280 › pressed, focused, 12 filters` is flaky
  • #3712: APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. displays fewer (if any at all) results on the source collection page for Europeana than it does when filtering by `source=europeana`
  • #3693: Prevent workflows specific to this repo and its management from running on forks
  • #3554: Add linting for `CODEOWNERS`
  • #2840: Source and provider definitions in single result page
  • #2775: Update the single result page
  • #2708: Ingestion server does not appropriately report when indexer workers cannot be reached
  • #523: `window.webkit.messageHandlers` access errors prior to Sentry initialization
  • #1778: Identify fields from which the license can be obtained for certain Smithsonian museums (original #472)

openverse-infrastructure

Merged PRs

  • #798: 🔄 synced file(s) with WordPress/openverse
  • #797: Bump ingestion-server to rel-2024.02.07.18.41.16
  • #795: 🔄 synced file(s) with WordPress/openverse
  • #791: 🔄 synced file(s) with WordPress/openverse
  • #790: Update the Nuxt's `request_count_anomaly` alarm
  • #788: Allow GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ groups in CF Access, add content moderators to API access
  • #589: Initial setup of the Sentry provider

Closed issues

  • #748: Add `WordPress/openverse-content-moderators` to Django admin Cloudflare Access
  • #567: Better task count metric
  • #284: Silence ES CPU usage > 20% alert during data refreshes and add a separate, temporary 70% > CPU usage alert
  • #215: Manage Airflow Variables using Terraform (or some other programmatically handled and auditable way)
  • #153: Create a "deployment-permissions" singleton module to manage policy attachments for github AWS user
  • #96: Add cloudflare page cache rules for API and frontend

#openverse, #week-in-openverse

A week in Openverse: 2024-01-29 – 2024-02-05

openverse

Merged PRs

  • #3740: Update dependency pook to v1.4.0
  • #3739: Update dependency elasticsearch to v8.12.0
  • #3736: Update workflows
  • #3735: Update docker.io/redis Docker tag to v7.2.4
  • #3732: Add a link to the GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ file history on the Terms of Service
  • #3730: Remove preceding `$` in documentation code blocks, use bash for code blocks, add pre-commit check for console usage
  • #3728: Add storybook snapshot update command to testing documentation
  • #3727: Add the ToS to the navigation bar
  • #3724: Use new favicon
  • #3720: Bump aiohttp from 3.9.1 to 3.9.2 in /api
  • #3718: Publish changelog for frontend-2024.01.29.19.41.17
  • #3717: Publish changelog for api-2024.01.29.19.36.26
  • #3715: Prevent real network requests in TLS cleanup test
  • #3709: Remove sentry exception capture for thumbnail errors
  • #3688: Fix tag casing match in new tag view
  • #3650: Implementation Plan: Move Airflow and APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. to openverse.org
  • #3567: Add initial vale configuration and apply editorial changes to documentation

Closed issues

  • #3708: Remove Sentry exception handling for thumbnails
  • #3694: [Nuxt 3] Playwright Docker build fails on MacOS
  • #3666: [Nuxt 3] Re-add transition animation to the homepage images
  • #3665: [Nuxt 3] Re-add Prometheus module
  • #3664: [Nuxt 3] Re-add Storybook and Storybook tests
  • #3564: Add a terms of service page to the frontend
  • #3495: TagTag Tag is one of the pre-defined taxonomies in WordPress. Users can add tags to their WordPress posts along with categories. However, while a category may cover a broad range of topics, tags are smaller in scope and focused to specific topics. Think of them as keywords used for topics discussed in a particular post. casing is not matched in new tag view
  • #3566: Integrate Vale for linting docs according to editorial style guide
  • #2630: Remove the mature models from the API
  • #2629: Remove all code references to the mature-related models without removing the models themselves
  • #2628: Point the ingestion server to the new sensitive tables
  • #2627: Create a data management command to copy data from the old mature tables to the new sensitive ones
  • #2626: Add new models `Sensitive<Media>` and `<Media>Report`
  • #2038: Implementation Plan: Sufficiently change usage of `openverse.engineering` Cloudflare zone so that it can be switched to a free account
  • #903: Replace frontend favicon with yellow background version

openverse-infrastructure

Merged PRs

  • #767: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
  • #766: Remove deprecated keys

Closed issues

  • #760: Add Nuxt 3 variables to frontend ECS template
  • #169: Add OATH-TOTP PAM module to all SSHSSH Secure SHell - a protocol for securely connecting to a remote system in addition to or in place of a password.-able infrastructure

#openverse, #week-in-openverse

A week in Openverse: 2024-01-22 – 2024-01-29

openverse

Merged PRs

  • #3706: Publish changelog for catalog-2024.01.25.17.42.59
  • #3705: Use format over toJSON for escaping quotes in GHA
  • #3702: Do not use unsupported folded chomping multiline YAML blockBlock Block is the abstract term used to describe units of markup that, composed together, form the content or layout of a webpage using the WordPress editor. The idea combines concepts of what in the past may have achieved with shortcodes, custom HTML, and embed discovery into a single consistent API and user experience. syntax
  • #3701: Update dependency apacheApache Apache is the most widely used web server software. Developed and maintained by Apache Software Foundation. Apache is an Open Source software available for free.-airflow to v2.8.1 [SECURITY]
  • #3699: Wrap PR and discussion titles in `toJSON` to escape them in SlackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/.
  • #3698: Enable the isort rules for ruff and fix linting issues
  • #3697: Use correct path when checking if DAGs.md needs to be regenerated
  • #3696: Update WordPress Photo Directory DAG to ingest weekly
  • #3692: Bump pillow from 10.1.0 to 10.2.0 in /utilities/project_planning
  • #3691: Update dependency Pillow to ~=10.2.0 [SECURITY]
  • #3690: Bump pillow from 10.0.1 to 10.2.0 in /utilities/provider_tallies
  • #3689: Revert "Toggle CloudWatch alarms actions during Data Refresh (#3652)"
  • #3687: Remove needs db and add patch
  • #3685: Bump jupyterlab from 4.0.8 to 4.0.11 in /utilities/project_planning
  • #3684: Bump notebook from 7.0.6 to 7.0.7 in /utilities/project_planning
  • #3680: Remove outdated Docker image deployment workflow and documentation
  • #3676: Combine write to file and STDOUT in one command using `tee`
  • #3669: Update Rawpixel image URLs for ingestion
  • #3596: Don't trigger PR limit reminder on PRs that are ignored
  • #3586: Make the terms of service apply to all services
  • #3568: Update copy changes implementation plan to avoid table rename
  • #3537: Add create_new_es_index DAGs

Closed issues

  • #3710: <Replace this with actual title>
  • #3695: Ruff failing to correctly sort imports
  • #3436: Skip `needs_db` and always map ES hits to DB results
  • #2492: Large SVGs can cause gunicorn workers to abort
  • #2372: Build ES index creation DAG
  • #2324: Implementation Plan – Nuxt 3 MigrationMigration Moving the code, database and media files for a website site from one server to another. Most typically done when changing hosting companies.

openverse-infrastructure

Merged PRs

  • #765: Add ssh-ed25519 key for Olga
  • #764: Add ssh-ed25519 key for Madison
  • #763: Bump catalog version
  • #762: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
  • #751: Update stacimc key to ed25519
  • #750: Add playbook to sync ssh keys to all ec2 instances
  • #743: Configure ansible to route through the bastion

Closed issues

  • #707: Route Ansible SSHSSH Secure SHell - a protocol for securely connecting to a remote system in addition to or in place of a password. connections through the jumphost and disable public IPs on all infrastructure

#openverse, #week-in-openverse

A week in Openverse: 2024-01-15 – 2024-01-22

openverse

Merged PRs

  • #3681: Add missing spaces in PR pingPing The act of sending a very small amount of data to an end point. Ping is used in computer science to illicit a response from a target server to test it’s connection. Ping is also a term used by Slack users to @ someone or send them a direct message (DM). Users might say something along the lines of “Ping me when the meeting starts.”
  • #3679: Add user-agent headerHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes. for rawpixel
  • #3678: Publish changelog for ingestion_server-2024.01.18.18.31.08
  • #3677: Bump jupyter-lsp from 2.2.0 to 2.2.2 in /utilities/project_planning
  • #3674: Allow CI + CD workflow to deployDeploy Launching code from a local development environment to the production web server, so that it's available to visitors. from a different branch
  • #3672: Update alarms runbooks
  • #3671: Publish changelog for api-2024.01.16.17.28.14
  • #3668: Add Rawpixel to authority data as CURATED
  • #3667: Update tests for Nuxt 3 migrationMigration Moving the code, database and media files for a website site from one server to another. Most typically done when changing hosting companies.
  • #3662: fix: broken pipenv install link in general quickstart guide
  • #3656: Simplify load sample data
  • #3655: Bump jinja2 from 3.1.2 to 3.1.3 in /utilities/project_planning
  • #3653: Fix formatting of PR ping SlackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. messages
  • #3652: Toggle CloudWatch alarms actions during Data Refresh
  • #3649: Draft PRs fix for PR Board automation
  • #3629: Add documentation for yearly planning
  • #3618: Do not ingest Jamendo records with downloads disabled
  • #3590: Additional service checks for ingestion server health endpoint
  • #3570: Add codeowners pre-commit check
  • #3025: Prevent iNaturalist from running alongside any other DAGs

Closed issues

  • #3647: Disable alarm notifications during ES index creation
  • #3630: Fix link to `pipenv` installation instructions on general setup guide
  • #3530: Do not ingest Jamendo tracks that do not allow downloads
  • #3467: PRs that both have changes requested and are drafted should be in the drafted column of the PR board
  • #2505: Frontend response count alarms
  • #2504: Frontend response time alarms
  • #2501: General APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. response time alarms
  • #2344: ECS Alarms for anomalous behavior
  • #2019: Add additional checks to ingestion server healthcheck endpoint
  • #1276: Prevent iNaturalist from running alongside any other DAGs

openverse-infrastructure

Merged PRs

  • #759: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
  • #757: Bump ingestion server to rel-2024.01.18.18.31.08
  • #754: 🔄 synced file(s) with WordPress/openverse
  • #753: Stabilize API Production alarms
  • #752: Stabilize and update Nuxt alarms settings
  • #749: 🔄 synced file(s) with WordPress/openverse
  • #736: Set up DNSDNS DNS is an acronym for Domain Name System - how you assign a human readable address to a website’s exact numeric coded location (ie. wordpress.org uses the actual IP address 198.143.164.252). records for ingestion server in staging

Closed issues

  • #14: Distinguish between dev & prod ingestion server DNS records

#openverse, #week-in-openverse