dhruvkb 12:17 am on February 19, 2024
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2024-02-12 – 2024-02-19

openverse

Merged PRs

#3806: Bump cryptography from 42.0.0 to 42.0.2 in /automations/python
#3800: Remove the repository specific code of conduct.
#3799: Prevent creation of `.md-e` files in the docs
#3792: Publish changelog for api-2024.02.13.05.45.50
#3790: Publish changelog for frontend-2024.02.12.23.34.43
#3789: Fix newline at end of folded env variable string and prevent confusing skips of the changelog PRs
#3788: Fix release tag formatting
#3787: Add Ralph Rinzler Folklife Archives and Collections to Smithsonian subproviders
#3784: feat: Updated Dockerfile to Use Specific Version of audiowaveform Image
#3774: Update NYPL DAG to use APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. v2
#3771: Remove `edited` type from PR automation init review trigger, enable concurrency
#3768: Change outdated links in about page for codebase and project board to current links
#3755: Separate release drafting from publishing
#3749: Add links to additional views to sources table
#3748: Add Elasticsearch cluster health monitor DAGs
#3682: Add check to skip toggling CloudWatch alarms
#3544: Refactor integration tests to have no side-effects

Closed issues

#3782: Pin version of `audiowaveform` image in API `Dockerfile`
#3770: Some PRs are not moved from Approved to Merged after they are merged
#3757: About page has outdated links for codebase and the GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ project board
#3747: Airflow DAG to monitor Elasticsearch cluster health
#3578: Sources page should link to new source view
#3492: Set up staging ingestion server connection in Airflow
#2747: Change NYPL DAG to use the API v2
#2264: Change release process to facilitate release notes previews

openverse-infrastructure

Merged PRs

#801: Fix ansible inventories listing recipe
#800: Add ssh-ed25519 key for zackkrida to globally_authorized_keys
#799: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
#793: Move Cloudflare Access into new `cloudflare` root module; rename `org` to `github`

Closed issues

#769: Rename the org root module to github
#768: Move `access` module into new `cloudflare` root module

#openverse, #week-in-openverse

dhruvkb 12:16 am on February 12, 2024
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2024-02-05 – 2024-02-12

openverse

Merged PRs

#3779: Revert Add SEARCH_RESPONSE_TIME analytics event to searches (#3632)
#3773: Prevent running certain workflows on forks
#3767: Fixed Typo in Frontend Icons.md file
#3765: Publish changelog for ingestion_server-2024.02.07.18.41.16
#3762: Remove codeowners validator from pre-commit
#3759: Fix flaky Playwright tests
#3756: Fix incorrect key `pass_filesnames`
#3754: Bump cryptography from 41.0.6 to 42.0.0 in /automations/python
#3752: Publish changelog for api-2024.02.05.20.34.01
#3751: Publish changelog for frontend-2024.02.05.18.10.41
#3738: Update dependency @playwright/test to v1.41.2
#3737: Update @openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org./eslint-pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party
#3734: Update dependency @types/node to v18.19.14
#3733: Replace dependency npm-run-all with npm-run-all2 ^6.1.2 (edited by @obulat)
#3726: Raise an exception if any indexer workers fail their health check
#3632: Add SEARCH_RESPONSE_TIME analytics event to searches
#3407: Add source and provider definition tooltips

Closed issues

#3775: `SEARCH_TIME_EVENT` is unusable due to plausible and CORS limitations
#3766: Small Typo Correction Documentation File
#3744: TypeError: 'NoneType' object is not subscriptable
#3714: `visual-regression/v-headerHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes.-internal.spec.ts:36:11 › VHeaderInternal › screen at breakpoint xs with width 340 › mobile-header-internal-modal-ltr` is flaky
#3713: `visual-regression/v-filterFilter Filters are one of the two types of Hooks https://codex.wordpress.org/Plugin_API/Hooks. They provide a way for functions to modify data of other functions. They are the counterpart to Actions. Unlike Actions, filters are meant to work in an isolated manner, and should never have side effects such as affecting global variables and output.-button.spec.ts:82:11 › VFilterButton › screen at breakpoint xl with width 1280 › pressed, focused, 12 filters` is flaky
#3712: APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. displays fewer (if any at all) results on the source collection page for Europeana than it does when filtering by `source=europeana`
#3693: Prevent workflows specific to this repo and its management from running on forks
#3554: Add linting for `CODEOWNERS`
#2840: Source and provider definitions in single result page
#2775: Update the single result page
#2708: Ingestion server does not appropriately report when indexer workers cannot be reached
#523: `window.webkit.messageHandlers` access errors prior to Sentry initialization
#1778: Identify fields from which the license can be obtained for certain Smithsonian museums (original #472)

openverse-infrastructure

Merged PRs

#798: 🔄 synced file(s) with WordPress/openverse
#797: Bump ingestion-server to rel-2024.02.07.18.41.16
#795: 🔄 synced file(s) with WordPress/openverse
#791: 🔄 synced file(s) with WordPress/openverse
#790: Update the Nuxt's `request_count_anomaly` alarm
#788: Allow GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ groups in CF Access, add content moderators to API access
#589: Initial setup of the Sentry provider

Closed issues

#748: Add `WordPress/openverse-content-moderators` to Django admin Cloudflare Access
#567: Better task count metric
#284: Silence ES CPU usage > 20% alert during data refreshes and add a separate, temporary 70% > CPU usage alert
#215: Manage Airflow Variables using Terraform (or some other programmatically handled and auditable way)
#153: Create a "deployment-permissions" singleton module to manage policy attachments for github AWS user
#96: Add cloudflare page cache rules for API and frontend

#openverse, #week-in-openverse

dhruvkb 12:17 am on February 5, 2024
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2024-01-29 – 2024-02-05

openverse

Merged PRs

#3740: Update dependency pook to v1.4.0
#3739: Update dependency elasticsearch to v8.12.0
#3736: Update workflows
#3735: Update docker.io/redis Docker tag to v7.2.4
#3732: Add a link to the GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ file history on the Terms of Service
#3730: Remove preceding `$` in documentation code blocks, use bash for code blocks, add pre-commit check for console usage
#3728: Add storybook snapshot update command to testing documentation
#3727: Add the ToS to the navigation bar
#3724: Use new favicon
#3720: Bump aiohttp from 3.9.1 to 3.9.2 in /api
#3718: Publish changelog for frontend-2024.01.29.19.41.17
#3717: Publish changelog for api-2024.01.29.19.36.26
#3715: Prevent real network requests in TLS cleanup test
#3709: Remove sentry exception capture for thumbnail errors
#3688: Fix tag casing match in new tag view
#3650: Implementation Plan: Move Airflow and APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. to openverse.org
#3567: Add initial vale configuration and apply editorial changes to documentation

Closed issues

#3708: Remove Sentry exception handling for thumbnails
#3694: [Nuxt 3] Playwright Docker build fails on MacOS
#3666: [Nuxt 3] Re-add transition animation to the homepage images
#3665: [Nuxt 3] Re-add Prometheus module
#3664: [Nuxt 3] Re-add Storybook and Storybook tests
#3564: Add a terms of service page to the frontend
#3495: TagTag Tag is one of the pre-defined taxonomies in WordPress. Users can add tags to their WordPress posts along with categories. However, while a category may cover a broad range of topics, tags are smaller in scope and focused to specific topics. Think of them as keywords used for topics discussed in a particular post. casing is not matched in new tag view
#3566: Integrate Vale for linting docs according to editorial style guide
#2630: Remove the mature models from the API
#2629: Remove all code references to the mature-related models without removing the models themselves
#2628: Point the ingestion server to the new sensitive tables
#2627: Create a data management command to copy data from the old mature tables to the new sensitive ones
#2626: Add new models `Sensitive<Media>` and `<Media>Report`
#2038: Implementation Plan: Sufficiently change usage of `openverse.engineering` Cloudflare zone so that it can be switched to a free account
#903: Replace frontend favicon with yellow background version

openverse-infrastructure

Merged PRs

#767: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
#766: Remove deprecated keys

Closed issues

#760: Add Nuxt 3 variables to frontend ECS template
#169: Add OATH-TOTP PAM module to all SSHSSH Secure SHell - a protocol for securely connecting to a remote system in addition to or in place of a password.-able infrastructure

#openverse, #week-in-openverse

dhruvkb 12:16 am on January 29, 2024
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2024-01-22 – 2024-01-29

openverse

Merged PRs

#3706: Publish changelog for catalog-2024.01.25.17.42.59
#3705: Use format over toJSON for escaping quotes in GHA
#3702: Do not use unsupported folded chomping multiline YAML blockBlock Block is the abstract term used to describe units of markup that, composed together, form the content or layout of a webpage using the WordPress editor. The idea combines concepts of what in the past may have achieved with shortcodes, custom HTML, and embed discovery into a single consistent API and user experience. syntax
#3701: Update dependency apacheApache Apache is the most widely used web server software. Developed and maintained by Apache Software Foundation. Apache is an Open Source software available for free.-airflow to v2.8.1 [SECURITY]
#3699: Wrap PR and discussion titles in `toJSON` to escape them in SlackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/.
#3698: Enable the isort rules for ruff and fix linting issues
#3697: Use correct path when checking if DAGs.md needs to be regenerated
#3696: Update WordPress Photo Directory DAG to ingest weekly
#3692: Bump pillow from 10.1.0 to 10.2.0 in /utilities/project_planning
#3691: Update dependency Pillow to ~=10.2.0 [SECURITY]
#3690: Bump pillow from 10.0.1 to 10.2.0 in /utilities/provider_tallies
#3689: Revert "Toggle CloudWatch alarms actions during Data Refresh (#3652)"
#3687: Remove needs db and add patch
#3685: Bump jupyterlab from 4.0.8 to 4.0.11 in /utilities/project_planning
#3684: Bump notebook from 7.0.6 to 7.0.7 in /utilities/project_planning
#3680: Remove outdated Docker image deployment workflow and documentation
#3676: Combine write to file and STDOUT in one command using `tee`
#3669: Update Rawpixel image URLs for ingestion
#3596: Don't trigger PR limit reminder on PRs that are ignored
#3586: Make the terms of service apply to all services
#3568: Update copy changes implementation plan to avoid table rename
#3537: Add create_new_es_index DAGs

Closed issues

#3710: <Replace this with actual title>
#3695: Ruff failing to correctly sort imports
#3436: Skip `needs_db` and always map ES hits to DB results
#2492: Large SVGs can cause gunicorn workers to abort
#2372: Build ES index creation DAG
#2324: Implementation Plan – Nuxt 3 MigrationMigration Moving the code, database and media files for a website site from one server to another. Most typically done when changing hosting companies.

openverse-infrastructure

Merged PRs

#765: Add ssh-ed25519 key for Olga
#764: Add ssh-ed25519 key for Madison
#763: Bump catalog version
#762: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
#751: Update stacimc key to ed25519
#750: Add playbook to sync ssh keys to all ec2 instances
#743: Configure ansible to route through the bastion

Closed issues

#707: Route Ansible SSHSSH Secure SHell - a protocol for securely connecting to a remote system in addition to or in place of a password. connections through the jumphost and disable public IPs on all infrastructure

#openverse, #week-in-openverse

dhruvkb 12:18 am on January 22, 2024
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2024-01-15 – 2024-01-22

openverse

Merged PRs

#3681: Add missing spaces in PR pingPing The act of sending a very small amount of data to an end point. Ping is used in computer science to illicit a response from a target server to test it’s connection. Ping is also a term used by Slack users to @ someone or send them a direct message (DM). Users might say something along the lines of “Ping me when the meeting starts.”
#3679: Add user-agent headerHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes. for rawpixel
#3678: Publish changelog for ingestion_server-2024.01.18.18.31.08
#3677: Bump jupyter-lsp from 2.2.0 to 2.2.2 in /utilities/project_planning
#3674: Allow CI + CD workflow to deployDeploy Launching code from a local development environment to the production web server, so that it's available to visitors. from a different branch
#3672: Update alarms runbooks
#3671: Publish changelog for api-2024.01.16.17.28.14
#3668: Add Rawpixel to authority data as CURATED
#3667: Update tests for Nuxt 3 migrationMigration Moving the code, database and media files for a website site from one server to another. Most typically done when changing hosting companies.
#3662: fix: broken pipenv install link in general quickstart guide
#3656: Simplify load sample data
#3655: Bump jinja2 from 3.1.2 to 3.1.3 in /utilities/project_planning
#3653: Fix formatting of PR ping SlackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. messages
#3652: Toggle CloudWatch alarms actions during Data Refresh
#3649: Draft PRs fix for PR Board automation
#3629: Add documentation for yearly planning
#3618: Do not ingest Jamendo records with downloads disabled
#3590: Additional service checks for ingestion server health endpoint
#3570: Add codeowners pre-commit check
#3025: Prevent iNaturalist from running alongside any other DAGs

Closed issues

#3647: Disable alarm notifications during ES index creation
#3630: Fix link to `pipenv` installation instructions on general setup guide
#3530: Do not ingest Jamendo tracks that do not allow downloads
#3467: PRs that both have changes requested and are drafted should be in the drafted column of the PR board
#2505: Frontend response count alarms
#2504: Frontend response time alarms
#2501: General APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. response time alarms
#2344: ECS Alarms for anomalous behavior
#2019: Add additional checks to ingestion server healthcheck endpoint
#1276: Prevent iNaturalist from running alongside any other DAGs

openverse-infrastructure

Merged PRs

#759: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
#757: Bump ingestion server to rel-2024.01.18.18.31.08
#754: 🔄 synced file(s) with WordPress/openverse
#753: Stabilize API Production alarms
#752: Stabilize and update Nuxt alarms settings
#749: 🔄 synced file(s) with WordPress/openverse
#736: Set up DNSDNS DNS is an acronym for Domain Name System - how you assign a human readable address to a website’s exact numeric coded location (ie. wordpress.org uses the actual IP address 198.143.164.252). records for ingestion server in staging

Closed issues

#14: Distinguish between dev & prod ingestion server DNS records

#openverse, #week-in-openverse

dhruvkb 12:18 am on January 15, 2024
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2024-01-08 – 2024-01-15

openverse

Merged PRs

#3657: Fix PR limit reminders
#3654: Bump jinja2 from 3.1.2 to 3.1.3 in /documentation
#3651: Fix slackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. pingPing The act of sending a very small amount of data to an end point. Ping is used in computer science to illicit a response from a target server to test it’s connection. Ping is also a term used by Slack users to @ someone or send them a direct message (DM). Users might say something along the lines of “Ping me when the meeting starts.” action version reference
#3648: Add additional_query_params to provider DAG configuration
#3645: Publish changelog for api-2024.01.08.20.06.53
#3644: Increase ES throttling rate in Ingestion Server
#3643: Publish changelog for frontend-2024.01.08.19.12.18
#3628: pgcli version is extracted into a docker argument
#3627: Remove unused AWS variables
#3623: Add secret-key check
#3622: Convert unittest to pytest
#3594: Documentation for becoming a committer, reorganize contributing pages
#3577: Replaced `cURL` slack workflows with `slackapi`
#3258: Retrieve Auckland Museum Image Data

Closed issues

#3533: Add optional `additional_query_params` config to provider DAGs
#3461: Replace cURL to Slack with `slackapi/slack-githubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/-action`
#3456: Add a check on startup to ensure application is not using default key in live environments
#3425: Convert unittest.TestCase tests to pytest
#2959: Extract the pgcli version for the Dockerfile from the api Pipfile
#1771: Auckland Museum

openverse-infrastructure

Merged PRs

#745: Increase settings of Response Time alarms for the APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. and Nuxt

Closed issues

#729: Delete thumbnails log group

#openverse, #week-in-openverse

dhruvkb 12:17 am on January 8, 2024
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2024-01-01 – 2024-01-08

openverse

Merged PRs

#3625: Publish changelog for catalog-2024.01.04.20.39.50
#3624: HOTFIX: Convert encoded HTTPHTTP HTTP is an acronym for Hyper Text Transfer Protocol. HTTP is the underlying protocol used by the World Wide Web and this protocol defines how messages are formatted and transmitted, and what actions Web servers and browsers should take in response to various commands. connection variables to http type not httpsHTTPS HTTPS is an acronym for Hyper Text Transfer Protocol Secure. HTTPS is the secure version of HTTP, the protocol over which data is sent between your browser and the website that you are connected to. The 'S' at the end of HTTPS stands for 'Secure'. It means all communications between your browser and the website are encrypted. This is especially helpful for protecting sensitive data like banking information.
#3617: Silence the gunicorn access log
#3615: Update dependency @playwright/test to v1.40.1
#3614: Refactor Playwright tests
#3613: Delete unused VOldIconButton
#3612: Publish changelog for api-2024.01.01.19.52.14
#3611: Remove step to deployDeploy Launching code from a local development environment to the production web server, so that it's available to visitors. production thumbnails
#3610: Publish changelog for frontend-2024.01.01.19.52.49
#3609: Update dependency eslint-pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party-playwright to ^0.21.0
#3608: Update dependency elasticsearch to v8.11.1
#3607: Update dependency babel-loader to v8.3.0
#3606: Update dependency async-mutex to ^0.4.0
#3604: Update workflows
#3603: Update dependency vue-tsc to v1.8.27
#3602: Update dependency @types/node to v18.19.4
#3591: Update Airflow filtered warnings, address deprecations
#3556: Update pnpm from 7.17.1 to 8.12.1
#3494: Implementation Plan: Django admin moderator access control and base improvements

Closed issues

#3382: Redis 7.x upgrade
#3349: Related endpoint returns 500 if the main item is not found in ES index
#3237: Duplication in APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. logging
#1966: Implementation Plan: Django admin access control and tool improvements
#1052: Upgrade to pnpm@8

openverse-infrastructure

Merged PRs

#742: Bump catalog version
#741: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
#739: Update Redis `engine_version` and `parameer_group_name`
#731: Complete command for SSHSSH Secure SHell - a protocol for securely connecting to a remote system in addition to or in place of a password. key configuration

Closed issues

#611: Upgrade Redis to 7.x

#openverse, #week-in-openverse

dhruvkb 12:19 am on January 1, 2024
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2023-12-25 – 2024-01-01

openverse

Merged PRs

#3600: Bump jwcrypto from 1.5.0 to 1.5.1 in /api
#3597: Docs: Fix typo
#3595: Update meeting times in README
#3593: Unify VueVue Vue (pronounced /vjuː/, like view) is a progressive framework for building user interfaces. https://vuejs.org/. components
#3589: Add "🗄️ aspect:data" label
#3588: Publish changelog for api-2023.12.26.05.11.22
#3575: Add a script to observe the APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. during Redis migrationMigration Moving the code, database and media files for a website site from one server to another. Most typically done when changing hosting companies.
#3572: Update dependency apacheApache Apache is the most widely used web server software. Developed and maintained by Apache Software Foundation. Apache is an Open Source software available for free.-airflow to v2.8.0 [SECURITY]
#3532: Remove Internet Archive Book Images sub provider

Closed issues

#3574: Add an `aspect: data` label?
#2661: Airflow scheduler will crash when connection to the database drops, but container will not stop
#754: Collect data on API usage

openverse-infrastructure

Merged PRs

#738: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
#737: Increase datapoints_to_alarm for p99 response time threshold alarm

Closed issues

#404: Ignore `latest_restorable_time` changes in `module.staging-api.module.rds.aws_db_instance.this`

#openverse, #week-in-openverse

dhruvkb 12:17 am on December 25, 2023
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2023-12-18 – 2023-12-25

openverse

Merged PRs

#3565: Remove exlusion of ContentProvider's notes in ProviderAdmin
#3563: Publish changelog for catalog-2023.12.20.22.19.13
#3562: Replace `requests` mocking with `pook`
#3561: Bump Redis to v7 in local dev environment
#3560: Use api_client, move fixtures around to share basic defaults
#3557: Fix linting in CI
#3553: Fix issues in the sync workflow and narrow down its triggers
#3552: Return status 404 instead of 500 when media not found
#3551: Handle multiple leading zeros in ccMixter's JSONJSON JSON, or JavaScript Object Notation, is a minimal, readable format for structuring data. It is used primarily to transmit data between a server and web application, as an alternative to XML. response
#3550: Remove front matter from project thread issue template
#3549: Publish changelog for api-2023.12.18.17.56.24
#3546: Replace Python toolchain with Ruff
#3545: Remove stray commas in the codebase
#3543: Use more flexible implementation for user mention link documentation extension
#3540: Upgrade actions and packages related to artifacts
#3538: Add some `just` recipes for the Redis cache service
#3535: Update dependency apacheApache Apache is the most widely used web server software. Developed and maintained by Apache Software Foundation. Apache is an Open Source software available for free.-airflow to v2.7.3 [SECURITY]
#3523: Stabilize APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. HTTPHTTP HTTP is an acronym for Hyper Text Transfer Protocol. HTTP is the underlying protocol used by the World Wide Web and this protocol defines how messages are formatted and transmitted, and what actions Web servers and browsers should take in response to various commands. alarms and remove thumbnails alarms runbooks
#3505: Make usages of Redis resilient to absence of Redis
#3486: Add referrer based throttle scope
#3482: Add external dag sensor utilities
#3472: Send SELECT_SEARCH_RESULT event only on left-mouse clicks
#3460: Raise Exception for SVG Watermark
#3458: Convert oembed to async
#3404: Add logging to project automations

Closed issues

#3542: Ignore `@` in code blocks when generating GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ username links
#3539: Upgrade to latest artifact actions and packages
#3520: Related endpoint on a missing/non-existent image raises a 500
#3501: The API is throtlling the openverse.org
#3485: Thumbnail rate limit incorrectly applied to non-thumbnail routes
#3484: Add naively higher rate limit for requests with `openverse.org` referrer
#3470: Add a "notes" field to `ContentProvider`
#3457: Convert oembed image endpoint to async
#3437: Handle exceptions from ingestion server's calls to Elasticsearch
#3396: Add logging to project automations
#3393: Add new image sources to the API
#3385: Make API resilient to a Redis outage
#3373: Watermarking fails for SVG images
#2843: Django ASGI
#2551: Any mouse click on a search results sends `SELECT_SEARCH_RESULT` analytics event
#2503: API thumbnails response count alarms
#2502: API thumbnails response time alarms
#2500: General API response count alarms
#2356: Consider making secondary icons official or revising them
#2256: Replace `requests` mocking with `pook`
#1885: Additional Django admin moderation tools improvements
#1874: Improved production -> staging database replication
#1207: Ensure all files have CODEOWNERS
#787: Replace all Python linters (flake8, isort, pyupgrade, pydocstyle) with Ruff
#428: Dead link ETL
#427: Duplicate image detection
#426: Machine Image Labeling pipeline
#425: Frontend keyboard shortcuts
#424: Improved search syntax experience
#423: Explore frontend performance measurement

openverse-infrastructure

Merged PRs

#735: Remove filebeat and graylog config from ingestion server
#732: Replace python linters with Ruff and add prettier hook
#730: Bump catalog-airflow to rel-2023.12.20.22.19.13
#728: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
#727: Remove production thumbnails service
#726: 🔄 synced file(s) with WordPress/openverse
#725: Fix normalization of API tg queries metrics
#724: Enable API action alarms
#719: Remove explicit data node heap override
#710: Add SSHSSH Secure SHell - a protocol for securely connecting to a remote system in addition to or in place of a password. Bastion production-only module

Closed issues

#677: Reduce data node heap
#493: Remove filebeat and graylog references from `ingestion-server/init.tpl`
#480: Move jumphost module into `next/production` root module
#136: Prevent warning from showing up after jumpbox is deployedDeploy Launching code from a local development environment to the production web server, so that it's available to visitors.

#openverse, #week-in-openverse

dhruvkb 12:17 am on December 18, 2023
Tags: openverse, week-in-openverse ( 93 )

A week in Openverse: 2023-12-11 – 2023-12-18

openverse

Merged PRs

#3536: Revert "Remove mysqlMySQL MySQL is a relational database management system. A database is a structured collection of data where content, configuration and other options are stored. https://www.mysql.com/. from apt repository sources for catalog due to expired key (#3527)"
#3529: Remove outdated pre-monorepo info from `README.md`
#3527: Remove mysql from apt repository sources for catalog due to expired key
#3526: Allow more than one aspect label
#3524: Add Jamendo's audiodownload_allowed field to metadata
#3522: Update catalog pgcli version to 4.0.1
#3521: Rename catalog requirements files to match Renovate pattern
#3519: Pin `@actions/artifact` to version 1
#3518: Publish changelog for ingestion_server-2023.12.12.17.23.14
#3516: Fix source query caching
#3515: Fix incorrect default production data refresh limit of 0
#3512: Publish changelog for frontend-2023.12.11.19.44.28
#3511: Publish changelog for api-2023.12.11.19.20.45
#3509: Remove staging thumbnails deployment
#3506: Use `.rest` in Octokit calls
#3503: Point Airflow deployment information to updated deployment runbook
#3502: Update links to archived repositories in documentation
#3479: Add DAG for ccMixter
#3465: Add catalog to dependencies to update by Renovate
#3427: Update dependency vue-tsc to v1.8.25
#3361: Unify DAG creation/database cleaning fixtures for testing
#3069: Move Oembed endpoint validation onto the serializer
#2679: Incident Response Plan

Closed issues

#3491: Add Internet Archive Book Images source in Django admin
#3490: Backfill Internet Archive Book Provider source
#3489: Backfill Flickr invalid license fix
#3212: Upgrade Ruff (and other pre-commit hooksHooks In WordPress theme and development, hooks are functions that can be applied to an action or a Filter in WordPress. Actions are functions performed when a certain event occurs in WordPress. Filters allow you to modify certain functions. Arguments used to hook both filters and actions look the same.)
#3202: Remove line regarding moving the catalog into the repository from the README
#2961: Increase timeout while waiting for RDS database rename
#2622: Unify DAG creation/database cleaning fixtures for testing
#2063: Create an "outage protocol" runbook / "Incident Response Plan"
#2060: Postmortem improvements from "OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. degraded performance 2023-05-03"
#897: Fuse `label_new_pr` and `label_pr` workflows
#581: Dependency Dashboard
#1770: ccMixter

openverse-infrastructure

Merged PRs

#723: Remove the production thumbnails monitoring service
#722: Bump ingestion server to rel-2023.12.12.17.23.14
#721: 🔄 synced file(s) with WordPress/openverse
#720: Route all thumbnails traffic to general APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. service

#openverse, #week-in-openverse

Welcome!

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs