dhruvkb 12:17 am on November 27, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-11-20 – 2023-11-27

openverse

Merged PRs

#3395: Drop separate download fallback
#3394: Use the `ACCESS_TOKEN` secret instead of `GITHUB_TOKEN`
#3392: Really fix import path for `.mjs` files
#3390: Fix path to automation `.mjs` files
#3381: Fix dynamically excluded providers caching
#3376: Publish changelog for api-2023.11.20.09.32.25
#3375: Implementation of project board automations
#3372: Publish changelog for frontend-2023.11.20.09.09.57
#3369: Add middleware to log application name and verification status
#3366: Add Elasticsearch Airflow provider
#3364: Add project planning voting boxplot generation script
#3363: Fix delete_records slackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. formatting
#3024: Add aiohttp client sharing
#3020: Add ADRF and make the thumbnail view async

Closed issues

#3380: Dynamically filtered providers cache is set incorrectly
#3374: Implementation of the project automation changes
#3368: Add response headers and nginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. logging to identify requests and registered applications used for a request
#3355: Fix axios integration for axios 1.x upgrade
#3342: Not all tags normalised to lower case
#3189: Add logging & tallying for deep pagination
#2788: Use a shared `aiohttp.ClientSession` rather than creating a new one per-request
#2436: `get-translations.js` logs raw error to console with explanation despite the case being handled just fine
#2371: Add Airflow Connections for Elasticsearch clusters
#2370: Add Elasticsearch Airflow Provider
#2348: Write a prettier pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party that formats admonition blocks as markdown
#2246: Add Django request ID to nginx log output
#2245: Nginx configuration logs structured (JSONJSON JSON, or JavaScript Object Notation, is a minimal, readable format for structuring data. It is used primarily to transmit data between a server and web application, as an alternative to XML.) and unstructured output for every event
#1929: Add talkback for events APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. in playwright
#1831: `visual-regression/v-checkbox.spec.ts:47:9 › v-checkbox › default › on` is flaky
#1161: Flaky playwright test `visual-regression/pages/pages-single-result.spec.ts:30:13`
#949: Switch to Caddy for API reverse proxy to simplify configuration
#464: Focus outline in media type selection dropdown is cropped on the right
#483: Failure comment is not removed after successful re-run
#514: Add a "Redeploy to current version" checkbox to the Rollback workflow
#516: Add link to staging deployment workflow run on PRs
#293: RFC Request: API unit and integration testing
#1477: PR review DAG pinging on PRs with requested changes
#1481: Clean up all previous indexes after successfully switching to a new one during data refresh
#685: Record dead link stats in a queryable way
#285: Workflow to run the load testing script against staging API
#686: Store dead links in database and expose an API endpoint that the catalog can pull from
#528: User agent string information reduction in Chrome
#540: Update TESTING_GUIDELINES.md to include instructions on how to run the test suite.
#544: Disable Renovate for pnpm dependencies and enable Dependabot instead

openverse-infrastructure

Merged PRs

#695: Use different jumphost port mappings based on environments
#687: Bump ingestion server version to rel-2023.11.14.18.39.29

Closed issues

#683: Investigate pagination depth for Elasticsearch queries
#679: Capture Elasticsearch queries during response time spike
#535: Use more distinct/obvious/harder-to-accidentally-misuse ports for mapping staging and production infrastructure locally

#openverse, #week-in-openverse

dhruvkb 12:17 am on November 20, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-11-13 – 2023-11-20

openverse

Merged PRs

#3365: Update VCollectionHeader.vue
#3359: Unpin glibc
#3358: Use the correct suffix for exact matches field
#3356: Publish changelog for api-2023.11.14.23.44.01
#3354: Add gc debugging flag to help debug prod thumbnails leak
#3352: Publish changelog for frontend-2023.11.14.19.30.29
#3351: Publish changelog for ingestion_server-2023.11.14.18.39.29
#3350: Publish changelog for catalog-2023.11.14.18.24.16
#3347: Publish changelog for api-2023.11.13.22.18.21
#3346: Use the `keyword` field for tags in related query
#3344: Configure the number of proxies to fix anon rate limiting
#3343: Update dependency axios to v1 [SECURITY]
#3341: Remove `this` from `VGridSkeleton` props `default`
#3334: Add logging around `_post_process_results` recursion
#3324: Include media provider in thumbnail failure logging and tallying
#3322: Add some VueVue Vue (pronounced /vjuː/, like view) is a progressive framework for building user interfaces. https://vuejs.org/. 3 Eslint rules
#3297: Update the Audio track in row, box and full layouts
#3259: Add DAG for filtering archived providers in catalog
#3042: Document existing project automations and plan implementation of new ones
#2853: Add APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. routes and controllers for additional search views

Closed issues

#3348: Related query does not use filtered index
#3269: Correctly set up mixing of exact search with stemming
#3268: Remove `this` from `VGridSkeleton` props `default`
#3257: FilterFilter Filters are one of the two types of Hooks https://codex.wordpress.org/Plugin_API/Hooks. They provide a way for functions to modify data of other functions. They are the counterpart to Actions. Unlike Actions, filters are meant to work in an isolated manner, and should never have side effects such as affecting global variables and output. dead link-only providers in the Catalog
#3157: Remove pinned glibc update once docker images are updated
#2910: Audio components improvement
#2850: Create a controller for Additional search views
#2849: Add additional search views endpoints to the API
#2320: Remove implicit `@testing-library` `get*` assertions: `v-box-layout.spec.js`
#2318: Remove implicit `@testing-library` `get*` assertions: `v-audio-track.spec.js`
#2314: Delay origin index alias promotion until after filtered index is created
#2299: Disable coverage by default when running unit tests locally
#1931: Implementation Plan: OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. Backlog project automation
#368: Integrate 'alex' to ensure our Markdown docs are considerate
#588: Enable some of the Vue 3 eslint rules related to composition API
#72: [Feature] Setup bot to automerge Dependabot PRs after approval

openverse-infrastructure

Merged PRs

#689: Set thumbnails prod logging to INFO
#688: Add gc debug logging flags to thumbnails
#686: Bump catalog version to rel-2023.11.14.18.24.16
#684: Reduce staging tasks
#681: Resize production API tasks
#680: Only run ansible-lint hook when ansible files change
#629: Enable verbose ES logging on the API

Closed issues

#638: Explore GC options for Elasticsearch
#528: Re-evaluate gunicorn worker count for API tasks
#278: Consider scaling down production frontend instance

#openverse, #week-in-openverse

dhruvkb 12:16 am on November 13, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-11-06 – 2023-11-13

openverse

Merged PRs

#3333: Use a default for `HOST_NETWORK_ADDRESS` to hide warnings
#3332: Unpin pytest-mock and rely on Airflow constraints for version
#3331: Fix APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. integration test for the related endpoint
#3329: Remove `–merge` and `–noinput` flags in Django migrationMigration Moving the code, database and media files for a website site from one server to another. Most typically done when changing hosting companies. check
#3325: Revise Catalog Quickstart
#3323: Add instructions on running individual test in new provider docs
#3321: Add a guide for upgrading and migrating ES indices
#3320: Publish changelog for frontend-2023.11.06.20.32.30
#3319: Upated new-provider docs to use correct `just` commands
#3318: Ignore `.iml` files created by JetBrains inside the project
#3317: Remove Storybook smoke test
#3315: Update TypeScript to v5.2.2
#3313: Fix the "search query" in the time took logs
#3312: Update renovate config to handle all dependency types and group upgrades
#3311: Fix accidental copy change causing dangling migration
#3307: Simplify related query to remove nesting and make more performant
#3305: Update Nuxt template overrides to latest versions of templates
#3303: Create filtered index before promoting primary index during data refresh
#3279: Update docker.io/nginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. Docker tag to v1.25.3
#3272: Use pytest-env to set up API key
#3265: Update the global audio player
#3247: Update nuxt, @nuxt/vue-app, @nuxt/types dependencies
#3233: Vendor in case functions
#3168: Remove unused fields from ES
#3011: Run the app as ASGI

Closed issues

#3339: <airflow alert>
#3316: Ability to exclude providers from data refresh
#3314: Write a documentation page for zero-downtime ES index migrations
#3310: Dangling migration in API
#3306: Excluded providers clause in the related query is inefficient
#3304: Both dependabot and renovate open dependency update PRs in the monorepo
#3242: Update frontend dependencies
#3196: Missing frontend release version in staging
#2993: Add access request logging to Nuxt
#2981: Wait to change all ES aliases until filtered index creation is complete
#2801: Update new provider docs to use correct just commands
#2800: Add instructions for running individual tests to new provider docs
#2790: Convert the API to ASGI
#2464: Vendor in `case` utilities
#2034: Move catalog's README information into documentation site, update just commands
#1969: Implementation Plan: Fine-grained API response cache management
#852: `TypeError` term.trim is not a function
#1382: Use pytest-env to set up API key shims for testing
#536: Add proper logging to frontend

openverse-infrastructure

Merged PRs

#673: Add Kenneth Ng as a contributor to the OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. repos
#672: Remove Storybook smoke test from required tests
#671: Enable canary API service in production
#616: Resize API tasks for ASGI workers

Closed issues

#676: Lower JVM Heap size on production ES data nodes
#675: Set unfiltered image alias to the filtered index
#651: Set up a dashboard for monitoring performance to the `/related/` endpoint
#484: Self-host renovate so that we can get regular dependency updates for the frontend

#openverse, #week-in-openverse

dhruvkb 12:16 am on November 6, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-10-30 – 2023-11-06

openverse

Merged PRs

#3302: Publish changelog for api-2023.11.01.21.27.09
#3301: Hotfix: Increase ES timeout and retries
#3300: Log times of ES queries
#3296: Bump renovatebot/githubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/-action from 39.0.5 to 39.1.1
#3295: Bump pytest from 7.4.2 to 7.4.3 in /ingestion_server
#3294: Bump filelock from 3.12.4 to 3.13.1 in /ingestion_server
#3293: Bump sentry-sdk from 1.31.0 to 1.33.1 in /ingestion_server
#3292: Bump boto3 from 1.28.58 to 1.28.75 in /ingestion_server
#3291: Bump elasticsearch from 8.10.0 to 8.10.1 in /ingestion_server
#3290: Bump apacheApache Apache is the most widely used web server software. Developed and maintained by Apache Software Foundation. Apache is an Open Source software available for free.-airflow[amazon,httpHTTP HTTP is an acronym for Hyper Text Transfer Protocol. HTTP is the underlying protocol used by the World Wide Web and this protocol defines how messages are formatted and transmitted, and what actions Web servers and browsers should take in response to various commands.,postgres] from 2.7.1 to 2.7.2 in /catalog
#3289: Bump tldextract from 3.6.0 to 5.0.1 in /catalog
#3287: Bump ipython from 8.16.1 to 8.17.2 in /automations/python
#3286: Bump pillow from 10.0.1 to 10.1.0 in /api
#3285: Bump ipython from 8.16.1 to 8.17.2 in /api
#3284: Bump pytest-django from 4.5.2 to 4.6.0 in /api
#3282: Bump django from 4.2.6 to 4.2.7 in /api
#3280: Update agilepathway/pull-request-label-checker Docker tag to v1.6.3
#3278: Update dependency elasticsearch to v8.10.1
#3277: Publish changelog for frontend-2023.11.01.00.18.44
#3275: Add ability to configure NginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. DNSDNS DNS is an acronym for Domain Name System - how you assign a human readable address to a website’s exact numeric coded location (ie. wordpress.org uses the actual IP address 198.143.164.252). resolver
#3273: move new provider docs to documentation folder
#3271: Publish changelog for api-2023.10.30.16.26.21
#3270: Publish changelog for frontend-2023.10.30.16.27.33
#3267: Replaced http link with httpsHTTPS HTTPS is an acronym for Hyper Text Transfer Protocol Secure. HTTPS is the secure version of HTTP, the protocol over which data is sent between your browser and the website that you are connected to. The 'S' at the end of HTTPS stands for 'Secure'. It means all communications between your browser and the website are encrypted. This is especially helpful for protecting sensitive data like banking information. in contributor.md
#3262: Encode spaces in metropolitan urls
#3261: Simplify search query
#3260: Add frontend to the nginx image tagging
#3248: Update Nuxt sentry dependency
#3239: Remove unused utils
#3019: Watermark exception

Closed issues

#3298: `stats` query in ES unnecessarily requests the sources
#3274: Plausible DNS resolution in Nginx container not working in live environments
#3266: Non secure links needs to be replaced with the secure ones
#3243: Search controller uses `should` for filtering instead of `filterFilter Filters are one of the two types of Hooks https://codex.wordpress.org/Plugin_API/Hooks. They provide a way for functions to modify data of other functions. They are the counterpart to Actions. Unlike Actions, filters are meant to work in an isolated manner, and should never have side effects such as affecting global variables and output.`
#3139: Add timing information to ES queries
#2794: Move new-provider docs to docs site
#1234: Unhandled exception when reading image in watermark route

openverse-infrastructure

Merged PRs

#669: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
#668: Finalise cluster monitoring configuration and tweak kibana settings for it.
#664: Add Nginx DNS resolver configuration
#662: Add playbook to enable monitoring and create split Elasticsearch config
#646: Enable canary in dashboards and monitors

Closed issues

#652: Add memory and disk metrics to the Elasticsearch dashboard
#644: Add a `restart` option to the Elasticsearch docker-compose config
#626: Capture canary service in Cloudwatch dashboards

#openverse, #week-in-openverse

dhruvkb 12:16 am on October 30, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-10-23 – 2023-10-30

openverse

Merged PRs

#3256: Update focus-trap dependency
#3255: Update uuid dependency
#3254: Update vue-demi dependencies
#3253: Update Tailwindcss dependencies
#3252: Update Clipboard dependencies
#3250: Update @popperjs/coreCore Core is the set of software required to run WordPress. The Core Development Team builds WordPress. dependency
#3249: Update @nuxtjs/i18n dependency
#3245: Publish changelog for ingestion_server-2023.10.25.06.38.07
#3238: Publish changelog for api-2023.10.23.11.40.59
#3236: Use pook from GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ to add binary support
#3225: Update close buttons
#3214: Add correct label to exclude
#3213: Use `property` attribute for OpenGraph title and image
#3198: Raise error when space is in URLURL A specific web address of a website or web page on the Internet, such as a website’s URL www.wordpress.org
#3185: Hotfix for `undefined` in Nuxt provider data
#3171: Allow data refresh poke interval for Image.
#3162: Remove unreferenced subfields in indices
#3161: Use top-level `keyword` fields instead of subfields
#3150: Update thumbnail response time runbooks
#3136: Simplify Nuxt query parameter computation

Closed issues

#3211: `name` incorrectly used instead of `property` for OpenGraph tags
#3184: Stats endpoint can return `undefined` in data
#3126: Duplicated APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. access logs
#2670: Implementation Plan: Dataset maintenance
#2669: Implementation Plan: Initial data dump creation
#2598: Auckland Museum
#2545: Providing and maintaining OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. media datasets
#2478: LoopExit in _post_process_results
#2456: Django API logs various warnings about OpenAPI configuration issues
#1279: Raise an exception if a space is found in URL fields
#445: Do not add "project" issues to the Backlog
#467: Part of the focus outline on the popover close button is cut off
#1472: Allow data refresh poke interval to be configured per media type

openverse-infrastructure

Merged PRs

#663: Update ingestion server to newest release
#661: Add nginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. proxy to production frontend
#659: 🔄 synced file(s) with WordPress/openverse
#656: Create `ec2-service` generic module and use it for Kibana with persistent storage
#648: Add nginx to staging frontend
#642: Add basic Ansible setup and work towards Elasticsearch monitoring configuration changes

Closed issues

#658: Spin up Kibana
#650: Forward Elasticsearch monitoring from production to staging
#647: Add audio index to staging

#openverse, #week-in-openverse

dhruvkb 12:16 am on October 23, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-10-16 – 2023-10-23

openverse

Merged PRs

#3231: Add shim `README.md` files in project directories
#3229: Remove `just` executions without arguments from CI
#3227: removed-igestion_server-readme.md
#3224: Publish changelog for ingestion_server-2023.10.19.06.08.15
#3221: Publish changelog for api-2023.10.18.15.25.27
#3220: Bump tldextract from 3.5.0 to 5.0.1 in /ingestion_server
#3219: Allow runtime configuration of nginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. listening port
#3218: Bump urllib3 from 1.26.17 to 1.26.18 in /ingestion_server
#3217: Bump urllib3 from 1.26.17 to 1.26.18 in /api
#3216: Bump urllib3 from 2.0.6 to 2.0.7 in /documentation
#3215: Bump urllib3 from 2.0.6 to 2.0.7 in /automations/python
#3209: Remove unnecessary information from APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. docs
#3204: Move catalog README to docs site quickstart
#3203: Limit indexer workers using env var
#3163: Make API nginx log once per request
#3143: Reduce ES shard count and simplify index properties
#2933: Update the full audio layout on the single result page

Closed issues

#3235: <Replace this with actual title>
#3234: <Replace this with actual title>
#3223: Remove `just` output from CI job
#3222: Replace upper case licenses with lower case ones in catalog database
#3208: Remove references to using cURL in the API documentation
#3206: Remove ingestion server README.md
#3205: Add shim READMEs to service subfolders pointing to the documentation site
#3167: National Gallery of Art (United States)
#2319: Remove implicit `@testing-library` `get*` assertions: `v-audio-details.spec.js`
#2181: Update caniuse
#2154: Remove `text` mapping on `identifier`
#462: Inadequate space between media and search box when 'Back to results' link is absent
#486: Add a new VNavLink component
#550: Related images showing bigger than the main image in the Details page
#602: Two e2e tests consistently fail when updating tapes but appear stable otherwise
#605: Use URLSearchParams to parse query params instead of using regexes
#616: Audit usage of `useMediaQuery`

openverse-infrastructure

Merged PRs

#660: Update ingestion server in staging and production
#654: Fix a typo in the staging deployment SlackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. message
#649: Remove cpu setting from frontend container

Closed issues

#653: Temporarily reduce the number of indexer workers for the data refresh process

#openverse, #week-in-openverse

dhruvkb 12:16 am on October 16, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-10-09 – 2023-10-16

openverse

Merged PRs

#3191: Re-add the style to tags container
#3187: Remove unused thumb tapes
#3186: Fix single result page test flakiness
#3183: Publish changelog for api-2023.10.11.04.49.20
#3182: Fix PR review reminder DAG for case where base branch is 2+ levels deep
#3181: Handle related media with missing title
#3179: Add VRT for content safety page
#3178: Publish changelog for api-2023.10.10.21.08.33
#3177: Handle instances where media items do not have creator
#3176: Publish changelog for api-2023.10.10.18.42.39
#3175: Fix MRO to return 405 for unsupported methods
#3174: Fix storybook v-image-cell test
#3173: Add result kind to the `SELECT_SEARCH_RESULT` event
#3172: fix: Replace RequestError with BadRequestError
#3170: Publish changelog for frontend-2023.10.09.17.18.13
#3165: added robots.txt for APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. endpoints
#3153: Wait for Plausible active state
#3151: Simplify the related search
#3137: Create VTag component
#3108: Add frontend nginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. container for logging and plausible proxying
#3085: Update agilepathway/pull-request-label-checker Docker tag to v1.5.9

Closed issues

#3169: Replace elasticsearch RequestError with BadRequestError
#3149: Improve related endpoint performance
#3112: Flaky test: visual-regression/pages/pages-single-result.spec.ts:27:11 › screen at breakpoint lg with width 1024 › image rtl single-result page snapshots from search results
#3081: Add visual regression tests for the sensitive content explanation page
#3060: Define a `robots.txt` for the API
#2773: Component: `VTag`
#2489: `just frontend/init` fails with cryptic error if plausible service isn't ready for requests
#2374: Prevent failing at /v1/auth_tokens/token/ due to `MethodNotAllowed`
#377: FilterFilter Filters are one of the two types of Hooks https://codex.wordpress.org/Plugin_API/Hooks. They provide a way for functions to modify data of other functions. They are the counterpart to Actions. Unlike Actions, filters are meant to work in an isolated manner, and should never have side effects such as affecting global variables and output. and blur sensitive results by term matching

openverse-infrastructure

Merged PRs

#645: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org.
#641: Bump catalog to rel-2023.10.06.18.29.33
#640: Bump ingestion server to rel-2023.10.06.18.02.20
#639: Add CloudWatch agent to Elasticsearch
#634: 🔄 synced file(s) with WordPress/openverse
#632: Skip first day of month for unhealthy host count alarm in staging

Closed issues

#637: Enable Cloudwatch agent on Elasticsearch boxes
#607: Add downtime to the staging API unhealthy hosts monitor to account for monthly staging database reset

#openverse, #week-in-openverse

dhruvkb 12:16 am on October 9, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-10-02 – 2023-10-09

openverse

Merged PRs

#3160: Publish changelog for catalog-2023.10.06.18.29.33
#3159: Publish changelog for ingestion_server-2023.10.06.18.02.20
#3158: Publish changelog for api-2023.10.06.17.13.36
#3156: Use simple query for related
#3155: Update record count on about page
#3154: Update glibc
#3144: Enable the sensitive content flag and cleanup
#3138: Disable running Renovate on forks
#3134: Bump pillow from 9.5.0 to 10.0.1 in /utilities/provider_tallies
#3133: Bump postcss from 8.4.21 to 8.4.31
#3132: Bump psycopg2 from 2.9.8 to 2.9.9 in /ingestion_server
#3131: Bump django-redis from 5.3.0 to 5.4.0 in /api
#3130: Bump boto3 from 1.28.48 to 1.28.58 in /ingestion_server
#3129: Bump ipython from 8.16.0 to 8.16.1 in /api
#3128: Bump ipython from 8.16.0 to 8.16.1 in /automations/python
#3124: Bump urllib3 from 1.26.16 to 1.26.17 in /ingestion_server
#3123: Bump urllib3 from 1.26.16 to 1.26.17 in /api
#3120: Bump urllib3 from 2.0.5 to 2.0.6 in /documentation
#3119: Bump urllib3 from 2.0.5 to 2.0.6 in /automations/python
#3113: Skip flaky test
#3111: Add various action folders to Dependabot
#3110: Bump ipython from 8.15.0 to 8.16.1 in /ingestion_server
#3107: Remove monetization metaMeta Meta is a term that refers to the inside workings of a group. For us, this is the team that works on internal WordPress sites like WordCamp Central and Make WordPress. tag
#3103: Bump elasticsearch from 8.8.2 to 8.10.0 in /api
#3102: Bump pygithub from 1.59.1 to 2.1.1 in /automations/python
#3100: Bump fakeredis from 2.18.0 to 2.19.0 in /api
#3098: Bump jsonschema from 4.19.0 to 4.19.1 in /ingestion_server
#3097: Bump psycopg2 from 2.9.7 to 2.9.8 in /ingestion_server
#3095: Bump elasticsearch from 8.8.2 to 8.10.0 in /ingestion_server
#3094: Bump apacheApache Apache is the most widely used web server software. Developed and maintained by Apache Software Foundation. Apache is an Open Source software available for free.-airflow[amazon,httpHTTP HTTP is an acronym for Hyper Text Transfer Protocol. HTTP is the underlying protocol used by the World Wide Web and this protocol defines how messages are formatted and transmitted, and what actions Web servers and browsers should take in response to various commands.,postgres] from 2.7.0 to 2.7.1 in /catalog

Closed issues

#3152: Update record count on about page
#3142: Enable sensitive content feature flag in production & cleanup
#3135: <Replace this with actual title>
#3127: <Replace this with the actual title>
#3028: APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. memory leak
#3027: Undefined mediaResults when switching quickly between filters with license_type applied
#2616: ESLint editor integrations fail if `@openverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org./eslint-pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party` isn't built
#2550: Add a page explaining the sensitive content filtering approaches
#2305: Remove `boto3` dependency and the s3 configuration from the API
#1025: Add composite action folders to dependabot config
#614: Add types to `server-middleware/healthcheck.js`
#632: Use the timeout error page for timeout errors

openverse-infrastructure

Merged PRs

#633: 🔄 synced file(s) with WordPress/openverse
#631: 🔄 synced file(s) with WordPress/openverse
#627: Define alarms for API Thumbnails 2XX & 5XX responses and Request Count

Closed issues

#636: Add timing information to ES queries

#openverse, #week-in-openverse

dhruvkb 12:16 am on October 2, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-09-25 – 2023-10-02

openverse

Merged PRs

#3099: Bump ipython from 8.14.0 to 8.16.0 in /automations/python
#3084: Publish changelog for api-2023.09.30.00.15.32
#3083: Increase the APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. sources cache TTL from 20 minutes to 4 hours
#3082: Publish changelog for ingestion_server-2023.09.29.17.40.50
#3079: Update `_AIRFLOW_DB_UPGRADE` to `_AIRFLOW_DB_MIGRATE`
#3071: Use fully qualified docker image names
#3070: Publish changelog for api-2023.09.28.00.26.34
#3068: Transfer UUID validation inside serializer
#3064: Upgrade psycopg to version 3 in the API
#3063: Publish changelog for frontend-2023.09.25.22.11.48
#3062: Publish changelog for api-2023.09.25.21.34.44
#3061: generate-dag-docs recipe move DAGs.md to documentation folder
#3055: Replace deprecated body in the ES requests with individual parameters
#3053: Add thumbnail repsonse time runbooks
#3026: Update VSourcesTable.vue
#3012: Add runbooks for Nuxt response times alarms

Closed issues

#3077: Update `_AIRFLOW_DB_UPGRADE` to `_AIRFLOW_DB_MIGRATE`
#3057: Validation error in OEmbed endpoint
#3043: Replace deprecated `body` in the ES requests
#3023: Use fully qualified image names
#1847: Include DAGs.md in documentation
#469: iNaturalist appears last in the alphabetically-sorted sources table

openverse-infrastructure

Merged PRs

#630: Change production API log level from WARNING to INFO
#628: Bump ingestion server version to 2023.09.29.17.40.50

#openverse, #week-in-openverse

dhruvkb 12:16 am on September 25, 2023
Tags: openverse ( 82 ), week-in-openverse

A week in Openverse: 2023-09-18 – 2023-09-25

openverse

Merged PRs

#3059: Fixes `KeyError` for `media_serializers.py`
#3054: Start data refreshes on Mondays UTC 00:00
#3052: Bump cryptography from 41.0.3 to 41.0.4 in /automations/python
#3050: Publish changelog for api-2023.09.20.11.16.51
#3049: Publish changelog for api-2023.09.20.07.37.52
#3048: Replace gevent with uvloop
#3047: Re-add gevent monkey-patching
#3044: Configure conf options as parameters
#3041: Remove mentions of tailwind-config-viewer from docs
#3040: Publish changelog for api-2023.09.19.08.13.24
#3039: Add pagination examples to fix DRF spectacular warnings
#3038: Reference WordPress CoC and etiquette in OpenverseOpenverse Openverse is a search engine for openly-licensed media, including images and audio. Find Openverse on GitHub and at https://openverse.org. CoC
#3036: Remove `django-storages` and associated conf
#3035: Correctly set up constant fields in APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. responses
#3033: Publish changelog for frontend-2023.09.18.10.25.25
#3032: Add Elasticsearch cluster maintenance documentation
#3029: Upgrade ES dependencies to match cluster version
#3022: Replace "mature" with "sensitive" in api help strings
#3008: Deduplicate checks between ESLint and TypeScript
#3001: Add runbooks for API response times alarms
#2891: Improve image grid

Closed issues

#3056: KeyError: 'reason'
#3037: Fix the API documentation pagination set up
#3034: Fix the API documentation set up for the constant fields
#3007: Enable import ESLint pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party's TypeScript rule override to deduplicate TypeScript functionality
#2976: Replace `CODE_OF_CONDUCT.md` with a reference to WordPress Foundation's community code of conduct
#2917: Update provider DAGs to configure conf options as @params
#2888: Remove `django-storages` dependency
#2833: Media results not checked for`undefined` before decoding
#2768: Image grid padding calculation issue
#2712: Tall images get poorly cropped and their license icons are hidden
#2625: `mature` -> `sensitive` copy changes for the API
#1881: Openverse deployments log
#1259: Missing logs when `pull_data` is manually failed
#547: Image results grid improvement
#563: Search results do not display the image license without hovering

openverse-infrastructure

Merged PRs

#623: 🔄 synced file(s) with WordPress/openverse
#622: Define API response time anomaly alarms and increase threshold
#621: Revert "Revert "Add canary service feature""
#620: Revert "Add canary service feature"
#619: Define alarms for API thumbnails response times
#618: Add canary service feature
#615: Define alarms for Nuxt response times
#614: Define alarms for API response times

Closed issues

#617: Create a "canary"/"migrator" API service with a single task to run migrations and unblock a rapid redeployment of a second API service that has the rest of the tasks

#openverse, #week-in-openverse

Welcome!

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Closed issues

Merged PRs

Merged PRs

Closed issues

Merged PRs

Closed issues