openverse

Merged PRs

• #2899: Bump boto3 from 1.28.20 to 1.28.34 in /ingestion_server
• #2892: Remove `gevent`, `django-braces`, and `ipaddress` dependencies
• #2875: Bump fakeredis from 2.15.0 to 2.18.0 in /api
• #2873: Bump jsonschema from 4.18.6 to 4.19.0 in /ingestion_server
• #2870: Bump furo from 2023.7.26 to 2023.8.19 in /documentation
• #2868: Bump pygithub from 1.59.0 to 1.59.1 in /automations/python
• #2866: Refactor search.vue and add it to tsconfig
• #2864: Revert changes to drop and recreate popularity constants views
• #2863: Update Tailwind `rounded-md`
• #2857: Publish changelog for frontend-2023.08.22.06.04.39
• #2856: Publish changelog for api-2023.08.22.04.57.04
• #2855: Add codespell pre-commit hook
• #2854: Add blurring to the global audio player
• #2852: Escape HTMLHTML HTML is an acronym for Hyper Text Markup Language. It is a markup language that is used in the development of web pages and websites. in media title and creator
• #2848: Fix nginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. redirect for no trailing slash
• #2847: Prevent errors when Plausible is not running
• #2841: Drop and recreate pop constants instead of refreshing
• #2824: Document Plausible configuration deployment & deprecated custom properties
• #2818: Update data refresh to use media tables
• #2803: Update audio and audioset_view to not rely on audio_view
• #2724: Update VSearchBarButton to use VButton instead of VIconButton

Closed issues

• #2890: Remove `django-braces` dependency from APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways.
• #2889: Remove `ipaddress` dependency from API
• #2862: Set `rounded-md` to 8px (instead of Tailwind default of 6px)
• #2861: Handle `SychronousOnlyOperation` exceptions
• #2787: Remove gevent
• #2785: Embed the production run command in the dockerfile rather than relying on ECS to override it
• #2658: Update right padding in HeaderHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes. internal
• #2094: Remove popularity steps from the data refresh DAGs
• #2093: Update ingestion server to copy data from the catalog media tables
• #1988: Update analytics documentation to include instructions for enabling the analytics feature flag
• #1880: Compress Docker images with zstd
• #378: Add pre-commit hooksHooks In WordPress theme and development, hooks are functions that can be applied to an action or a Filter in WordPress. Actions are functions performed when a certain event occurs in WordPress. Filters allow you to modify certain functions. Arguments used to hook both filters and actions look the same. for spell checking
• #658: SystemExit
• #728: Path `/static` redirects to port 8080

openverse-infrastructure

Merged PRs

• #601: Use built in API run command
• #600: Remove prod ES 7 cluster
• #598: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including photos, audio, and video. Openverse is also the name for the collection of related code repositories that make up the project. find Openverse at https://openverse.org.
• #596: Change tag `Name` of `prod_es_instances`
• #591: Make all-branch rule default for all repositories, add gh-pages rule
• #590: 🔄 synced file(s) with WordPress/openverse
• #588: Use built in API run command
• #584: Update production API services to use the new ES8 Cluster

Closed issues

• #597: Deprovision the ES7 cluster
• #593: Escape HTML in results
• #553: Upgrade to Elasticsearch 8
• #173: Set branch protection rules on both monorepo and infra repo for non-`main` branches.

#openverse, #week-in-openverse

openverse

Merged PRs

• #2842: Unexpose port 3000 from APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. Dockerfile
• #2837: Prevent < and > in commit titles from breaking dag-sync slackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. message
• #2832: Run API and Ingestion Server tests with all relevant ES versions
• #2830: Bump tornado from 6.3.2 to 6.3.3 in /documentation
• #2829: Publish changelog for api-2023.08.14.16.35.15
• #2828: Publish changelog for frontend-2023.08.14.16.26.44
• #2827: Remove reference to tailwind config viewer from docs
• #2826: Extract use-external-sources composable
• #2822: polyfill flatMap for Chrome < 69
• #2821: Fix VImageCell storybook test
• #2819: Update popularity refresh schedule and timeouts
• #2817: Adjust the date filterFilter Filters are one of the two types of Hooks https://codex.wordpress.org/Plugin_API/Hooks. They provide a way for functions to modify data of other functions. They are the counterpart to Actions. Unlike Actions, filters are meant to work in an isolated manner, and should never have side effects such as affecting global variables and output. in Europeana to pull updates rather than created records
• #2808: Set API Dockerfile run to production config
• #2783: Replace request mocks with pook in tests
• #2777: Remove `body` from the index.update elasticsearch requests
• #2748: Bump apacheApache Apache is the most widely used web server software. Developed and maintained by Apache Software Foundation. Apache is an Open Source software available for free.-airflow[amazon,httpHTTP HTTP is an acronym for Hyper Text Transfer Protocol. HTTP is the underlying protocol used by the World Wide Web and this protocol defines how messages are formatted and transmitted, and what actions Web servers and browsers should take in response to various commands.,postgres] from 2.6.2 to 2.6.3 in /catalog
• #2737: Fix mobile headerHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes. spacing
• #2660: Custom ESLint pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party to Skip Unit Tests if Preceded by Comment with GithubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ Issue Link
• #2647: Show individual doc differences for rendered documentation preview on PRs
• #2637: Project Proposal: OpenverseOpenverse Openverse is a search engine for openly-licensed media, including photos, audio, and video. Openverse is also the name for the collection of related code repositories that make up the project. find Openverse at https://openverse.org. Datasets
• #2490: JavaScriptJavaScript JavaScript or JS is an object-oriented computer programming language commonly used to create interactive effects within web browsers. WordPress makes extensive use of JS for a better user experience. While PHP is executed on the server, JS executes within a user’s browser. https://www.javascript.com/. to TypeScript

Closed issues

• #2825: Extract use-external-sources as a composable
• #2820: Storybook visual-regression/v-image-cell.spec.ts:19:9 › VImageCell › intrinsic loaded test is flaky
• #2785: Embed the production run command in the dockerfile rather than relying on ECS to override it
• #2776: The elasticsearch-py is deprecating `body` parameter in index.update calls in version 9
• #2745: Error when cleaning up vueuse event handlers on Chrome 68 TypeError: n.flatMap is not a function
• #2646: Add a list of (changed) rendered files to the "docs emitted" PR comment
• #2573: Custom ESLint plugin to allow skipped unit tests only if there is a comment attached to the test with a GitHub issue link
• #2342: Use TypeScript for Tailwind config
• #2092: Update the `popularity_refresh` DAG schedule and timeouts
• #1909: Remove Sphinx live view port forwarded to API container
• #1862: Add better error handling and reporting to the PR review reminders DAG
• #1268: Update Europeana to ingest by timestamp_updated

openverse-infrastructure

Merged PRs

• #588: Use built in API run command
• #586: Update org Terraform lock file
• #578: Use docker-compose for indexer worker, other init improvements

Closed issues

• #576: Convert indexer worker init into docker-compose format

#openverse, #week-in-openverse

openverse

Merged PRs

• #2812: Improve the docs
• #2809: Remove unused WSGIBasicAuth and django-cron
• #2806: Publish changelog for api-2023.08.08.22.22.02
• #2804: Publish changelog for frontend-2023.08.08.21.19.44
• #2781: fix: adding mce-visual-caret-hidden pattern to ignored Sentry errors
• #2778: Stop converting timeout error to an object in Nuxt APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. requests
• #2743: Fix audio snackbar and box audio seeking
• #2740: Clean up Popularity Refresh notifications and adjust poke interval

Closed issues

• #2786: Remove unused WSGI Basic Auth middleware
• #2779: Unrelated error sent to Sentry: TypeError: undefined is not an object (evaluating 'document.getElementsByClassName('hide-icon hidden mce-vis…
• #2746: Timeout errors are not handled correctly
• #2742: Audio instructions snackbar is not hidden when you navigate from All results to single result page
• #2566: Evaluate feasibility of Django ASGI and ADRF conversion
• #2511: Documentation is not emitted on PRs if playwright tests are skipped
• #2124: Boxed audio layout should not be seekable
• #2090: Complete a full run of all popularity_refresh DAGs
• #1239: Add link to quickstart at the top of the general setup documentation
• #1172: Automate project thread update reminders
• #1168: Add automation for projects
• #1166: Docs are missing explicit instructions to install `pnpm`
• #1059: Error in ingestion server tests: index `audio_temporary` not found
• #1035: Consider disabling exposed ports in CI to avoid port conflict flakiness
• #800: Bind adress 50280 is reported to be in use
• #779: Configure other filetypes in EditorConfig
• #778: Unify ESLint configuration between the JS automations and the frontend
• #772: Enable fallback in `just` scripts
• #479: Add an optional focus ring to `VLink` component
• #489: Add OpenverseOpenverse Openverse is a search engine for openly-licensed media, including photos, audio, and video. Openverse is also the name for the collection of related code repositories that make up the project. find Openverse at https://openverse.org. UA string to server-side API requests
• #493: Change the mobile content settings tabs using swipe gesture
• #507: Page for 'not supported' / 'coming soon' content types
• #508: Global audio e2e tests are failing
• #515: PR GHCR builds are adding `main` tag
• #296: Should we have an 'effort' label?
• #295: Remove manual `credits` section from release notes template
• #517: Replace @nuxtjs/svg `.svg?inline` components with native `svg`s
• #291: Explore splitting CI into multiple workflow files
• #290: Prevent workflows from eating up GitHubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/ openverse-bot user's API requests
• #275: Guard against PR pings when a PR has two reviews

openverse-infrastructure

Closed issues

• #520: Add alarms to alert when deployments never settle
• #498: Remove legacy Kibana instance
• #495: Use the warnings provider to add a note describing the expected plan when deployingDeploy Launching code from a local development environment to the production web server, so that it's available to visitors. the catalog
• #474: Broken link to the API deployment doc in README
• #444: Update README regarding new API deployment method
• #442: Remove Terraform version-specific note from README
• #421: Share mounts between NginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers. https://www.nginx.com/. and Docker to prevent duplicating static files
• #361: Address the archived browser extension repository
• #265: Look into best practices for `concrete` service module default tags
• #260: Airflow permission update errors
• #239: Audit all passwords to ensure we are not using any defaults
• #228: Expose the Airflow Configuration in the UIUI UI is an acronym for User Interface - the layout of the page the user interacts with. Think ‘how are they doing that’ and less about what they are doing.
• #220: Explore whether using a `callable_workflow` instead of a composite action would result in an easier to audit deployment log
• #212: Workflow to automatically sync updated deployment workflows to the repositories that need them
• #206: Add EventBridge matcher for container state change from Running to Stopped
• #191: Evaluate ElasticSearch 8 and/or OpenSearch
• #180: Store Elasticsearch log group
• #178: Change response status code widgets in Service-Dashboard to line graphs
• #145: Ability to run Django management commands in ECS
• #92: Move GitHub cross-repository label management into Terraform
• #54: Update Grafana provisioning to use static provisioning files as proposed in the monitoring RFC
• #53: Add Prometheus and GNU Mailman via ECS
• #48: API: postgres connection is crashing in production
• #43: Handle DNSDNS DNS is an acronym for Domain Name System - how you assign a human readable address to a website’s exact numeric coded location (ie. wordpress.org uses the actual IP address 198.143.164.252). records with CloudFlare terraform provider
• #37: Elasticsearch init does not finish
• #34: Create an Outage Protocol in P2P2 P2 or O2 is the term people use to refer to the Make WordPress blog. It can be found at https://make.wordpress.org/.
• #15: Catalog deployment documentation

#openverse, #week-in-openverse

openverse

Merged PRs

• #2771: Bump cryptography from 41.0.2 to 41.0.3 in /api
• #2770: Bump cryptography from 41.0.2 to 41.0.3 in /automations/python
• #2764: Bump nunjucks from 3.2.3 to 3.2.4
• #2763: bump django-cors-headers from 4.1.0 to 4.2.0 in /api
• #2762: Bump gunicorn from 20.1.0 to 21.2.0 in /api
• #2761: Bump django-redis from 5.2.0 to 5.3.0 in /api
• #2760: Bump furo from 2023.5.20 to 2023.7.26 in /documentation
• #2759: Bump sphinx from 6.2.1 to 7.1.1 in /documentation
• #2758: Bump hvac from 1.1.0 to 1.1.1 in /api
• #2757: Bump gevent from 22.10.2 to 23.7.0 in /api
• #2756: Bump boto3 from 1.26.165 to 1.28.16 in /ingestion_server
• #2755: Bump gunicorn from 20.1.0 to 21.2.0 in /ingestion_server
• #2753: Bump pyyaml from 6.0 to 6.0.1 in /ingestion_server
• #2752: Bump sentry-sdk from 1.26.0 to 1.29.0 in /ingestion_server
• #2751: Bump renovatebot/githubGitHub GitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/-action from 38.1.8 to 39.0.1
• #2750: Bump pyyaml from 6.0 to 6.0.1 in /automations/python
• #2749: Bump pyotp from 2.8.0 to 2.9.0 in /automations/python
• #2736: Add a wait for the fonts to load in the internal headerHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes. modal
• #2721: Rename `mature` to `includeSensitiveResults`
• #2676: Implementation Plan: Additional search views

Closed issues

• #2720: "visual-regression/v-header-internal.spec.ts:35:11 › VHeaderInternal › screen at breakpoint xs with width 340 › mobile-header-internal-modal-ltr" is flaky again
• #2560: Implementation Plan: Additional search views for the frontend
• #2548: Rename 'mature' query param to 'include_sensitive_results'
• #1381: Capture Phylopic creator even if only first or last name is defined

openverse-infrastructure

Merged PRs

• #583: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including photos, audio, and video. Openverse is also the name for the collection of related code repositories that make up the project. find Openverse at https://openverse.org.

#openverse, #week-in-openverse

openverse

Merged PRs

• #2741: Publish changelog for frontend-2023.07.28.23.42.26
• #2739: BlockBlock Block is the abstract term used to describe units of markup that, composed together, form the content or layout of a webpage using the WordPress editor. The idea combines concepts of what in the past may have achieved with shortcodes, custom HTML, and embed discovery into a single consistent API and user experience. crawling on search results views
• #2733: Add `additional_search_views` feature flag
• #2728: Fix double-scroll issue on iOSiOS The operating system used on iPhones and iPads. devices
• #2726: Re-add request ID tracking to APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. middleware
• #2723: Update VBackToSearchResultsLink size to "small"
• #2722: Extract `use-audio-snackbar` component
• #2719: Bump certifi from 2023.5.7 to 2023.7.22 in /automations/python
• #2718: Bump certifi from 2023.5.7 to 2023.7.22 in /ingestion_server
• #2717: Bump certifi from 2023.5.7 to 2023.7.22 in /api
• #2716: Bump certifi from 2023.5.7 to 2023.7.22 in /documentation
• #2714: Update the Box image and Large image cell component hover state
• #2713: Add test/ to .dockerignore to exlcude tests and test assets from frontend image build context
• #2707: Publish changelog for frontend-2023.07.24.21.23.45
• #2706: Publish changelog for api-2023.07.24.20.47.04
• #2703: Add additional details to implementation plan template
• #2700: useSensitiveMedia composable
• #2697: Create a new `VIconButton`
• #2696: Update back to results button area
• #2695: Extract reusable VAudioCollection.vue
• #2693: Remove External sources section from All content page
• #2691: Add development guidelines/documentation for eslint-pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party
• #2690: Corrections to the catalog & ingestion server deployment run books
• #2651: Content Safety UIUI UI is an acronym for User Interface - the layout of the page the user interacts with. Think ‘how are they doing that’ and less about what they are doing. for single results
• #2618: Fix fetching search results and handle fetching errors
• #2592: Add popularity refresh DAGs
• #2570: Make batched_update DAG resistent to mid-update failures
• #2386: Removed connection ID variables in favour of simply defining

Closed issues

• #2732: Add a switchable `additional_search_views` feature flag
• #2694: Extract `VAudioCollection` component
• #2683: Hidden headerHeader The header of your site is typically the first thing people will experience. The masthead or header art located across the top of your page is part of the look and feel of your website. It can influence a visitor’s opinion about your content and you/ your organization’s brand. It may also look different on different screen sizes. as scrolling down
• #2657: Update "Back to results" and "Report this content" buttons
• #2638: Request ID shows up as `[none]` in the logs
• #2588: Improve error handling in the media store
• #2507: Make batched_update DAG resilient to task failures
• #2499: Baseline monitoring changes for Terraform and the unhealthy host count alarm
• #2463: Component: 'Hide content' button
• #2462: Component: Content safety wall
• #2294: Remove connection ID environment variables in favor of simply defining them
• #2089: Create `popularity_refresh` DAG factory
• #856: Exclude tests and test assets from frontend image build context
• #505: Blur single results marked as sensitive
• #533: MetaMeta Meta is a term that refers to the inside workings of a group. For us, this is the team that works on internal WordPress sites like WordCamp Central and Make WordPress. search should be disabled on all content results

openverse-infrastructure

Merged PRs

• #580: Update catalog docker-compose to include triggerer
• #579: 🔄 synced file(s) with WordPress/openverseOpenverse Openverse is a search engine for openly-licensed media, including photos, audio, and video. Openverse is also the name for the collection of related code repositories that make up the project. find Openverse at https://openverse.org.
• #577: Quote datetime format string for indexer worker log config
• #573: Remove redundant gunicorn config for the API
• #569: Production Elasticsearch 8 cluster

Closed issues

• #575: Unquoted date format breaks indexer server `docker run` command

#openverse, #week-in-openverse