Title: Antsy for 3.6 to start and need a… Author: Jen Published: December 16, 2012 --- [ ](https://profiles.wordpress.org/jenmylo/) [Jen](https://profiles.wordpress.org/jenmylo/) 11:00 pm _on_ December 16, 2012 Tags: [importers ( 6 )](https://make.wordpress.org/core/tag/importers/), [plugin ( 3 )](https://make.wordpress.org/core/tag/plugin/), twitter    # Antsy for 3.6 to start and need a… Antsy for 3.6 to start and need a project? Who wants to make an official importer for the new Twitter archives? Would think we’ll want to add that into the importers list. Would suggest importer auto-assign “status” or “aside” post format (or make it an option in the pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory [https://wordpress.org/plugins/](https://wordpress.org/plugins/) or can be cost-based plugin from a third-party. to choose format). Who’s in? I volunteer to ux review and test. 🙂 http://thenextweb.com/twitter/2012/12/16/twitter-has- started-rolling-out-the-option-to-download-all-your-tweets/ [#importers](https://make.wordpress.org/core/tag/importers/), [#plugin](https://make.wordpress.org/core/tag/plugin/), [#twitter](https://make.wordpress.org/core/tag/twitter/) ### Share this: * [ Threads ](https://make.wordpress.org/core/2012/12/16/antsy-for-3-6-to-start-and-need-a/?share=threads) * [ Mastodon ](https://make.wordpress.org/core/2012/12/16/antsy-for-3-6-to-start-and-need-a/?share=mastodon) * [ Bluesky ](https://make.wordpress.org/core/2012/12/16/antsy-for-3-6-to-start-and-need-a/?share=bluesky) * [ X ](https://make.wordpress.org/core/2012/12/16/antsy-for-3-6-to-start-and-need-a/?share=x) * [ Facebook ](https://make.wordpress.org/core/2012/12/16/antsy-for-3-6-to-start-and-need-a/?share=facebook) * [ LinkedIn ](https://make.wordpress.org/core/2012/12/16/antsy-for-3-6-to-start-and-need-a/?share=linkedin) 1. ![](https://secure.gravatar.com/avatar/eb35704499c3f93dcf67a9c54f5cc3d3998218b0d277746e09de0fb7956ce9f9? s=32&d=mm&r=g) 2. [Aaron Brazell](https://profiles.wordpress.org/technosailor/) 11:05 pm _on_ December 16, 2012 3. I already was planning on doing this as a pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory [https://wordpress.org/plugins/](https://wordpress.org/plugins/) or can be cost-based plugin from a third-party., and I’ve been quiet for awhile. I can do this. But… I need to have the archives available to me, and my account doesn’t have it yet. 4. * ![](https://secure.gravatar.com/avatar/9c184f96bd47233afcf0623851f129c13009d7886753f40867c9d4b5856ec080? s=32&d=mm&r=g) * [Jane Wells](https://profiles.wordpress.org/jenmylo/) 11:26 pm _on_ December 16, 2012 * Mine either, but I’ll see if I can wrangle one we can use. * ![](https://secure.gravatar.com/avatar/ba937927014c577fae3acb28246ab9b58d342e9f98099a88a97b16e3d3ab55e6? s=32&d=mm&r=g) * [Ryan Duff](https://profiles.wordpress.org/ryanduff/) 11:26 pm _on_ December 16, 2012 * Or as soon as someone gets and volunteers a copy of their archive. From the post it doesn’t seem there’s an api, but a set of htmlHTML HyperText Markup Language. The semantic scripting language primarily used for outputting content in web browsers. pages + xml, or jsonJSON JSON, or JavaScript Object Notation, is a minimal, readable format for structuring data. It is used primarily to transmit data between a server and web application, as an alternative to XML. files (pick your poison) * Also, from what I’ve heard they files are monthly, so if you’ve been on Twitter for 4 years you’d be looking at 48 json files to handle w/ an importer. * Of course that’s all based off what I’ve read. I don’t have it yet. Just something to chew on. - ![](https://secure.gravatar.com/avatar/eb35704499c3f93dcf67a9c54f5cc3d3998218b0d277746e09de0fb7956ce9f9? s=32&d=mm&r=g) - [Aaron Brazell](https://profiles.wordpress.org/technosailor/) 11:32 pm _on_ December 16, 2012 - Yeah it’ll be an interesting challenge but I wanna see what the data looks like first. If they turn it on for me, I’ve got 6 years of archives which would be a good stress test too. * ![](https://secure.gravatar.com/avatar/1a7df76f4f6519a5618c32428b277a5c7a89798394965b67e50528ca57c1b5a8? s=32&d=mm&r=g) * [Andrew Nacin](https://profiles.wordpress.org/nacin/) 11:33 pm _on_ December 16, 2012 * Could handle the zip that they send you as-is. In fact, I imagine that would be the best approach for users. - ![](https://secure.gravatar.com/avatar/eb35704499c3f93dcf67a9c54f5cc3d3998218b0d277746e09de0fb7956ce9f9? s=32&d=mm&r=g) - [Aaron Brazell](https://profiles.wordpress.org/technosailor/) 2: 54 pm _on_ December 17, 2012 - I feel like we need to be able to parse the HTMLHTML HyperText Markup Language. The semantic scripting language primarily used for outputting content in web browsers., CSV and JSONJSON JSON, or JavaScript Object Notation, is a minimal, readable format for structuring data. It is used primarily to transmit data between a server and web application, as an alternative to XML. in any zip file if we approach it that way. From the user perspective, I think you’re right but I sure hope the CSV and HTML are decent enough. - ![](https://secure.gravatar.com/avatar/250257111d1248c34046552bbcdf6999949ef56b2f992dd5eb39bf45cabeb18a? s=32&d=mm&r=g) - [Samuel Wood (Otto)](https://profiles.wordpress.org/otto42/) 11:38 pm _on_ December 16, 2012 - It’ll just be a matter of iterating the jsonJSON JSON, or JavaScript Object Notation, is a minimal, readable format for structuring data. It is used primarily to transmit data between a server and web application, as an alternative to XML.. Simple stupid, for the most part. 5. ![](https://secure.gravatar.com/avatar/250257111d1248c34046552bbcdf6999949ef56b2f992dd5eb39bf45cabeb18a? s=32&d=mm&r=g) 6. [Samuel Wood (Otto)](https://profiles.wordpress.org/otto42/) 11:06 pm _on_ December 16, 2012 7. If they actually roll it out to people unchanged, then it should be fairly trivial. When I get it on my account, I’ll let you know. 8. ![](https://secure.gravatar.com/avatar/9313d724fe0c0d4aaf6a2486e7cbcba00590de96ed449779babbba3505ff379a? s=32&d=mm&r=g) 9. [Phil Erb](https://profiles.wordpress.org/philerb/) 11:25 pm _on_ December 16, 2012 10. When archives are available to me, I’d love to help test. 11. ![](https://secure.gravatar.com/avatar/1a7df76f4f6519a5618c32428b277a5c7a89798394965b67e50528ca57c1b5a8? s=32&d=mm&r=g) 12. [Andrew Nacin](https://profiles.wordpress.org/nacin/) 11:36 pm _on_ December 16, 2012 13. We now have an APIAPI An API or Application Programming Interface is a software intermediary that allows programs to interact with each other and share data in limited, clearly defined ways. for importers, which means we can add this to wp- adminadmin (and super admin)/import.php the moment it is done. 14. When anyone gets access to their zip, please share it (or at least a sample so we can learn the format). 15. ![](https://secure.gravatar.com/avatar/87f8c2bbfabbae3462bbab2c83ce82763c7ff91bc632b64f3af7e24d929633f6? s=32&d=mm&r=g) 16. [Aaron D. Campbell](https://profiles.wordpress.org/aaroncampbell/) 12:29 am _on_ December 17, 2012 17. Looks like my account has the option. I’m requesting an archive and will post it somewhere to use. 18. * ![](https://secure.gravatar.com/avatar/87f8c2bbfabbae3462bbab2c83ce82763c7ff91bc632b64f3af7e24d929633f6? s=32&d=mm&r=g) * [Aaron D. Campbell](https://profiles.wordpress.org/aaroncampbell/) 12:39 am _on_ December 17, 2012 * Looks like it comes down to a bunch of poorly formatted CSV files. Here’s what they sent me: [http://s.ran.ge/0o2F011v3I2p](http://s.ran.ge/0o2F011v3I2p) * The CSVs don’t quote data, so commas in the tweet will be a bit of a pain. However, since it’s ID, time, tweet you can probably just process the ID and time, then assume the rest is the tweet (trimming the strange trailing comma). - ![](https://secure.gravatar.com/avatar/c5a8ef92e2c96e80ead10c58086bdbfcd803797e40e45a409a8ff50d83bfb586? s=32&d=mm&r=g) - [deltafactory](https://profiles.wordpress.org/deltafactory/) 6:04 am _on_ December 17, 2012 - I’d be curious to peek at the format. Your link is broken – not sure if that was intentional or not. * ![](https://secure.gravatar.com/avatar/87f8c2bbfabbae3462bbab2c83ce82763c7ff91bc632b64f3af7e24d929633f6? s=32&d=mm&r=g) * [Aaron D. Campbell](https://profiles.wordpress.org/aaroncampbell/) 8:56 pm _on_ December 17, 2012 * Sorry about the broken link. I uploaded the export to the TracTrac An open source project by Edgewall Software that serves as a bug tracker and project management tool for WordPress. ticketticket Created for both bug reports and feature development on the bug tracker.: [https://core.trac.wordpress.org/ticket/22981](https://core.trac.wordpress.org/ticket/22981) - ![](https://secure.gravatar.com/avatar/9c184f96bd47233afcf0623851f129c13009d7886753f40867c9d4b5856ec080? s=32&d=mm&r=g) - [Jane Wells](https://profiles.wordpress.org/jenmylo/) 6:12 pm _on_ December 19, 2012 - I mentioned to Ev that commas in tweets was requiring some hackiness. * ![](https://secure.gravatar.com/avatar/b7de6a94b9995112e7a39ae351e78c0a04431cf6e069662ba2645b58ac4b8473? s=32&d=mm&r=g) * [Pete Mall](https://profiles.wordpress.org/petemall/) 9:23 pm _on_ December 19, 2012 * We don’t have to worry about it since we are using the JSONJSON JSON, or JavaScript Object Notation, is a minimal, readable format for structuring data. It is used primarily to transmit data between a server and web application, as an alternative to XML. instead of the CSV. - ![](https://secure.gravatar.com/avatar/b5f16acb1bc24ca6bf644adb593384de64046fa69c5de867a7647c7f736a1271? s=32&d=mm&r=g) - [Alex Mills (Viper007Bond)](https://profiles.wordpress.org/viper007bond/) 9:30 pm _on_ December 19, 2012 - True, but still a bugbug A bug is an error or unexpected result. Performance improvements, code optimization, and are considered enhancements, not defects. After feature freeze, only bugs are dealt with, with regressions (adverse changes from the previous version) being the highest priority.. Delimiters in CSVs need to be escaped. 19. ![](https://secure.gravatar.com/avatar/c1d3a178d0b39565183051195916eb759a0c76bdc24f8154ea16a69d8389a3bf? s=32&d=mm&r=g) 20. Anonymous User 6:53 am _on_ December 17, 2012 21. Wouldn’t it be more sensible to have this as a 3rd party pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory [https://wordpress.org/plugins/](https://wordpress.org/plugins/) or can be cost- based plugin from a third-party., rather than having to maintain more bloat? 22. * ![](https://secure.gravatar.com/avatar/34368b9c92a4bfa3bd2a84a222147375526d5ccfbbb3afe32abfbd1bc37f5b58? s=32&d=mm&r=g) * [Peter Westwood](https://profiles.wordpress.org/westi/) 10:40 am _on_ December 17, 2012 * It will be a pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory [https://wordpress.org/plugins/](https://wordpress.org/plugins/) or can be cost-based plugin from a third-party. anyway not in the coreCore Core is the set of software required to run WordPress. The Core Development Team builds WordPress. download – all the importers are plugins now. - ![](https://secure.gravatar.com/avatar/c1d3a178d0b39565183051195916eb759a0c76bdc24f8154ea16a69d8389a3bf? s=32&d=mm&r=g) - Anonymous User 6:21 am _on_ December 18, 2012 - Actually forgot about that! Shows how often I’ve used that feature. I stand corrected 🙂 * ![](https://secure.gravatar.com/avatar/9c184f96bd47233afcf0623851f129c13009d7886753f40867c9d4b5856ec080? s=32&d=mm&r=g) * [Jane Wells](https://profiles.wordpress.org/jenmylo/) 11:39 am _on_ December 17, 2012 * As [@westi](https://profiles.wordpress.org/westi/) states, all importers are plugins, not coreCore Core is the set of software required to run WordPress. The Core Development Team builds WordPress. code. I didn’t specify that in my post, since I took it as a given that core developers know that. 23. ![](https://secure.gravatar.com/avatar/e49d2b93d450309099cec2e577bc6fa5501b07ab80bdd7381eb971cc8137f717? s=32&d=mm&r=g) 24. [Simon Wheatley](https://profiles.wordpress.org/simonwheatley/) 8:34 am _on_ December 17, 2012 25. Note that the current Twitter IDs overflow (?) and corrupt if you convert them to integers on a 32bit system. That one has got me before. (Apologies if that’s teaching everyone to suck eggs.) 26. Also, would you mind putting in a filterFilter Filters are one of the two types of Hooks [https://codex.wordpress.org/Plugin_API/Hooks](https://codex.wordpress.org/Plugin_API/Hooks). They provide a way for functions to modify data of other functions. They are the counterpart to Actions. Unlike Actions, filters are meant to work in an isolated manner, and should never have side effects such as affecting global variables and output. for the post data before save… I’d prefer to store tweets in a custom post typeCustom Post Type WordPress can hold and display many different types of content. A single item of such a content is generally called a post, although post is also a specific post type. Custom Post Types gives your site the ability to have templated posts, to simplify the concept.. Ta! 🙂 27. * ![](https://secure.gravatar.com/avatar/d48e0f742e0182e0f377c1087a76c42abff4bf25a55a4f25b66c8ffd7fe869ce? s=32&d=mm&r=g) * [Brad Williams](https://profiles.wordpress.org/williamsba1/) 2:59 pm _on_ December 17, 2012 * Was thinking the same thing regarding CPTs. A filterFilter Filters are one of the two types of Hooks [https://codex.wordpress.org/Plugin_API/Hooks](https://codex.wordpress.org/Plugin_API/Hooks). They provide a way for functions to modify data of other functions. They are the counterpart to Actions. Unlike Actions, filters are meant to work in an isolated manner, and should never have side effects such as affecting global variables and output. would be perfect 28. ![](https://secure.gravatar.com/avatar/1a7df76f4f6519a5618c32428b277a5c7a89798394965b67e50528ca57c1b5a8? s=32&d=mm&r=g) 29. [Andrew Nacin](https://profiles.wordpress.org/nacin/) 6:49 pm _on_ December 17, 2012 30. I’ve outlined a potential plan for such an importer on a TracTrac An open source project by Edgewall Software that serves as a bug tracker and project management tool for WordPress. ticketticket Created for both bug reports and feature development on the bug tracker.: [https://core.trac.wordpress.org/ticket/22981](https://core.trac.wordpress.org/ticket/22981). If you want to continue to discuss the idea, feel free to do so here. Implementation can occur on the ticket. (This is a pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory [https://wordpress.org/plugins/](https://wordpress.org/plugins/) or can be cost-based plugin from a third-party., but an official importer is also a coreCore Core is the set of software required to run WordPress. The Core Development Team builds WordPress. priority, hence the use of core trac.) 31. I’ve also uploaded a tweet archive contributed by [@chadhuber](http://twitter.com/chadhuber) to the ticket. It **does** contain sane jsonJSON JSON, or JavaScript Object Notation, is a minimal, readable format for structuring data. It is used primarily to transmit data between a server and web application, as an alternative to XML.. 32. * ![](https://secure.gravatar.com/avatar/b7de6a94b9995112e7a39ae351e78c0a04431cf6e069662ba2645b58ac4b8473? s=32&d=mm&r=g) * [Pete Mall](https://profiles.wordpress.org/petemall/) 6:56 pm _on_ December 17, 2012 * [@aaroncampbell](https://profiles.wordpress.org/aaroncampbell/) and I worked on the pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory [https://wordpress.org/plugins/](https://wordpress.org/plugins/) or can be cost-based plugin from a third-party. yesterday. There’s an early patchpatch A special text file that describes changes to code, by identifying the files and lines which are added, removed, and altered. It may also be referred to as a **diff**. A patch can be _applied_ to a codebase for testing. on the ticketticket Created for both bug reports and feature development on the bug tracker. already. I’m working on it today and will add an updated patch eod. 33. ![](https://secure.gravatar.com/avatar/d7a8778a3ad9a1b17d7c2c1bb5026ca4565f46bb5552c8f8853053279b02563e? s=32&d=mm&r=g) 34. [Beau Lebens](https://profiles.wordpress.org/beaulebens/) 9:23 pm _on_ December 17, 2012 35. In case it helps, I already made one, packaged in here: [https://wordpress.org/extend/plugins/keyring-social-importers/](https://wordpress.org/extend/plugins/keyring-social-importers/) 36. * ![](https://secure.gravatar.com/avatar/b7de6a94b9995112e7a39ae351e78c0a04431cf6e069662ba2645b58ac4b8473? s=32&d=mm&r=g) * [Pete Mall](https://profiles.wordpress.org/petemall/) 9:26 pm _on_ December 17, 2012 * Looks like we should be able to use your “parser”. Comments are closed. # Post navigation [← Went to tally team rep votes and only…](https://make.wordpress.org/core/2012/12/16/went-to-tally-team-rep-votes-and-only/) [The release cycle for WordPress 3.6 isn’t going… →](https://make.wordpress.org/core/2012/12/17/the-release-cycle-has-wordpress-3-6-isnt-going/)