653 rows

View and edit SQL

rowid repo release date body_markdown published_at topics
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.6 2020-11-28
  • Now adds a link to Datasette's global navigation menu. #16
  • Code snippets in search scroll horizontally.
2020-11-28T22:28:30Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.5 2020-11-28
  • Support for ?glob= option for adding -g file filter patterns. #9
  • Improved configuration instructions. #15
2020-11-28T20:02:36Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.4 2020-11-28
  • Show context around each match. #13
  • Use :target CSS instead of JavaScript to highlight linked line. Thanks, Louis Lévêque. #14
2020-11-28T18:07:08Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.3 2020-11-28
  • Option to ignore case. #12
  • Option to treat input as a literal string, not a regular expression. #8
2020-11-28T16:57:14Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.2.1 2020-11-28
  • Fixed a bug where patterns like -v could be interpreted as command-line arguments. #7
  • Links to view files now correctly escape characters such as {.
2020-11-28T16:16:38Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.2 2020-11-28
  • Search results now link to the full source code, with line numbers and highlights. #4
  • Respect view-instance permission, so you can protect this using Datasette's authentication and permissions system. #6
2020-11-28T06:23:37Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.1 2020-11-26
  • First non-alpha release
  • Now implements both a time limit and a lines-returned limit. #3
  • New time_limit and max_lines configuration options.
  • Live demo at https://ripgrep.datasette.io/-/ripgrep
2020-11-26T02:36:56Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
209091256 https://github.com/simonw/datasette-atom https://github.com/simonw/datasette-atom/releases/tag/0.8.1 2020-11-25
  • Removed rogue print statement. #14
2020-11-25T19:40:13Z ["datasette", "datasette-io", "datasette-plugin"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.1a1 2020-11-25
  • Fixed bug where template was not packaged in the release. #1
  • Fixed bug caused by call to proc.terminate()
2020-11-25T01:56:20Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.1a0 2020-11-25
  • Initial alpha prototype
2020-11-25T01:28:13Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
284383265 https://github.com/simonw/datasette-graphql https://github.com/simonw/datasette-graphql/releases/tag/1.2.1 2020-11-24
  • Fix for forthcoming change to Datasette undocumented internal method. #66
  • Now tested against Python 3.9
2020-11-24T21:56:43Z ["datasette", "datasette-io", "datasette-plugin", "graphql", "sqlite"]
284383265 https://github.com/simonw/datasette-graphql https://github.com/simonw/datasette-graphql/releases/tag/1.2 2020-11-21
  • Plugin now respects the view-instance and view-database permissions. Previously the plugin could expose schema details of databases that should not be visible, though not their actual row content. See security advisory: datasette-graphql leaks details of the schema of private database files . #65
  • Adds links to the GraphQL API in the database and table action menus, including example table queries. #63
  • Running the plugin against Datasette with no attached databases no longer returns a 500 error. #64
2020-11-21T22:05:14Z ["datasette", "datasette-io", "datasette-plugin", "graphql", "sqlite"]
281481347 https://github.com/simonw/datasette-copyable https://github.com/simonw/datasette-copyable/releases/tag/0.3.1 2020-11-14
  • Fixed 500 error with .copyable?_labels=on. #4
2020-11-14T21:45:10Z ["datasette", "datasette-io", "datasette-plugin"]
245856731 https://github.com/simonw/datasette-search-all https://github.com/simonw/datasette-search-all/releases/tag/1.0 2020-11-12
  • Added loading indicators. #7
  • URLs in search results are turned into links. #9
  • Now uses datasette.urls to construct paths that work with the base_url config setting. #10
  • Adds a link to Datasette navigation menu. #11
2020-11-12T22:34:18Z ["datasette", "datasette-io", "datasette-plugin", "search"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/3.0 2020-11-08

This release introduces a new sqlite-utils search command for searching tables, see Executing searches. (#192)

The table.search() method has been redesigned, see Searching with table.search(). (#197)

The release includes minor backwards-incompatible changes, hence the version bump to 3.0. Those changes, which should not affect most users, are:

  • The -c shortcut option for outputting CSV is no longer available. The full --csv option is required instead.
  • The -f shortcut for --fmt has also been removed - use --fmt.
  • The table.search() method now defaults to sorting by relevance, not sorting by rowid. (#198)
  • The table.search() method now returns a generator over a list of Python dictionaries. It previously returned a list of tuples.

Also in this release:

  • The query, tables, rows and search CLI commands now accept a new --tsv option which outputs the results in TSV. (#193)
  • A new table.virtual_table_using property reveals if a table is a virtual table, and returns the upper case type of virtual table (e.g. FTS4 or FTS5) if it is. It returns None if the table is not a virtual table. (#196)
  • The new table.search_sql() method returns the SQL for searching a table, see Building SQL queries with table.search_sql().
  • sqlite-utils rows now accepts multiple optional -c parameters specifying the columns to return. (#200)

Changes since the 3.0a0 alpha release:

  • The sqlite-utils search command now defaults to returning every result, unless you add a --limit 20 option.
  • The sqlite-utils search -c and table.search(columns=[]) options are now fully respected. (#201)
2020-11-08T17:24:27Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/3.0a0 2020-11-07

This release introduces a new sqlite-utils search command for searching tables, see Executing searches. (#192)

The table.search() method has been redesigned, see Searching with table.search(). (#197)

The release includes minor backwards-incompatible changes, hence the version bump to 3.0. Those changes, which should not affect most users, are:

  • The -c shortcut option for outputting CSV is no longer available. The full --csv option is required instead.
  • The -f shortcut for --fmt has also been removed - use --fmt.
  • The table.search() method now defaults to sorting by relevance, not sorting by rowid. (#198)
  • The table.search() method now returns a generator over a list of Python dictionaries. It previously returned a list of tuples.

Also in this release:

  • The query, tables, rows and search CLI commands now accept a new --tsv option which outputs the results in TSV. (#193)
  • A new table.virtual_table_using property reveals if a table is a virtual table, and returns the upper case type of virtual table (e.g. FTS4 or FTS5) if it is. It returns None if the table is not a virtual table. (#196)
  • The new table.search_sql() method returns the SQL for searching a table, see Building SQL queries with table.search_sql().
  • sqlite-utils rows now accepts multiple optional -c parameters specifying the columns to return. (#200)
2020-11-07T01:24:43Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
110509816 https://github.com/simonw/csvs-to-sqlite https://github.com/simonw/csvs-to-sqlite/releases/tag/1.2 2020-11-03
  • Upgraded dependencies, including Pandas. #73
2020-11-03T23:27:47Z ["click", "csv", "datasette", "datasette-io", "datasette-tool", "pandas", "python", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51.1 2020-11-01
  • Improvements to the new Binary data documentation page.
2020-11-01T03:34:36Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
243887036 https://github.com/simonw/datasette-configure-fts https://github.com/simonw/datasette-configure-fts/releases/tag/1.1 2020-11-01
  • Link to interface from table actions menu. #12
2020-11-01T02:31:01Z ["datasette", "datasette-io", "datasette-plugin"]
284383265 https://github.com/simonw/datasette-graphql https://github.com/simonw/datasette-graphql/releases/tag/1.1 2020-11-01
  • Adds "GraphQL API" link to Datasette's new navigation menu, added in Datasette 0.51. #62
2020-11-01T02:10:32Z ["datasette", "datasette-io", "datasette-plugin", "graphql", "sqlite"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.4 2020-10-31
  • Registers a table action using the new table_actions() plugin hook in Datasette 0.51. #26
2020-10-31T22:56:51Z ["datasette", "datasette-io", "datasette-plugin"]
234825790 https://github.com/simonw/datasette-upload-csvs https://github.com/simonw/datasette-upload-csvs/releases/tag/0.6 2020-10-31
  • Adds link to Datasette's new navigation menu, added in Datasette 0.51. #15
2020-10-31T22:45:20Z ["csvs", "datasette", "datasette-io", "datasette-plugin"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51 2020-10-31

A new visual design, plugin hooks for adding navigation options, better handling of binary data, URL building utility methods and better support for running Datasette behind a proxy.

New visual design

Datasette is no longer white and grey with blue and purple links! Natalie Downe has been working on a visual refresh, the first iteration of which is included in this release. (#1056)

<img alt="datasette-0 51" src="https://user-images.githubusercontent.com/9599/97791267-d9011e80-1b8d-11eb-9b1b-42908266f36f.png">

Plugins can now add links within Datasette

A number of existing Datasette plugins add new pages to the Datasette interface, providig tools for things like uploading CSVs, editing table schemas or configuring full-text search.

Plugins like this can now link to themselves from other parts of Datasette interface. The menu_links(datasette, actor) hook (#1064) lets plugins add links to Datasette's new top-right application menu, and the table_actions(datasette, actor, database, table) hook (#1066) adds links to a new "table actions" menu on the table page.

The demo at latest.datasette.io now includes some example plugins. To see the new table actions menu first sign into that demo as root and then visit the facetable table to see the new cog icon menu at the top of the page.

Binary data

SQLite tables can contain binary data in BLOB columns. Datasette now provides links for users to download this data directly from Datasette, and uses those links to make binary data available from CSV exports. See Binary data for more details. (#1036 and #1034).

URL building

The new datasette.urls family of methods can be used to generate URLs to key pages within the Datasette interface, both within custom templates and Datasette plugins. See Building URLs within plugins for more details. (#904)

Running Datasette behind a proxy

The base_url configuration option is designed to help run Datasette on a specific path behind a proxy - for example if you want to run an instance of Datasette at /my-datasette/ within your existing site's URL hierarchy, proxied behind nginx or Apache.

Support for this configuration option has been greatly improved (#1023), and guidelines for using it are now available in a new documentation section on Running Datasette behind a proxy. (#1027)

Smaller changes

  • Wide tables shown within Datasette now scroll horizontally (#998). This is achieved using a new <div class="table-wrapper"> element which may impact the implementation of some plugins (for example this change to datasette-cluster-map).
  • New debug-menu permission. (#1068)
  • Removed --debug option, which didn't do anything. (#814)
  • Link: HTTP header pagination. (#1014)
  • x button for clearing filters. (#1016)
  • Edit SQL button on canned queries, (#1019)
  • --load-extension=spatialite shortcut. (#1028)
  • scale-in animation for column action menu. (#1039)
  • Option to pass a list of templates to .render_template() is now documented. (#1045)
  • New datasette.urls.static_plugins() method. (#1033)
  • datasette -o option now opens the most relevant page. (#976)
  • datasette --cors option now enables access to /database.db downloads. (#1057)
  • Database file downloads now implement cascading permissions, so you can download a database if you have view-database-download permission even if you do not have permission to access the Datasette instance. (#1058)
  • New documentation on Designing URLs for your plugin. (#1053)
2020-10-31T22:29:33Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51a2 2020-10-30
2020-10-30T17:57:53Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.4a0 2020-10-30
  • Registers a table action using the new table_actions() plugin hook. #26
2020-10-30T05:51:34Z ["datasette", "datasette-io", "datasette-plugin"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51a1 2020-10-30
  • New colour scheme and improved visual design, courtesy of Natalie Downe. (#1056)
  • scale-in animation for column action menu. (#1039)
  • Wide tables now scroll horizontally. (#998)
  • Option to pass a list of templates to .render_template() is now documented. (#1045)
  • New datasette.urls.static_plugins() method. (#1033)
  • BLOB column values can now be downloaded directly from the Datasette UI. (#1036)
  • .csv exports now link to direct BLOB downloads. (#1034)
  • datasette -o option now opens the most relevant page. (#976)
  • datasette --cors option now enables access to /database.db downloads. (#1057)
  • Database file downloads now implement cascading permissions, so you can download a database if you have view-database-download permission even if you do not have permission to access the Datasette instance. (#1058)
  • New documentation on Designing URLs for your plugin. (#1053)
  • New navigation menu plus a menu_links(datasette, actor) plugin hook to customize it. (#1064)
  • table_actions(datasette, actor, database, table) plugin hook for the new table actions menu. (#1066)
2020-10-30T05:37:34Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
220716822 https://github.com/simonw/datasette-render-markdown https://github.com/simonw/datasette-render-markdown/releases/tag/1.2 2020-10-28
  • Now uses white-space: normal to fix a bug caused by Datasette's use of white-space: pre-wrap. #9
2020-10-28T22:54:59Z ["datasette", "datasette-io", "datasette-plugin", "markdown"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/2.23 2020-10-28
  • table.m2m(other_table, records) method now takes any iterable, not just a list or tuple. Thanks, Adam Wolf. (#189)
  • sqlite-utils insert now displays a progress bar for CSV or TSV imports. (#173)
  • New @db.register_function(deterministic=True) option for registering deterministic SQLite functions in Python 3.8 or higher. (#191)
2020-10-28T21:38:54Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
305199661 https://github.com/simonw/sphinx-to-sqlite https://github.com/simonw/sphinx-to-sqlite/releases/tag/0.1a1 2020-10-22
  • Fixed a bug where tokens did not have spaces between them. #2
2020-10-22T04:55:45Z ["datasette-io", "datasette-tool", "sphinx", "sqlite"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.14 2020-10-22
  • Forwards compatibility with a change to Datasette's HTML scheduled for the next Datasette release. (Datasette #998)
2020-10-22T03:52:30Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
206202864 https://github.com/dogsheep/inaturalist-to-sqlite https://github.com/dogsheep/inaturalist-to-sqlite/releases/tag/0.2.1 2020-10-22
  • Tweaked dependencies for compatibility with new PyPI resolver.
2020-10-22T00:08:58Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "inaturalist", "sqlite"]
213286752 https://github.com/dogsheep/pocket-to-sqlite https://github.com/dogsheep/pocket-to-sqlite/releases/tag/0.2.1 2020-10-22
  • Tweaked dependencies for compatibility with new PyPI resolver.
2020-10-22T00:08:24Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "pocket", "pocket-api", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51a0 2020-10-20
  • Fixed a bunch of issues relating to the base_url setting. (#1023)
  • New datasette.urls URL builder for plugins, see Building URLs within plugins. (#904)
  • Removed --debug option, which didn't do anything. (#814)
  • Link: HTTP header pagination. (#1014)
  • x button for clearing filters. (#1016)
  • Edit SQL button on canned queries, (#1019)
  • --load-extension=spatialite shortcut. (#1028)
2020-10-20T05:33:01Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.13 2020-10-19
  • Default popup window row representation is now a definition list, not JSON. #20
2020-10-19T21:39:40Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
207052882 https://github.com/dogsheep/github-to-sqlite https://github.com/dogsheep/github-to-sqlite/releases/tag/2.7 2020-10-19
  • github-to-sqlite repos command now takes options --readme and --readme-html, which write the README or rendered HTML README into the readme or readme_html columns, respectively. #52
  • New --accept option for github-to-sqlite get. #50
2020-10-19T05:38:34Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "github-api", "sqlite"]
305199661 https://github.com/simonw/sphinx-to-sqlite https://github.com/simonw/sphinx-to-sqlite/releases/tag/0.1a 2020-10-18

Initial alpha release.

2020-10-18T21:28:45Z ["datasette-io", "datasette-tool", "sphinx", "sqlite"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.9 2020-10-17
  • Facet by date. #16
  • Now depends on Datasette 0.50.2
  • Uses datasette.client and passes through authentication cookies. #28
2020-10-17T23:03:04Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197882382 https://github.com/dogsheep/healthkit-to-sqlite https://github.com/dogsheep/healthkit-to-sqlite/releases/tag/1.0 2020-10-17
  • Fixed a bug where export files generated in languages other than English failed to import. #11
  • CI now uses GitHub Actions
2020-10-17T21:17:34Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "healthkit", "sqlite"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/2.22 2020-10-16
  • New --encoding option for processing CSV and TSV files that use a non-utf-8 encoding, for both the insert and update commands. (#182)
  • The --load-extension option is now available to many more commands. (#137)
  • --load-extension=spatialite can be used to load SpatiaLite from common installation locations, if it is available. (#136)
  • Tests now also run against Python 3.9. (#184)
  • Passing pk=["id"] now has the same effect as passing pk="id". (#181)
2020-10-16T19:31:45Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
175321497 https://github.com/simonw/csv-diff https://github.com/simonw/csv-diff/releases/tag/1.0 2020-10-16
  • New --show-unchanged option for outputting the unchanged values of rows that had at least one change. #9
  • Fix for bug with column names that contained a . character. #7
  • Fix for error when no --key provided - thanks, @MainHanzo. #3
  • CSV delimiter sniffer now ; delimited files. #6
2020-10-16T01:31:05Z ["click", "csv", "datasette-io", "datasette-tool", "diff", "git-scraping"]
205429375 https://github.com/dogsheep/swarm-to-sqlite https://github.com/dogsheep/swarm-to-sqlite/releases/tag/0.3.2 2020-10-12
  • Fix for "table photos has no column named hasSticker" bug, thanks @mattiaborsoi. #10
  • Switched CI to GitHub Actions.
2020-10-12T20:33:48Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "foursquare", "foursquare-api", "sqlite", "swarm"]
303218369 https://github.com/dogsheep/evernote-to-sqlite https://github.com/dogsheep/evernote-to-sqlite/releases/tag/0.2 2020-10-12
  • Notes now use an ID derived from a hash of their contents. #3
  • Date columns are now in ISO format, and indexd. #4
  • Notes and resources table now have full-text search configured. #4
  • Improved how OCR is stored in the database, only storing the most confident matches. #6
2020-10-12T00:07:24Z ["datasette-io", "datasette-tool", "dogsheep", "evernote", "sqlite"]
303218369 https://github.com/dogsheep/evernote-to-sqlite https://github.com/dogsheep/evernote-to-sqlite/releases/tag/0.1 2020-10-11
  • Initial release, with support for importing ENEX files.
2020-10-11T21:47:39Z ["datasette-io", "datasette-tool", "dogsheep", "evernote", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50.2 2020-10-10
  • Fixed another bug introduced in 0.50 where column header links on the table page were broken. (#1011)
2020-10-10T03:59:18Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50.1 2020-10-10
  • Fixed a bug introduced in 0.50 where the export as JSON/CSV links on the table, row and query pages were broken. (#1010)
2020-10-10T00:44:23Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50 2020-10-09

The key new feature in this release is the column actions menu on the table page (#891). This can be used to sort a column in ascending or descending order, facet data by that column or filter the table to just rows that have a value for that column.

Plugin authors can use the new datasette.client object to make internal HTTP requests from their plugins, allowing them to make use of Datasette's JSON API. (#943)

New Deploying Datasette documentation with guides for deploying Datasette on a Linux server using systemd or to hosting providers that support buildpacks. (#514, #997)

Other improvements in this release:

  • Publishing to Google Cloud Run documentation now covers Google Cloud SDK options. Thanks, Geoffrey Hing. (#995)
  • New datasette -o option which opens your browser as soon as Datasette starts up. (#970)
  • Datasette now sets sqlite3.enable_callback_tracebacks(True) so that errors in custom SQL functions will display tracebacks. (#891)
  • Fixed two rendering bugs with column headers in portrait mobile view. (#978, #980)
  • New db.table_column_details(table) introspection method for retrieving full details of the columns in a specific table, see Database introspection.
  • Fixed a routing bug with custom page wildcard templates. (#996)
  • datasette publish heroku now deploys using Python 3.8.6.
  • New datasette publish heroku --tar= option. (#969)
  • OPTIONS requests against HTML pages no longer return a 500 error. (#1001)
  • Datasette now supports Python 3.9.
2020-10-09T17:58:27Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50a1 2020-10-06
  • Column action menu now shows the column type. (#993)
  • Column action sort links now correctly link to the first page of sorted results. (#989)
  • Publishing to Google Cloud Run documentation now covers Google Cloud SDK options. Thanks, Geoffrey Hing. (#995)
2020-10-06T20:52:49Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50a0 2020-10-01
  • New column action menu - table columns now show a cog icon which provides a contextual menu for that column. (#981)
  • New datasette -o option which opens your browser as soon as Datasette starts up. (#970
  • sqlite3.enable_callback_tracebacks(True) so errors in custom SQL functions will now display tracebacks. (#891)
  • Fixed two rendering bugs with column headers in portrait mobile view. (#978, #980)
2020-10-01T23:35:54Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.12.4 2020-10-01
  • Fixed a bug where this could cause errors if other plugins provide custom templates. #19
2020-10-01T23:24:20Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.3 2020-10-01
  • First non-alpha release.
  • Ability to rename a table. #19
  • Improved ability to add a column. #4
2020-10-01T22:41:06Z ["datasette", "datasette-io", "datasette-plugin"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.3a2 2020-10-01
  • Renamed to datasette-edit-schema. #20
  • Now controlled by edit-schema permission. #9
  • Improved /-/edit-schema/databasename page. #15
  • Now ships with a copy of Draggable.js. #16
  • Interface links back to table page. #18
2020-10-01T21:28:19Z ["datasette", "datasette-io", "datasette-plugin"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.12.3 2020-10-01
  • Fix for a bug where the map fails to display if the table is sorted by latitude or longitude. This fix depends on the upcoming release of Datasette (0.50). #18
2020-10-01T00:30:03Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.12.2 2020-10-01
  • Fixed bug with case sensitivity, LATITUDE and LONGITUDE columns will now work. #17
2020-10-01T00:11:09Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.12.1 2020-09-30
  • Accidental release, this does not change anything.
2020-09-30T18:30:30Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.3a1 2020-09-30
  • Fix bug with editing column types. #17
2020-09-30T18:12:06Z ["datasette", "datasette-io", "datasette-plugin"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.3a 2020-09-30
  • First prototype of transform table interface. #11
2020-09-30T17:00:54Z ["datasette", "datasette-io", "datasette-plugin"]
299143849 https://github.com/simonw/datasette-dateutil https://github.com/simonw/datasette-dateutil/releases/tag/0.2.1 2020-09-30
  • Documentation showing how to use these functions in conjunction with json_each() to join against other tables. #2
2020-09-30T01:07:35Z ["datasette", "datasette-io", "datasette-plugin", "dateutil"]
299143849 https://github.com/simonw/datasette-dateutil https://github.com/simonw/datasette-dateutil/releases/tag/0.2 2020-09-29
  • New dateutil_rrule() and dateutil_rrule_date() SQL functions. #1
  • New dateutil_dates_between() SQL function. #1
2020-09-29T06:41:03Z ["datasette", "datasette-io", "datasette-plugin", "dateutil"]
299198369 https://github.com/simonw/datasette-import-table https://github.com/simonw/datasette-import-table/releases/tag/0.2 2020-09-28
  • Tables that are currently importing now display a progress bar. #2
2020-09-28T15:27:45Z ["datasette", "datasette-io", "datasette-plugin"]
299198369 https://github.com/simonw/datasette-import-table https://github.com/simonw/datasette-import-table/releases/tag/0.1 2020-09-28
  • First non-alpha release.
  • Now checks for import-table permission, which by default is only granted to the root actor. #1
  • Uses ?_size=max to import the maximum number of rows per batch, speeding up imports. #2
2020-09-28T14:32:03Z ["datasette", "datasette-io", "datasette-plugin"]
299198369 https://github.com/simonw/datasette-import-table https://github.com/simonw/datasette-import-table/releases/tag/0.1a2 2020-09-28
  • Second attempt at fixing the template packaging issue.
2020-09-28T05:48:34Z ["datasette", "datasette-io", "datasette-plugin"]
299198369 https://github.com/simonw/datasette-import-table https://github.com/simonw/datasette-import-table/releases/tag/0.1a1 2020-09-28
  • Fixed bug where templates were not correctly packaged.
2020-09-28T05:42:00Z ["datasette", "datasette-io", "datasette-plugin"]
299198369 https://github.com/simonw/datasette-import-table https://github.com/simonw/datasette-import-table/releases/tag/0.1a0 2020-09-28
  • Initial alpha version.
2020-09-28T05:31:43Z ["datasette", "datasette-io", "datasette-plugin"]
299143849 https://github.com/simonw/datasette-dateutil https://github.com/simonw/datasette-dateutil/releases/tag/0.1 2020-09-28
  • Initial release.
2020-09-28T00:16:10Z ["datasette", "datasette-io", "datasette-plugin", "dateutil"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/2.21 2020-09-24
  • table.extract() and sqlite-utils extract now apply much, much faster - one example operation reduced from twelve minutes to just four seconds! (#172)
  • sqlite-utils extract no longer shows a progress bar, because it's fast enough not to need one.
  • New column_order= option for table.transform() which can be used to alter the order of columns in a table. (#175)
  • sqlite-utils transform --column-order= option (with a -o shortcut) for changing column order. (#176)
  • The table.transform(drop_foreign_keys=) parameter and the sqlite-utils transform --drop-foreign-key option have changed. They now accept just the name of the column rather than requiring all three of the column, other table and other column. This is technically a backwards-incompatible change but I chose not to bump the major version number because the transform feature is so new. (#177)
  • The table .disable_fts(), .rebuild_fts(), .delete(), .delete_where() and .add_missing_columns() methods all now return self, which means they can be chained together with other table operations.
2020-09-24T16:45:44Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/2.20 2020-09-23

This release introduces two key new capabilities: transform (#114) and extract (#42).

Transform

SQLite's ALTER TABLE has several documented limitations. The table.transform() Python method and sqlite-utils transform CLI command work around these limitations using a pattern where a new table with the desired structure is created, data is copied over to it and the old table is then dropped and replaced by the new one.

You can use these tools to drop columns, change column types, rename columns, add and remove NOT NULL and defaults, remove foreign key constraints and more. See the transforming tables (CLI) and transforming tables (Python library) documentation for full details of how to use them.

Extract

Sometimes a database table - especially one imported from a CSV file - will contain duplicate data. A Trees table may include a Species column with only a few dozen unique values, when the table itself contains thousands of rows.

The table.extract() method and sqlite-utils extract commands can extract a column - or multiple columns - out into a separate lookup table, and set up a foreign key relationship from the original table.

The Python library extract() documentation describes how extraction works in detail, and Extracting columns into a separate table in the CLI documentation includes a detailed example.

Other changes

  • The @db.register_function decorator can be used to quickly register Python functions as custom SQL functions, see Registering custom SQL functions. (#162)
  • The table.rows_where() method now accepts an optional select= argument for specifying which columns should be selected, see Listing rows.
2020-09-23T00:37:01Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.9a0 2020-09-20
  • Added by date, as part of developing a timeline view. #16
2020-09-20T23:37:48Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/2.19 2020-09-20
  • New sqlite-utils add-foreign-keys command for Adding multiple foreign keys at once. (#157)
  • New table.enable_fts(..., replace=True) argument for replacing an existing FTS table with a new configuration. (#160)
  • New table.add_foreign_key(..., ignore=True) argument for ignoring a foreign key if it already exists. (#112)
2020-09-20T22:24:04Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.8 2020-09-18
  • New template_debug configuration setting. #25
  • Templates now autoescape by default, use {{ display.foo|safe }} if you know you want HTML not to be escaped.
  • Fixed bug where the wrong template fragment could be used for a row. #24
  • Sort order is now persisted when you execute a new search. #23
2020-09-18T22:41:33Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.7.1 2020-09-17
  • Fixed bug with sort orders displayed for the timeline view. #22
2020-09-17T23:13:46Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.7 2020-09-17
  • Option to sort by relevance / oldest / newest. #21
  • Renamed table column to type. #17
  • New -d option for passing one or more databases to index. Without this all databases in the config file will be indexed.
2020-09-17T22:57:09Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
207052882 https://github.com/dogsheep/github-to-sqlite https://github.com/dogsheep/github-to-sqlite/releases/tag/2.6 2020-09-17
  • New github-to-sqlite get /gists command for making authenticated API calls against any API path. #50
2020-09-17T03:55:03Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "github-api", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.49.1 2020-09-15
  • Fixed a bug with writable canned queries that use magic parameters but accept no non-magic arguments. (#967)
2020-09-15T20:21:16Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
243710733 https://github.com/simonw/datasette-ics https://github.com/simonw/datasette-ics/releases/tag/0.5 2020-09-14
  • Now depends on Datasette 0.49.
2020-09-14T22:19:06Z ["datasette", "datasette-io", "datasette-plugin", "icalendar", "ics"]
281481347 https://github.com/simonw/datasette-copyable https://github.com/simonw/datasette-copyable/releases/tag/0.3 2020-09-14
  • Now depends on Datasette 0.49.
2020-09-14T22:17:41Z ["datasette", "datasette-io", "datasette-plugin"]
209091256 https://github.com/simonw/datasette-atom https://github.com/simonw/datasette-atom/releases/tag/0.8 2020-09-14
  • Now depends on Datasette 0.49.
2020-09-14T22:15:38Z ["datasette", "datasette-io", "datasette-plugin"]
291359358 https://github.com/simonw/datasette-yaml https://github.com/simonw/datasette-yaml/releases/tag/0.1 2020-09-14
  • Initial release
2020-09-14T22:13:36Z ["datasette", "datasette-io", "datasette-plugin", "yaml"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.49 2020-09-14
  • Writable canned queries now expose a JSON API, see JSON API for writable canned queries. (#880)
  • New mechanism for defining page templates with custom path parameters - a template file called pages/about/{slug}.html will be used to render any requests to /about/something. See Path parameters for pages. (#944)
  • register_output_renderer() render functions can now return a Response. (#953)
  • New --upgrade option for datasette install. (#945)
  • New datasette --pdb option. (#962)
  • datasette --get exit code now reflects the internal HTTP status code. (#947)
  • New raise_404() template function for returning 404 errors. (#964)
  • datasette publish heroku now deploys using Python 3.8.5
  • Upgraded CodeMirror to 5.57.0. (#948)
  • Upgraded code style to Black 20.8b1. (#958)
  • Fixed bug where selected facets were not correctly persisted in hidden form fields on the table page. (#963)
  • Renamed the default error template from 500.html to error.html.
  • Custom error pages are now documented, see Custom error pages. (#965)
2020-09-14T21:40:11Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.49a1 2020-09-14
  • Upgraded CodeMirror to 5.57.0. (#948)
  • Upgraded code style to Black 20.8b1. (#958)
  • New datasette --pdb option. (#962)
  • datasette --get exit code now reflects the internal HTTP status code. (#947)
  • Fixed bug where selected facets were not correctly persisted in hidden form fields on the table page. (#963)
  • New mechanism for defining page templates with custom path parameters. (#944)
2020-09-14T02:48:19Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
294706267 https://github.com/simonw/datasette-seaborn https://github.com/simonw/datasette-seaborn/releases/tag/0.1a1 2020-09-11
  • Changes to address weird global state issues. #1
2020-09-11T17:01:17Z ["datasette", "datasette-io", "datasette-plugin", "seaborn", "visualization"]
294706267 https://github.com/simonw/datasette-seaborn https://github.com/simonw/datasette-seaborn/releases/tag/0.1a0 2020-09-11
  • First working alpha. Buggy and probably insecure.
2020-09-11T15:03:26Z ["datasette", "datasette-io", "datasette-plugin", "seaborn", "visualization"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.7a0 2020-09-09
  • Renamed table column to type. #17
  • New -d option for passing one or more databases to index. Without this all databases in the config file will be indexed.
2020-09-09T00:46:06Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/2.18 2020-09-08
  • table.rebuild_fts() method for rebuilding a FTS index, see Rebuilding a full-text search table. (#155)
  • sqlite-utils rebuild-fts data.db command for rebuilding FTS indexes across all tables, or just specific tables. (#155)
  • table.optimize() method no longer deletes junk rows from the *_fts_docsize table. This was added in 2.17 but it turns out running table.rebuild_fts() is a better solution to this problem.
  • Fixed a bug where rows with additional columns that are inserted after the first batch of records could cause an error due to breaking SQLite's maximum number of parameters. Thanks, Simon Wiles. (#145)
2020-09-08T23:39:21Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/2.17 2020-09-07

This release handles a bug where replacing rows in FTS tables could result in growing numbers of unneccessary rows in the associated *_fts_docsize table. (#149)

  • PRAGMA recursive_triggers=on by default for all connections. You can turn it off with Database(recursive_triggers=False). (#152)
  • table.optimize() method now deletes unnecessary rows from the *_fts_docsize table. (#153)
  • New tracer method for tracking underlying SQL queries, see Tracing queries. (#150)
  • Neater indentation for schema SQL. (#148)
  • Documentation for sqlite_utils.AlterError exception thrown by in add_foreign_keys().
2020-09-07T22:08:33Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
293164447 https://github.com/simonw/datasette-backup https://github.com/simonw/datasette-backup/releases/tag/0.1 2020-09-07
  • Now handles FTS tables using the new sqlite-dump library. #5
2020-09-07T02:27:30Z ["datasette", "datasette-io", "datasette-plugin"]
293164447 https://github.com/simonw/datasette-backup https://github.com/simonw/datasette-backup/releases/tag/0.1a 2020-09-06
  • First working version. /-/backup/db-name.sql. #2
2020-09-06T07:23:00Z ["datasette", "datasette-io", "datasette-plugin"]
274293597 https://github.com/simonw/datasette-block-robots https://github.com/simonw/datasette-block-robots/releases/tag/0.3 2020-09-06
  • literal plugin configuration option for defining the full contents of robots.txt. #3
2020-09-06T01:43:52Z ["datasette", "datasette-io", "datasette-plugin", "robots-txt"]
274293597 https://github.com/simonw/datasette-block-robots https://github.com/simonw/datasette-block-robots/releases/tag/0.2 2020-09-05
  • New disallow plugin configuration option for specifically listing paths to disallow from robots. #2
2020-09-05T17:14:56Z ["datasette", "datasette-io", "datasette-plugin", "robots-txt"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.6 2020-09-05
  • Rerun the search query with FTS quoting if a SQLite FTS error occurs. This means searching for e.g. "#dogfest" will no longer throw an error, while still supporting advanced SQLite FTS syntax. #14
  • Maximum width 100% on images in results
  • Don't display facet headers if there are no results for that facet.
2020-09-05T16:26:06Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.5 2020-09-04
  • Custom template displays can now render a point on a map. #12
2020-09-04T01:46:16Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.4.1 2020-09-03
2020-09-03T21:41:52Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.4 2020-09-03
  • Working faceted search interface at /-/beta #3
  • is_public column for filtering between public and private data. #11
  • New received category. #10
2020-09-03T21:11:28Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.4a1 2020-09-03
  • Added received category. #10
  • New is_public column. #11
2020-09-03T18:03:50Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.4a0 2020-09-03
  • Incomplete preview of the /-/beta search interface. #3 #9
2020-09-03T03:54:23Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.3 2020-09-02
  • New category column plus default categories table. #7
2020-09-02T21:07:44Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.2 2020-09-01
  • Use Porter stemming by default, allow that to be over-ridden with the new --tokenize= option. #2
2020-09-01T20:41:31Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.1 2020-09-01
  • Optimize the FTS table and vacuum the database. #4
  • First non-alpha release
2020-09-01T06:12:05Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.1a2 2020-09-01
  • Now creates an index on the timestamp column. #1
2020-09-01T04:50:01Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.1a 2020-09-01
  • First working version
2020-09-01T04:19:00Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
291339086 https://github.com/simonw/airtable-export https://github.com/simonw/airtable-export/releases/tag/0.4 2020-08-30
  • Support --yaml, --ndjson and --json options all at once. #5
2020-08-30T03:13:50Z ["airtable", "airtable-api", "datasette-io", "datasette-tool", "yaml"]

Next page

Advanced export

JSON shape: default, array, newline-delimited

CSV options:

CREATE VIEW recent_releases AS select
  repos.rowid as rowid,
  repos.html_url as repo,
  releases.html_url as release,
  substr(releases.published_at, 0, 11) as date,
  releases.body as body_markdown,
  releases.published_at,
  coalesce(repos.topics, '[]') as topics
from
  releases
  join repos on repos.id = releases.repo
order by
  releases.published_at desc;