573 rows

View and edit SQL

Suggested facets: date (date), published_at (date), topics (array)

rowid repo release date body_markdown published_at topics
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.15 2021-01-18
  • Fixed bug where foreign key labels were displayed as [object Object]. #26
2021-01-18T21:49:39Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
219372133 https://github.com/simonw/sqlite-transform https://github.com/simonw/sqlite-transform/releases/tag/0.3.1 2021-01-18
  • Better --help for sqlite-transform lambda. #7
2021-01-18T21:01:06Z ["datasette-io", "datasette-tool", "sqlite"]
205429375 https://github.com/dogsheep/swarm-to-sqlite https://github.com/dogsheep/swarm-to-sqlite/releases/tag/0.3.3 2021-01-18
  • Fixed bug where tool could crash with an error about missing columns. #11
2021-01-18T04:36:03Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "foursquare", "foursquare-api", "sqlite", "swarm"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/3.3 2021-01-18
2021-01-18T04:29:48Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
167759846 https://github.com/simonw/markdown-to-sqlite https://github.com/simonw/markdown-to-sqlite/releases/tag/0.2 2021-01-14
  • Upgraded tests for latest dependencies
  • Switched CI to GitHub Actions
2021-01-14T20:21:19Z ["datasette-io", "datasette-tool", "markdown", "sqlite", "yaml"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/3.2.1 2021-01-12
  • Fixed a bug where .add_missing_columns() failed to take case insensitive column names into account. (#221)
2021-01-12T23:23:25Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
327236119 https://github.com/simonw/datasette-export-notebook https://github.com/simonw/datasette-export-notebook/releases/tag/0.2 2021-01-11
  • Observable export instructions are only shown if Datasette is run with the --cors option. #5
  • Export notebook page links back to view the rows. #6
  • CSV streaming export instructions are provided, if available. #7
2021-01-11T22:29:04Z ["datasette-io", "datasette-plugin"]
327236119 https://github.com/simonw/datasette-export-notebook https://github.com/simonw/datasette-export-notebook/releases/tag/0.1.1 2021-01-09

Improved README with links to a live demo.

2021-01-09T23:57:26Z ["datasette-io", "datasette-plugin"]
327087207 https://github.com/simonw/datasette-css-properties https://github.com/simonw/datasette-css-properties/releases/tag/0.2 2021-01-07
  • .css pages now send the x-content-type-options: nosniff header, to protect against browsers incorrectly rendering the CSS as HTML which could be an XSS security hole. #1
2021-01-07T20:28:40Z ["datasette-io", "datasette-plugin"]
327087207 https://github.com/simonw/datasette-css-properties https://github.com/simonw/datasette-css-properties/releases/tag/0.1.1 2021-01-07
  • Improved README
2021-01-07T19:48:50Z ["datasette-io", "datasette-plugin"]
327236119 https://github.com/simonw/datasette-export-notebook https://github.com/simonw/datasette-export-notebook/releases/tag/0.1 2021-01-06

First working version. #1

2021-01-06T08:12:31Z ["datasette-io", "datasette-plugin"]
327087207 https://github.com/simonw/datasette-css-properties https://github.com/simonw/datasette-css-properties/releases/tag/0.1 2021-01-05

Initial prototype.

2021-01-05T18:39:44Z ["datasette-io", "datasette-plugin"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/3.2 2021-01-03

This release introduces a new mechanism for speeding up count(*) queries using cached table counts, stored in a _counts table and updated by triggers. This mechanism is described in Cached table counts using triggers, and can be enabled using Python API methods or the new enable-counts CLI command. (#212)

  • table.enable_counts() method for enabling these triggers on a specific table.
  • db.enable_counts() method for enabling triggers on every table in the database. (#213)
  • New sqlite-utils enable-counts my.db command for enabling counts on all or specific tables, see Enabling cached counts. (#214)
  • New sqlite-utils triggers command for listing the triggers defined for a database or specific tables, see Listing triggers. (#218)
  • New db.use_counts_table property which, if True, causes table.count to read from the _counts table. (#215)
  • table.has_counts_triggers property revealing if a table has been configured with the new _counts database triggers.
  • db.reset_counts() method and sqlite-utils reset-counts command for resetting the values in the _counts table. (#219)
  • The previously undocumented db.escape() method has been renamed to db.quote() and is now covered by the documentation: Quoting strings for use in SQL. (#217)
  • New table.triggers_dict and db.triggers_dict introspection properties. (#211, #216)
  • sqlite-utils insert now shows a more useful error message for invalid JSON. (#206)
2021-01-03T21:17:37Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/3.1.1 2021-01-01
  • Fixed failing test caused by optimize sometimes creating larger database files. (#209)
  • Documentation now lives on https://sqlite-utils.datasette.io/
  • README now includes brew install sqlite-utils installation method.
2021-01-01T23:57:07Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
253632948 https://github.com/simonw/datasette-publish-vercel https://github.com/simonw/datasette-publish-vercel/releases/tag/0.9.1 2020-12-28
  • Fixed a bug with the datasette publish now alias for datasette publish vercel. #31
2020-12-28T19:39:10Z ["datasette", "datasette-io", "datasette-plugin", "vercel", "zeit-now"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.10.1 2020-12-19
  • Fix for error if search query contains hyphens such as github-to-sqlite. #31
2020-12-19T06:19:13Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.10 2020-12-16
  • Now depends on sqlite-utils >= 3.0. #30
  • The user's original search term is now passed to the display_sql SQL query as the :q parameter. #29
2020-12-16T21:28:13Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
207052882 https://github.com/dogsheep/github-to-sqlite https://github.com/dogsheep/github-to-sqlite/releases/tag/2.8.2 2020-12-16
  • --readme now stores null if the README file does not exist, rather than throwing an error. #57
  • README HTML is rewritten to fix broken internal links, e.g. for a table of contents. #58
2020-12-16T19:21:58Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "github-api", "sqlite"]
253632948 https://github.com/simonw/datasette-publish-vercel https://github.com/simonw/datasette-publish-vercel/releases/tag/0.9 2020-12-14
  • New --setting option for specifying Datasette settings, as a working alternative to --extra-options. #30
2020-12-14T04:03:06Z ["datasette", "datasette-io", "datasette-plugin", "vercel", "zeit-now"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/3.1 2020-12-13
  • New command: sqlite-utils analyze-tables my.db outputs useful information about the table columns in the database, such as the number of distinct values and how many rows are null. See Analyzing tables for documentation. (#207)
  • New table.analyze_column(column) Python method used by the analyze-tables command - see Analyzing a column.
  • The table.update() method now correctly handles values that should be stored as JSON. Thanks, Andreas Madsack. (#204)
2020-12-13T07:31:40Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
248385299 https://github.com/simonw/datasette-publish-fly https://github.com/simonw/datasette-publish-fly/releases/tag/1.0.1 2020-12-12
  • Fixed various errors that occurred when using latest version of flyctl. #7
2020-12-12T21:11:49Z ["datasette", "datasette-io", "datasette-plugin", "fly"]
279357123 https://github.com/simonw/datasette-auth-passwords https://github.com/simonw/datasette-auth-passwords/releases/tag/0.3.3 2020-12-11
  • Fixed bug where users with a "someusername_password_hash" value defined in metadata.json but no corresponding "actor" record were incorrectly signed in as an actor with "id": "username", when they should have been signed in as an actor with "id": "someusername". #14
2020-12-11T05:29:14Z ["datasette", "datasette-io", "datasette-plugin"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.53 2020-12-11

Datasette has an official project website now, at https://datasette.io/. This release mainly updates the documentation to reflect the new site.

  • New ?column__arraynotcontains= table filter. (#1132)
  • datasette serve has a new --create option, which will create blank database files if they do not already exist rather than exiting with an error. (#1135)
  • New ?_header=off option for CSV export which omits the CSV header row, documented here. (#1133)
  • "Powered by Datasette" link in the footer now links to https://datasette.io/. (#1138)
  • Project news no longer lives in the README - it can now be found at https://datasette.io/news. (#1137)
2020-12-11T01:46:44Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
246108561 https://github.com/simonw/datasette-column-inspect https://github.com/simonw/datasette-column-inspect/releases/tag/0.2a 2020-12-09
  • Correctly parse column links. #3
  • Show a message encouraging mobile users to rotate to landscape. #2
2020-12-09T21:47:38Z ["datasette", "datasette-io", "datasette-plugin"]
167730071 https://github.com/simonw/datasette-pretty-json https://github.com/simonw/datasette-pretty-json/releases/tag/0.2.1 2020-12-09
  • Switched CI to GitHub Actions
2020-12-09T21:22:43Z ["datasette", "datasette-io", "datasette-plugin", "json"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.52.5 2020-12-09
  • Fix for error caused by combining the _searchmode=raw and ?_search_COLUMN parameters. (#1134)
2020-12-09T20:10:23Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
175550127 https://github.com/simonw/yaml-to-sqlite https://github.com/simonw/yaml-to-sqlite/releases/tag/0.3.1 2020-12-07
  • Updated for latest sqlite-utils library
  • Fixed bug where import failed if user did not provide a --pk option
2020-12-07T21:12:55Z ["datasette-io", "datasette-tool", "sqlite", "yaml"]
294706267 https://github.com/simonw/datasette-seaborn https://github.com/simonw/datasette-seaborn/releases/tag/0.2a0 2020-12-07
  • Chart rendering now takes place in a subprocess with a 5 second default time limit. Time limit can be customized using a new render_time_limit plugin configuration option. #4
2020-12-07T01:39:12Z ["datasette", "datasette-io", "datasette-plugin", "seaborn", "visualization"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.52.4 2020-12-05
  • Show pysqlite3 version on /-/versions, if installed. (#1125)
  • Errors output by Datasette (e.g. for invalid SQL queries) now go to stderr, not stdout. (#1131)
  • Fix for a startup error on windows caused by unnecessary from os import EX_CANTCREAT - thanks, Abdussamet Koçak. (#1094)
2020-12-05T19:42:57Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
245856731 https://github.com/simonw/datasette-search-all https://github.com/simonw/datasette-search-all/releases/tag/1.0.1 2020-12-04
  • Form inputs are now wrapped in a paragraph, making form less cramped when displayed next to metadata. #12
2020-12-04T21:12:26Z ["datasette", "datasette-io", "datasette-plugin", "search"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.52.3 2020-12-03
  • Fixed bug where static assets would 404 for Datasette installed on ARM Amazon Linux. (#1124)
2020-12-03T19:08:29Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.52.2 2020-12-03
  • Generated columns from SQLite 3.31.0 or higher are now correctly displayed. (#1116)
  • Error message if you attempt to open a SpatiaLite database now suggests using --load-extension=spatialite if it detects that the extension is available in a common location. (#1115)
  • OPTIONS requests against the /database page no longer raise a 500 error. (#1100)
  • Databases larger than 32MB that are published to Cloud Run can now be downloaded. (#749)
  • Fix for misaligned cog icon on table and database pages. Thanks, Abdussamet Koçak. (#1121)
2020-12-03T00:58:43Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
291359358 https://github.com/simonw/datasette-yaml https://github.com/simonw/datasette-yaml/releases/tag/0.1.1 2020-12-03
  • Depend on datasette without version pinning.
2020-12-03T00:09:35Z ["datasette", "datasette-io", "datasette-plugin", "yaml"]
284383265 https://github.com/simonw/datasette-graphql https://github.com/simonw/datasette-graphql/releases/tag/1.3.1 2020-11-30
  • Fixed bug where in: and notin: filters raised an error when run against lists of integers rather than lists of strings. #68
2020-11-30T19:02:51Z ["datasette", "datasette-io", "datasette-plugin", "graphql", "sqlite"]
284383265 https://github.com/simonw/datasette-graphql https://github.com/simonw/datasette-graphql/releases/tag/1.3 2020-11-30
  • Suggested queries for tables (available from the table actions cog menu) now include foreign key expansions. #67
2020-11-30T18:11:47Z ["datasette", "datasette-io", "datasette-plugin", "graphql", "sqlite"]
207052882 https://github.com/dogsheep/github-to-sqlite https://github.com/dogsheep/github-to-sqlite/releases/tag/2.8.1 2020-11-30
  • README now links to example database tables for each command. #56
  • Added documentation for github-to-sqlite releases.
2020-11-30T04:18:21Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "github-api", "sqlite"]
207052882 https://github.com/dogsheep/github-to-sqlite https://github.com/dogsheep/github-to-sqlite/releases/tag/2.8 2020-11-30
  • New command: github-to-sqlite workflows, for fetching the YAML configuration used by GitHub Actions workflows and using it to populate new workflows, jobs and steps tables. #54
  • New command: github-to-sqlite pull-requests - thanks, @adamjonas! #48
  • github-to-sqlite issues --issue option can now be used multiple times.
2020-11-30T01:41:38Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "github-api", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.52.1 2020-11-29
2020-11-29T19:39:52Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.52 2020-11-28

This release includes a number of changes relating to an internal rebranding effort: Datasette's configuration mechanism (things like datasette --config default_page_size:10) has been renamed to settings.

  • New --setting default_page_size 10 option as a replacement for --config default_page_size:10 (note the lack of a colon). The --config option is deprecated but will continue working until Datasette 1.0. (#992)
  • The /-/config introspection page is now /-/settings, and the previous page redirects to the new one. (#1103)
  • The config.json file in Configuration directory mode is now called settings.json. (#1104)
  • The undocumented datasette.config() internal method has been replaced by a documented .setting(key) method. (#1107)

Also in this release:

  • New plugin hook: database_actions(datasette, actor, database), which adds menu items to a new cog menu shown at the top of the database page. (#1077)
  • datasette publish cloudrun has a new --apt-get-install option that can be used to install additional Ubuntu packages as part of the deployment. This is useful for deploying the new datasette-ripgrep plugin. (#1110)
  • Swept the documentation to remove words that minimize involved difficulty. (#1089)

And some bug fixes:

  • Foreign keys linking to rows with blank label columns now display as a hyphen, allowing those links to be clicked. (#1086)
  • Fixed bug where row pages could sometimes 500 if the underlying queries exceeded a time limit. (#1088)
  • Fixed a bug where the table action menu could appear partially obscured by the edge of the page. (#1084)
2020-11-28T23:57:12Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.6.1 2020-11-28
  • Improved README with better tagline and better examples.
2020-11-28T22:42:44Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.6 2020-11-28
  • Now adds a link to Datasette's global navigation menu. #16
  • Code snippets in search scroll horizontally.
2020-11-28T22:28:30Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.5 2020-11-28
  • Support for ?glob= option for adding -g file filter patterns. #9
  • Improved configuration instructions. #15
2020-11-28T20:02:36Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.4 2020-11-28
  • Show context around each match. #13
  • Use :target CSS instead of JavaScript to highlight linked line. Thanks, Louis Lévêque. #14
2020-11-28T18:07:08Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.3 2020-11-28
  • Option to ignore case. #12
  • Option to treat input as a literal string, not a regular expression. #8
2020-11-28T16:57:14Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.2.1 2020-11-28
  • Fixed a bug where patterns like -v could be interpreted as command-line arguments. #7
  • Links to view files now correctly escape characters such as {.
2020-11-28T16:16:38Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.2 2020-11-28
  • Search results now link to the full source code, with line numbers and highlights. #4
  • Respect view-instance permission, so you can protect this using Datasette's authentication and permissions system. #6
2020-11-28T06:23:37Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.1 2020-11-26
  • First non-alpha release
  • Now implements both a time limit and a lines-returned limit. #3
  • New time_limit and max_lines configuration options.
  • Live demo at https://ripgrep.datasette.io/-/ripgrep
2020-11-26T02:36:56Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
209091256 https://github.com/simonw/datasette-atom https://github.com/simonw/datasette-atom/releases/tag/0.8.1 2020-11-25
  • Removed rogue print statement. #14
2020-11-25T19:40:13Z ["datasette", "datasette-io", "datasette-plugin"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.1a1 2020-11-25
  • Fixed bug where template was not packaged in the release. #1
  • Fixed bug caused by call to proc.terminate()
2020-11-25T01:56:20Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
315796015 https://github.com/simonw/datasette-ripgrep https://github.com/simonw/datasette-ripgrep/releases/tag/0.1a0 2020-11-25
  • Initial alpha prototype
2020-11-25T01:28:13Z ["codesearch", "datasette", "datasette-io", "datasette-plugin", "ripgrep"]
284383265 https://github.com/simonw/datasette-graphql https://github.com/simonw/datasette-graphql/releases/tag/1.2.1 2020-11-24
  • Fix for forthcoming change to Datasette undocumented internal method. #66
  • Now tested against Python 3.9
2020-11-24T21:56:43Z ["datasette", "datasette-io", "datasette-plugin", "graphql", "sqlite"]
284383265 https://github.com/simonw/datasette-graphql https://github.com/simonw/datasette-graphql/releases/tag/1.2 2020-11-21
  • Plugin now respects the view-instance and view-database permissions. Previously the plugin could expose schema details of databases that should not be visible, though not their actual row content. See security advisory: datasette-graphql leaks details of the schema of private database files . #65
  • Adds links to the GraphQL API in the database and table action menus, including example table queries. #63
  • Running the plugin against Datasette with no attached databases no longer returns a 500 error. #64
2020-11-21T22:05:14Z ["datasette", "datasette-io", "datasette-plugin", "graphql", "sqlite"]
281481347 https://github.com/simonw/datasette-copyable https://github.com/simonw/datasette-copyable/releases/tag/0.3.1 2020-11-14
  • Fixed 500 error with .copyable?_labels=on. #4
2020-11-14T21:45:10Z ["datasette", "datasette-io", "datasette-plugin"]
245856731 https://github.com/simonw/datasette-search-all https://github.com/simonw/datasette-search-all/releases/tag/1.0 2020-11-12
  • Added loading indicators. #7
  • URLs in search results are turned into links. #9
  • Now uses datasette.urls to construct paths that work with the base_url config setting. #10
  • Adds a link to Datasette navigation menu. #11
2020-11-12T22:34:18Z ["datasette", "datasette-io", "datasette-plugin", "search"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/3.0 2020-11-08

This release introduces a new sqlite-utils search command for searching tables, see Executing searches. (#192)

The table.search() method has been redesigned, see Searching with table.search(). (#197)

The release includes minor backwards-incompatible changes, hence the version bump to 3.0. Those changes, which should not affect most users, are:

  • The -c shortcut option for outputting CSV is no longer available. The full --csv option is required instead.
  • The -f shortcut for --fmt has also been removed - use --fmt.
  • The table.search() method now defaults to sorting by relevance, not sorting by rowid. (#198)
  • The table.search() method now returns a generator over a list of Python dictionaries. It previously returned a list of tuples.

Also in this release:

  • The query, tables, rows and search CLI commands now accept a new --tsv option which outputs the results in TSV. (#193)
  • A new table.virtual_table_using property reveals if a table is a virtual table, and returns the upper case type of virtual table (e.g. FTS4 or FTS5) if it is. It returns None if the table is not a virtual table. (#196)
  • The new table.search_sql() method returns the SQL for searching a table, see Building SQL queries with table.search_sql().
  • sqlite-utils rows now accepts multiple optional -c parameters specifying the columns to return. (#200)

Changes since the 3.0a0 alpha release:

  • The sqlite-utils search command now defaults to returning every result, unless you add a --limit 20 option.
  • The sqlite-utils search -c and table.search(columns=[]) options are now fully respected. (#201)
2020-11-08T17:24:27Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/3.0a0 2020-11-07

This release introduces a new sqlite-utils search command for searching tables, see Executing searches. (#192)

The table.search() method has been redesigned, see Searching with table.search(). (#197)

The release includes minor backwards-incompatible changes, hence the version bump to 3.0. Those changes, which should not affect most users, are:

  • The -c shortcut option for outputting CSV is no longer available. The full --csv option is required instead.
  • The -f shortcut for --fmt has also been removed - use --fmt.
  • The table.search() method now defaults to sorting by relevance, not sorting by rowid. (#198)
  • The table.search() method now returns a generator over a list of Python dictionaries. It previously returned a list of tuples.

Also in this release:

  • The query, tables, rows and search CLI commands now accept a new --tsv option which outputs the results in TSV. (#193)
  • A new table.virtual_table_using property reveals if a table is a virtual table, and returns the upper case type of virtual table (e.g. FTS4 or FTS5) if it is. It returns None if the table is not a virtual table. (#196)
  • The new table.search_sql() method returns the SQL for searching a table, see Building SQL queries with table.search_sql().
  • sqlite-utils rows now accepts multiple optional -c parameters specifying the columns to return. (#200)
2020-11-07T01:24:43Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
110509816 https://github.com/simonw/csvs-to-sqlite https://github.com/simonw/csvs-to-sqlite/releases/tag/1.2 2020-11-03
  • Upgraded dependencies, including Pandas. #73
2020-11-03T23:27:47Z ["click", "csv", "datasette", "datasette-io", "datasette-tool", "pandas", "python", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51.1 2020-11-01
  • Improvements to the new Binary data documentation page.
2020-11-01T03:34:36Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
243887036 https://github.com/simonw/datasette-configure-fts https://github.com/simonw/datasette-configure-fts/releases/tag/1.1 2020-11-01
  • Link to interface from table actions menu. #12
2020-11-01T02:31:01Z ["datasette", "datasette-io", "datasette-plugin"]
284383265 https://github.com/simonw/datasette-graphql https://github.com/simonw/datasette-graphql/releases/tag/1.1 2020-11-01
  • Adds "GraphQL API" link to Datasette's new navigation menu, added in Datasette 0.51. #62
2020-11-01T02:10:32Z ["datasette", "datasette-io", "datasette-plugin", "graphql", "sqlite"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.4 2020-10-31
  • Registers a table action using the new table_actions() plugin hook in Datasette 0.51. #26
2020-10-31T22:56:51Z ["datasette", "datasette-io", "datasette-plugin"]
234825790 https://github.com/simonw/datasette-upload-csvs https://github.com/simonw/datasette-upload-csvs/releases/tag/0.6 2020-10-31
  • Adds link to Datasette's new navigation menu, added in Datasette 0.51. #15
2020-10-31T22:45:20Z ["csvs", "datasette", "datasette-io", "datasette-plugin"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51 2020-10-31

A new visual design, plugin hooks for adding navigation options, better handling of binary data, URL building utility methods and better support for running Datasette behind a proxy.

New visual design

Datasette is no longer white and grey with blue and purple links! Natalie Downe has been working on a visual refresh, the first iteration of which is included in this release. (#1056)

<img alt="datasette-0 51" src="https://user-images.githubusercontent.com/9599/97791267-d9011e80-1b8d-11eb-9b1b-42908266f36f.png">

Plugins can now add links within Datasette

A number of existing Datasette plugins add new pages to the Datasette interface, providig tools for things like uploading CSVs, editing table schemas or configuring full-text search.

Plugins like this can now link to themselves from other parts of Datasette interface. The menu_links(datasette, actor) hook (#1064) lets plugins add links to Datasette's new top-right application menu, and the table_actions(datasette, actor, database, table) hook (#1066) adds links to a new "table actions" menu on the table page.

The demo at latest.datasette.io now includes some example plugins. To see the new table actions menu first sign into that demo as root and then visit the facetable table to see the new cog icon menu at the top of the page.

Binary data

SQLite tables can contain binary data in BLOB columns. Datasette now provides links for users to download this data directly from Datasette, and uses those links to make binary data available from CSV exports. See Binary data for more details. (#1036 and #1034).

URL building

The new datasette.urls family of methods can be used to generate URLs to key pages within the Datasette interface, both within custom templates and Datasette plugins. See Building URLs within plugins for more details. (#904)

Running Datasette behind a proxy

The base_url configuration option is designed to help run Datasette on a specific path behind a proxy - for example if you want to run an instance of Datasette at /my-datasette/ within your existing site's URL hierarchy, proxied behind nginx or Apache.

Support for this configuration option has been greatly improved (#1023), and guidelines for using it are now available in a new documentation section on Running Datasette behind a proxy. (#1027)

Smaller changes

  • Wide tables shown within Datasette now scroll horizontally (#998). This is achieved using a new <div class="table-wrapper"> element which may impact the implementation of some plugins (for example this change to datasette-cluster-map).
  • New debug-menu permission. (#1068)
  • Removed --debug option, which didn't do anything. (#814)
  • Link: HTTP header pagination. (#1014)
  • x button for clearing filters. (#1016)
  • Edit SQL button on canned queries, (#1019)
  • --load-extension=spatialite shortcut. (#1028)
  • scale-in animation for column action menu. (#1039)
  • Option to pass a list of templates to .render_template() is now documented. (#1045)
  • New datasette.urls.static_plugins() method. (#1033)
  • datasette -o option now opens the most relevant page. (#976)
  • datasette --cors option now enables access to /database.db downloads. (#1057)
  • Database file downloads now implement cascading permissions, so you can download a database if you have view-database-download permission even if you do not have permission to access the Datasette instance. (#1058)
  • New documentation on Designing URLs for your plugin. (#1053)
2020-10-31T22:29:33Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51a2 2020-10-30
2020-10-30T17:57:53Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.4a0 2020-10-30
  • Registers a table action using the new table_actions() plugin hook. #26
2020-10-30T05:51:34Z ["datasette", "datasette-io", "datasette-plugin"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51a1 2020-10-30
  • New colour scheme and improved visual design, courtesy of Natalie Downe. (#1056)
  • scale-in animation for column action menu. (#1039)
  • Wide tables now scroll horizontally. (#998)
  • Option to pass a list of templates to .render_template() is now documented. (#1045)
  • New datasette.urls.static_plugins() method. (#1033)
  • BLOB column values can now be downloaded directly from the Datasette UI. (#1036)
  • .csv exports now link to direct BLOB downloads. (#1034)
  • datasette -o option now opens the most relevant page. (#976)
  • datasette --cors option now enables access to /database.db downloads. (#1057)
  • Database file downloads now implement cascading permissions, so you can download a database if you have view-database-download permission even if you do not have permission to access the Datasette instance. (#1058)
  • New documentation on Designing URLs for your plugin. (#1053)
  • New navigation menu plus a menu_links(datasette, actor) plugin hook to customize it. (#1064)
  • table_actions(datasette, actor, database, table) plugin hook for the new table actions menu. (#1066)
2020-10-30T05:37:34Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
220716822 https://github.com/simonw/datasette-render-markdown https://github.com/simonw/datasette-render-markdown/releases/tag/1.2 2020-10-28
  • Now uses white-space: normal to fix a bug caused by Datasette's use of white-space: pre-wrap. #9
2020-10-28T22:54:59Z ["datasette", "datasette-io", "datasette-plugin", "markdown"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/2.23 2020-10-28
  • table.m2m(other_table, records) method now takes any iterable, not just a list or tuple. Thanks, Adam Wolf. (#189)
  • sqlite-utils insert now displays a progress bar for CSV or TSV imports. (#173)
  • New @db.register_function(deterministic=True) option for registering deterministic SQLite functions in Python 3.8 or higher. (#191)
2020-10-28T21:38:54Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
305199661 https://github.com/simonw/sphinx-to-sqlite https://github.com/simonw/sphinx-to-sqlite/releases/tag/0.1a1 2020-10-22
  • Fixed a bug where tokens did not have spaces between them. #2
2020-10-22T04:55:45Z ["datasette-io", "datasette-tool", "sphinx", "sqlite"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.14 2020-10-22
  • Forwards compatibility with a change to Datasette's HTML scheduled for the next Datasette release. (Datasette #998)
2020-10-22T03:52:30Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
206202864 https://github.com/dogsheep/inaturalist-to-sqlite https://github.com/dogsheep/inaturalist-to-sqlite/releases/tag/0.2.1 2020-10-22
  • Tweaked dependencies for compatibility with new PyPI resolver.
2020-10-22T00:08:58Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "inaturalist", "sqlite"]
213286752 https://github.com/dogsheep/pocket-to-sqlite https://github.com/dogsheep/pocket-to-sqlite/releases/tag/0.2.1 2020-10-22
  • Tweaked dependencies for compatibility with new PyPI resolver.
2020-10-22T00:08:24Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "pocket", "pocket-api", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.51a0 2020-10-20
  • Fixed a bunch of issues relating to the base_url setting. (#1023)
  • New datasette.urls URL builder for plugins, see Building URLs within plugins. (#904)
  • Removed --debug option, which didn't do anything. (#814)
  • Link: HTTP header pagination. (#1014)
  • x button for clearing filters. (#1016)
  • Edit SQL button on canned queries, (#1019)
  • --load-extension=spatialite shortcut. (#1028)
2020-10-20T05:33:01Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.13 2020-10-19
  • Default popup window row representation is now a definition list, not JSON. #20
2020-10-19T21:39:40Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
207052882 https://github.com/dogsheep/github-to-sqlite https://github.com/dogsheep/github-to-sqlite/releases/tag/2.7 2020-10-19
  • github-to-sqlite repos command now takes options --readme and --readme-html, which write the README or rendered HTML README into the readme or readme_html columns, respectively. #52
  • New --accept option for github-to-sqlite get. #50
2020-10-19T05:38:34Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "github-api", "sqlite"]
305199661 https://github.com/simonw/sphinx-to-sqlite https://github.com/simonw/sphinx-to-sqlite/releases/tag/0.1a 2020-10-18

Initial alpha release.

2020-10-18T21:28:45Z ["datasette-io", "datasette-tool", "sphinx", "sqlite"]
197431109 https://github.com/dogsheep/dogsheep-beta https://github.com/dogsheep/dogsheep-beta/releases/tag/0.9 2020-10-17
  • Facet by date. #16
  • Now depends on Datasette 0.50.2
  • Uses datasette.client and passes through authentication cookies. #28
2020-10-17T23:03:04Z ["datasette", "datasette-io", "datasette-plugin", "datasette-tool", "dogsheep", "search"]
197882382 https://github.com/dogsheep/healthkit-to-sqlite https://github.com/dogsheep/healthkit-to-sqlite/releases/tag/1.0 2020-10-17
  • Fixed a bug where export files generated in languages other than English failed to import. #11
  • CI now uses GitHub Actions
2020-10-17T21:17:34Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "healthkit", "sqlite"]
140912432 https://github.com/simonw/sqlite-utils https://github.com/simonw/sqlite-utils/releases/tag/2.22 2020-10-16
  • New --encoding option for processing CSV and TSV files that use a non-utf-8 encoding, for both the insert and update commands. (#182)
  • The --load-extension option is now available to many more commands. (#137)
  • --load-extension=spatialite can be used to load SpatiaLite from common installation locations, if it is available. (#136)
  • Tests now also run against Python 3.9. (#184)
  • Passing pk=["id"] now has the same effect as passing pk="id". (#181)
2020-10-16T19:31:45Z ["cli", "click", "datasette", "datasette-io", "datasette-tool", "python", "sqlite", "sqlite-database"]
205429375 https://github.com/dogsheep/swarm-to-sqlite https://github.com/dogsheep/swarm-to-sqlite/releases/tag/0.3.2 2020-10-12
  • Fix for "table photos has no column named hasSticker" bug, thanks @mattiaborsoi. #10
  • Switched CI to GitHub Actions.
2020-10-12T20:33:48Z ["datasette", "datasette-io", "datasette-tool", "dogsheep", "foursquare", "foursquare-api", "sqlite", "swarm"]
303218369 https://github.com/dogsheep/evernote-to-sqlite https://github.com/dogsheep/evernote-to-sqlite/releases/tag/0.2 2020-10-12
  • Notes now use an ID derived from a hash of their contents. #3
  • Date columns are now in ISO format, and indexd. #4
  • Notes and resources table now have full-text search configured. #4
  • Improved how OCR is stored in the database, only storing the most confident matches. #6
2020-10-12T00:07:24Z ["datasette-io", "datasette-tool", "dogsheep", "evernote", "sqlite"]
303218369 https://github.com/dogsheep/evernote-to-sqlite https://github.com/dogsheep/evernote-to-sqlite/releases/tag/0.1 2020-10-11
  • Initial release, with support for importing ENEX files.
2020-10-11T21:47:39Z ["datasette-io", "datasette-tool", "dogsheep", "evernote", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50.2 2020-10-10
  • Fixed another bug introduced in 0.50 where column header links on the table page were broken. (#1011)
2020-10-10T03:59:18Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50.1 2020-10-10
  • Fixed a bug introduced in 0.50 where the export as JSON/CSV links on the table, row and query pages were broken. (#1010)
2020-10-10T00:44:23Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50 2020-10-09

The key new feature in this release is the column actions menu on the table page (#891). This can be used to sort a column in ascending or descending order, facet data by that column or filter the table to just rows that have a value for that column.

Plugin authors can use the new datasette.client object to make internal HTTP requests from their plugins, allowing them to make use of Datasette's JSON API. (#943)

New Deploying Datasette documentation with guides for deploying Datasette on a Linux server using systemd or to hosting providers that support buildpacks. (#514, #997)

Other improvements in this release:

  • Publishing to Google Cloud Run documentation now covers Google Cloud SDK options. Thanks, Geoffrey Hing. (#995)
  • New datasette -o option which opens your browser as soon as Datasette starts up. (#970)
  • Datasette now sets sqlite3.enable_callback_tracebacks(True) so that errors in custom SQL functions will display tracebacks. (#891)
  • Fixed two rendering bugs with column headers in portrait mobile view. (#978, #980)
  • New db.table_column_details(table) introspection method for retrieving full details of the columns in a specific table, see Database introspection.
  • Fixed a routing bug with custom page wildcard templates. (#996)
  • datasette publish heroku now deploys using Python 3.8.6.
  • New datasette publish heroku --tar= option. (#969)
  • OPTIONS requests against HTML pages no longer return a 500 error. (#1001)
  • Datasette now supports Python 3.9.
2020-10-09T17:58:27Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50a1 2020-10-06
  • Column action menu now shows the column type. (#993)
  • Column action sort links now correctly link to the first page of sorted results. (#989)
  • Publishing to Google Cloud Run documentation now covers Google Cloud SDK options. Thanks, Geoffrey Hing. (#995)
2020-10-06T20:52:49Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
107914493 https://github.com/simonw/datasette https://github.com/simonw/datasette/releases/tag/0.50a0 2020-10-01
  • New column action menu - table columns now show a cog icon which provides a contextual menu for that column. (#981)
  • New datasette -o option which opens your browser as soon as Datasette starts up. (#970
  • sqlite3.enable_callback_tracebacks(True) so errors in custom SQL functions will now display tracebacks. (#891)
  • Fixed two rendering bugs with column headers in portrait mobile view. (#978, #980)
2020-10-01T23:35:54Z ["asgi", "automatic-api", "csv", "datasets", "datasette", "datasette-io", "docker", "json", "python", "sql", "sqlite"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.12.4 2020-10-01
  • Fixed a bug where this could cause errors if other plugins provide custom templates. #19
2020-10-01T23:24:20Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.3 2020-10-01
  • First non-alpha release.
  • Ability to rename a table. #19
  • Improved ability to add a column. #4
2020-10-01T22:41:06Z ["datasette", "datasette-io", "datasette-plugin"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.3a2 2020-10-01
  • Renamed to datasette-edit-schema. #20
  • Now controlled by edit-schema permission. #9
  • Improved /-/edit-schema/databasename page. #15
  • Now ships with a copy of Draggable.js. #16
  • Interface links back to table page. #18
2020-10-01T21:28:19Z ["datasette", "datasette-io", "datasette-plugin"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.12.3 2020-10-01
  • Fix for a bug where the map fails to display if the table is sorted by latitude or longitude. This fix depends on the upcoming release of Datasette (0.50). #18
2020-10-01T00:30:03Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.12.2 2020-10-01
  • Fixed bug with case sensitivity, LATITUDE and LONGITUDE columns will now work. #17
2020-10-01T00:11:09Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
130236762 https://github.com/simonw/datasette-cluster-map https://github.com/simonw/datasette-cluster-map/releases/tag/0.12.1 2020-09-30
  • Accidental release, this does not change anything.
2020-09-30T18:30:30Z ["datasette", "datasette-io", "datasette-plugin", "leafletjs"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.3a1 2020-09-30
  • Fix bug with editing column types. #17
2020-09-30T18:12:06Z ["datasette", "datasette-io", "datasette-plugin"]
247527438 https://github.com/simonw/datasette-edit-schema https://github.com/simonw/datasette-edit-schema/releases/tag/0.3a 2020-09-30
  • First prototype of transform table interface. #11
2020-09-30T17:00:54Z ["datasette", "datasette-io", "datasette-plugin"]
299143849 https://github.com/simonw/datasette-dateutil https://github.com/simonw/datasette-dateutil/releases/tag/0.2.1 2020-09-30
  • Documentation showing how to use these functions in conjunction with json_each() to join against other tables. #2
2020-09-30T01:07:35Z ["datasette", "datasette-io", "datasette-plugin", "dateutil"]
299143849 https://github.com/simonw/datasette-dateutil https://github.com/simonw/datasette-dateutil/releases/tag/0.2 2020-09-29
  • New dateutil_rrule() and dateutil_rrule_date() SQL functions. #1
  • New dateutil_dates_between() SQL function. #1
2020-09-29T06:41:03Z ["datasette", "datasette-io", "datasette-plugin", "dateutil"]
299198369 https://github.com/simonw/datasette-import-table https://github.com/simonw/datasette-import-table/releases/tag/0.2 2020-09-28
  • Tables that are currently importing now display a progress bar. #2
2020-09-28T15:27:45Z ["datasette", "datasette-io", "datasette-plugin"]
299198369 https://github.com/simonw/datasette-import-table https://github.com/simonw/datasette-import-table/releases/tag/0.1 2020-09-28
  • First non-alpha release.
  • Now checks for import-table permission, which by default is only granted to the root actor. #1
  • Uses ?_size=max to import the maximum number of rows per batch, speeding up imports. #2
2020-09-28T14:32:03Z ["datasette", "datasette-io", "datasette-plugin"]
299198369 https://github.com/simonw/datasette-import-table https://github.com/simonw/datasette-import-table/releases/tag/0.1a2 2020-09-28
  • Second attempt at fixing the template packaging issue.
2020-09-28T05:48:34Z ["datasette", "datasette-io", "datasette-plugin"]

Next page

Advanced export

JSON shape: default, array, newline-delimited

CSV options:

CREATE VIEW recent_releases AS select
  repos.rowid as rowid,
  repos.html_url as repo,
  releases.html_url as release,
  substr(releases.published_at, 0, 11) as date,
  releases.body as body_markdown,
  releases.published_at,
  coalesce(repos.topics, '[]') as topics
from
  releases
  join repos on repos.id = releases.repo
order by
  releases.published_at desc;