Search

Got 1,601 results, sorted by newest / oldest

Release: sqlite-transform 1.2.1

This tool is no longer maintained. The latest release of sqlite-utils introduces a new sqlite-utils convert command which provides a super-set of the functionality provided by sqlite-transform. #11

Released 2021-08-02T22:07:57Z

Release: sqlite-utils 3.14

This release introduces the new sqlite-utils convert command (#251) and corresponding table.convert(...) Python method (#302). These tools can be used to apply a Python conversion function to one or more columns of a table, either updating the column in place or using transformed data from that column to populate one or more other columns. This command-line example uses the Python standard library...

Released 2021-08-02T21:34:43Z

Release: datasette-json-html 1.0.1

Now also tested against Python 3.9. Fixed Jinja2 deprecation warnings. #7

Released 2021-07-31T19:22:20Z

Release: datasette-json-html 1.0

1.0 release reflecting the stability of this plugin Extremely minor documentation improvements

Released 2021-07-31T19:10:13Z

Release: datasette-publish-fly 1.0.2

Now uses --json option to read existing application names from flyctl apps list. #5

Released 2021-07-30T22:11:11Z

Blog: Weeknotes: datasette-remote-metadata, sqlite-transform --multi

I mentioned Project Pelican (still a codename until the end of the embargo) last week. This week it inspired a new plugin, datasette-remote-metadata. I also published an article describing the Baked Data architectural patttern and shared the video and transcript of a talk I gave at PyGotham last year. datasette-remote-metadata Datasette's metadata system is one of the key ways of customizing a Dat...

Published 2021-07-29T19:32:45+00:00

Release: datasette-remote-metadata 0.1

Quit Datasette on startup if remote metadata cannot be fetched. #1 Documentation and tests for all configuration options. #2

Released 2021-07-29T01:43:16Z

Release: datasette-remote-metadata 0.1a0

First working release.

Released 2021-07-28T23:28:46Z

Plugin: datasette-remote-metadata

Periodically refresh Datasette metadata from a remote URL datasette-remote-metadata Periodically refresh Datasette metadata from a remote URL Installation Install this plugin in the same environment as Datasette. $ datasette install datasette-remote-metadata Usage Add the following to your metadata.json: { "plugins": { "datasette-remote-metadata": { "url": "https://exa...

Created 2021-07-28T23:17:19Z

Blog: The Baked Data architectural pattern

I've been exploring an architectural pattern for publishing websites over the past few years that I call the "Baked Data" pattern. It provides many of the advantages of static site generators while avoiding most of their limitations. I think it deserves to be used more widely. I define the Baked Data architectural pattern as the following: Baked Data: bundling a read-only copy of your data alongs...

Published 2021-07-28T20:23:44+00:00

Release: datasette-haversine 0.2

Handle string columns in addition to float columns. #1

Released 2021-07-28T20:14:24Z

Datasette News: 2021-07-28

The Baked Data architectural pattern describes a pattern commonly used with Datasette where the content for a site is bundled inside a SQLite database file and included alongside templates and application code in a deployment to a serverless hosting provider.

Release: datasette-publish-vercel 0.10

New --scope option for publishing to a different Vercel scope, for example a different team. #47

Released 2021-07-25T18:38:42Z

Release: sqlite-transform 1.2

sqlite-transform lambda --multi option allowing the function to return a Python dictionary defining multiple columns that will be created and populated. #4 --drop option can be used with --output or --multi to drop the original column. #15 All commands now require at least one column to be specified. #17

Released 2021-07-25T01:02:14Z

Release: sqlite-utils 3.13

sqlite-utils schema my.db table1 table2 command now accepts optional table names. (#299) sqlite-utils memory --help now describes the --schema option.

Released 2021-07-24T22:17:47Z

Blog: Datasette - an ecosystem of tools for working with small data

This is the transcript and video from a talk I gave at PyGotham 2020 about using SQLite, Datasette and Dogsheep to work with small data. I really like the term "small data", as a counterpoint to big data. I define small data as anything that fits on a mobile phone, and since my iPhone has half a terabyte of storage these days that ends up covering a lot of ground! I think SQLite is the ideal tool ...

Published 2021-07-22T18:13:40+00:00

Blog: Weeknotes: sqlite-transform 1.1, Datasette 0.58.1, datasette-graphql 1.5

Work on Project Pelican inspires new features and improvements across a number of different projects. Project Pelican is an upcoming collaborative data release I'm working on with an embargo - hence the code name. It involves around 700MB of CSV data converted to SQLite, which has lead to some small but notable improvements in several of my tools. Datasette 0.58 and 0.58.1 I published annotated re...

Published 2021-07-21T21:29:07+00:00

Release: sqlite-transform 1.1

New -s or --silent option for hiding the progress bar. #14

Released 2021-07-21T19:05:25Z

Release: sqlite-transform 1.0

New --output colname and --output-type integer options for all of the commands, see saving the result to a separate column. #13

Released 2021-07-21T01:05:05Z

Blog: Datasette downloads per day (with Observable Plot)

Datasette downloads per day (with Observable Plot) I built an Observable notebook that imports PyPI package download data from datasette.io (itself scraped from pypistats.org using a scheduled GitHub Action) and plots it using Observable Plot. Datasette downloads from PyPI apparently jumped from ~800/day in May to ~4,000/day in July - would love to know why! Via @simonw

Published 2021-07-17T17:01:46+00:00

Release: datasette-export-notebook 1.0

New "copy to clipboard" buttons next to each code example. #12 Observable export code no longer needs to import d3. #10 Better wrapping of code, especially on mobile screens. #11 d3 export examples now use d3.autoType. #13

Released 2021-07-17T04:01:49Z

Release: datasette-graphql 1.5

Now uses the datasette.client mechanism for internal calls. #61 Depends on datasette>=0.58.1

Released 2021-07-16T20:03:28Z

Release: datasette 0.58.1

Fix for an intermittent race condition caused by the refresh_schemas() internal function. (#1231)

Released 2021-07-16T19:51:15Z

Blog: Datasette 0.58: The annotated release notes

I released Datasette 0.58 last night, with new plugin hooks, Unix domain socket support, a major faceting performance fix and a few other improvements. Here are the annotated release notes. Faceting performance improvement Facets remains my favourite feature in Datasette: it turns out a simple group by / count against a column is one of the most productive ways I know of to start understanding new...

Published 2021-07-16T02:21:11+00:00

Release: datasette 0.58

New datasette --uds /tmp/datasette.sock option for binding Datasette to a Unix domain socket, see proxy documentation. (#1388) "searchmode": "raw" table metadata option for defaulting a table to executing SQLite full-text search syntax without first escaping it, see Advanced SQLite search queries. (#1389) New plugin hook: get_metadata(datasette, key, database, table), for returning custom metadat...

Released 2021-07-15T00:37:57Z

Datasette News: 2021-07-15

Datasette 0.58 has new plugin hooks, a huge performance improvement for faceting, support for Unix domain sockets and several other improvements. Read the annotated release notes for extra background and context on the release.

Blog: Weeknotes: Fun with Unix domain sockets

A small enhancement to Datasette this week: I've added support for proxying via Unix domain sockets. This started out as a feature request from Aslak Raanes: #1388: Serve using UNIX domain socket. I've not worked with these much before so it was a good opportunity to learn something new. Unix domain sockets provide a mechanism whereby different processes on a machine can communicate with each over...

Published 2021-07-13T18:57:10+00:00

Blog: Django SQL Dashboard 1.0

Earlier this week I released Django SQL Dashboard 1.0. I also just released 1.0.1, with a bug fix for PostgreSQL 10 contributed by Ryan Cheley. Django SQL Dashboard is my tool for adding a read-only, bookmarkable SQL querying interface to any Django plus PostgreSQL project. I introduced it with a demo video back in May. Django SQL Dashboard column menu The big new feature in 1.0 (aside from the co...

Published 2021-07-06T02:19:57+00:00

Release: django-sql-dashboard 1.0.1

Fixed an error when running against PostgreSQL 10 - thanks, Ryan Cheley. #138 This tool is now tested against PostgreSQL 10, 11, 12 and 13. #139

Released 2021-07-06T00:37:06Z

Release: django-sql-dashboard 1.0

Implemented a new column cog menu, with options for sorting, counting distinct items and counting by values. #57 Fixed bug where columns named after PostgreSQL reserved words (such as on or group) produced invalid suggested SELECT queries. #134 New Docker Compose configuration to support Docker development environments. Thanks, Atul Varma. #128 Admin change list view now only shows dashboards the...

Released 2021-07-01T03:58:28Z

Blog: Weeknotes: sqlite-utils updates, Datasette and asgi-csrf, open-sourcing VIAL

Some work on sqlite-utils, asgi-csrf, a Datasette alpha and we open-sourced VIAL. sqlite-utils Last week's sqlite-utils 3.10 introduced a huge new feature: the ability to run joins directly against CSV and JSON files from the command-line. I've since released sqlite-utils 3.11 and 3.12, much smaller releases. 3.11 added a new --schema option to the sqlite-utils memory command which lets you see th...

Published 2021-06-28T17:23:21+00:00

Blog: A Datasette tutorial in Portuguese

A Datasette tutorial in Portuguese Nicolás Linares put together this Datasette tutorial in Portuguese, including an explanation of the project, how to get it up and running on a laptop, how to use it to explore and facet data, how to use plugins (including datasette-vega and datasette-cluster-map) and how to publish data using Vercel. I ran this through Google Translate and I can confirm that it&#...

Published 2021-06-25T22:57:08+00:00

Release: sqlite-utils 3.12

New db.query(sql, params) method, which executes a SQL query and returns the results as an iterator over Python dictionaries. (#290) This project now uses flake8 and has started to use mypy. (#291) New documentation on contributing to this project. (#292)

Released 2021-06-25T18:00:18Z

Release: datasette 0.58a1

New plugin hook: skip_csrf(datasette, scope), for opting out of CSRF protection based on the incoming request. (#1377) POST requests to endpoints that do not support that HTTP verb now return a 405 error. db.path can now be provided as a pathlib.Path object, useful when writing unit tests for plugins. Thanks, Chris Amico. (#1365)

Released 2021-06-24T16:29:09Z

Release: sqlite-utils 3.11

New sqlite-utils memory data.csv --schema option, for outputting the schema of the in-memory database generated from one or more files. See --schema, --dump and --save. (#288) Added installation instructions. (#286)

Released 2021-06-20T18:53:09Z

Blog: Joining CSV and JSON data with an in-memory SQLite database

The new sqlite-utils memory command can import CSV and JSON data directly into an in-memory SQLite datbase, combine and query it using SQL and output the results as CSV, JSON or various other formats of plain text tables. sqlite-utils memory The new feature is part of sqlite-utils 3.10, released this morning. I've recorded this video demonstrating the new feature - with full accompanying notes bel...

Published 2021-06-19T22:55:57+00:00

Release: sqlite-utils 3.10

This release introduces the sqlite-utils memory command, which can be used to load CSV or JSON data into a temporary in-memory database and run SQL queries (including joins across multiple files) directly against that data. Also new: sqlite-utils insert --detect-types, sqlite-utils dump, table.use_rowid plus some smaller fixes. sqlite-utils memory This example of sqlite-utils memory retrieves info...

Released 2021-06-19T16:13:11Z

Release: dogsheep-beta 0.10.2

Fixed bug where searches consisting only of whitespace caused a server error. #33

Released 2021-06-13T14:38:09Z

Release: yaml-to-sqlite 1.0

New feature: yaml-to-sqlite dogs.db dogs.yaml --single-column=name can be used to import YAML files consisting of a list of items into a single table with a single primary key column. #5 Importing YAML files with new columns will now alter the table to add those columns. #4

Released 2021-06-13T04:45:52Z

Release: markdown-to-sqlite 1.0

BREAKING CHANGE: The option order for this command is now markdown-to-sqlite database.db tablename file1.md file2.md - prior to version 1.0 the order was markdown-to-sqlite file1.md file2.md database.db tablename. This change was made for improved consistency with other x-to-sqlite tools.

Released 2021-06-13T04:17:15Z