Jq Release 1.8.0

1 day ago 5

We are pleased to announce the release of version 1.8.0.
This release includes a number of improvements since the last version.
Note that some changes may introduce breaking changes to existing scripts,
so be sure to read the following information carefully.
Full commit log can be found at jq-1.7.1...jq-1.8.0.

Releasing

  • Change the version number pattern to 1.X.Y (1.8.0 instead of 1.8). @itchyny #2999

  • Generate provenance attestations for release artifacts and docker image. @lectrical #3225

    gh attestation verify --repo jqlang/jq jq-linux-amd64 gh attestation verify --repo jqlang/jq oci://ghcr.io/jqlang/jq:1.8.0

Security fixes

  • CVE-2024-23337: Fix signed integer overflow in jvp_array_write and jvp_object_rehash. @itchyny de21386
    • The fix for this issue now limits the maximum size of arrays and objects to 536870912 (2^29) elements.
  • CVE-2024-53427: Reject NaN with payload while parsing JSON. @itchyny a09a4df
    • The fix for this issue now drops support for NaN with payload in JSON (like NaN123).
      Other JSON extensions like NaN and Infinity are still supported.
  • CVE-2025-48060: Fix heap buffer overflow in jv_string_vfmt. @itchyny c6e0416
  • Fix use of uninitialized value in check_literal. @itchyny #3324
  • Fix segmentation fault on strftime/1, strflocaltime/1. @itchyny #3271
  • Fix unhandled overflow in @base64d. @emanuele6 #3080

CLI changes

  • Fix --indent 0 implicitly enabling --compact-output. @amarshall @gbrlmarn @itchyny #3232

    $ jq --indent 0 . <<< '{ "foo": ["hello", "world"] }' { "foo": [ "hello", "world" ] } # Previously, this implied --compact-output, but now outputs with new lines.

  • Improve error messages to show problematic position in the filter. @itchyny #3292

    $ jq -n '1 + $foo + 2' jq: error: $foo is not defined at <top-level>, line 1, column 5: 1 + $foo + 2 ^^^^ jq: 1 compile error

  • Include column number in parser and compiler error messages. @liviubobocu #3257

  • Fix error message for string literal beginning with single quote. @mattmeyers #2964

    $ jq .foo <<< "{'foo':'bar'}" jq: parse error: Invalid string literal; expected ", but got ' at line 1, column 7 # Previously, the error message was Invalid numeric literal at line 1, column 7.

  • Improve JQ_COLORS environment variable to support larger escapes like truecolor. @SArpnt #3282

    JQ_COLORS="38;2;255;173;173:38;2;255;214;165:38;2;253;255;182:38;2;202;255;191:38;2;155;246;255:38;2;160;196;255:38;2;189;178;255:38;2;255;198;255" jq -nc '[null,false,true,42,{"a":"bc"}]'

  • Add --library-path long option for -L. @thaliaarchi #3194

  • Fix --slurp --stream when input has no trailing newline character. @itchyny #3279

  • Fix --indent option to error for malformed values. @thaliaarchi #3195

  • Fix option parsing of --binary on non-Windows platforms. @calestyo #3131

  • Fix issue with ~/.jq on Windows where $HOME is not set. @kirkoman #3114

  • Fix broken non-Latin output in the command help on Windows. @itchyny #3299

  • Increase the maximum parsing depth for JSON to 10000. @itchyny #3328

  • Parse short options in order given. @thaliaarchi #3194

  • Consistently reset color formatting. @thaliaarchi #3034

New functions

  • Add trim/0, ltrim/0 and rtrim/0 to trim leading and trailing white spaces. @wader #3056

    $ jq -n '" hello " | trim, ltrim, rtrim' "hello" "hello " " hello"

  • Add trimstr/1 to trim string from both ends. @gbrlmarn #3319

    $ jq -n '"foobarfoo" | trimstr("foo")' "bar"

  • Add add/1. Generator variant of add/0. @myaaaaaaaaa #3144

    $ jq -c '.sum = add(.xs[])' <<< '{"xs":[1,2,3]}' {"xs":[1,2,3],"sum":6}

  • Add skip/2 as the counterpart to limit/2. @itchyny #3181

    $ jq -nc '[1,2,3,4,5] | [skip(2; .[])]' [3,4,5]

  • Add toboolean/0 to convert strings to booleans. @brahmlower @itchyny #2098

    $ jq -n '"true", "false" | toboolean' true false

  • Add @urid format. Reverse of @uri. @fmgornick #3161

    $ jq -Rr '@urid' <<< '%6a%71' jq

Changes to existing functions

Language changes

  • Fix precedence of binding syntax against unary and binary operators.
    Also, allow some expressions as object values. @itchyny #3053 #3326

    • This is a breaking change that may change the output of filters with binding syntax as follows.
    $ jq -nc '[-1 as $x | 1,$x]' [1,-1] # previously, [-1,-1] $ jq -nc '1 | . + 2 as $x | -$x' -3 # previously, -1 $ jq -nc '{x: 1 + 2, y: false or true, z: null // 3}' {"x":3,"y":true,"z":3} # previously, syntax error

  • Support Tcl-style multiline comments. @emanuele6 #2989

    #!/bin/sh -- # Can be use to do shebang scripts. # Next line will be seen as a comment be of the trailing backslash. \ exec jq ... # this jq expression will result in [1] [ 1, # \ 2 ]

  • Fix foreach not to break init backtracking with DUPN. @kanwren #3266

    $ jq -n '[1, 2] | foreach .[] as $x (0, 1; . + $x)' 1 3 2 4

  • Fix reduce/foreach state variable should not be reset each iteration. @itchyny #3205

    $ jq -n 'reduce range(5) as $x (0; .+$x | select($x!=2))' 8 $ jq -nc '[foreach range(5) as $x (0; .+$x | select($x!=2); [$x,.])]' [[0,0],[1,1],[3,4],[4,8]]

  • Support CRLF line breaks in filters. @itchyny #3274

  • Improve performance of repeating strings. @itchyny #3272

Documentation changes

Build improvements

Test improvements

Read Entire Article
  1. Homepage
  2. Technology
  3. Jq Release 1.8.0

Related

Learnings, data, & interesting things that happen when you write 100 newsletters

Learnings, data, & interesting things that happen when you w...

38 minutes ago 1
New FEMA chief told staff he didn't know about Atlantic hurricane season

New FEMA chief told staff he didn't know about Atlantic hurr...

42 minutes ago 1
Lean AI Native Companies Leaderboard

Lean AI Native Companies Leaderboard

50 minutes ago 1
Hostinger Web Hosting