Compare commits

..

No commits in common. "master" and "1.1.1" have entirely different histories.

18 changed files with 242 additions and 533 deletions

View file

@ -1,37 +0,0 @@
name: CI
on: [push, pull_request]
jobs:
test:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
with:
fetch_depth: 0
- name: Setup Babashka
uses: turtlequeue/setup-babashka@v1.3.0
with:
babashka-version: 0.7.8
- name: Prepare java
uses: actions/setup-java@v2
with:
distribution: 'zulu'
java-version: '8'
- name: Install clojure tools
uses: DeLaGuardo/setup-clojure@4.0
with:
lein: 2.9.1
- name: Run clj tests
run: bb test:clj
- name: Run cljs tests
run: bb test:cljs
- name: Run babashka tests
run: bb test:bb

2
.gitignore vendored
View file

@ -11,5 +11,3 @@ pom.xml.asc
.lein-failures .lein-failures
.cljs_node_repl .cljs_node_repl
out/ out/
.cpcache
.cache

8
.travis.yml Normal file
View file

@ -0,0 +1,8 @@
language: clojure
lein: 2.7.1
cache:
directories:
- $HOME/.m2
script:
- lein test
- lein doo node test-build once

View file

@ -1,21 +1,3 @@
## 1.1.4
* Add arglist metadata to navs (thanks @phronmophobic)
* Improve before-index performance by 150x on lists and 5x on vectors (thanks @jeff303)
* Bug fix: BEFORE-ELEM, AFTER-ELEM, FIRST, LAST, BEGINNING, and END on subvecs now produce vector type in cljs
* Add compatibility with [babashka](https://babashka.org/)
## 1.1.3 - 2019-10-13
* Better AOT behavior: path functions for inline caching and protpath extensions no longer write eval'd class files. You can force path functions to not override `*compile-files*` by binding `com.rpl.specter.impl/*path-compile-files*` to `true`.
* Bug fix: fix throw-illegal in cljs
## 1.1.2 - 2018-11-01
* Eliminate reflection warning
* Bug fix: Fix inline compiler symbol handling so class references can be used as constants within paths
* Bug fix: Fix handling of subvector paths in cljs
## 1.1.1 - 2018-04-23 ## 1.1.1 - 2018-04-23
* ClojureScript 1.10 introduced a change causing the `walker` navigator to fail to walk records. `ALL` has been updated to operate over `MapEntry` in ClojureScript, fixing the issue. * ClojureScript 1.10 introduced a change causing the `walker` navigator to fail to walk records. `ALL` has been updated to operate over `MapEntry` in ClojureScript, fixing the issue.

View file

@ -1,9 +0,0 @@
# Contributing
We welcome external contributions to this project. For ideas for new functionality, we recommend first opening an issue so we can discuss whether it makes sense for the project.
## Contribution process
1. Open a pull request. If possible, please include thorough tests of the new code.
2. If you have not already signed a contributor agreement, we will request that you sign one. We use Adobe Sign for this so it's very quick and easy. Note that we cannot look at your pull request until a contributor agreement is signed.
3. We will then review your pull request and possibly ask for changes.

View file

@ -1,7 +1,7 @@
# Running Clojure tests # Running Clojure tests
``` ```
lein do clean, test lein cleantest
``` ```
# Running ClojureScript tests # Running ClojureScript tests
@ -10,16 +10,3 @@ lein do clean, test
lein javac lein javac
lein doo node test-build once lein doo node test-build once
``` ```
# Running benchmarks
## All benchmarks
```
scripts/run-benchmarks
```
## Individual benchmark(s)
Specify the benchmark names as command line args. They will likely each need quoted because they contain spaces.
Order is ignored.
```
scripts/run-benchmarks "prepend to a vector" "filter a sequence"
```

View file

@ -1,10 +1,10 @@
# Specter # Specter [![Build Status](https://secure.travis-ci.org/nathanmarz/specter.png?branch=master)](http://travis-ci.org/nathanmarz/specter)
Specter rejects Clojure's restrictive approach to immutable data structure manipulation, instead exposing an elegant API to allow any sort of manipulation imaginable. Specter especially excels at querying and transforming nested and recursive data, important use cases that are very complex to handle with vanilla Clojure. Specter rejects Clojure's restrictive approach to immutable data structure manipulation, instead exposing an elegant API to allow any sort of manipulation imaginable. Specter especially excels at querying and transforming nested and recursive data, important use cases that are very complex to handle with vanilla Clojure.
Specter has an extremely simple core, just a single abstraction called "navigator". Queries and transforms are done by composing navigators into a "path" precisely targeting what you want to retrieve or change. Navigators can be composed with any other navigators, allowing sophisticated manipulations to be expressed very concisely. Specter has an extremely simple core, just a single abstraction called "navigator". Queries and transforms are done by composing navigators into a "path" precisely targeting what you want to retrieve or change. Navigators can be composed with any other navigators, allowing sophisticated manipulations to be expressed very concisely.
In addition, Specter has performance rivaling hand-optimized code (see [this benchmark](https://gist.github.com/nathanmarz/b7c612b417647db80b9eaab618ff8d83)). Clojure's only comparable built-in operations are `get-in` and `update-in`, and the Specter equivalents are 30% and 85% faster respectively (while being just as concise). Under the hood, Specter uses [advanced dynamic techniques](https://github.com/redplanetlabs/specter/wiki/Specter's-inline-caching-implementation) to strip away the overhead of composition. In addition, Specter has performance rivaling hand-optimized code (see [this benchmark](https://gist.github.com/nathanmarz/b7c612b417647db80b9eaab618ff8d83)). Clojure's only comparable built-in operations are `get-in` and `update-in`, and the Specter equivalents are 30% and 85% faster respectively (while being just as concise). Under the hood, Specter uses [advanced dynamic techniques](https://github.com/nathanmarz/specter/wiki/Specter's-inline-caching-implementation) to strip away the overhead of composition.
There are some key differences between the Clojure approach to data manipulation and the Specter approach. Unlike Clojure, Specter always uses the most efficient method possible to implement an operation for a datatype (e.g. `last` vs. `LAST`). Clojure intentionally leaves out many operations, such as prepending to a vector or inserting into the middle of a sequence. Specter has navigators that cover these use cases (`BEFORE-ELEM` and `before-index`) and many more. Finally, Specter transforms always target precise parts of a data structure, leaving everything else the same. For instance, `ALL` targets every value within a sequence, and the resulting transform is always the same type as the input (e.g. a vector stays a vector, a sorted map stays a sorted map). There are some key differences between the Clojure approach to data manipulation and the Specter approach. Unlike Clojure, Specter always uses the most efficient method possible to implement an operation for a datatype (e.g. `last` vs. `LAST`). Clojure intentionally leaves out many operations, such as prepending to a vector or inserting into the middle of a sequence. Specter has navigators that cover these use cases (`BEFORE-ELEM` and `before-index`) and many more. Finally, Specter transforms always target precise parts of a data structure, leaving everything else the same. For instance, `ALL` targets every value within a sequence, and the resulting transform is always the same type as the input (e.g. a vector stays a vector, a sorted map stays a sorted map).
@ -84,23 +84,23 @@ The latest release version of Specter is hosted on [Clojars](https://clojars.org
- Presentation about Specter: [Specter: Powerful and Simple Data Structure Manipulation](https://www.youtube.com/watch?v=VTCy_DkAJGk) - Presentation about Specter: [Specter: Powerful and Simple Data Structure Manipulation](https://www.youtube.com/watch?v=VTCy_DkAJGk)
- Note that this presentation was given before Specter's inline compilation/caching system was developed. You no longer need to do anything special to get near-optimal performance. - Note that this presentation was given before Specter's inline compilation/caching system was developed. You no longer need to do anything special to get near-optimal performance.
- Screencast on Specter: [Understanding Specter](https://www.youtube.com/watch?v=rh5J4vacG98) - Screencast on Specter: [Understanding Specter](https://www.youtube.com/watch?v=rh5J4vacG98)
- List of navigators with examples: [This wiki page](https://github.com/redplanetlabs/specter/wiki/List-of-Navigators) provides a more comprehensive overview than the API docs about the behavior of specific navigators and includes many examples. - List of navigators with examples: [This wiki page](https://github.com/nathanmarz/specter/wiki/List-of-Navigators) provides a more comprehensive overview than the API docs about the behavior of specific navigators and includes many examples.
- Core operations and defining new navigators: [This wiki page](https://github.com/redplanetlabs/specter/wiki/List-of-Macros) provides a more comprehensive overview than the API docs of the core select/transform/etc. operations and the operations for defining new navigators. - Core operations and defining new navigators: [This wiki page](https://github.com/nathanmarz/specter/wiki/List-of-Macros) provides a more comprehensive overview than the API docs of the core select/transform/etc. operations and the operations for defining new navigators.
- [This wiki page](https://github.com/redplanetlabs/specter/wiki/Using-Specter-Recursively) explains how to do precise and efficient recursive navigation with Specter. - [This wiki page](https://github.com/nathanmarz/specter/wiki/Using-Specter-Recursively) explains how to do precise and efficient recursive navigation with Specter.
- [This wiki page](https://github.com/redplanetlabs/specter/wiki/Using-Specter-With-Zippers) provides a comprehensive overview of how to use Specter's zipper navigators. Zippers are a much slower navigation method but can perform certain tasks that are not possible with Specter's regular navigators. Note that zippers are rarely needed. - [This wiki page](https://github.com/nathanmarz/specter/wiki/Using-Specter-With-Zippers) provides a comprehensive overview of how to use Specter's zipper navigators. Zippers are a much slower navigation method but can perform certain tasks that are not possible with Specter's regular navigators. Note that zippers are rarely needed.
- [Cheat Sheet](https://github.com/redplanetlabs/specter/wiki/Cheat-Sheet) - [Cheat Sheet](https://github.com/nathanmarz/specter/wiki/Cheat-Sheet)
- [API docs](http://redplanetlabs.github.io/specter/) - [API docs](http://nathanmarz.github.io/specter/)
- Performance guide: [This post](https://github.com/redplanetlabs/specter/wiki/Specter's-inline-caching-implementation) provides an overview of how Specter achieves its performance. - Performance guide: [This post](https://github.com/nathanmarz/specter/wiki/Specter's-inline-caching-implementation) provides an overview of how Specter achieves its performance.
Specter's API is contained in these files: Specter's API is contained in these files:
- [specter.cljc](https://github.com/redplanetlabs/specter/blob/master/src/clj/com/rpl/specter.cljc): This contains the built-in navigators and the definition of the core operations. - [specter.cljc](https://github.com/nathanmarz/specter/blob/master/src/clj/com/rpl/specter.cljc): This contains the built-in navigators and the definition of the core operations.
- [transients.cljc](https://github.com/redplanetlabs/specter/blob/master/src/clj/com/rpl/specter/transients.cljc): This contains navigators for transient collections. - [transients.cljc](https://github.com/nathanmarz/specter/blob/master/src/clj/com/rpl/specter/transients.cljc): This contains navigators for transient collections.
- [zipper.cljc](https://github.com/redplanetlabs/specter/blob/master/src/clj/com/rpl/specter/zipper.cljc): This integrates zipper-based navigation into Specter. - [zipper.cljc](https://github.com/nathanmarz/specter/blob/master/src/clj/com/rpl/specter/zipper.cljc): This integrates zipper-based navigation into Specter.
# Questions? # Questions?
You can ask questions about Specter by [opening an issue](https://github.com/redplanetlabs/specter/issues?utf8=%E2%9C%93&q=is%3Aissue+label%3Aquestion+) on Github. You can ask questions about Specter by [opening an issue](https://github.com/nathanmarz/specter/issues?utf8=%E2%9C%93&q=is%3Aissue+label%3Aquestion+) on Github.
You can also find help in the #specter channel on [Clojurians](http://clojurians.net/). You can also find help in the #specter channel on [Clojurians](http://clojurians.net/).
@ -322,22 +322,6 @@ Specter supports ClojureScript! However, some of the differences between Clojure
# Future work # Future work
- Integrate Specter with other kinds of data structures, such as graphs. Desired navigations include: reduction in topological order, navigate to outgoing/incoming nodes, to a subgraph (with metadata indicating how to attach external edges on transformation), to node attributes, to node values, to specific nodes. - Integrate Specter with other kinds of data structures, such as graphs. Desired navigations include: reduction in topological order, navigate to outgoing/incoming nodes, to a subgraph (with metadata indicating how to attach external edges on transformation), to node attributes, to node values, to specific nodes.
# clj-kondo
When using Specter in a project with [clj-kondo](https://github.com/clj-kondo/clj-kondo), a lot of the vars will be considered unresolved because internally Specter defines them with macros. The following configuration snippet will resolve these issues if you include it in your `.clj-kondo/config.edn` file.
```clojure
{:lint-as {com.rpl.specter/defcollector clojure.core/defn
com.rpl.specter/defdynamicnav clojure.core/defn
com.rpl.specter/defmacroalias clojure.core/def
com.rpl.specter/defnav clojure.core/defn
com.rpl.specter/defrichnav clojure.core/defn}}
```
# Babashka
This library is compatible with [babashka](https://babashka.org/) as of specter 1.1.4 and babashka 0.7.8.
# License # License
Copyright 2015-2020 Red Planet Labs, Inc. Specter is licensed under Apache License v2.0. Copyright 2015-2018 Red Planet Labs, Inc. Specter is licensed under Apache License v2.0.

View file

@ -1 +1 @@
1.1.5-SNAPSHOT 1.1.1

19
bb.edn
View file

@ -1,19 +0,0 @@
{:paths ["src/clj"]
:tasks
{test:clj {:doc "Run clj tests with leiningen"
:task (shell "lein test")}
test:cljs {:doc "Run cljs tests with leiningen"
:task (shell "lein doo node test-build once")}
test:bb {:doc "Run bb tests"
:extra-paths ["test"]
:extra-deps {org.clojure/test.check {:mvn/version "0.9.0"}
io.github.cognitect-labs/test-runner
{:git/tag "v0.5.0" :git/sha "b3fd0d2"}
org.clojure/tools.namespace {:git/url "https://github.com/babashka/tools.namespace"
:git/sha "3625153ee66dfcec2ba600851b5b2cbdab8fae6c"}}
:requires ([cognitect.test-runner :as tr])
:task (apply tr/-main
"-d" "test"
*command-line-args*)}}}

View file

@ -9,7 +9,7 @@
:test-paths ["test", "target/test-classes"] :test-paths ["test", "target/test-classes"]
:auto-clean false :auto-clean false
:dependencies [[riddley "0.1.12"]] :dependencies [[riddley "0.1.12"]]
:plugins [[lein-codox "0.10.7"] :plugins [[lein-codox "0.9.5"]
[lein-doo "0.1.7"]] [lein-doo "0.1.7"]]
:codox {:source-paths ["target/classes" "src/clj"] :codox {:source-paths ["target/classes" "src/clj"]
:namespaces [com.rpl.specter :namespaces [com.rpl.specter
@ -31,13 +31,8 @@
:profiles {:dev {:dependencies :profiles {:dev {:dependencies
[[org.clojure/test.check "0.9.0"] [[org.clojure/test.check "0.9.0"]
[org.clojure/clojure "1.9.0"] [org.clojure/clojure "1.9.0"]
[org.clojure/clojurescript "1.10.439"]]} [org.clojure/clojurescript "1.10.126"]]}
:bench {:dependencies [[org.clojure/clojure "1.9.0"]
[criterium "0.4.4"]]}
:test {:dependencies [[org.clojure/clojure "1.7.0"]]}} :test {:dependencies [[org.clojure/clojure "1.7.0"]]}}
:deploy-repositories
[["clojars" {:url "https://repo.clojars.org"
:sign-releases false}]]
:aliases {"deploy" ["do" "clean," "deploy" "clojars"]}) :aliases {"deploy" ["do" "clean," "deploy" "clojars"]})

View file

@ -2,31 +2,57 @@
(:use [com.rpl.specter] (:use [com.rpl.specter]
[com.rpl.specter.transients]) [com.rpl.specter.transients])
(:require [clojure.walk :as walk] (:require [clojure.walk :as walk]
[com.rpl.specter.impl :as i] [com.rpl.specter.impl :as i]))
[criterium.core :as bench]))
;; run via `lein repl` with `(load-file "scripts/benchmarks.clj")`
(defn pretty-float5 [anum]
(format "%.5g" anum))
(defn pretty-float3 [anum] (defn pretty-float3 [anum]
(format "%.3g" anum)) (format "%.3g" anum))
(defn mean [a-fn] (defn time-ms [amt afn]
(-> a-fn (bench/benchmark* {}) :mean first (* 1000000))) (let [start (System/nanoTime)
_ (dotimes [_ amt] (afn))
end (System/nanoTime)]
(/ (- end start) 1000000.0)))
(defn compare-benchmark [afn-map]
(let [results (transform MAP-VALS mean afn-map) (defn avg [numbers]
(/ (reduce + numbers)
(count numbers)
1.0))
(defn average-time-ms [iters amt-per-iter afn]
(avg
;; treat 1st run as warmup
(next
(for [i (range (inc iters))]
(time-ms amt-per-iter afn)))))
(defn compare-benchmark [amt-per-iter afn-map]
(System/runFinalization)
(System/gc)
(let [results (transform MAP-VALS
(fn [afn]
(average-time-ms 8 amt-per-iter afn))
afn-map)
[[_ best-time] & _ :as sorted] (sort-by last results)] [[_ best-time] & _ :as sorted] (sort-by last results)]
(println "\nMean(us)\tvs best\t\tCode")
(doseq [[k t] sorted]
(println (pretty-float3 t) "\t\t" (pretty-float3 (/ t best-time 1.0)) "\t\t" k))))
(defmacro run-benchmark [name & exprs] (println "\nAvg(ms)\t\tvs best\t\tCode")
(let [only-benchmarks (set (filter some? *command-line-args*)) (doseq [[k t] sorted]
all-benchmarks? (empty? only-benchmarks)] (println (pretty-float5 t) "\t\t" (pretty-float3 (/ t best-time 1.0)) "\t\t" k))))
(if (or all-benchmarks? (contains? only-benchmarks name))
(let [afn-map (->> exprs shuffle (map (fn [e] [`(quote ~e) `(fn [] ~e)])) (into {}))]
`(do (defmacro run-benchmark [name amt-per-iter & exprs]
(println "Benchmark:" ~name) (let [afn-map (->> exprs shuffle (map (fn [e] [`(quote ~e) `(fn [] ~e)])) (into {}))]
(compare-benchmark ~afn-map) `(do
(println "\n********************************\n")))))) (println "Benchmark:" ~name (str "(" ~amt-per-iter " iterations)"))
(compare-benchmark ~amt-per-iter ~afn-map)
(println "\n********************************\n"))))
(defn specter-dynamic-nested-get [data a b c] (defn specter-dynamic-nested-get [data a b c]
(select-any (keypath a b c) data)) (select-any (keypath a b c) data))
@ -43,7 +69,7 @@
(let [data {:a {:b {:c 1}}} (let [data {:a {:b {:c 1}}}
p (comp-paths :a :b :c)] p (comp-paths :a :b :c)]
(run-benchmark "get value in nested map" (run-benchmark "get value in nested map" 2500000
(select-any [:a :b :c] data) (select-any [:a :b :c] data)
(select-any (keypath :a :b :c) data) (select-any (keypath :a :b :c) data)
(select-one [:a :b :c] data) (select-one [:a :b :c] data)
@ -60,7 +86,7 @@
(let [data {:a {:b {:c 1}}}] (let [data {:a {:b {:c 1}}}]
(run-benchmark "set value in nested map" (run-benchmark "set value in nested map" 2500000
(assoc-in data [:a :b :c] 1) (assoc-in data [:a :b :c] 1)
(setval [:a :b :c] 1 data))) (setval [:a :b :c] 1 data)))
@ -77,7 +103,7 @@
(my-update m3 :c afn)))))) (my-update m3 :c afn))))))
(let [data {:a {:b {:c 1}}}] (let [data {:a {:b {:c 1}}}]
(run-benchmark "update value in nested map" (run-benchmark "update value in nested map" 500000
(update-in data [:a :b :c] inc) (update-in data [:a :b :c] inc)
(transform [:a :b :c] inc data) (transform [:a :b :c] inc data)
(manual-transform data inc))) (manual-transform data inc)))
@ -109,14 +135,14 @@
(let [data '(1 2 3 4 5)] (let [data '(1 2 3 4 5)]
(run-benchmark "transform values of a list" (run-benchmark "transform values of a list" 500000
(transform ALL inc data) (transform ALL inc data)
(doall (sequence (map inc) data)) (doall (sequence (map inc) data))
(reverse (into '() (map inc) data)) (reverse (into '() (map inc) data))
)) ))
(let [data {:a 1 :b 2 :c 3 :d 4}] (let [data {:a 1 :b 2 :c 3 :d 4}]
(run-benchmark "transform values of a small map" (run-benchmark "transform values of a small map" 500000
(into {} (for [[k v] data] [k (inc v)])) (into {} (for [[k v] data] [k (inc v)]))
(reduce-kv (fn [m k v] (assoc m k (inc v))) {} data) (reduce-kv (fn [m k v] (assoc m k (inc v))) {} data)
(persistent! (reduce-kv (fn [m k v] (assoc! m k (inc v))) (transient {}) data)) (persistent! (reduce-kv (fn [m k v] (assoc! m k (inc v))) (transient {}) data))
@ -132,7 +158,7 @@
(let [data (->> (for [i (range 1000)] [i i]) (into {}))] (let [data (->> (for [i (range 1000)] [i i]) (into {}))]
(run-benchmark "transform values of large map" (run-benchmark "transform values of large map" 600
(into {} (for [[k v] data] [k (inc v)])) (into {} (for [[k v] data] [k (inc v)]))
(reduce-kv (fn [m k v] (assoc m k (inc v))) {} data) (reduce-kv (fn [m k v] (assoc m k (inc v))) {} data)
(persistent! (reduce-kv (fn [m k v] (assoc! m k (inc v))) (transient {}) data)) (persistent! (reduce-kv (fn [m k v] (assoc! m k (inc v))) (transient {}) data))
@ -148,7 +174,7 @@
(let [data [1 2 3 4 5 6 7 8 9 10]] (let [data [1 2 3 4 5 6 7 8 9 10]]
(run-benchmark "first value of a size 10 vector" (run-benchmark "first value of a size 10 vector" 10000000
(first data) (first data)
(select-any ALL data) (select-any ALL data)
(select-any FIRST data) (select-any FIRST data)
@ -156,7 +182,7 @@
)) ))
(let [data [1 2 3 4 5]] (let [data [1 2 3 4 5]]
(run-benchmark "map a function over a vector" (run-benchmark "map a function over a vector" 1000000
(vec (map inc data)) (vec (map inc data))
(mapv inc data) (mapv inc data)
(transform ALL inc data) (transform ALL inc data)
@ -164,7 +190,7 @@
(let [data [1 2 3 4 5 6 7 8 9 10]] (let [data [1 2 3 4 5 6 7 8 9 10]]
(run-benchmark "filter a sequence" (run-benchmark "filter a sequence" 500000
(doall (filter even? data)) (doall (filter even? data))
(filterv even? data) (filterv even? data)
(select [ALL even?] data) (select [ALL even?] data)
@ -174,7 +200,7 @@
(let [data [{:a 2 :b 2} {:a 1} {:a 4} {:a 6}] (let [data [{:a 2 :b 2} {:a 1} {:a 4} {:a 6}]
xf (comp (map :a) (filter even?))] xf (comp (map :a) (filter even?))]
(run-benchmark "even :a values from sequence of maps" (run-benchmark "even :a values from sequence of maps" 500000
(select [ALL :a even?] data) (select [ALL :a even?] data)
(->> data (mapv :a) (filter even?) doall) (->> data (mapv :a) (filter even?) doall)
(into [] (comp (map :a) (filter even?)) data) (into [] (comp (map :a) (filter even?)) data)
@ -183,13 +209,14 @@
(let [v (vec (range 1000))] (let [v (vec (range 1000))]
(run-benchmark "Append to a large vector" (run-benchmark "Append to a large vector"
2000000
(setval END [1] v) (setval END [1] v)
(setval AFTER-ELEM 1 v) (setval AFTER-ELEM 1 v)
(reduce conj v [1]) (reduce conj v [1])
(conj v 1))) (conj v 1)))
(let [data [1 2 3 4 5 6 7 8 9 10]] (let [data [1 2 3 4 5 6 7 8 9 10]]
(run-benchmark "prepend to a vector" (run-benchmark "prepend to a vector" 1000000
(vec (cons 0 data)) (vec (cons 0 data))
(setval BEFORE-ELEM 0 data) (setval BEFORE-ELEM 0 data)
(into [0] data) (into [0] data)
@ -217,6 +244,7 @@
(let [data [1 2 [[3]] [4 6 [7 [8]] 10]]] (let [data [1 2 [[3]] [4 6 [7 [8]] 10]]]
(run-benchmark "update every value in a tree (represented with vectors)" (run-benchmark "update every value in a tree (represented with vectors)"
50000
(walk/postwalk (fn [e] (if (and (number? e) (even? e)) (inc e) e)) data) (walk/postwalk (fn [e] (if (and (number? e) (even? e)) (inc e) e)) data)
(transform [(walker number?) even?] inc data) (transform [(walker number?) even?] inc data)
(transform [TreeValues even?] inc data) (transform [TreeValues even?] inc data)
@ -226,6 +254,7 @@
(let [toappend (range 1000)] (let [toappend (range 1000)]
(run-benchmark "transient comparison: building up vectors" (run-benchmark "transient comparison: building up vectors"
8000
(reduce (fn [v i] (conj v i)) [] toappend) (reduce (fn [v i] (conj v i)) [] toappend)
(reduce (fn [v i] (conj! v i)) (transient []) toappend) (reduce (fn [v i] (conj! v i)) (transient []) toappend)
(setval END toappend []) (setval END toappend [])
@ -233,6 +262,7 @@
(let [toappend (range 1000)] (let [toappend (range 1000)]
(run-benchmark "transient comparison: building up vectors one at a time" (run-benchmark "transient comparison: building up vectors one at a time"
7000
(reduce (fn [v i] (conj v i)) [] toappend) (reduce (fn [v i] (conj v i)) [] toappend)
(reduce (fn [v i] (conj! v i)) (transient []) toappend) (reduce (fn [v i] (conj! v i)) (transient []) toappend)
(reduce (fn [v i] (setval END [i] v)) [] toappend) (reduce (fn [v i] (setval END [i] v)) [] toappend)
@ -243,6 +273,7 @@
tdata (transient data) tdata (transient data)
tdata2 (transient data)] tdata2 (transient data)]
(run-benchmark "transient comparison: assoc'ing in vectors" (run-benchmark "transient comparison: assoc'ing in vectors"
2500000
(assoc data 600 0) (assoc data 600 0)
(assoc! tdata 600 0) (assoc! tdata 600 0)
(setval (keypath 600) 0 data) (setval (keypath 600) 0 data)
@ -253,6 +284,7 @@
tdata (transient data) tdata (transient data)
tdata2 (transient data)] tdata2 (transient data)]
(run-benchmark "transient comparison: assoc'ing in maps" (run-benchmark "transient comparison: assoc'ing in maps"
1500000
(assoc data 600 0) (assoc data 600 0)
(assoc! tdata 600 0) (assoc! tdata 600 0)
(setval (keypath 600) 0 data) (setval (keypath 600) 0 data)
@ -266,27 +298,31 @@
[k (rand)])) [k (rand)]))
tdata (transient data)] tdata (transient data)]
(run-benchmark "transient comparison: submap" (run-benchmark "transient comparison: submap"
150000
(transform (submap [600 700]) modify-submap data) (transform (submap [600 700]) modify-submap data)
(transform (submap! [600 700]) modify-submap tdata))) (transform (submap! [600 700]) modify-submap tdata)))
(let [data {:x 1} (let [data {:x 1}
meta-map {:my :metadata}] meta-map {:my :metadata}]
(run-benchmark "set metadata" (run-benchmark "set metadata"
1500000
(with-meta data meta-map) (with-meta data meta-map)
(setval META meta-map data))) (setval META meta-map data)))
(let [data (with-meta {:x 1} {:my :metadata})] (let [data (with-meta {:x 1} {:my :metadata})]
(run-benchmark "get metadata" (run-benchmark "get metadata"
15000000
(meta data) (meta data)
(select-any META data))) (select-any META data)))
(let [data (with-meta {:x 1} {:my :metadata})] (let [data (with-meta {:x 1} {:my :metadata})]
(run-benchmark "vary metadata" (run-benchmark "vary metadata"
800000
(vary-meta data assoc :y 2) (vary-meta data assoc :y 2)
(setval [META :y] 2 data))) (setval [META :y] 2 data)))
(let [data (range 1000)] (let [data (range 1000)]
(run-benchmark "Traverse into a set" (run-benchmark "Traverse into a set" 5000
(set data) (set data)
(set (select ALL data)) (set (select ALL data))
(into #{} (traverse ALL data)) (into #{} (traverse ALL data))
@ -298,18 +334,18 @@
(defn mult-10 [v] (* 10 v)) (defn mult-10 [v] (* 10 v))
(let [data [1 2 3 4 5 6 7 8 9]] (let [data [1 2 3 4 5 6 7 8 9]]
(run-benchmark "multi-transform vs. consecutive transforms, one shared nav" (run-benchmark "multi-transform vs. consecutive transforms, one shared nav" 300000
(->> data (transform [ALL even?] mult-10) (transform [ALL odd?] dec)) (->> data (transform [ALL even?] mult-10) (transform [ALL odd?] dec))
(multi-transform [ALL (multi-path [even? (terminal mult-10)] [odd? (terminal dec)])] data))) (multi-transform [ALL (multi-path [even? (terminal mult-10)] [odd? (terminal dec)])] data)))
(let [data [[1 2 3 4 :a] [5] [6 7 :b 8 9] [10 11 12 13]]] (let [data [[1 2 3 4 :a] [5] [6 7 :b 8 9] [10 11 12 13]]]
(run-benchmark "multi-transform vs. consecutive transforms, three shared navs" (run-benchmark "multi-transform vs. consecutive transforms, three shared navs" 150000
(->> data (transform [ALL ALL number? even?] mult-10) (transform [ALL ALL number? odd?] dec)) (->> data (transform [ALL ALL number? even?] mult-10) (transform [ALL ALL number? odd?] dec))
(multi-transform [ALL ALL number? (multi-path [even? (terminal mult-10)] [odd? (terminal dec)])] data))) (multi-transform [ALL ALL number? (multi-path [even? (terminal mult-10)] [odd? (terminal dec)])] data)))
(let [data {:a 1 :b 2 :c 3 :d 4}] (let [data {:a 1 :b 2 :c 3 :d 4}]
(run-benchmark "namespace qualify keys of a small map" (run-benchmark "namespace qualify keys of a small map" 1000000
(into {} (into {}
(map (fn [[k v]] [(keyword (str *ns*) (name k)) v])) (map (fn [[k v]] [(keyword (str *ns*) (name k)) v]))
data) data)
@ -319,7 +355,7 @@
(let [data (->> (for [i (range 1000)] [(keyword (str i)) i]) (into {}))] (let [data (->> (for [i (range 1000)] [(keyword (str i)) i]) (into {}))]
(run-benchmark "namespace qualify keys of a large map" (run-benchmark "namespace qualify keys of a large map" 1200
(into {} (into {}
(map (fn [[k v]] [(keyword (str *ns*) (name k)) v])) (map (fn [[k v]] [(keyword (str *ns*) (name k)) v]))
data) data)
@ -334,24 +370,7 @@
(i/walk-until afn next-fn structure))) (i/walk-until afn next-fn structure)))
(let [data {:a [1 2 {:c '(3 4) :d {:e [1 2 3] 7 8 9 10}}]}] (let [data {:a [1 2 {:c '(3 4) :d {:e [1 2 3] 7 8 9 10}}]}]
(run-benchmark "walker vs. clojure.walk version" (run-benchmark "walker vs. clojure.walk version" 150000
(transform (walker number?) inc data) (transform (walker number?) inc data)
(transform (walker-old number?) inc data) (transform (walker-old number?) inc data)
)) ))
(let [size 1000
middle-idx (/ size 2)
v -1
rng (range size)
data-vec (vec rng)
data-lst (apply list rng)]
(run-benchmark "before-index vs. srange in middle (vector)"
(setval (before-index middle-idx) v data-vec)
(setval (srange middle-idx middle-idx) [v] data-vec))
(run-benchmark "before-index vs. srange in middle (list)"
(setval (before-index middle-idx) v data-lst)
(setval (srange middle-idx middle-idx) [v] data-lst))
(run-benchmark "before-index at 0 vs. srange vs. cons (list)"
(setval (before-index 0) v data-lst)
(setval (srange 0 0) [v] data-lst)
(cons v data-lst)))

View file

@ -1,8 +1,4 @@
#!/bin/bash #!/bin/bash
lein javac `lein javac`
lein version java -server -XX:MaxPermSize=128m -XX:MaxInlineSize=100 -cp `lein classpath` clojure.main scripts/benchmarks.clj
echo
lein show-profiles bench
echo
java -server -XX:MaxInlineSize=100 -cp "$(lein with-profile bench classpath)" clojure.main scripts/benchmarks.clj "$@"

View file

@ -115,32 +115,7 @@
(providepath ~self-sym ~path) (providepath ~self-sym ~path)
~self-sym))))) ~self-sym)))))
;; copied from clojure.core ;; copied from tools.macro to avoid the dependency
(def
^{:private true}
sigs
(fn [fdecl]
(let [asig
(fn [fdecl]
(let [arglist (first fdecl)
;; elide implicit macro args
arglist (if (= '&form (first arglist))
(subvec arglist 2 (count arglist))
arglist)
body (next fdecl)]
(if (map? (first body))
(if (next body)
(with-meta arglist (conj (if (meta arglist) (meta arglist) {}) (first body)))
arglist)
arglist)))]
(if (seq? (first fdecl))
(loop [ret [] fdecls fdecl]
(if fdecls
(recur (conj ret (asig (first fdecls))) (next fdecls))
(seq ret)))
(list (asig fdecl))))))
;; partially copied from clojure.core/defn
(defn- name-with-attributes (defn- name-with-attributes
"To be used in macro definitions. "To be used in macro definitions.
Handles optional docstrings and attribute maps for a name to be defined Handles optional docstrings and attribute maps for a name to be defined
@ -151,31 +126,20 @@
macro argument list. The return value is a vector containing the name macro argument list. The return value is a vector containing the name
with its extended metadata map and the list of unprocessed macro with its extended metadata map and the list of unprocessed macro
arguments." arguments."
[name fdecl] [name macro-args]
(let [m (if (string? (first fdecl)) (let [[docstring macro-args] (if (string? (first macro-args))
{:doc (first fdecl)} [(first macro-args) (next macro-args)]
{}) [nil macro-args])
[attr macro-args] (if (map? (first macro-args))
fdecl (if (string? (first fdecl)) [(first macro-args) (next macro-args)]
(next fdecl) [{} macro-args])
fdecl) attr (if docstring
m (if (map? (first fdecl)) (assoc attr :doc docstring)
(conj m (first fdecl)) attr)
m) attr (if (meta name)
fdecl (if (map? (first fdecl)) (conj (meta name) attr)
(next fdecl) attr)]
fdecl) [(with-meta name attr) macro-args]))
fdecl (if (vector? (first fdecl))
(list fdecl)
fdecl)
m (if (map? (last fdecl))
(conj m (last fdecl))
m)
fdecl (if (map? (last fdecl))
(butlast fdecl)
fdecl)
m (conj {:arglists (list 'quote (sigs fdecl))} m)]
[(with-meta name m) fdecl]))
(defmacro dynamicnav [& args] (defmacro dynamicnav [& args]
`(vary-meta (wrap-dynamic-nav (fn ~@args)) assoc :dynamicnav true)) `(vary-meta (wrap-dynamic-nav (fn ~@args)) assoc :dynamicnav true))
@ -202,10 +166,7 @@
embed (i/maybe-direct-nav path (-> s meta :direct-nav))] embed (i/maybe-direct-nav path (-> s meta :direct-nav))]
`(com.rpl.specter.impl/->LocalSym ~path (quote ~embed))) `(com.rpl.specter.impl/->LocalSym ~path (quote ~embed)))
;; var-get doesn't work in cljs, so capture the val in the macro instead ;; var-get doesn't work in cljs, so capture the val in the macro instead
`(com.rpl.specter.impl/->VarUse `(com.rpl.specter.impl/->VarUse ~path (var ~path) (quote ~path)))
~path
~(if-not (instance? Class (resolve path)) `(var ~path))
(quote ~path)))
(i/fn-invocation? path) (i/fn-invocation? path)
@ -492,8 +453,7 @@
params (-> protpath-prot :sigs first last :arglists first)] params (-> protpath-prot :sigs first last :arglists first)]
(doseq [[atype path-code] extensions] (doseq [[atype path-code] extensions]
(extend atype protpath-prot (extend atype protpath-prot
{m (binding [*compile-files* false] {m (eval `(fn ~params (path ~path-code)))}))))
(eval `(fn ~params (path ~path-code))))}))))
(defmacro extend-protocolpath (defmacro extend-protocolpath
"Used in conjunction with `defprotocolpath`. See [[defprotocolpath]]." "Used in conjunction with `defprotocolpath`. See [[defprotocolpath]]."
@ -1010,10 +970,11 @@
NONE) NONE)
(transform* [this vals structure next-fn] (transform* [this vals structure next-fn]
(let [v (next-fn vals NONE)] (let [v (next-fn vals NONE)]
(if (if (identical? NONE v)
(identical? NONE v) structure
structure ;; TODO: make a more efficient impl
(n/insert-before-idx structure index v))))) (setval (srange index index) [v] structure)
))))
(defrichnav (defrichnav
^{:doc "Navigates to the index of the sequence if within 0 and size. Transforms move element ^{:doc "Navigates to the index of the sequence if within 0 and size. Transforms move element
@ -1308,7 +1269,7 @@
ns (namespace structure)] ns (namespace structure)]
(cond (keyword? structure) (keyword ns new-name) (cond (keyword? structure) (keyword ns new-name)
(symbol? structure) (symbol ns new-name) (symbol? structure) (symbol ns new-name)
:else (throw (ex-info "NAME can only be used on symbols or keywords" {:structure structure})) :else (i/throw-illegal "NAME can only be used on symbols or keywords - " structure)
)))) ))))
(defnav ^{:doc "Navigates to the namespace portion of the keyword or symbol"} (defnav ^{:doc "Navigates to the namespace portion of the keyword or symbol"}
@ -1321,8 +1282,7 @@
new-ns (next-fn (namespace structure))] new-ns (next-fn (namespace structure))]
(cond (keyword? structure) (keyword new-ns name) (cond (keyword? structure) (keyword new-ns name)
(symbol? structure) (symbol new-ns name) (symbol? structure) (symbol new-ns name)
:else (throw (ex-info "NAMESPACE can only be used on symbols or keywords" :else (i/throw-illegal "NAMESPACE can only be used on symbols or keywords - " structure)
{:structure structure}))
)))) ))))
(defdynamicnav (defdynamicnav

View file

@ -1,8 +1,7 @@
(ns com.rpl.specter.impl (ns com.rpl.specter.impl
#?(:cljs (:require-macros #?(:cljs (:require-macros
[com.rpl.specter.util-macros [com.rpl.specter.util-macros
:refer [doseqres mk-comp-navs mk-late-fn mk-late-fn-records]] :refer [doseqres mk-comp-navs mk-late-fn mk-late-fn-records]]))
))
;; workaround for cljs bug that emits warnings for vars named the same as a ;; workaround for cljs bug that emits warnings for vars named the same as a
;; private var in cljs.core (in this case `NONE`, added as private var to ;; private var in cljs.core (in this case `NONE`, added as private var to
;; cljs.core with 1.9.562) ;; cljs.core with 1.9.562)
@ -15,11 +14,10 @@
#?(:clj [clojure.pprint :as pp]) #?(:clj [clojure.pprint :as pp])
[clojure.string :as s] [clojure.string :as s]
[clojure.walk :as walk] [clojure.walk :as walk]
#?(:bb [clojure.walk :as riddley] #?(:clj [riddley.walk :as riddley]))
:clj [riddley.walk :as riddley]))
#?(:clj (:import [com.rpl.specter Util MutableCell])))
#?@(:bb []
:clj [(:import [com.rpl.specter Util MutableCell])]))
(def NONE ::NONE) (def NONE ::NONE)
@ -51,6 +49,21 @@
([a1 a2 a3 a4 a5 a6 a7 a8 a9 a10 & r] v))) ([a1 a2 a3 a4 a5 a6 a7 a8 a9 a10 & r] v)))
#?(:clj
(defmacro throw* [etype & args]
`(throw (new ~etype (smart-str ~@args)))))
#?(
:clj
(defmacro throw-illegal [& args]
`(throw* IllegalArgumentException ~@args))
:cljs
(defn throw-illegal [& args]
(throw (js/Error. (apply str args)))))
;; need to get the expansion function like this so that ;; need to get the expansion function like this so that
;; this code compiles in a clojure environment where cljs.analyzer ;; this code compiles in a clojure environment where cljs.analyzer
;; namespace does not exist ;; namespace does not exist
@ -72,7 +85,7 @@
:cljs :cljs
(defn clj-macroexpand-all [form] (defn clj-macroexpand-all [form]
(throw (ex-info "not implemented" {})))) (throw-illegal "not implemented")))
#?( #?(
@ -81,11 +94,9 @@
:cljs :cljs
(defn intern* [ns name val] (defn intern* [ns name val]
(throw (ex-info "intern not supported in ClojureScript" {})))) (throw-illegal "intern not supported in ClojureScript")))
#?(:bb #?(
(defmacro fast-object-array [i]
`(object-array ~i))
:clj :clj
(defmacro fast-object-array [i] (defmacro fast-object-array [i]
`(com.rpl.specter.Util/makeObjectArray ~i))) `(com.rpl.specter.Util/makeObjectArray ~i)))
@ -104,8 +115,7 @@
(if (= platform :cljs) (if (= platform :cljs)
`(p/select* ~this ~@args) `(p/select* ~this ~@args)
`(let [~hinted ~this] `(let [~hinted ~this]
(#?(:bb p/select* (.select* ~hinted ~@args)))))
:clj .select*) ~hinted ~@args)))))
:cljs :cljs
(defn exec-select* [this vals structure next-fn] (defn exec-select* [this vals structure next-fn]
(p/select* ^not-native this vals structure next-fn))) (p/select* ^not-native this vals structure next-fn)))
@ -119,8 +129,7 @@
(if (= platform :cljs) (if (= platform :cljs)
`(p/transform* ~this ~@args) `(p/transform* ~this ~@args)
`(let [~hinted ~this] `(let [~hinted ~this]
(#?(:bb p/transform* (.transform* ~hinted ~@args)))))
:clj .transform*) ~hinted ~@args)))))
:cljs :cljs
(defn exec-transform* [this vals structure next-fn] (defn exec-transform* [this vals structure next-fn]
@ -139,9 +148,7 @@
(defn- coerce-object [this] (defn- coerce-object [this]
(cond (rich-nav? this) this (cond (rich-nav? this) this
(satisfies? p/ImplicitNav this) (p/implicit-nav this) (satisfies? p/ImplicitNav this) (p/implicit-nav this)
:else (throw (ex-info "Not a navigator" :else (throw-illegal "Not a navigator: " this " " (pr-str (type this)))))
{:this this
:type-str (pr-str (type this))}))))
(defprotocol CoercePath (defprotocol CoercePath
@ -170,7 +177,7 @@
(coerce-path (vec this)))) (coerce-path (vec this))))
#?(:cljs cljs.core/Subvec) #?(:cljs cljs.core/Subvec)
#?(:cljs (coerce-path [this] #?(:cljs (coerce-path [this]
(coerce-path (into [] this)))) (coerce-path (vec this))))
#?(:clj Object :cljs default) #?(:clj Object :cljs default)
(coerce-path [this] (coerce-path [this]
@ -219,19 +226,13 @@
(set_cell [cell x]))) (set_cell [cell x])))
#?(:bb #?(:cljs
(defrecord MutableCell [x])
:cljs
(deftype MutableCell [^:volatile-mutable q] (deftype MutableCell [^:volatile-mutable q]
PMutableCell PMutableCell
(set_cell [this x] (set! q x)))) (set_cell [this x] (set! q x))))
#?(:bb #?(
(defn mutable-cell
([] (mutable-cell nil))
([v] (MutableCell. (volatile! v))))
:clj :clj
(defn mutable-cell (defn mutable-cell
([] (mutable-cell nil)) ([] (mutable-cell nil))
@ -243,10 +244,7 @@
([init] (MutableCell. init)))) ([init] (MutableCell. init))))
#?(:bb #?(
(defn set-cell! [^MutableCell c v]
(vreset! (:x c) v))
:clj :clj
(defn set-cell! [^MutableCell c v] (defn set-cell! [^MutableCell c v]
(.set c v)) (.set c v))
@ -256,10 +254,7 @@
(set_cell cell val))) (set_cell cell val)))
#?(:bb #?(
(defn get-cell [^MutableCell c]
@(:x c))
:clj :clj
(defn get-cell [^MutableCell c] (defn get-cell [^MutableCell c]
(.get c)) (.get c))
@ -307,10 +302,8 @@
(defn do-compiled-traverse* [apath structure] (defn do-compiled-traverse* [apath structure]
(reify #?(:clj clojure.lang.IReduce :cljs cljs.core/IReduce) (reify #?(:clj clojure.lang.IReduce :cljs cljs.core/IReduce)
(#?(:clj reduce :cljs -reduce) (#?(:clj reduce :cljs -reduce)
[this afn] [this afn]
#?(:bb (reduce afn (afn) this) (#?(:clj .reduce :cljs -reduce) this afn (afn)))
:default
(#?(:clj .reduce :cljs -reduce) this afn (afn))))
(#?(:clj reduce :cljs -reduce) (#?(:clj reduce :cljs -reduce)
[this afn start] [this afn start]
(let [cell (mutable-cell start)] (let [cell (mutable-cell start)]
@ -326,31 +319,15 @@
(get-cell cell) (get-cell cell)
)))) ))))
#?(
:bb
(defn- call-reduce-interface [^clojure.lang.IReduce traverser afn start]
(reduce afn start traverser))
:clj
(defn- call-reduce-interface [^clojure.lang.IReduce traverser afn start]
(.reduce traverser afn start)
)
:cljs
(defn- call-reduce-interface [^cljs.core/IReduce traverser afn start]
(-reduce traverser afn start)
))
(defn do-compiled-traverse [apath structure] (defn do-compiled-traverse [apath structure]
(let [traverser (do-compiled-traverse* apath structure)] (let [traverser (do-compiled-traverse* apath structure)]
(reify #?(:clj clojure.lang.IReduce :cljs cljs.core/IReduce) (reify #?(:clj clojure.lang.IReduce :cljs cljs.core/IReduce)
(#?(:clj reduce :cljs -reduce) (#?(:clj reduce :cljs -reduce)
[this afn] [this afn]
#?(:bb (reduce afn (afn) this) (#?(:clj .reduce :cljs -reduce) this afn (afn)))
:default
(#?(:clj .reduce :cljs -reduce) this afn (afn))))
(#?(:clj reduce :cljs -reduce) (#?(:clj reduce :cljs -reduce)
[this afn start] [this afn start]
(let [res (call-reduce-interface traverser afn start)] (let [res (#?(:clj .reduce :cljs -reduce) traverser afn start)]
(unreduced res) (unreduced res)
))))) )))))
@ -384,8 +361,7 @@
(let [curr (get-cell res)] (let [curr (get-cell res)]
(if (identical? curr NONE) (if (identical? curr NONE)
(set-cell! res structure) (set-cell! res structure)
(throw (ex-info "More than one element found in structure" (throw-illegal "More than one element found in structure: " structure))))]
{:structure structure})))))]
(compiled-traverse* path result-fn structure) (compiled-traverse* path result-fn structure)
(let [ret (get-cell res)] (let [ret (get-cell res)]
@ -400,12 +376,11 @@
(let [curr (get-cell res)] (let [curr (get-cell res)]
(if (identical? curr NONE) (if (identical? curr NONE)
(set-cell! res structure) (set-cell! res structure)
(throw (ex-info "More than one element found in structure" (throw-illegal "More than one element found in structure: " structure))))]
{:structure structure})))))]
(compiled-traverse* path result-fn structure) (compiled-traverse* path result-fn structure)
(let [ret (get-cell res)] (let [ret (get-cell res)]
(if (identical? NONE ret) (if (identical? NONE ret)
(throw (ex-info "Found no elements for select-one!" {:structure structure}))) (throw-illegal "Found no elements for select-one! on " structure))
ret))) ret)))
@ -716,18 +691,16 @@
(preserve-map magic-precompilation* o) (preserve-map magic-precompilation* o)
(instance? VarUse o) (instance? VarUse o)
(let [v (:avar o)] (if (dynamic-var? (:avar o))
;; v can be nil if the symbol referred to an imported class (->DynamicVal (maybe-direct-nav
(if (and v (dynamic-var? v)) (:sym o)
(->DynamicVal (maybe-direct-nav (or (-> o :avar direct-nav?)
(:sym o) (-> o :sym direct-nav?))))
(or (direct-nav? v) (maybe-direct-nav
(-> o :sym direct-nav?)))) (:val o)
(maybe-direct-nav (or (-> o :avar direct-nav?)
(:val o) (-> o :sym direct-nav?)
(or (and v (direct-nav? v)) (-> o :val direct-nav?))))
(-> o :sym direct-nav?)
(-> o :val direct-nav?)))))
(instance? LocalSym o) (instance? LocalSym o)
(->DynamicVal (:sym o)) (->DynamicVal (:sym o))
@ -823,8 +796,7 @@
(defn dynamic-val-code [code possible-params] (defn dynamic-val-code [code possible-params]
(let [[i] (keep-indexed (fn [i v] (if (= v code) i)) possible-params)] (let [[i] (keep-indexed (fn [i v] (if (= v code) i)) possible-params)]
(if (nil? i) (if (nil? i)
(throw (ex-info "Could not find code in possible params" (throw-illegal "Could not find " code " in possible params " possible-params))
{:code code :possible-params possible-params})))
(maybe-direct-nav (maybe-direct-nav
(->LocalParam i) (->LocalParam i)
(direct-nav? code))))) (direct-nav? code)))))
@ -919,8 +891,6 @@
(if (fn? e) (re-find #" .*" (pr-str e)) e)) (if (fn? e) (re-find #" .*" (pr-str e)) e))
o))) o)))
(def ^:dynamic *path-compile-files* false)
#?(:clj #?(:clj
(defn mk-dynamic-path-maker [resolved-code ns-str used-locals-list possible-param] (defn mk-dynamic-path-maker [resolved-code ns-str used-locals-list possible-param]
(let [code `(fn [~@used-locals-list] ~resolved-code) (let [code `(fn [~@used-locals-list] ~resolved-code)
@ -929,11 +899,7 @@
(println "Produced code:") (println "Produced code:")
(pp/pprint code) (pp/pprint code)
(println)) (println))
(binding [*ns* ns (binding [*ns* ns] (eval+ code))))
*compile-files* (if *path-compile-files*
*compile-files*
false)]
(eval+ code))))
:cljs :cljs
(defn mk-dynamic-path-maker [resolved-code ns-str used-locals-list possible-params] (defn mk-dynamic-path-maker [resolved-code ns-str used-locals-list possible-params]
@ -996,9 +962,9 @@
(defn- multi-transform-error-fn [& nav] (defn- multi-transform-error-fn [& nav]
(throw (throw-illegal
(ex-info "All navigation in multi-transform must end in 'terminal' navigators" "All navigation in multi-transform must end in 'terminal' "
{:nav nav}))) "navigators. Instead navigated to: " nav))
(defn compiled-multi-transform* [path structure] (defn compiled-multi-transform* [path structure]
(compiled-transform* path multi-transform-error-fn structure)) (compiled-transform* path multi-transform-error-fn structure))

View file

@ -6,8 +6,8 @@
(defn- determine-params-impls [impls] (defn- determine-params-impls [impls]
(let [grouped (->> impls (map (fn [[n & body]] [n body])) (into {}))] (let [grouped (->> impls (map (fn [[n & body]] [n body])) (into {}))]
(if-not (= #{'select* 'transform*} (-> grouped keys set)) (if-not (= #{'select* 'transform*} (-> grouped keys set))
(throw (ex-info "defnav must implement select* and transform*" (i/throw-illegal "defnav must implement select* and transform*, instead got "
{:methods (keys grouped)}))) (keys grouped)))
grouped)) grouped))
@ -39,16 +39,11 @@
(let [helpers (for [[mname [_ & mparams] & mbody] impls] (let [helpers (for [[mname [_ & mparams] & mbody] impls]
`(defn ~(helper-name name mname) [~@params ~@mparams] ~@mbody)) `(defn ~(helper-name name mname) [~@params ~@mparams] ~@mbody))
decls (for [[mname & _] impls] decls (for [[mname & _] impls]
`(declare ~(helper-name name mname))) `(declare ~(helper-name name mname)))]
name-with-meta (vary-meta name
assoc :arglists (list 'quote (list params)))]
`(do `(do
~@decls ~@decls
~@helpers ~@helpers
(def ~name-with-meta (nav ~params ~@impls))))) (def ~name (nav ~params ~@impls)))))
(defmacro defrichnav [name params & impls] (defmacro defrichnav [name params & impls]
(let [name-with-meta (vary-meta name `(def ~name (richnav ~params ~@impls)))
assoc :arglists (list 'quote (list params)))]
`(def ~name-with-meta
(richnav ~params ~@impls))))

View file

@ -8,8 +8,7 @@
#?(:clj (:use [com.rpl.specter.macros :only [defnav defrichnav]] #?(:clj (:use [com.rpl.specter.macros :only [defnav defrichnav]]
[com.rpl.specter.util-macros :only [doseqres]])) [com.rpl.specter.util-macros :only [doseqres]]))
(:require [com.rpl.specter.impl :as i] (:require [com.rpl.specter.impl :as i]
#?@(:bb [] #?(:clj [clojure.core.reducers :as r])))
:clj [[clojure.core.reducers :as r]])))
(defn not-selected?* (defn not-selected?*
@ -96,13 +95,6 @@
(filter not-NONE?)) (filter not-NONE?))
structure)) structure))
#?(:clj String :cljs string)
(all-transform [structure next-fn]
(apply str (into []
(comp (map next-fn)
(filter not-NONE?))
structure)))
#?(:clj clojure.lang.PersistentHashSet :cljs cljs.core/PersistentHashSet) #?(:clj clojure.lang.PersistentHashSet :cljs cljs.core/PersistentHashSet)
(all-transform [structure next-fn] (all-transform [structure next-fn]
(into #{} (into #{}
@ -111,10 +103,7 @@
structure)) structure))
#?(:clj clojure.lang.PersistentArrayMap) #?(:clj clojure.lang.PersistentArrayMap)
#?(:bb #?(:clj
(all-transform [structure next-fn]
(non-transient-map-all-transform structure next-fn {}))
:clj
(all-transform [structure next-fn] (all-transform [structure next-fn]
(let [k-it (.keyIterator structure) (let [k-it (.keyIterator structure)
v-it (.valIterator structure) v-it (.valIterator structure)
@ -196,13 +185,10 @@
:else :else
#?(:bb (into empty-structure (->> structure
(comp (map next-fn) (filter not-NONE?)) (r/map next-fn)
structure) (r/filter not-NONE?)
:clj (->> structure (into empty-structure))))))
(r/map next-fn)
(r/filter not-NONE?)
(into empty-structure)))))))
#?(:cljs default) #?(:cljs default)
@ -269,10 +255,7 @@
#?(:clj clojure.lang.PersistentArrayMap) #?(:clj clojure.lang.PersistentArrayMap)
#?(:bb #?(:clj
(map-vals-transform [structure next-fn]
(map-vals-non-transient-transform structure {} next-fn))
:clj
(map-vals-transform [structure next-fn] (map-vals-transform [structure next-fn]
(let [k-it (.keyIterator structure) (let [k-it (.keyIterator structure)
v-it (.valIterator structure) v-it (.valIterator structure)
@ -299,10 +282,7 @@
array array
)] )]
(clojure.lang.PersistentArrayMap. array))))) (clojure.lang.PersistentArrayMap. array)))))
#?(:bb #?(:clj
(map-keys-transform [structure next-fn]
(map-keys-non-transient-transform structure {} next-fn))
:clj
(map-keys-transform [structure next-fn] (map-keys-transform [structure next-fn]
(let [k-it (.keyIterator structure) (let [k-it (.keyIterator structure)
v-it (.valIterator structure) v-it (.valIterator structure)
@ -469,24 +449,6 @@
(prepend-one [structure elem] (prepend-one [structure elem]
(into [elem] structure)) (into [elem] structure))
#?(:cljs cljs.core/Subvec)
#?(:cljs
(append-all [structure elements]
(reduce conj structure elements)))
#?(:cljs
(prepend-all [structure elements]
(let [ret (transient [])]
(as-> ret <>
(reduce conj! <> elements)
(reduce conj! <> structure)
(persistent! <>)))))
#?(:cljs
(append-one [structure elem]
(conj structure elem)))
#?(:cljs
(prepend-one [structure elem]
(into [elem] structure)))
#?(:clj Object :cljs default) #?(:clj Object :cljs default)
(append-all [structure elements] (append-all [structure elements]
@ -512,9 +474,6 @@
(defprotocol FastEmpty (defprotocol FastEmpty
(fast-empty? [s])) (fast-empty? [s]))
(defprotocol InsertBeforeIndex
(insert-before-idx [aseq idx val]))
(defnav PosNavigator [getter updater] (defnav PosNavigator [getter updater]
(select* [this structure next-fn] (select* [this structure next-fn]
(if-not (fast-empty? structure) (if-not (fast-empty? structure)
@ -525,17 +484,6 @@
structure structure
(updater structure next-fn)))) (updater structure next-fn))))
#?(:bb
(defn vec-count [v]
(count v))
:clj
(defn vec-count [^clojure.lang.IPersistentVector v]
(.length v))
:cljs
(defn vec-count [v]
(count v)))
(defn- update-first-list [l afn] (defn- update-first-list [l afn]
(let [newf (afn (first l)) (let [newf (afn (first l))
@ -551,39 +499,17 @@
(if (nil? bl) '() bl) (if (nil? bl) '() bl)
(concat bl [lastl])))) (concat bl [lastl]))))
(defn- update-first-vector [v afn] #?(
(let [val (nth v 0) :clj
newv (afn val)] (defn vec-count [^clojure.lang.IPersistentVector v]
(if (identical? i/NONE newv) (.length v))
(subvec v 1)
(assoc v 0 newv)
)))
(defn- update-last-vector [v afn] :cljs
;; type-hinting vec-count to ^int caused weird errors with case (defn vec-count [v]
(let [c (int (vec-count v))] (count v)))
(case c
1 (let [[e] v
newe (afn e)]
(if (identical? i/NONE newe)
[]
[newe]))
2 (let [[e1 e2] v
newe (afn e2)]
(if (identical? i/NONE newe)
[e1]
[e1 newe]))
(let [i (dec c)
newe (afn (nth v i))]
(if (identical? i/NONE newe)
(pop v)
(assoc v i newe))))))
#?(:bb #?(
(defn transient-vec-count [v]
(count v))
:clj :clj
(defn transient-vec-count [^clojure.lang.ITransientVector v] (defn transient-vec-count [^clojure.lang.ITransientVector v]
(.count v)) (.count v))
@ -596,18 +522,32 @@
(extend-protocol UpdateExtremes (extend-protocol UpdateExtremes
#?(:clj clojure.lang.IPersistentVector :cljs cljs.core/PersistentVector) #?(:clj clojure.lang.IPersistentVector :cljs cljs.core/PersistentVector)
(update-first [v afn] (update-first [v afn]
(update-first-vector v afn)) (let [val (nth v 0)
newv (afn val)]
(if (identical? i/NONE newv)
(subvec v 1)
(assoc v 0 newv)
)))
(update-last [v afn] (update-last [v afn]
(update-last-vector v afn)) ;; type-hinting vec-count to ^int caused weird errors with case
(let [c (int (vec-count v))]
#?(:cljs cljs.core/Subvec) (case c
#?(:cljs 1 (let [[e] v
(update-first [v afn] newe (afn e)]
(update-first-vector v afn))) (if (identical? i/NONE newe)
#?(:cljs []
(update-last [v afn] [newe]))
(update-last-vector v afn))) 2 (let [[e1 e2] v
newe (afn e2)]
(if (identical? i/NONE newe)
[e1]
[e1 newe]))
(let [i (dec c)
newe (afn (nth v i))]
(if (identical? i/NONE newe)
(pop v)
(assoc v i newe))))))
#?(:clj String :cljs string) #?(:clj String :cljs string)
(update-first [s afn] (update-first [s afn]
@ -751,36 +691,3 @@
((:end-fn end-fn) structure start) ((:end-fn end-fn) structure start)
(end-fn structure) (end-fn structure)
)) ))
(defn- insert-before-index-list [lst idx val]
;; an implementation that is most efficient for list style structures
(let [[front back] (split-at idx lst)]
(concat front (cons val back))))
(extend-protocol InsertBeforeIndex
nil
(insert-before-idx [_ idx val]
(if (= 0 idx)
(list val)
(throw (ex-info "For a nil structure, can only insert before index 0"
{:insertion-index idx}))))
#?(:clj java.lang.String :cljs string)
(insert-before-idx [aseq idx val]
(apply str (insert-before-index-list aseq idx val)))
#?(:clj clojure.lang.LazySeq :cljs cljs.core/LazySeq)
(insert-before-idx [aseq idx val]
(insert-before-index-list aseq idx val))
#?(:clj clojure.lang.IPersistentVector :cljs cljs.core/PersistentVector)
(insert-before-idx [aseq idx val]
(let [front (subvec aseq 0 idx)
back (subvec aseq idx)]
(into (conj front val) back)))
#?(:clj clojure.lang.IPersistentList :cljs cljs.core/List)
(insert-before-idx [aseq idx val]
(cond (= idx 0)
(cons val aseq)
:else (insert-before-index-list aseq idx val))))

View file

@ -65,4 +65,4 @@
`(defn ~'late-fn [~f ~args] `(defn ~'late-fn [~f ~args]
(case (count ~args) (case (count ~args)
~@(apply concat cases) ~@(apply concat cases)
(throw (ex-info "Cannot have late function with more than 18 args" {})))))) (com.rpl.specter.impl/throw-illegal "Cannot have late function with more than 18 args")))))

View file

@ -1320,13 +1320,9 @@
(deftest traversed-test (deftest traversed-test
(is (= 10 (select-any (s/traversed s/ALL +) [1 2 3 4])))) (is (= 10 (select-any (s/traversed s/ALL +) [1 2 3 4]))))
(defn- predand= [pred v1 v2] (defn- predand= [pred ret v]
(and (pred v1) (and (pred ret)
(pred v2) (= ret v)))
(= v1 v2)))
(defn listlike? [v]
(or (list? v) (seq? v)))
(deftest nthpath-test (deftest nthpath-test
(is (predand= vector? [1 2 -3 4] (transform (s/nthpath 2) - [1 2 3 4]))) (is (predand= vector? [1 2 -3 4] (transform (s/nthpath 2) - [1 2 3 4])))
@ -1338,7 +1334,7 @@
(deftest remove-with-NONE-test (deftest remove-with-NONE-test
(is (predand= vector? [1 2 3] (setval [s/ALL nil?] s/NONE [1 2 nil 3 nil]))) (is (predand= vector? [1 2 3] (setval [s/ALL nil?] s/NONE [1 2 nil 3 nil])))
(is (predand= listlike? '(1 2 3) (setval [s/ALL nil?] s/NONE '(1 2 nil 3 nil)))) (is (predand= list? '(1 2 3) (setval [s/ALL nil?] s/NONE '(1 2 nil 3 nil))))
(is (= {:b 2} (setval :a s/NONE {:a 1 :b 2}))) (is (= {:b 2} (setval :a s/NONE {:a 1 :b 2})))
(is (= {:b 2} (setval (s/must :a) s/NONE {:a 1 :b 2}))) (is (= {:b 2} (setval (s/must :a) s/NONE {:a 1 :b 2})))
(is (predand= vector? [1 3] (setval (s/keypath 1) s/NONE [1 2 3]))) (is (predand= vector? [1 3] (setval (s/keypath 1) s/NONE [1 2 3])))
@ -1440,15 +1436,6 @@
(is (= "abq" (setval s/LAST "q" "abc"))) (is (= "abq" (setval s/LAST "q" "abc")))
) )
(defn whitespace? [char]
(re-matches #"\s" (str char)))
(deftest string-transform-test
(is (= "123" (transform s/ALL identity "123")))
(is (= "123" (transform [s/ALL whitespace?] s/NONE "1 2 3")))
#?(:clj (is (= "123" (setval [s/ALL #(Character/isWhitespace %)] s/NONE "1 2 3"))))
#?(:clj (is (= "123" (transform [(s/filterer #(Character/isWhitespace %))] s/NONE "1 2 3")))))
(deftest regex-navigation-test (deftest regex-navigation-test
;; also test regexes as implicit navs ;; also test regexes as implicit navs
(is (= (select #"t" "test") ["t" "t"])) (is (= (select #"t" "test") ["t" "t"]))
@ -1467,11 +1454,11 @@
(deftest single-value-none-navigators-test (deftest single-value-none-navigators-test
(is (predand= vector? [1 2 3] (setval s/AFTER-ELEM 3 [1 2]))) (is (predand= vector? [1 2 3] (setval s/AFTER-ELEM 3 [1 2])))
(is (predand= listlike? '(1 2 3) (setval s/AFTER-ELEM 3 '(1 2)))) (is (predand= list? '(1 2 3) (setval s/AFTER-ELEM 3 '(1 2))))
(is (predand= listlike? '(1) (setval s/AFTER-ELEM 1 nil))) (is (predand= list? '(1) (setval s/AFTER-ELEM 1 nil)))
(is (predand= vector? [3 1 2] (setval s/BEFORE-ELEM 3 [1 2]))) (is (predand= vector? [3 1 2] (setval s/BEFORE-ELEM 3 [1 2])))
(is (predand= listlike? '(3 1 2) (setval s/BEFORE-ELEM 3 '(1 2)))) (is (predand= list? '(3 1 2) (setval s/BEFORE-ELEM 3 '(1 2))))
(is (predand= listlike? '(1) (setval s/BEFORE-ELEM 1 nil))) (is (predand= list? '(1) (setval s/BEFORE-ELEM 1 nil)))
(is (= #{1 2 3} (setval s/NONE-ELEM 3 #{1 2}))) (is (= #{1 2 3} (setval s/NONE-ELEM 3 #{1 2})))
(is (= #{1} (setval s/NONE-ELEM 1 nil))) (is (= #{1} (setval s/NONE-ELEM 1 nil)))
) )
@ -1515,7 +1502,7 @@
[l (limit-size 10 (gen/not-empty (gen/list gen/int)))] [l (limit-size 10 (gen/not-empty (gen/list gen/int)))]
(let [newl (setval s/FIRST s/NONE l)] (let [newl (setval s/FIRST s/NONE l)]
(and (= newl (rest l)) (and (= newl (rest l))
(listlike? newl) (list? newl)
)))) ))))
(defspec remove-last-vector (defspec remove-last-vector
@ -1622,18 +1609,14 @@
(deftest before-index-test (deftest before-index-test
(let [data [1 2 3] (let [data [1 2 3]
datal '(1 2 3) datal '(1 2 3)]
data-str "abcdef"]
(is (predand= vector? [:a 1 2 3] (setval (s/before-index 0) :a data))) (is (predand= vector? [:a 1 2 3] (setval (s/before-index 0) :a data)))
(is (predand= vector? [1 2 3] (setval (s/before-index 1) s/NONE data))) (is (predand= vector? [1 2 3] (setval (s/before-index 1) s/NONE data)))
(is (predand= vector? [1 :a 2 3] (setval (s/before-index 1) :a data))) (is (predand= vector? [1 :a 2 3] (setval (s/before-index 1) :a data)))
(is (predand= vector? [1 2 3 :a] (setval (s/before-index 3) :a data))) (is (predand= vector? [1 2 3 :a] (setval (s/before-index 3) :a data)))
; ensure inserting at index 0 in nil structure works, as in previous impl (is (predand= list? '(:a 1 2 3) (setval (s/before-index 0) :a datal)))
(is (predand= listlike? '(:a) (setval (s/before-index 0) :a nil))) (is (predand= list? '(1 :a 2 3) (setval (s/before-index 1) :a datal)))
(is (predand= listlike? '(:a 1 2 3) (setval (s/before-index 0) :a datal))) (is (predand= list? '(1 2 3 :a) (setval (s/before-index 3) :a datal)))
(is (predand= listlike? '(1 :a 2 3) (setval (s/before-index 1) :a datal)))
(is (predand= listlike? '(1 2 3 :a) (setval (s/before-index 3) :a datal)))
(is (predand= string? "abcxdef" (setval (s/before-index 3) (char \x) data-str)))
)) ))
(deftest index-nav-test (deftest index-nav-test
@ -1646,12 +1629,12 @@
(is (predand= vector? [1 2 4 5 6 3] (setval (s/index-nav 2) 5 data))) (is (predand= vector? [1 2 4 5 6 3] (setval (s/index-nav 2) 5 data)))
(is (predand= vector? [6 1 2 3 4 5] (setval (s/index-nav 5) 0 data))) (is (predand= vector? [6 1 2 3 4 5] (setval (s/index-nav 5) 0 data)))
(is (predand= listlike? '(3 1 2 4 5 6) (setval (s/index-nav 2) 0 datal))) (is (predand= list? '(3 1 2 4 5 6) (setval (s/index-nav 2) 0 datal)))
(is (predand= listlike? '(1 3 2 4 5 6) (setval (s/index-nav 2) 1 datal))) (is (predand= list? '(1 3 2 4 5 6) (setval (s/index-nav 2) 1 datal)))
(is (predand= listlike? '(1 2 3 4 5 6) (setval (s/index-nav 2) 2 datal))) (is (predand= list? '(1 2 3 4 5 6) (setval (s/index-nav 2) 2 datal)))
(is (predand= listlike? '(1 2 4 5 3 6) (setval (s/index-nav 2) 4 datal))) (is (predand= list? '(1 2 4 5 3 6) (setval (s/index-nav 2) 4 datal)))
(is (predand= listlike? '(1 2 4 5 6 3) (setval (s/index-nav 2) 5 datal))) (is (predand= list? '(1 2 4 5 6 3) (setval (s/index-nav 2) 5 datal)))
(is (predand= listlike? '(6 1 2 3 4 5) (setval (s/index-nav 5) 0 datal))) (is (predand= list? '(6 1 2 3 4 5) (setval (s/index-nav 5) 0 datal)))
)) ))
(deftest indexed-vals-test (deftest indexed-vals-test
@ -1696,12 +1679,6 @@
{:a [{:b 2 :c 1}]}]))) {:a [{:b 2 :c 1}]}])))
) )
(deftest class-constant-test
(let [f (fn [p] (fn [v] (str p (inc v))))]
(is (= (str #?(:clj String :cljs js/String) 2)
(multi-transform (s/terminal (f #?(:clj String :cljs js/String))) 1)))
))
#?(:clj #?(:clj
(do (do
(defprotocolpath FooPP) (defprotocolpath FooPP)