error: could not compile candle-core (lib) due to 20 previous errors

[tanliboy]

System Info

I am consistenly running into a compilation error while building it for Mac M4 with cargo install --path router -F metal. Is it a KP or did I miss something?

error[E0277]: the trait bound `bf16: SampleUniform` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2478:50
     |
2478 |                     data.push(rng.sample::<bf16, _>(uniform))
     |                                                  ^ the trait `SampleUniform` is not implemented for `bf16`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:216:1
     |
216  | pub trait SampleUniform: Sized {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/half-2.5.0/src/bfloat.rs:47:1
     |
47   | pub struct bf16(u16);
     | --------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `Uniform`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:179:23
     |
179  | pub struct Uniform<X: SampleUniform>(X::Sampler);
     |                       ^^^^^^^^^^^^^ required by this bound in `Uniform`

error[E0277]: the trait bound `half::f16: SampleUniform` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2485:55
     |
2485 |                     rand::distributions::Uniform::new(f16::from_f64(min), f16::from_f64(max));
     |                     --------------------------------- ^^^^^^^^^^^^^^^^^^ the trait `SampleUniform` is not implemented for `half::f16`
     |                     |
     |                     required by a bound introduced by this call
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:216:1
     |
216  | pub trait SampleUniform: Sized {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/half-2.5.0/src/binary16.rs:47:1
     |
47   | pub struct f16(u16);
     | -------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
     = note: required for `half::f16` to implement `SampleBorrow<half::f16>`
note: required by a bound in `Uniform::<X>::new`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:186:13
     |
184  |     pub fn new<B1, B2>(low: B1, high: B2) -> Uniform<X>
     |            --- required by a bound in this associated function
185  |     where
186  |         B1: SampleBorrow<X> + Sized,
     |             ^^^^^^^^^^^^^^^ required by this bound in `Uniform::<X>::new`

error[E0277]: the trait bound `half::f16: SampleBorrow<half::f16>` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2485:75
     |
2485 |                     rand::distributions::Uniform::new(f16::from_f64(min), f16::from_f64(max));
     |                     ---------------------------------                     ^^^^^^^^^^^^^^^^^^ the trait `SampleUniform` is not implemented for `half::f16`
     |                     |
     |                     required by a bound introduced by this call
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:216:1
     |
216  | pub trait SampleUniform: Sized {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/half-2.5.0/src/binary16.rs:47:1
     |
47   | pub struct f16(u16);
     | -------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
     = note: required for `half::f16` to implement `SampleBorrow<half::f16>`
note: required by a bound in `Uniform::<X>::new`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:187:13
     |
184  |     pub fn new<B1, B2>(low: B1, high: B2) -> Uniform<X>
     |            --- required by a bound in this associated function
...
187  |         B2: SampleBorrow<X> + Sized,
     |             ^^^^^^^^^^^^^^^ required by this bound in `Uniform::<X>::new`

error[E0277]: the trait bound `half::f16: SampleUniform` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2485:21
     |
2485 |                     rand::distributions::Uniform::new(f16::from_f64(min), f16::from_f64(max));
     |                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the trait `SampleUniform` is not implemented for `half::f16`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:216:1
     |
216  | pub trait SampleUniform: Sized {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/half-2.5.0/src/binary16.rs:47:1
     |
47   | pub struct f16(u16);
     | -------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `Uniform`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:179:23
     |
179  | pub struct Uniform<X: SampleUniform>(X::Sampler);
     |                       ^^^^^^^^^^^^^ required by this bound in `Uniform`

error[E0277]: the trait bound `half::f16: SampleUniform` is not satisfied in `Uniform<half::f16>`
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2484:21
     |
2484 |                 let uniform =
     |                     ^^^^^^^ within `Uniform<half::f16>`, the trait `SampleUniform` is not implemented for `half::f16`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:216:1
     |
216  | pub trait SampleUniform: Sized {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/half-2.5.0/src/binary16.rs:47:1
     |
47   | pub struct f16(u16);
     | -------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required because it appears within the type `Uniform<half::f16>`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:179:12
     |
179  | pub struct Uniform<X: SampleUniform>(X::Sampler);
     |            ^^^^^^^
     = note: all local variables must have a statically known size
     = help: unsized locals are gated as an unstable feature

error[E0277]: the trait bound `half::f16: SampleUniform` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2487:49
     |
2487 |                     data.push(rng.sample::<f16, _>(uniform))
     |                                                 ^ the trait `SampleUniform` is not implemented for `half::f16`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:216:1
     |
216  | pub trait SampleUniform: Sized {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/half-2.5.0/src/binary16.rs:47:1
     |
47   | pub struct f16(u16);
     | -------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `Uniform`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/uniform.rs:179:23
     |
179  | pub struct Uniform<X: SampleUniform>(X::Sampler);
     |                       ^^^^^^^^^^^^^ required by this bound in `Uniform`

error[E0277]: the trait bound `StandardNormal: rand_distr::Distribution<bf16>` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2521:30
     |
2521 |                 let normal = rand_distr::Normal::new(bf16::from_f64(mean), bf16::from_f64(std))
     |                              ^^^^^^^^^^^^^^^^^^^^^^^ the trait `rand_distr::Distribution<bf16>` is not implemented for `StandardNormal`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `rand_distr::Normal::<F>::new`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:147:33
     |
147  | where F: Float, StandardNormal: Distribution<F>
     |                                 ^^^^^^^^^^^^^^^ required by this bound in `Normal::<F>::new`
...
156  |     pub fn new(mean: F, std_dev: F) -> Result<Normal<F>, Error> {
     |            --- required by a bound in this associated function

error[E0277]: the trait bound `StandardNormal: rand_distr::Distribution<bf16>` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2521:30
     |
2521 |                 let normal = rand_distr::Normal::new(bf16::from_f64(mean), bf16::from_f64(std))
     |                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the trait `rand_distr::Distribution<bf16>` is not implemented for `StandardNormal`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `rand_distr::Normal`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:118:33
     |
117  | pub struct Normal<F>
     |            ------ required by a bound in this struct
118  | where F: Float, StandardNormal: Distribution<F>
     |                                 ^^^^^^^^^^^^^^^ required by this bound in `Normal`

error[E0277]: the trait bound `StandardNormal: rand_distr::Distribution<bf16>` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2521:30
     |
2521 |                   let normal = rand_distr::Normal::new(bf16::from_f64(mean), bf16::from_f64(std))
     |  ______________________________^
2522 | |                     .map_err(Error::wrap)?;
     | |_________________________________________^ the trait `rand_distr::Distribution<bf16>` is not implemented for `StandardNormal`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `rand_distr::Normal`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:118:33
     |
117  | pub struct Normal<F>
     |            ------ required by a bound in this struct
118  | where F: Float, StandardNormal: Distribution<F>
     |                                 ^^^^^^^^^^^^^^^ required by this bound in `Normal`

error[E0277]: the trait bound `StandardNormal: rand_distr::Distribution<bf16>` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2521:30
     |
2521 |                   let normal = rand_distr::Normal::new(bf16::from_f64(mean), bf16::from_f64(std))
     |  ______________________________^
2522 | |                     .map_err(Error::wrap)?;
     | |__________________________________________^ the trait `rand_distr::Distribution<bf16>` is not implemented for `StandardNormal`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `rand_distr::Normal`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:118:33
     |
117  | pub struct Normal<F>
     |            ------ required by a bound in this struct
118  | where F: Float, StandardNormal: Distribution<F>
     |                                 ^^^^^^^^^^^^^^^ required by this bound in `Normal`

error[E0599]: the method `sample` exists for struct `Normal<bf16>`, but its trait bounds were not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2524:38
     |
2524 |                     data.push(normal.sample(&mut rng))
     |                                      ^^^^^^ method cannot be called on `Normal<bf16>` due to unsatisfied trait bounds
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- doesn't satisfy `StandardNormal: rand_distr::Distribution<bf16>`
...
117  | pub struct Normal<F>
     | -------------------- doesn't satisfy `_: Distribution<bf16>`, `rand_distr::Normal<bf16>: RngCore` or `rand_distr::Normal<bf16>: rand::Rng`
     |
     = note: the following trait bounds were not satisfied:
             `StandardNormal: rand_distr::Distribution<bf16>`
             which is required by `rand_distr::Normal<bf16>: rand_distr::Distribution<bf16>`
             `rand_distr::Normal<bf16>: RngCore`
             which is required by `rand_distr::Normal<bf16>: rand::Rng`

error[E0277]: the trait bound `StandardNormal: rand_distr::Distribution<half::f16>` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2530:30
     |
2530 |                 let normal = rand_distr::Normal::new(f16::from_f64(mean), f16::from_f64(std))
     |                              ^^^^^^^^^^^^^^^^^^^^^^^ the trait `rand_distr::Distribution<half::f16>` is not implemented for `StandardNormal`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `rand_distr::Normal::<F>::new`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:147:33
     |
147  | where F: Float, StandardNormal: Distribution<F>
     |                                 ^^^^^^^^^^^^^^^ required by this bound in `Normal::<F>::new`
...
156  |     pub fn new(mean: F, std_dev: F) -> Result<Normal<F>, Error> {
     |            --- required by a bound in this associated function

error[E0277]: the trait bound `StandardNormal: rand_distr::Distribution<half::f16>` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2530:30
     |
2530 |                 let normal = rand_distr::Normal::new(f16::from_f64(mean), f16::from_f64(std))
     |                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ the trait `rand_distr::Distribution<half::f16>` is not implemented for `StandardNormal`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `rand_distr::Normal`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:118:33
     |
117  | pub struct Normal<F>
     |            ------ required by a bound in this struct
118  | where F: Float, StandardNormal: Distribution<F>
     |                                 ^^^^^^^^^^^^^^^ required by this bound in `Normal`

error[E0277]: the trait bound `StandardNormal: rand_distr::Distribution<half::f16>` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2530:30
     |
2530 |                   let normal = rand_distr::Normal::new(f16::from_f64(mean), f16::from_f64(std))
     |  ______________________________^
2531 | |                     .map_err(Error::wrap)?;
     | |_________________________________________^ the trait `rand_distr::Distribution<half::f16>` is not implemented for `StandardNormal`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `rand_distr::Normal`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:118:33
     |
117  | pub struct Normal<F>
     |            ------ required by a bound in this struct
118  | where F: Float, StandardNormal: Distribution<F>
     |                                 ^^^^^^^^^^^^^^^ required by this bound in `Normal`

error[E0277]: the trait bound `StandardNormal: rand_distr::Distribution<half::f16>` is not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2530:30
     |
2530 |                   let normal = rand_distr::Normal::new(f16::from_f64(mean), f16::from_f64(std))
     |  ______________________________^
2531 | |                     .map_err(Error::wrap)?;
     | |__________________________________________^ the trait `rand_distr::Distribution<half::f16>` is not implemented for `StandardNormal`
     |
note: there are multiple different versions of crate `rand` in the dependency graph
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.8.5/src/distributions/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ^^^^^^^^^^^^^^^^^^^^^^^^^ this is the required trait
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2465:13
     |
2465 |         use rand::prelude::*;
     |             ---- one version of crate `rand` used here, as a direct dependency of the current crate
     |
    ::: /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/convert.rs:3:5
     |
3    | use half::{bf16, f16, slice::HalfFloatSliceExt};
     |     ---- one version of crate `rand` used here, as a dependency of crate `half`
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- this type doesn't implement the required trait
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand-0.9.0/src/distr/distribution.rs:35:1
     |
35   | pub trait Distribution<T> {
     | ------------------------- this is the found trait
     = help: you can use `cargo tree` to explore your dependency tree
note: required by a bound in `rand_distr::Normal`
    --> /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:118:33
     |
117  | pub struct Normal<F>
     |            ------ required by a bound in this struct
118  | where F: Float, StandardNormal: Distribution<F>
     |                                 ^^^^^^^^^^^^^^^ required by this bound in `Normal`

error[E0599]: the method `sample` exists for struct `Normal<f16>`, but its trait bounds were not satisfied
    --> /Users/litan/.cargo/git/checkouts/candle-3a48dae19aa5d5b6/7e02ad8/candle-core/src/cpu_backend/mod.rs:2533:38
     |
2533 |                     data.push(normal.sample(&mut rng))
     |                                      ^^^^^^ method cannot be called on `Normal<f16>` due to unsatisfied trait bounds
     |
    ::: /Users/litan/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/rand_distr-0.4.3/src/normal.rs:41:1
     |
41   | pub struct StandardNormal;
     | ------------------------- doesn't satisfy `_: Distribution<f16>`
...
117  | pub struct Normal<F>
     | -------------------- doesn't satisfy `_: Distribution<f16>`, `rand_distr::Normal<half::f16>: RngCore` or `rand_distr::Normal<half::f16>: rand::Rng`
     |
     = note: the following trait bounds were not satisfied:
             `StandardNormal: rand_distr::Distribution<half::f16>`
             which is required by `rand_distr::Normal<half::f16>: rand_distr::Distribution<half::f16>`
             `rand_distr::Normal<half::f16>: RngCore`
             which is required by `rand_distr::Normal<half::f16>: rand::Rng`

   Compiling system-configuration v0.5.1
   Compiling derive_builder_core v0.20.2
   Compiling proc-macro-error-attr v1.0.4
   Compiling onig_sys v69.8.1
   Compiling fancy-regex v0.13.0
   Compiling syn v1.0.109
   Compiling tower v0.5.2
   Compiling hyper-tls v0.5.0
   Compiling candle-metal-kernels v0.6.0 (https://github.com/OlivierDehaene/candle#3522de30)
   Compiling rustls-pemfile v1.0.4
   Compiling rustls-webpki v0.103.0
   Compiling webpki-roots v0.26.8
   Compiling text-embeddings-backend-candle v1.6.0 (/Users/litan/projects/text-embeddings-inference/backends/candle)
   Compiling vergen v8.3.2
   Compiling core-foundation v0.10.0
   Compiling opentelemetry v0.23.0
   Compiling concurrent-queue v2.5.0
   Compiling serde_plain v1.0.2
   Compiling esaxx-rs v0.1.10
   Compiling cpufeatures v0.2.17
   Compiling num_threads v0.1.7
   Compiling nohash-hasher v0.2.0
   Compiling itoa v1.0.15
   Compiling number_prefix v0.4.0
Some errors have detailed explanations: E0277, E0599.
For more information about an error, try `rustc --explain E0277`.
error: could not compile `candle-core` (lib) due to 20 previous errors
warning: build failed, waiting for other jobs to finish...
error: failed to compile `text-embeddings-router v1.6.0 (/Users/litan/projects/text-embeddings-inference/router)`, intermediate artifacts can be found at `/Users/litan/projects/text-embeddings-inference/target`.
To reuse those artifacts with a future compilation, set the environment variable `CARGO_TARGET_DIR` to that path.

Information

• Docker
• The CLI directly

Tasks

• An officially supported command
• My own modifications

Reproduction

On Mac M4, download the repository and install with

cargo install --path router -F metal

Expected behavior

Successful installation without errors

[alikefia]

I had the same and running with --locked fixed the issue for me as suggested in #522

[tanliboy]

Thank you, @alikefia !
It works for me.

[alvarobartt]

Hey @alikefia and @tanliboy thanks for reporting! FYI the candle integration within TEI has been recently re-organized into a cleaner way, so if you could give it a try again from the main that may solve your issues, let us know otherwise 🤗