Code

Run bench on demo#1552

Code

Merged

noonio merged 115 commits intomastercardano-scaling/hydra:masterfrom demo-benchcardano-scaling/hydra:demo-benchCopy head branch name to clipboardAug 29, 2024

+771-269

Commits

Commits on Aug 28, 2024

• Define basic demo options

  

  ffakenz

  authored and

  ch1bo

  committed
  fe73fd1

  Copy full SHA for fe73fd1

• Extract genDatasetConstantUTxO

  Show description for 86201c0
  

  ffakenz

  authored and

  ch1bo

  committed
  86201c0

  Copy full SHA for 86201c0

• Extract bench scenario

  Show description for ffaf84c
  

  ffakenz

  authored and

  ch1bo

  committed
  ffaf84c

  Copy full SHA for ffaf84c

• Extract findRunningCardanoNode'

  Show description for 74ad553
  

  ffakenz

  authored and

  ch1bo

  committed
  74ad553

  Copy full SHA for 74ad553

• Add network id as part of the options

  Show description for 8d1eb68
  

  ffakenz

  authored and

  ch1bo

  committed
  8d1eb68

  Copy full SHA for 8d1eb68

• Draft base bench demo script

  

  ffakenz

  authored and

  ch1bo

  committed
  85667fd

  Copy full SHA for 85667fd

• Fix seeding devnet on bench-demo given scripts were already published

  

  ffakenz

  authored and

  ch1bo

  committed
  22a0dbd

  Copy full SHA for 22a0dbd

• Fix tx building for funding transaction

  Show description for 1a16408
  

  ffakenz

  authored and

  ch1bo

  committed
  1a16408

  Copy full SHA for 1a16408

• Add hydra signing keys as option args to bench-demo

  

  ffakenz

  authored and

  ch1bo

  committed
  03da04b

  Copy full SHA for 03da04b

• Extend generator of constant utxo property

  Show description for 47f105c
  

  ffakenz

  authored and

  ch1bo

  committed
  47f105c

  Copy full SHA for 47f105c

• Trying to work out why large numbers of clients fail

  Show description for 6b5b52e
  

  noonio

  authored and

  ch1bo

  committed
  6b5b52e

  Copy full SHA for 6b5b52e

• Limit the nbr of client keys on arbitrary for dataset

  

  ffakenz

  authored and

  ch1bo

  committed
  85c6f75

  Copy full SHA for 85c6f75

• Return funds to faucet when it finishes

  

  ffakenz

  authored and

  ch1bo

  committed
  f338f27

  Copy full SHA for f338f27

• Avoid passing network id to options and faucet keys on generators

  Show description for 8cb5813
  

  ffakenz

  authored and

  ch1bo

  committed
  8cb5813

  Copy full SHA for 8cb5813

• Make bench-demo sim to run on top of previous run

  Show description for 74d6896
  

  ffakenz

  authored and

  ch1bo

  committed
  74d6896

  Copy full SHA for 74d6896

• Replace hydra-keys options by hydra-client hosts instead

  Show description for b6d53d8
  

  ffakenz

  authored and

  ch1bo

  committed
  b6d53d8

  Copy full SHA for b6d53d8

• Start a github action for network testing

  ch1bo

  committed
  d1716b7

  Copy full SHA for d1716b7

• Spin up things individually

  ch1bo

  committed
  a449194

  Copy full SHA for a449194

• Acquire and upload logs

  ch1bo

  committed
  9e0041c

  Copy full SHA for 9e0041c

• Make the hnode fallback in demo/seed-devnet.sh non-interactive tty

  ch1bo

  committed
  1de6a0a

  Copy full SHA for 1de6a0a

• Add invocation to produce traffic

  ch1bo

  committed
  0cc7f8a

  Copy full SHA for 0cc7f8a

• check socket permissions

  

  noonio

  authored and

  ch1bo

  committed
  d1a7094

  Copy full SHA for d1a7094

• ls not la

  

  noonio

  authored and

  ch1bo

  committed
  04f7724

  Copy full SHA for 04f7724

• tmate

  

  noonio

  authored and

  ch1bo

  committed
  8800ea3

  Copy full SHA for 8800ea3

• tmate; socket file permissions

  

  noonio

  authored and

  ch1bo

  committed
  59d27da

  Copy full SHA for 59d27da

• split setup and run benchmarks

  

  noonio

  authored and

  ch1bo

  committed
  6c8cc69

  Copy full SHA for 6c8cc69

• Run pumba and the benchmarks

  Show description for 7039d7f
  

  noonio

  authored and

  ch1bo

  committed
  7039d7f

  Copy full SHA for 7039d7f

• Line buffering; 100% loss on pumba

  

  noonio

  authored and

  ch1bo

  committed
  781200d

  Copy full SHA for 781200d

• tmate

  

  noonio

  authored and

  ch1bo

  committed
  7a5750e

  Copy full SHA for 7a5750e

• Rebase and make use new hydra-client options during CI

  

  ffakenz

  authored and

  ch1bo

  committed
  cca50cc

  Copy full SHA for cca50cc

• Use docker version of pumba

  Show description for a8c420f
  

  noonio

  authored and

  ch1bo

  committed
  a8c420f

  Copy full SHA for a8c420f

• Does it work with 20% loss?

  

  noonio

  authored and

  ch1bo

  committed
  7d77a2f

  Copy full SHA for 7d77a2f

• See if it succeeds with 0% loss

  

  noonio

  authored and

  ch1bo

  committed
  f79dbb4

  Copy full SHA for f79dbb4

• What about 5%

  

  noonio

  authored and

  ch1bo

  committed
  69ced33

  Copy full SHA for 69ced33

• Optional tmate'ing

  

  noonio

  authored and

  ch1bo

  committed
  c1d15e7

  Copy full SHA for c1d15e7

• Disable condition as it doesn't work

  

  noonio

  authored and

  ch1bo

  committed
  26998e8

  Copy full SHA for 26998e8

• Try nix again; leave very long running time

  

  noonio

  authored and

  ch1bo

  committed
  4fc35a2

  Copy full SHA for 4fc35a2

• Try a sleep

  

  noonio

  authored and

  ch1bo

  committed
  61b1e89

  Copy full SHA for 61b1e89

• Horrible hack

  

  noonio

  authored and

  ch1bo

  committed
  9703451

  Copy full SHA for 9703451

• Note about checking for pumba working

  

  noonio

  authored and

  ch1bo

  committed
  9e00319

  Copy full SHA for 9e00319

• Target node 1 for loss and limit target ips for node-2, and node-3

  

  noonio

  authored and

  ch1bo

  committed
  336ae3f

  Copy full SHA for 336ae3f

• Try /24

  

  noonio

  authored and

  ch1bo

  committed
  9ad4b41

  Copy full SHA for 9ad4b41

• Multiple targets is right

  

  noonio

  authored and

  ch1bo

  committed
  9530f1e

  Copy full SHA for 9530f1e

• Let's try 2%

  

  noonio

  authored and

  ch1bo

  committed
  a0e18bc

  Copy full SHA for a0e18bc

• Add now 5%

  

  noonio

  authored and

  ch1bo

  committed
  9c49594

  Copy full SHA for 9c49594

• 3%

  

  noonio

  authored and

  ch1bo

  committed
  b66a128

  Copy full SHA for b66a128

• 4%

  

  noonio

  authored and

  ch1bo

  committed
  e6e0e2a

  Copy full SHA for e6e0e2a

• Try to wait for alice peer disconnected from bob and carol nodes

  

  ffakenz

  authored and

  ch1bo

  committed
  314ec58

  Copy full SHA for 314ec58

• Executable; compatible with NixOS

  

  noonio

  authored and

  ch1bo

  committed
  8dcb837

  Copy full SHA for 8dcb837

• Add persitency-dir options to hydra-node

  Show description for a9ff65b
  

  ffakenz

  authored and

  ch1bo

  committed
  a9ff65b

  Copy full SHA for a9ff65b

• Use a special image built for netem; no more tcimage

  

  noonio

  authored and

  ch1bo

  committed
  88e5bce

  Copy full SHA for 88e5bce

• Add base network testing readme docs

  

  ffakenz

  authored and

  ch1bo

  committed
  080d915

  Copy full SHA for 080d915

• Use local functions to seed the network

  Show description for 6290615
  

  ffakenz

  authored and

  ch1bo

  committed
  6290615

  Copy full SHA for 6290615

• Do not seed neetwork before runnin bench-demo

  Show description for de10549
  

  ffakenz

  authored and

  ch1bo

  committed
  de10549

  Copy full SHA for de10549

• Remove FIXME as its not reproduceable

  Show description for 1c086e9
  

  ffakenz

  authored and

  ch1bo

  committed
  1c086e9

  Copy full SHA for 1c086e9

• Minor refactor on generateOneTransfer

  Show description for 58eab02
  

  ffakenz

  authored and

  ch1bo

  committed
  58eab02

  Copy full SHA for 58eab02

• Use random/self transfer generator functions

  

  noonio

  authored and

  ch1bo

  committed
  088d661

  Copy full SHA for 088d661

• Update demo-bech to take datasets from args

  

  ffakenz

  authored and

  ch1bo

  committed
  e48b67a

  Copy full SHA for e48b67a

• Gen demo datasets

  

  ffakenz

  authored and

  ch1bo

  committed
  4d1b2cb

  Copy full SHA for 4d1b2cb

• Refactor HydraClient to keep peer information

  Show description for eaef6ec
  

  ffakenz

  authored and

  ch1bo

  committed
  eaef6ec

  Copy full SHA for eaef6ec

• dbg

  

  ffakenz

  authored and

  ch1bo

  committed
  b29df8f

  Copy full SHA for b29df8f

• Try to use the pre-seeded client funds instead of faucet's

  

  ffakenz

  authored and

  ch1bo

  committed
  7be87ce

  Copy full SHA for 7be87ce

• Generate each client dataset from a different client funding tx

  Show description for 6c517b7
  

  ffakenz

  authored and

  ch1bo

  committed
  6c517b7

  Copy full SHA for 6c517b7

• Try not to specify any output

  

  ffakenz

  authored and

  ch1bo

  committed
  5a61308

  Copy full SHA for 5a61308

• Try using mkTxOutAutoBalance instead

  

  ffakenz

  authored and

  ch1bo

  committed
  2a69816

  Copy full SHA for 2a69816

• Fix client utxo

  

  ffakenz

  authored and

  ch1bo

  committed
  3a67f0c

  Copy full SHA for 3a67f0c

• Try not to specify any output ~ v2

  

  ffakenz

  authored and

  ch1bo

  committed
  6eec715

  Copy full SHA for 6eec715

• Go back to unbalanced outputs ~ v2

  

  ffakenz

  authored and

  ch1bo

  committed
  b8bfb3e

  Copy full SHA for b8bfb3e

• Make funding tx optional for datasets

  Show description for 99035a4
  

  ffakenz

  authored and

  ch1bo

  committed
  99035a4

  Copy full SHA for 99035a4

• Try not to specify any output ~ v3

  

  ffakenz

  authored and

  ch1bo

  committed
  374147a

  Copy full SHA for 374147a

• Try using mkTxOutAutoBalance instead ~ v2

  

  ffakenz

  authored and

  ch1bo

  committed
  0250340

  Copy full SHA for 0250340

• WIP; Revert faucet; use buildRawTransaction

  

  noonio

  authored and

  ch1bo

  committed
  5617254

  Copy full SHA for 5617254

• Create workdir if it doesn't exist

  

  noonio

  authored and

  ch1bo

  committed
  ef399ad

  Copy full SHA for ef399ad

• WIP on generateDemoUTxO function; just missing witnesses.

  

  noonio

  authored and

  ch1bo

  committed
  04648a9

  Copy full SHA for 04648a9

• Small refactors around types

  

  noonio

  authored and

  ch1bo

  committed
  0d7c62c

  Copy full SHA for 0d7c62c

• WIP back to generating the dataset on the fly

  

  noonio

  authored and

  ch1bo

  committed
  c17ecfb

  Copy full SHA for c17ecfb

• Do not pre-seed devnet

  Show description for b98ad0a
  

  ffakenz

  authored and

  ch1bo

  committed
  b98ad0a

  Copy full SHA for b98ad0a

• Use other script for exporting pparams

  

  noonio

  authored and

  ch1bo

  committed
  42d4cdf

  Copy full SHA for 42d4cdf

• Short contestation period so that it closes fast

  

  noonio

  authored and

  ch1bo

  committed
  b761578

  Copy full SHA for b761578

• add failure handling on tx processing while head is open

  Show description for 79dfee8
  

  ffakenz

  authored and

  ch1bo

  committed
  79dfee8

  Copy full SHA for 79dfee8

• Compute pct of transactions confirmed

  

  noonio

  authored and

  ch1bo

  committed
  0a15354

  Copy full SHA for 0a15354

• 4% should work

  

  noonio

  authored and

  ch1bo

  committed
  e205443

  Copy full SHA for e205443

• Enhance workflow

  

  ffakenz

  authored and

  ch1bo

  committed
  b00a43c

  Copy full SHA for b00a43c

• Some nice refactoring

  

  ffakenz

  authored and

  ch1bo

  committed
  0872fa1

  Copy full SHA for 0872fa1

• Make watch for logs optional

  

  ffakenz

  authored and

  ch1bo

  committed
  8e2c14d

  Copy full SHA for 8e2c14d

• Reframe wait for peer disconnected variable

  

  noonio

  authored and

  ch1bo

  committed
  f77ef9b

  Copy full SHA for f77ef9b

• Experiment with a matrix

  

  noonio

  authored and

  ch1bo

  committed
  a855021

  Copy full SHA for a855021

• Name in artifact

  

  noonio

  authored and

  ch1bo

  committed
  faee8b8

  Copy full SHA for faee8b8

• Expect-failure matrix configuration

  

  noonio

  authored and

  ch1bo

  committed
  0efbdc4

  Copy full SHA for 0efbdc4

• Add failure mode we expect; refine matrix

  

  noonio

  authored and

  ch1bo

  committed
  7335112

  Copy full SHA for 7335112

• Fix order of detecting error conditions

  

  noonio

  authored and

  ch1bo

  committed
  c80281f

  Copy full SHA for c80281f

• Add scaling factor to matrix config

  

  noonio

  authored and

  ch1bo

  committed
  a1e0de4

  Copy full SHA for a1e0de4

• Replace yq by docker inspect

  

  ffakenz

  authored and

  ch1bo

  committed
  d14576b

  Copy full SHA for d14576b

• Upload the results as part of the artifacts

  

  ffakenz

  authored and

  ch1bo

  committed
  b90ee87

  Copy full SHA for b90ee87

• Make sure results.csv is written to the outputDirectory not the tmp directory

  

  ffakenz

  authored and

  ch1bo

  committed
  46746c6

  Copy full SHA for 46746c6

• Write the summary out even when it failed

  

  ffakenz

  authored and

  ch1bo

  committed
  8324d53

  Copy full SHA for 8324d53

• Make peers part of the matrix

  

  noonio

  authored and

  ch1bo

  committed
  0ccb72d

  Copy full SHA for 0ccb72d

• Allow 5% to fail

  

  noonio

  authored and

  ch1bo

  committed
  dd2051f

  Copy full SHA for dd2051f

• Remove explicit failure tracking in the includes/excludes

  

  noonio

  authored and

  ch1bo

  committed
  b4c3376

  Copy full SHA for b4c3376

• Add extra scaling factor

  

  noonio

  authored and

  ch1bo

  committed
  d7b18ab

  Copy full SHA for d7b18ab

• Matrix information in the name

  

  noonio

  authored and

  ch1bo

  committed
  fc26227

  Copy full SHA for fc26227

• Rename hydra clients peers to api hosts

  

  ffakenz

  authored and

  ch1bo

  committed
  4f31cfe

  Copy full SHA for 4f31cfe

• Update README

  

  ffakenz

  authored and

  ch1bo

  committed
  cc59644

  Copy full SHA for cc59644

• Enhance user error during processTransactions

  

  ffakenz

  authored and

  ch1bo

  committed
  116976f

  Copy full SHA for 116976f

• Update bench demo option description

  

  ffakenz

  authored and

  ch1bo

  committed
  d1d96fd

  Copy full SHA for d1d96fd

• Make the scenario to seed the network

  

  ffakenz

  authored and

  ch1bo

  committed
  a5185a5

  Copy full SHA for a5185a5

• Rever changes over the benchmarks slug used by the website

  

  ffakenz

  authored and

  ch1bo

  committed
  02d460d

  Copy full SHA for 02d460d

• Do not trace signing keys during benchmark

  

  ffakenz

  authored and

  ch1bo

  committed
  36ac132

  Copy full SHA for 36ac132

• Remove watch logs step and simplify workflow args

  

  ffakenz

  authored and

  ch1bo

  committed
  cdf5ff6

  Copy full SHA for cdf5ff6

• Remove unnecessary scripts

  

  ffakenz

  authored and

  ch1bo

  committed
  5e69dd7

  Copy full SHA for 5e69dd7

• Enhance failure message for HUnitFailure errors

  ffakenz

  committed
  a555aec

  Copy full SHA for a555aec

Commits on Aug 29, 2024

• Remove hack to check every node sees head is initialized for demo

  Show description for 3aafd9c
  ffakenz

  committed
  3aafd9c

  Copy full SHA for 3aafd9c

• Refactor hacky boolean blindness to manage query params on withConnectionToNode

  ffakenz

  committed
  710d65f

  Copy full SHA for 710d65f

• Fix not seeding during scenario but before it gets executed

  Show description for 6654d08
  ffakenz

  committed
  6654d08

  Copy full SHA for 6654d08

• Don't call --random on pumba; note about time

  noonio

  committed
  c5d1208

  Copy full SHA for c5d1208