Dependence aware tests for `ppc*ecdf`#428

Merged

avehtari merged 176 commits into

stan-dev:masterfrom

florence-bockting:dependence-aware-LOO-PIT

Jun 25, 2026

Commits on Feb 20, 2026

add helper functions for correlation-aware uniformity test
florence-bockting
committed
incorporate in ppc_loo_pit_ecdf correlation-aware uniformity test
florence-bockting
committed
add tests for updated ppc_loo_pit_ecdf function
florence-bockting
committed

Commits on Feb 21, 2026

formatting and efficiency improvements
florence-bockting
committed
improve description and computation of uniformity tests for pcc_loo_pit_ecdf
florence-bockting
committed
add unit-tests for dependence-aware uniformity tests
florence-bockting
committed
do not remove NA when using sort() in pot_test
florence-bockting
committed
move unittest for uniformity tests from test-ppc-loo.R to test-helpers-ppc.R
florence-bockting
committed
improve descripting and naming of function to compute shapley values
florence-bockting
committed
improve descripting and naming of function to compute shapley values
florence-bockting
committed
add unittest for compute_shapley_values
florence-bockting
committed
improve computation of Cauchy combination test and std. Cauchy values
florence-bockting
committed
make variable namings more descriptive
florence-bockting
committed
add unittests for Cauchy combination test
florence-bockting
committed
improve efficiency of influential_points_idx
florence-bockting
committed
add unittests for influential_points_idx
florence-bockting
committed
update unittests for ppc_loo_pit_ecdf
florence-bockting
committed

Commits on Feb 23, 2026

Commits on Mar 2, 2026

change highlighting color to red
florence-bockting
committed
add knitting output to gitignore
florence-bockting
committed
add initial draft for ppc-loo-pit vignette
florence-bockting
committed
add p-value info as text instead of title to plot
Florence Bockting
committed
add automatic scaling to y-axis
Florence Bockting
committed
add updated snapshots for visual regression tests
Florence Bockting
committed
add draft vignette to gitignore
Florence Bockting
committed
fix typo in .gitignore
Florence Bockting
committed
change geom_abline to geom_segment to adhere to 0-1 intervall
Florence Bockting
committed
update snapshots for visual regression test
Florence Bockting
committed
update snapshot for ppc-loo-pit-overlay-boundary
Florence Bockting
committed
add draft vignette to .gitignore
Florence Bockting
committed
add additional arguments required for method='correlated'
Florence Bockting
committed
modify ppc_pit_ecdf to support method='correlated'
Florence Bockting
committed
add helper functions for uniformity tests
Florence Bockting
committed
update parameter description
Florence Bockting
committed
add tests for updated ppc_pit_ecdf()
Florence Bockting
committed

Commits on Mar 3, 2026

minor theme adjustments and add help_text arg
Florence Bockting
committed
add new tests for adjusted themes
Florence Bockting
committed
add updated snapshots for visual regression tests
Florence Bockting
committed
update snapshots
Florence Bockting
committed
add updated documentation
Florence Bockting
committed
update snapshots for visual regression test
Florence Bockting
committed
fix function call in tests
Florence Bockting
committed
update snapshots
florence-bockting
committed
update default colors in description
Florence Bockting
committed
Merge branch 'dependence-aware-LOO-PIT' of https://github.com/florence-bockting/bayesplot-private into dependence-aware-LOO-PIT
Florence Bockting
committed
update gitignore
Florence Bockting
committed
update default color from black to grey60
Florence Bockting
committed

Commits on Mar 4, 2026

update gitignore
Florence Bockting
committed
update theme for ppc_loo_pit_ecdf
Florence Bockting
committed
update snapshots for regression test
Florence Bockting
committed
udpate theme for correlated method
Florence Bockting
committed
update gitignore
Florence Bockting
committed
update ppc_pit_ecdf to match changes in ppc_loo_pit_ecdf
Florence Bockting
committed
update unittests for ppc_pit_ecdf
Florence Bockting
committed
add new snapshots for visual regression tests
Florence Bockting
committed
Merge branch 'dependence-aware-LOO-PIT' into dependence-aware-pit
florence-bockting
authored
update documentation for ppc_pit_ecdf
Florence Bockting
committed
add further visual regression tests
Florence Bockting
committed
fix duplicate naming in visual regression tests
Florence Bockting
committed
update snapshots for visual regression tests
Florence Bockting
committed
Merge branch 'dependence-aware-pit' of https://github.com/florence-bockting/bayesplot into dependence-aware-pit
Florence Bockting
committed
Merge pull request #5 from florence-bockting/dependence-aware-pit
florence-bockting
authored

Commits on Mar 5, 2026

add pareto_pit function temporarily until available via posterior
Florence Bockting
committed
add pareto_pit function temporarily until available via posterior
Florence Bockting
committed
update ppc_loo_pit_ecdf to support pareto_pit & minor refactoring to clean up new code structure
Florence Bockting
committed
add test for ppc_loo_pit_ecdf with pareto_pit support
Florence Bockting
committed
fix typo in x-label
Florence Bockting
committed
add test name in helper text
Florence Bockting
committed
fix test regarding xlabel (changed from LOO PIT to PIT)
Florence Bockting
committed
update snapshots for visual regression test
Florence Bockting
committed
fix that pareto_pit default can be changed by the user
Florence Bockting
committed
add pareto_pit support for ppc_pit_ecdf
Florence Bockting
committed
add test for checking correct PIT computation
Florence Bockting
committed
add test for correct PIT comptutation with ppc_pit_ecdf
Florence Bockting
committed
update snapshots for visual regression test
Florence Bockting
committed
change default pareto_pit from True to False for method='independent'
florence-bockting
committed
add test for using ppc_pit_ecdf with brms::pp_check()
florence-bockting
committed
add args-methods-dots to man-roxygen folder
florence-bockting
committed
update documentation
florence-bockting
committed
remove necessary weights for method='independent' and pareto_pit=True
florence-bockting
committed
adjust test for ppc_pit with pp_check
florence-bockting
committed
change x-axis to LOO PIT
florence-bockting
committed
adjust p-value formatting for ppc_loo_pit_ecdf
florence-bockting
committed
remove weights from arguments for ppc_pit_ecdf
florence-bockting
committed
add helper for formatting p-value
florence-bockting
committed
add unittest for p-value-formatting helper
florence-bockting
committed
update tests for ppc_pit_ecdf
florence-bockting
committed
add snapshots for visual regression tests
florence-bockting
committed

Commits on Mar 6, 2026

fix x-axis label to LOO-PIT
Florence Bockting
committed
adjust internal referencing
Florence Bockting
committed
update documentation for ppc_pit_ecdf
Florence Bockting
committed
minor change in code comment
Florence Bockting
committed
update documentation files
Florence Bockting
committed
update snapshots for regression test
Florence Bockting
committed
update references in documentation
Florence Bockting
committed
add brms as testing dependeny
Florence Bockting
committed
move helper functions insight the testthat block
Florence Bockting
committed
use logsumExp from matrixStats for numerical stability
florence-bockting
committed
Merge branch 'dependence-aware-LOO-PIT' of https://github.com/florence-bockting/bayesplot into dependence-aware-LOO-PIT
florence-bockting
committed

Commits on Mar 7, 2026

Merge branch 'dependence-aware-LOO-PIT' of https://github.com/florence-bockting/bayesplot-private into dependence-aware-LOO-PIT
Florence Bockting
committed

Commits on Mar 8, 2026

adjust some comments in code
Florence Bockting
committed
remove old test-code
Florence Bockting
committed

Commits on Mar 12, 2026

remove pareto-pit computation (outsourced to posterior pkg)
Florence Bockting
committed
call posterior_pit() from posterior
Florence Bockting
committed
add agents/skills to gitignore
Florence Bockting
committed
import pareto_pit() and uniformity_test() from posterior pkg instead of local implementation
Florence Bockting
committed

Commits on Mar 13, 2026

Merge branch 'master' into dependence-aware-LOO-PIT
jgabry
authored

Commits on Mar 26, 2026

fix: clean-up .gitignore
Florence Bockting
committed
Merge branch 'master' into dependence-aware-LOO-PIT
florence-bockting
authored
Merge branch 'dependence-aware-LOO-PIT' of https://github.com/florence-bockting/bayesplot into dependence-aware-LOO-PIT
Florence Bockting
committed
fix: remove custom files from gitignore
Florence Bockting
committed

Commits on Apr 2, 2026

chore: update .gitignore to match master
Florence Bockting
committed
Merge branch 'master' into dependence-aware-LOO-PIT
florence-bockting
authored
build: update minimum posterior version
Florence Bockting
committed

Commits on Apr 4, 2026

feat: update ppc-pit-ecdf-grouped to support correlated method
Florence Bockting
committed
Merge branch 'dependence-aware-LOO-PIT' of https://github.com/florence-bockting/bayesplot into dependence-aware-LOO-PIT
Florence Bockting
committed
tests: fix monkey-patching
Florence Bockting
committed
tests: check for vectorized in monkey-patch
Florence Bockting
committed

Commits on Apr 5, 2026

style: clean-up code
Florence Bockting
committed
docs: update documentation
Florence Bockting
committed
fix: update expected test output
Florence Bockting
committed

Commits on Apr 7, 2026

fix: update x-label in loo-pit, independent plot
Florence Bockting
committed
fix: adjust test to modified x-label
Florence Bockting
committed
Merge branch 'master' into dependence-aware-LOO-PIT
florence-bockting
authored

Commits on Apr 10, 2026

docs: fix description of 'gamma' and add special condition to 'pareto_pit'
Florence Bockting
committed
fix: update condition for 'pareto_pit', improve input checks, and add corresponding unittests
Florence Bockting
committed
Merge branch 'dependence-aware-LOO-PIT' of https://github.com/florence-bockting/bayesplot into dependence-aware-LOO-PIT
Florence Bockting
committed
Merge branch 'master' into dependence-aware-LOO-PIT
florence-bockting
authored
fix: merge description
Florence Bockting
committed

Commits on Apr 15, 2026

refactor: create helpers to remove duplicate code between ecdf-functions
Florence Bockting
committed
docs,refactor: update function documentation and outsource common arguments into single docs file
Florence Bockting
committed
tests: update snapshots wrt to increased size of help-text in ppc-ecdf plots
Florence Bockting
committed
fix: fix duplicate linewidth, prob arguments
Florence Bockting
committed

Commits on Apr 16, 2026

chore: label size compatible with var. ggplot2 versions
Florence Bockting
committed
Merge branch 'master' into dependence-aware-LOO-PIT
florence-bockting
authored
chore: check for S4 class using base R
Florence Bockting
committed
chore: remove tests that require brms and also brms dependency in Suggests
Florence Bockting
committed
fix: handle 0-1 PIT values for POT and PIET
Florence Bockting
committed

Commits on Apr 21, 2026

Merge branch 'master' into dependence-aware-LOO-PIT
florence-bockting
authored
fix: ensure warning/error messages are below 80 characters
Florence Bockting
committed
chore: add florence-bockting to Description file
Florence Bockting
committed
merge: update from master
Florence Bockting
committed

Commits on Jun 4, 2026