[Autoloop: perf-comparison] - #435
Draft
github-actions[bot] wants to merge 44 commits into
Draft
Conversation
…ndex benchmark Run: https://github.com/githubnext/tsb/actions/runs/30010910150 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Benchmark BooleanArray extension array (100k elements, ~10% nulls, 50 iters): from/any/all/sum/and/or/not/fillna. TS: arrays.BooleanArray from tsb; Python: pd.array(dtype='boolean'). Run: https://github.com/githubnext/tsb/actions/runs/30058807058 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
Run: https://github.com/githubnext/tsb/actions/runs/30096576504 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
Contributor
Author
|
🤖 Iteration 420 — ✅ Accepted
|
Add bench_datetime_array.ts and bench_datetime_array.py benchmarking nullable datetime extension array: from/year/month/day/isna/notna/fillna. 100k elements with ~10% nulls, 50 iterations. Run: https://github.com/githubnext/tsb/actions/runs/30138360760 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
Add bench_timedelta_array.ts and bench_timedelta_array.py benchmarks for TimedeltaArray (100k elements, ~10% nulls, 50 iters): from/days/hours/ totalSeconds/isna/notna/sum/min/max/fillna. Run: https://github.com/githubnext/tsb/actions/runs/30159549081 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
Add matched TypeScript + Python benchmarks for Gaussian KDE (evaluate + integrate) on a bimodal 10k-point dataset with 200 evaluation points, 20 iterations. Run: https://github.com/githubnext/tsb/actions/runs/30182788398 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
Run: https://github.com/githubnext/tsb/actions/runs/30203838065 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
…tropy/jsDivergence/jsDistance/crossEntropy benchmark Run: https://github.com/githubnext/tsb/actions/runs/30248425219 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
…alEntropy/variationOfInformation benchmark 1000-element paired observations, 10 categories, 50 iters each. Python: pure-numpy implementations matching tsb semantics. Run: https://github.com/githubnext/tsb/actions/runs/30297867311 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
…marks (jsDivergence/jsDistance/crossEntropy/renyiEntropy/tsallisEntropy/jointEntropy/conditionalEntropy/variationOfInformation) Run: https://github.com/githubnext/tsb/actions/runs/30483937580 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
…/toStata round-trip, 500 rows, 20 iters) Run: https://github.com/githubnext/tsb/actions/runs/30523821551 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
…lity ops benchmark Add bench_sparse_array_ops.ts and bench_sparse_array_ops.py benchmarking SparseArray.add(), mul(), fillna(), slice(), toCoo(), std(), min(), max() on a 100k-element sparse array at 5% density (30 iterations). Python: pd.arrays.SparseArray equivalents. Run: https://github.com/githubnext/tsb/actions/runs/30574434717 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
…s benchmark Add bench_integer_array_ops.ts and bench_integer_array_ops.py benchmarking IntegerArray.sub(), floordiv(), mod(), pow(), astype(), count() on a 100k-element Int32 array with 10% nulls (20 iterations). Python: pd.array arithmetic operators and astype/count equivalents. Run: https://github.com/githubnext/tsb/actions/runs/30614182745 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
Adds element-wise DataFrame cell mapping benchmark (applymap/df.map), 50k rows × 4 float columns, 30 iterations, Python uses df.map/df.applymap with pandas >= 2.1 compatibility. Run: https://github.com/githubnext/tsb/actions/runs/30677780854 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
…(split/replace/extract/join, 100k strings, 15 iters) Run: https://github.com/githubnext/tsb/actions/runs/30701520139 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
Add TypeScript and Python benchmarks for clipSeriesWithBounds / clipDataFrameWithBounds, benchmarking per-element clipping with Series/array bounds (100k rows, 4-col DataFrame). Run: https://github.com/githubnext/tsb/actions/runs/30726948175 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
Add bench_swaplevel_dataframe.ts and bench_swaplevel_dataframe.py benchmarking swapLevelDataFrame and reorderLevelsDataFrame on a 50k-row × 3-column DataFrame with a 3-level MultiIndex row index (30 iterations, warm-up 5). Run: https://github.com/githubnext/tsb/actions/runs/30749712022 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
…mark Add bench_information_advanced.ts and bench_information_advanced.py covering 9 advanced information-theory functions: jsDivergence, jsDistance, crossEntropy, renyiEntropy, tsallisEntropy, jointEntropy, conditionalEntropy, normalizedMI, variationOfInformation. Dataset: N=200 PMF + 1000 paired observations, 50 iters. Run: https://github.com/githubnext/tsb/actions/runs/30776731199 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
…Markdown/toLaTeX/seriesToMarkdown, 1000-row DataFrame, 20 iters) Run: https://github.com/githubnext/tsb/actions/runs/30819531253 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Contributor
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🤖 This PR is maintained by Autoloop. Each accepted iteration adds a commit to this branch.
Autoloop: perf-comparison
Goal: Benchmark every tsb function vs pandas equivalent.
Current Best Metric: 756 benchmarked function pairs
Program Issue: #221
Latest Iteration (418)
Added
firstValidIndex/lastValidIndexbenchmarks:benchmarks/tsb/bench_first_last_valid_index.ts— 100k-row Series with NaN at start, end, and scattered; 500 measured iterationsbenchmarks/pandas/bench_first_last_valid_index.py— matching dataset and loop structure usingSeries.first_valid_index()/Series.last_valid_index()Metric: 755 → 756 (+1)
Warning
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
releaseassets.githubusercontent.comSee Network Configuration for more information.