G
YouTube TikTok Games
Skip to content

[Perf] Linux/arm64: 7 Regressions on 4/16/2024 8:34:24 PM #101247

New issue
New issue
Closed
Closed
[Perf] Linux/arm64: 7 Regressions on 4/16/2024 8:34:24 PM#101247
Assignees
amanasifkhalid
Labels
Priority:2Work that is important, but not critical for the releasearch-arm64area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMIos-linuxLinux OS (any supported distro)runtime-coreclrspecific to the CoreCLR runtimetenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark
Milestone
9.0.0

Description

@performanceautofiler
performanceautofiler
bot
opened on Apr 18, 2024

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 08426cd832dade35426b511284dc4e843054dcf5
Compare e126f8ff2e635ef104b8f1212ec76420f114e99d
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Random

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
547.36 ns 587.56 ns 1.07 0.00 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Random*'
Details

System.Tests.Perf_Random.ctor_seeded

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 08426cd832dade35426b511284dc4e843054dcf5
Compare e126f8ff2e635ef104b8f1212ec76420f114e99d
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.ContainsTrue<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
481.84 μs 523.07 μs 1.09 0.02 False
482.85 μs 525.62 μs 1.09 0.00 False
483.22 μs 523.15 μs 1.08 0.01 False
478.02 μs 520.53 μs 1.09 0.04 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue&lt;String&gt;*'
Details

System.Collections.ContainsTrue<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.ImmutableArray(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.ICollection(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 08426cd832dade35426b511284dc4e843054dcf5
Compare e126f8ff2e635ef104b8f1212ec76420f114e99d
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in Benchstone.BenchI.BenchE

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
711.75 ms 859.03 ms 1.21 0.01 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.BenchE*'
Details

Benchstone.BenchI.BenchE.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture arm64
OS ubuntu 22.04
Queue AmpereUbuntu
Baseline 08426cd832dade35426b511284dc4e843054dcf5
Compare e126f8ff2e635ef104b8f1212ec76420f114e99d
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
364.78 ns 406.26 ns 1.11 0.05 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
Details

System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Activity

  1. performanceautofiler
    added
    arch-arm64
    os-linuxLinux OS (any supported distro)
    runtime-coreclrspecific to the CoreCLR runtime
    untriagedNew issue has not been triaged by the area owner
    on Apr 18, 2024
  2. DrewScoggins
    removed
    untriagedNew issue has not been triaged by the area owner
    on Apr 18, 2024
  3. DrewScoggins
    transferred this issue fromdotnet/perf-autofiling-issueson Apr 18, 2024
  4. ghost added
    needs-area-labelAn area label is needed to ensure this gets routed to the appropriate area owners
    on Apr 18, 2024
  5. dotnet-policy-service
    added
    untriagedNew issue has not been triaged by the area owner
    on Apr 18, 2024
  6. DrewScoggins
    added
    tenet-performancePerformance related issue
    tenet-performance-benchmarksIssue from performance benchmark
    and removed
    untriagedNew issue has not been triaged by the area owner
    needs-area-labelAn area label is needed to ensure this gets routed to the appropriate area owners
    on Apr 18, 2024

  7. DrewScoggins commented on Apr 18, 2024

    @DrewScoggins
    DrewScoggins
    on Apr 18, 2024
    Member

    Related to #99736 @amanasifkhalid
    Other regressions:
    Windows x64: dotnet/perf-autofiling-issues#33045, dotnet/perf-autofiling-issues#33046
    Linux x64: dotnet/perf-autofiling-issues#33063

  8. AndyAyersMS commented on Apr 18, 2024

    @AndyAyersMS
    AndyAyersMS
    on Apr 18, 2024
    Member

    Also note improvements:
    dotnet/perf-autofiling-issues#32889
    dotnet/perf-autofiling-issues#32908
    dotnet/perf-autofiling-issues#33068
    dotnet/perf-autofiling-issues#33083

  9. jeffschwMSFT
    added
    area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI
    on Apr 19, 2024

  10. dotnet-policy-service commented on Apr 19, 2024

    @dotnet-policy-service
    dotnet-policy-serviceBot
    on Apr 19, 2024 – with Dotnet Policy Service
    Contributor

    Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
    See info in area-owners.md if you want to be subscribed.

  11. JulieLeeMSFT
    assigned
    amanasifkhalid
    on Apr 19, 2024
  12. JulieLeeMSFT
    added this to the 9.0.0 milestone on Apr 19, 2024
  13. amanasifkhalid
    added
    Priority:2Work that is important, but not critical for the release
    on May 3, 2024

  14. amanasifkhalid commented on Jul 8, 2024

    @amanasifkhalid
    amanasifkhalid
    on Jul 8, 2024
    Contributor

    Switching on the new block layout seems to have brought these back to (or below) their baseline results.

  15. amanasifkhalid
    closed this as completedon Jul 8, 2024
  16. github-actions
    locked and limited conversation to collaborators on Aug 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Priority:2Work that is important, but not critical for the releasearch-arm64area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMIos-linuxLinux OS (any supported distro)runtime-coreclrspecific to the CoreCLR runtimetenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions