[Bug libstdc++/54075] [4.7.1] unordered_map insert still slower than 4.6.2

Paolo Carlini paolo.carlini@oracle.com
Tue Dec 4 22:11:00 GMT 2012


Hi,

>     I spent some more time on checking why performance changed.
> 
>     After having reverted hash policy modification and use original Foo implementation I can't confirm original numbers. the difference between hash code cached and not is indeed smaller in the std implementation than in the tr1 one. I can't explain why as I can't explain why tr1 unordered_multiset is behaving so badly compared to the std one.
> 
>     I want to signal that I experiment some reliability issues with performance tests. When I started to rollback stuff I saw major performance issue on first std container bench. But when I switch std and tr1 benches then the performance issue appeared in tr1 implementation. Attached you will find the modifications I have done to 54075 to let me challenge the performance. If you want to run test on your side don't hesitate.

Thanks for the additional effort on this. I believe that for 4.8 we should really thoroughly double check what we are changing: my point is that we don't want to change the caching policy in the light of numbers which aren't sound, even if theoretically we may find the idea appealing. Over the next days I will rerun the test on my machines, anyway. 

Note, *very important*, that new performance testcases should be always carefully checked outside the testsuite (before tweaking it to use the performance infrastructure and adding it) to make sure the optimizers aren't optimizing away whole loops to nothing and similar unwanted effects. Please do those checks with me, please see if the numbers you get become more stable if you make the tests more complex to counteract the effect of the optimizers (eg, a typical pattern: have main returning a sum obtained from partial sums computed in each iteration of the code under tests). It may be also useful to run the tests at -O1: the relative performance differences should be much more trustworthy.

Paolo



More information about the Libstdc++ mailing list