<div dir="ltr">It looks like Haskell stack's profile options are defeating stream fusion.<div><br></div><div>Anyone know a work-around?<br><div><br></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Mon, 28 Nov 2016 at 08:23 John Ky <<a href="mailto:newhoggy@gmail.com">newhoggy@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="gmail_msg"><div class="m_-9148532425262574777markdown-here-wrapper gmail_msg"><p style="margin:0px 0px 1.2em!important" class="gmail_msg">Hello Haskellers,</p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">I have been working through the <a href="http://book.realworldhaskell.org/read/profiling-and-optimization.html" class="gmail_msg" target="_blank">Real World Haskell chapter on Profiling and Optimisation</a>, and got to the section <em class="gmail_msg">Advanced techniques: fusion</em>, where I encountered some code using  <code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline" class="gmail_msg">Data.Array.Vector</code> from the deprecated library <code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline" class="gmail_msg">uvector</code>.</p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">Does anyone know how to rewrite this to not use deprecated libraries?</p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">I have tried to use <code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline" class="gmail_msg">Data.Vector.Unboxed</code> from <code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline" class="gmail_msg">vector</code>, but my version consumes a lot of memory.</p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">The code I have is here:</p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg"><a href="https://github.com/haskell-works/hw-tutorial-performance/blob/master/hw-tutorial-performance-rwhe/Main.hs" class="gmail_msg" target="_blank">https://github.com/haskell-works/hw-tutorial-performance/blob/master/hw-tutorial-performance-rwhe/Main.hs</a></p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">With that code, I get “1831 MB total memory in use”, which is terrible</p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">Build run steps I used were:</p>
<pre style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;font-size:1em;line-height:1.2em;margin:1.2em 0px" class="gmail_msg"><code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline;white-space:pre-wrap;overflow:auto;border-radius:3px;border:1px solid rgb(204,204,204);padding:0.5em 0.7em;display:block!important" class="gmail_msg">stack build --executable-profiling --library-profiling --ghc-options="-fprof-auto -rtsopts -auto-all -caf-all -fforce-recomp"

time /Users/jky/wrk/haskell-works/hw-tutorial-performance/.stack-work/install/x86_64-osx/lts-7.10/8.0.1/bin/hw-tutorial-performance-rwhe +RTS -sstderr -p -hy -RTS 1e7
</code></pre><p style="margin:0px 0px 1.2em!important" class="gmail_msg">I get very large numbers of allocations of <code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline" class="gmail_msg">Pair</code> and <code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline" class="gmail_msg">Double</code>.</p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">There is also a very large upfront allocation <code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline" class="gmail_msg">ARR_WORDS</code>, which I feared would happen when using <code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline" class="gmail_msg">Data.Vector</code></p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">Any help appreciated.</p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">Cheers,</p>
<p style="margin:0px 0px 1.2em!important" class="gmail_msg">-John</p>
<div title="MDH:SGVsbG8gSGFza2VsbGVycyw8ZGl2Pjxicj48L2Rpdj48ZGl2PkkgaGF2ZSBiZWVuIHdvcmtpbmcg
dGhyb3VnaCB0aGUgPGEgaHJlZj0iaHR0cDovL2Jvb2sucmVhbHdvcmxkaGFza2VsbC5vcmcvcmVh
ZC9wcm9maWxpbmctYW5kLW9wdGltaXphdGlvbi5odG1sIj5SZWFsIFdvcmxkIEhhc2tlbGwgY2hh
cHRlciBvbiBQcm9maWxpbmcgYW5kIE9wdGltaXNhdGlvbjwvYT4sIGFuZCBnb3QgdG8gdGhlIHNl
Y3Rpb24gX0FkdmFuY2VkIHRlY2huaXF1ZXM6IGZ1c2lvbl8sIHdoZXJlIEkgZW5jb3VudGVyZWQg
c29tZSBjb2RlIHVzaW5nJm5ic3A7PHNwYW4gY2xhc3M9ImluYm94LWluYm94LUFwcGxlLWNvbnZl
cnRlZC1zcGFjZSI+Jm5ic3A7YDwvc3Bhbj5EYXRhLkFycmF5LlZlY3RvcmAgZnJvbSB0aGUgZGVw
cmVjYXRlZCBsaWJyYXJ5IGB1dmVjdG9yYC48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkRvZXMg
YW55b25lIGtub3cgaG93IHRvIHJld3JpdGUgdGhpcyB0byBub3QgdXNlIGRlcHJlY2F0ZWQgbGli
cmFyaWVzPzwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+SSBoYXZlIHRyaWVkIHRvIHVzZSBgRGF0
YS5WZWN0b3IuVW5ib3hlZGAgZnJvbSBgdmVjdG9yYCwgYnV0IG15IHZlcnNpb24gY29uc3VtZXMg
YSBsb3Qgb2YgbWVtb3J5LjwvZGl2PjxkaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5UaGUgY29kZSBJ
IGhhdmUgaXMgaGVyZTo8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pmh0dHBzOi8vZ2l0aHViLmNv
bS9oYXNrZWxsLXdvcmtzL2h3LXR1dG9yaWFsLXBlcmZvcm1hbmNlL2Jsb2IvbWFzdGVyL2h3LXR1
dG9yaWFsLXBlcmZvcm1hbmNlLXJ3aGUvTWFpbi5oczwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+
V2l0aCB0aGF0IGNvZGUsIEkgZ2V0ICIxODMxIE1CIHRvdGFsIG1lbW9yeSBpbiB1c2UiLCB3aGlj
aCBpcyB0ZXJyaWJsZTwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+QnVpbGQgcnVuIHN0ZXBzIEkg
dXNlZCB3ZXJlOjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+YGBgPC9kaXY+PGRpdj5zdGFjayBi
dWlsZCAtLWV4ZWN1dGFibGUtcHJvZmlsaW5nIC0tbGlicmFyeS1wcm9maWxpbmcgLS1naGMtb3B0
aW9ucz0iLWZwcm9mLWF1dG8gLXJ0c29wdHMgLWF1dG8tYWxsIC1jYWYtYWxsIC1mZm9yY2UtcmVj
b21wIjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+dGltZSAvVXNlcnMvamt5L3dyay9oYXNrZWxs
LXdvcmtzL2h3LXR1dG9yaWFsLXBlcmZvcm1hbmNlLy5zdGFjay13b3JrL2luc3RhbGwveDg2XzY0
LW9zeC9sdHMtNy4xMC84LjAuMS9iaW4vaHctdHV0b3JpYWwtcGVyZm9ybWFuY2UtcndoZSArUlRT
IC1zc3RkZXJyIC1wIC1oeSAtUlRTIDFlNzwvZGl2PjxkaXY+YGBgPC9kaXY+PGRpdj48YnI+PC9k
aXY+PGRpdj5JIGdldCB2ZXJ5IGxhcmdlIG51bWJlcnMgb2YgYWxsb2NhdGlvbnMgb2YgYFBhaXJg
IGFuZCBgRG91YmxlYC48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PlRoZXJlIGlzIGFsc28gYSB2
ZXJ5IGxhcmdlIHVwZnJvbnQgYWxsb2NhdGlvbiBgQVJSX1dPUkRTYCwgd2hpY2ggSSBmZWFyZWQg
d291bGQgaGFwcGVuIHdoZW4gdXNpbmcgYERhdGEuVmVjdG9yYDwvZGl2PjxkaXY+PGJyPjwvZGl2
PjwvZGl2PjxkaXY+QW55IGhlbHAgYXBwcmVjaWF0ZWQuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRp
dj5DaGVlcnMsPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj4tSm9objwvZGl2PjxkaXY+PC9kaXY+
PGRpdj48YnI+PC9kaXY+" style="height:0;width:0;max-height:0;max-width:0;overflow:hidden;font-size:0em;padding:0;margin:0" class="gmail_msg">​</div></div></div></blockquote></div>