Mercurial > hg > Members > masakoha > masa

annotate Cerium_IO/Cerium_IO_memo.txt @ 100:e64b09046d20

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
add madvise result
author Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
date Wed, 14 May 2014 01:28:00 +0900
parents b41e121acc0b
children bb7a0778747b
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
99
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
1 -------------------------------------------------------------------
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
2 2014/05/11 (Sun)
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
3 [memo]
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
4 void *mmap(void *addr, size_t len, int prot, int flags, int fildes, off_t off);
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
5
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
6 off はページサイズの整数倍でなければならない。
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
7 ページサイズの取得は、getpagesize() で調べることができる。
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
8 (ページサイズの整数倍でないと、error することを確認)
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
9
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
10 http://www.gadgety.net/shin/tips/unix/ipc/mmap.html
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
11
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
12 -------------------------------------------------------------------
95
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
13 2014/05/08 (Thu)
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
14 [memo]
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
15 IO についての具体的な論文を出したい
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
16 こういうアプリケーションは mmap がいい。fread がいい etc...
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
17 Task の負荷が大きい例題があるといいよね
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
18
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
19 GPU で word count を走らせた時も計測してみよう
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
20 pread を fread で書き換えたり、Blocked mmap もやってみて、様々な読み込み方法を試してみよう
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
21
99
b41e121acc0b add mmap
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 97
diff changeset
22 -------------------------------------------------------------------
91
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
23 2014/05/01 (Thu)
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
24 [memo]
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
25 Linux のメモリキャッシュをクリアする
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
26 http://futuremix.org/2009/09/clear-linux-memory-cach
100
e64b09046d20 add madvise result
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 99
diff changeset
27 %sysctl -w vm.drop_caches=3
91
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
28
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
29 vm.drop_caches=index
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
30 index : 内容
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
31 1 : ページキャッシュ解放
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
32 2 : ダーティキャッシュ、inode 解放
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
33 3 : 1 かつ 2
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
34
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
35 sysctl について
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
36
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
37 ページキャッシュとは??
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
38 ダーティキャッシュとは??
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
39
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
40 Linux PC でのスペックの確認方法
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
41 http://www.asterisk-works.jp/wiki/index.php/Linux_PC%E3%81%A7%E3%81%AE%E3%82%B9%E3%83%9A%E3%83%83%E3%82%AF%E7%A2%BA%E8%AA%8D%E6%96%B9%E6%B3%95
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
42
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
43 OS の確認方法
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
44 cat /etc/redhat-release redhat 系
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
45 cat /etc/debian_version Debian 系
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
46 cat /etc/lsb-release Ubuntu
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
47
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
48 様々なハードウェア情報
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
49 cat /proc/cpuinfo
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
50 cat /proc/meminfo
92
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
51
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
52 計測を Block num division size いろいろ試してみよう
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
53 Solaris でも測ってみたいよね -> mmap がはやいらしい
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
54
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
55 read size を自動チューニングしたい
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
56 どうにかできないかな??
95
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
57
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
58